scholarly journals Evaluating the Impact of the Grading and Assessment of Predictive Tools Framework on Clinicians and Health Care Professionals’ Decisions in Selecting Clinical Predictive Tools: Randomized Controlled Trial (Preprint)

2019 ◽  
Author(s):  
Mohamed Khalifa ◽  
Farah Magrabi ◽  
Blanca Gallego Luxan

BACKGROUND While selecting predictive tools for implementation in clinical practice or for recommendation in clinical guidelines, clinicians and health care professionals are challenged with an overwhelming number of tools. Many of these tools have never been implemented or evaluated for comparative effectiveness. To overcome this challenge, the authors developed and validated an evidence-based framework for grading and assessment of predictive tools (the GRASP framework). This framework was based on the critical appraisal of the published evidence on such tools. OBJECTIVE The aim of the study was to examine the impact of using the GRASP framework on clinicians’ and health care professionals’ decisions in selecting clinical predictive tools. METHODS A controlled experiment was conducted through a web-based survey. Participants were randomized to either review the derivation publications, such as studies describing the development of the predictive tools, on common traumatic brain injury predictive tools (control group) or to review an evidence-based summary, where each tool had been graded and assessed using the GRASP framework (intervention group). Participants in both groups were asked to select the best tool based on the greatest validation or implementation. A wide group of international clinicians and health care professionals were invited to participate in the survey. Task completion time, rate of correct decisions, rate of objective versus subjective decisions, and level of decisional conflict were measured. RESULTS We received a total of 194 valid responses. In comparison with not using GRASP, using the framework significantly increased correct decisions by 64%, from 53.7% to 88.1% (88.1/53.7=1.64; <i>t<sub>193</sub></i>=8.53; <i>P</i>&lt;.001); increased objective decision making by 32%, from 62% (3.11/5) to 82% (4.10/5; <i>t<sub>189</sub></i>=9.24; <i>P</i>&lt;.001); decreased subjective decision making based on guessing by 20%, from 49% (2.48/5) to 39% (1.98/5; <i>t<sub>188</sub></i>=−5.47; <i>P</i>&lt;.001); and decreased prior knowledge or experience by 8%, from 71% (3.55/5) to 65% (3.27/5; <i>t<sub>187</sub></i>=−2.99; <i>P</i>=.003). Using GRASP significantly decreased decisional conflict and increased the confidence and satisfaction of participants with their decisions by 11%, from 71% (3.55/5) to 79% (3.96/5; <i>t<sub>188</sub></i>=4.27; <i>P</i>&lt;.001), and by 13%, from 70% (3.54/5) to 79% (3.99/5; <i>t<sub>188</sub></i>=4.89; <i>P</i>&lt;.001), respectively. Using GRASP decreased the task completion time, on the 90th percentile, by 52%, from 12.4 to 6.4 min (<i>t<sub>193</sub></i>=−0.87; <i>P</i>=.38). The average System Usability Scale of the GRASP framework was very good: 72.5% and 88% (108/122) of the participants found the GRASP useful. CONCLUSIONS Using GRASP has positively supported and significantly improved evidence-based decision making. It has increased the accuracy and efficiency of selecting predictive tools. GRASP is not meant to be prescriptive; it represents a high-level approach and an effective, evidence-based, and comprehensive yet simple and feasible method to evaluate, compare, and select clinical predictive tools.

10.2196/15770 ◽  
2020 ◽  
Vol 22 (7) ◽  
pp. e15770
Author(s):  
Mohamed Khalifa ◽  
Farah Magrabi ◽  
Blanca Gallego Luxan

Background While selecting predictive tools for implementation in clinical practice or for recommendation in clinical guidelines, clinicians and health care professionals are challenged with an overwhelming number of tools. Many of these tools have never been implemented or evaluated for comparative effectiveness. To overcome this challenge, the authors developed and validated an evidence-based framework for grading and assessment of predictive tools (the GRASP framework). This framework was based on the critical appraisal of the published evidence on such tools. Objective The aim of the study was to examine the impact of using the GRASP framework on clinicians’ and health care professionals’ decisions in selecting clinical predictive tools. Methods A controlled experiment was conducted through a web-based survey. Participants were randomized to either review the derivation publications, such as studies describing the development of the predictive tools, on common traumatic brain injury predictive tools (control group) or to review an evidence-based summary, where each tool had been graded and assessed using the GRASP framework (intervention group). Participants in both groups were asked to select the best tool based on the greatest validation or implementation. A wide group of international clinicians and health care professionals were invited to participate in the survey. Task completion time, rate of correct decisions, rate of objective versus subjective decisions, and level of decisional conflict were measured. Results We received a total of 194 valid responses. In comparison with not using GRASP, using the framework significantly increased correct decisions by 64%, from 53.7% to 88.1% (88.1/53.7=1.64; t193=8.53; P<.001); increased objective decision making by 32%, from 62% (3.11/5) to 82% (4.10/5; t189=9.24; P<.001); decreased subjective decision making based on guessing by 20%, from 49% (2.48/5) to 39% (1.98/5; t188=−5.47; P<.001); and decreased prior knowledge or experience by 8%, from 71% (3.55/5) to 65% (3.27/5; t187=−2.99; P=.003). Using GRASP significantly decreased decisional conflict and increased the confidence and satisfaction of participants with their decisions by 11%, from 71% (3.55/5) to 79% (3.96/5; t188=4.27; P<.001), and by 13%, from 70% (3.54/5) to 79% (3.99/5; t188=4.89; P<.001), respectively. Using GRASP decreased the task completion time, on the 90th percentile, by 52%, from 12.4 to 6.4 min (t193=−0.87; P=.38). The average System Usability Scale of the GRASP framework was very good: 72.5% and 88% (108/122) of the participants found the GRASP useful. Conclusions Using GRASP has positively supported and significantly improved evidence-based decision making. It has increased the accuracy and efficiency of selecting predictive tools. GRASP is not meant to be prescriptive; it represents a high-level approach and an effective, evidence-based, and comprehensive yet simple and feasible method to evaluate, compare, and select clinical predictive tools.


2021 ◽  
Vol 2 (1) ◽  
Author(s):  
Agnes T. Black ◽  
Marla Steinberg ◽  
Amanda E. Chisholm ◽  
Kristi Coldwell ◽  
Alison M. Hoens ◽  
...  

Abstract Background The KT Challenge program supports health care professionals to effectively implement evidence-based practices. Unlike other knowledge translation (KT) programs, this program is grounded in capacity building, focuses on health care professionals (HCPs), and uses a multi-component intervention. This study presents the evaluation of the KT Challenge program to assess the impact on uptake, KT capacity, and practice change. Methods The evaluation used a mixed-methods retrospective pre-post design involving surveys and review of documents such as teams’ final reports. Online surveys collecting both quantitative and qualitative data were deployed at four time points (after both workshops, 6 months into implementation, and at the end of the 2-year funded projects) to measure KT capacity (knowledge, skills, and confidence) and impact on practice change. Qualitative data was analyzed using a general inductive approach and quantitative data was analyzed using non-parametric statistics. Results Participants reported statistically significant increases in knowledge and confidence across both workshops, at the 6-month mark of their projects, and at the end of their projects. In addition, at the 6-month check-in, practitioners reported statistically significant improvements in their ability to implement practice changes. In the first cohort of the program, of the teams who were able to complete their projects, half were able to show demonstrable practice changes. Conclusions The KT Challenge was successful in improving the capacity of HCPs to implement evidence-based practice changes and has begun to show demonstrable improvements in a number of practice areas. The program is relevant to a variety of HCPs working in diverse practice settings and is relatively inexpensive to implement. Like all practice improvement programs in health care settings, a number of challenges emerged stemming from the high turnover of staff and the limited capacity of some practitioners to take on anything beyond direct patient care. Efforts to address these challenges have been added to subsequent cohorts of the program and ongoing evaluation will examine if they are successful. The KT Challenge program has continued to garner great interest among practitioners, even in the midst of dealing with the COVID-19 pandemic, and shows promise for organizations looking for better ways to mobilize knowledge to improve patient care and empower staff. This study contributes to the implementation science literature by providing a description and evaluation of a new model for embedding KT practice skills in health care settings.


Symmetry ◽  
2021 ◽  
Vol 13 (3) ◽  
pp. 395
Author(s):  
Chien-Hsiung Chen ◽  
Miao Huang

This study investigated the impacts of different notification modalities used in low and high ambient sound environments for mobile phone interaction. Three different notification modalities—Shaking Visual, Shaking Visual + Vibration, and Vibration—were designed and experimentally tested by asking users to conduct a maze task. A total of 72 participants were invited to take part in the experiment through the convenience sampling method. The generated results indicated that (1) the notification modality affects participants’ task completion time, (2) the error rate pertinent to the number of notifications is positively related to the participants’ task completion time, and (3) the ambient sound level and notification modalities impact the overall experience of the participants. The main contributions of this study are twofold. First, it verifies that the multi-dimensional feature of a Shaking Visual + Vibration synesthesia notification design is implementable. Second, this study demonstrated that the synesthesia notification could be feasible for mobile notification, and it was more perceptible by the users.


Author(s):  
Eelco Draaisma ◽  
Lauren A. Maggio ◽  
Jolita Bekhof ◽  
A. Debbie C. Jaarsma ◽  
Paul L. P. Brand

Abstract Introduction Although evidence-based medicine (EBM) teaching activities may improve short-term EBM knowledge and skills, they have little long-term impact on learners’ EBM attitudes and behaviour. This study examined the effects of learning EBM through stand-alone workshops or various forms of deliberate EBM practice. Methods We assessed EBM attitudes and behaviour with the evidence based practice inventory questionnaire, in paediatric health care professionals who had only participated in a stand-alone EBM workshop (controls), participants with a completed PhD in clinical research (PhDs), those who had completed part of their paediatric residency at a department (Isala Hospital) which systematically implemented EBM in its clinical and teaching activities (former Isala residents), and a reference group of paediatric professionals currently employed at Isala’s paediatric department (current Isala participants). Results Compared to controls (n = 16), current Isala participants (n = 13) reported more positive EBM attitudes (p < 0.01), gave more priority to using EBM in decision making (p = 0.001) and reported more EBM behaviour (p = 0.007). PhDs (n = 20) gave more priority to using EBM in medical decision making (p < 0.001) and reported more EBM behaviour than controls (p = 0.016). Discussion Health care professionals exposed to deliberate practice of EBM, either in the daily routines of their department or by completing a PhD in clinical research, view EBM as more useful and are more likely to use it in decision making than their peers who only followed a standard EBM workshop. These findings support the use of deliberate practice as the basis for postgraduate EBM educational activities.


2020 ◽  
Vol 34 (1) ◽  
pp. 12-23
Author(s):  
Joseph D Z ◽  
Aminu B ◽  
Halilu S ◽  
Mark A D ◽  
Kayode O ◽  
...  

Introduction: Interdisciplinary collaboration (IDC) is important in health care settings as the complex nature and demands of the health care work environment requires the expertise and knowledge of different individuals or specialists working together to solve multifaceted and complex patient care problems. Objective: To assess the health professionals' attitude towards the development of an interdisciplinary collaborative approach to patient care in health institutions and to systematically review the impact of IDC as a panacea for effective health outcomes in Nigeria. Methodology: The research is a systematic review that provides various approaches for studying interdisciplinary teams. Fifty articles were selected from different search engines such as Google, google scholar, science direct and research gate with the search term Interdisciplinary collaboration among health care professionals. Articles were arranged based on most relevant, relevant and closely related articles. Result: The study revealed that IDC is pivotal in evidence-based care and contributes immensely to effective and efficient health outcomes. It puts the patient at the centre of the healthcare team's focus and allows all health professionals, with the patient, to collaboratively provide input, be part of the decision making, and improve outcomes. Although there are several obstacles to IDC, adopting this team-based culture of mutual respect and understanding is possible and, in fact, necessary. Conclusion: This study reveals that there are many benefits to IDC. It can improve safety and healthcare delivery, as well as reduce costs. The interprofessional team supports patient and personnel engagement, organizational efficiency and innovation.


2020 ◽  
Author(s):  
Agnes Black ◽  
Marla Steinberg ◽  
Amanda Chisholm ◽  
Kristi Coldwell ◽  
Alison Hoens ◽  
...  

Abstract Background The KT Challenge program supports health care professionals to effectively implement evidence-based practices. Unlike other knowledge translation (KT) programs, this program is grounded in capacity building, focuses on health care professionals (HCPs), and uses a multi-component intervention. This study presents the evaluation of the KT Challenge program to assess the impact on uptake, KT capacity and practice change. MethodsThe evaluation used a mixed-methods, time-series design involving surveys and review of documents such as teams’ final reports. Online surveys collecting both quantitative and qualitative data were deployed at four time points (after both workshops, six months into implementation, and at the end of the two-year funded projects) to measure KT capacity ( knowledge, skills and confidence), and impact on practice change. Qualitative data was analyzed using a general inductive approach and quantitative data was analysed using non-parametric statistics. ResultsParticipants reported statistically significant increases in knowledge and confidence across both workshops, at the 6-month mark of their projects, and at the end of their projects. In addition, at the 6-month check-in, practitioners reported statistically significant improvements in their ability to implement practice changes. In the first cohort of the program, of the teams who were able to complete their projects, half were able to show demonstrable practice changes. ConclusionsThe KT Challenge was successful in improving the capacity of HCPs to implement evidence-based practice changes and has begun to show demonstrable improvements in a number of practice areas. The program is relevant to a variety of HCPs working in diverse practice settings and is relatively inexpensive to implement. Like all practice improvement programs in health care settings, a number of challenges emerged stemming from the high turnover of staff and the limited capacity of some practitioners to take on anything beyond direct patient care. Efforts to address these challenges have been added to subsequent cohorts of the KT Challenge program and ongoing evaluation will examine if they are successful. The KT Challenge program has continued to garner great interest among practitioners, even in the midst of dealing with the COVID-19 pandemic, and shows promise for organizations looking for better ways to mobilize knowledge to improve patient care and empower staff. This study contributes to the implementation science literature by providing a description and evaluation of a new model for embedding KT practice skills in health care settings.


2021 ◽  
Author(s):  
Agnes Black ◽  
Marla Steinberg ◽  
Amanda Chisholm ◽  
Kristi Coldwell ◽  
Alison Hoens ◽  
...  

Abstract Background The KT Challenge program supports health care professionals to effectively implement evidence-based practices. Unlike other knowledge translation (KT) programs, this program is grounded in capacity building, focuses on health care professionals (HCPs), and uses a multi-component intervention. This study presents the evaluation of the KT Challenge program to assess the impact on uptake, KT capacity and practice change. MethodsThe evaluation used a mixed-methods, time-series design involving surveys and review of documents such as teams’ final reports. Online surveys collecting both quantitative and qualitative data were deployed at four time points (after both workshops, six months into implementation, and at the end of the two-year funded projects) to measure KT capacity ( knowledge, skills and confidence), and impact on practice change. Qualitative data was analyzed using a general inductive approach and quantitative data was analysed using non-parametric statistics. ResultsParticipants reported statistically significant increases in knowledge and confidence across both workshops, at the 6-month mark of their projects, and at the end of their projects. In addition, at the 6-month check-in, practitioners reported statistically significant improvements in their ability to implement practice changes. In the first cohort of the program, of the teams who were able to complete their projects, half were able to show demonstrable practice changes. ConclusionsThe KT Challenge was successful in improving the capacity of HCPs to implement evidence-based practice changes and has begun to show demonstrable improvements in a number of practice areas. The program is relevant to a variety of HCPs working in diverse practice settings and is relatively inexpensive to implement. Like all practice improvement programs in health care settings, a number of challenges emerged stemming from the high turnover of staff and the limited capacity of some practitioners to take on anything beyond direct patient care. Efforts to address these challenges have been added to subsequent cohorts of the program and ongoing evaluation will examine if they are successful. The KT Challenge program has continued to garner great interest among practitioners, even in the midst of dealing with the COVID-19 pandemic, and shows promise for organizations looking for better ways to mobilize knowledge to improve patient care and empower staff. This study contributes to the implementation science literature by providing a description and evaluation of a new model for embedding KT practice skills in health care settings.


2010 ◽  
Vol 6 (6) ◽  
pp. e17-e20 ◽  
Author(s):  
Bianca Devitt ◽  
Jennifer Philip ◽  
Sue-Anne McLachlan

As the complexity of cancer treatment increases so too has the need for coordination between health care professionals. Multidisciplinary meetings are a useful tool in treating patients with cancer and are shown to improve survival and adherence to evidence based-guidelines.


10.2196/18508 ◽  
2020 ◽  
Vol 7 (2) ◽  
pp. e18508
Author(s):  
Olli Korhonen ◽  
Karin Väyrynen ◽  
Tino Krautwald ◽  
Glenn Bilby ◽  
Hedwig Anna Theresia Broers ◽  
...  

Background Advanced sensor, measurement, and analytics technologies are enabling entirely new ways to deliver health care. The increased availability of digital data can be used for data-driven personalization of care. Data-driven personalization can complement expert-driven personalization by providing support for decision making or even by automating some parts of decision making in relation to the care process. Objective The aim of this study was to analyze how digital data acquired from posture scanning can enhance physiotherapy services and enable more personalized delivery of physiotherapy. Methods A case study was conducted with a company that designed a posture scan recording system (PSRS), which is an information system that can digitally record, measure, and report human movement for use in physiotherapy. Data were collected through interviews with different stakeholders, such as health care professionals, health care users, and the information system provider, and were analyzed thematically. Results Based on the results of our thematic analysis, we propose three different types of support that posture scanning data can provide to enhance and enable more personalized delivery of physiotherapy: 1) modeling the condition, in which the posture scanning data are used to detect and understand the health care user’s condition and the root cause of the possible pain; 2) visualization for shared understanding, in which the posture scanning data are used to provide information to the health care user and involve them in more collaborative decision-making regarding their care; and 3) evaluating the impact of the intervention, in which the posture scanning data are used to evaluate the care progress and impact of the intervention. Conclusions The adoption of digital tools in physiotherapy has remained low. Physiotherapy has also lacked digital tools and means to inform and involve the health care user in their care in a person-centered manner. In this study, we gathered insights from different stakeholders to provide understanding of how the availability of digital posture scanning data can enhance and enable personalized physiotherapy services.


Sign in / Sign up

Export Citation Format

Share Document