Expanding Our Understanding of Fidelity: The Development of and Implementation Fidelity Measure for and Evidence-Based Prevention Program

2007 ◽  
Author(s):  
Rochelle Rokusek ◽  
Paul Flaspoholer
2018 ◽  
Author(s):  
Srijesa Khasnabish ◽  
Zoe Burns ◽  
Madeline Couch ◽  
Mary Mullin ◽  
Randall Newmark ◽  
...  

BACKGROUND Data visualization experts have identified core principles to follow when creating visual displays of data that facilitate comprehension. Such principles can be applied to creating effective reports for clinicians that display compliance with quality improvement protocols. A basic tenet of implementation science is continuous monitoring and feedback. Applying best practices for data visualization to reports for clinicians can catalyze implementation and sustainment of new protocols. OBJECTIVE To apply best practices for data visualization to create reports that clinicians find clear and useful. METHODS First, we conducted a systematic literature review to identify best practices for data visualization. We applied these findings and feedback collected via a questionnaire to improve the Fall TIPS Monthly Report (FTMR), which shows compliance with an evidence-based fall prevention program, Fall TIPS (Tailoring Interventions for Patient Safety). This questionnaire was based on the requirements for effective data display suggested by expert Stephen Few. We then evaluated usability of the FTMR using a 15-item Health Information Technology Usability Evaluation Scale (Health-ITUES). Items were rated on a 5-point Likert scale from strongly disagree (1) to strongly agree (5). RESULTS The results of the systematic literature review emphasized that the ideal data display maximizes the information communicated while minimizing the cognitive efforts involved with data interpretation. Factors to consider include selecting the correct type of display (e.g. line vs bar graph) and creating simplistic reports. The qualitative and quantitative evaluations of the original and final FTMR revealed improved perceptions of the visual display of the reports and their usability. Themes that emerged from the staff interviews emphasized the value of simplified reports, meaningful data, and usefulness to clinicians. The mean (SD) rating on the Health-ITUES scale when evaluating the original FTMR was 3.86 (0.19) and increased to 4.29 (0.11) when evaluating the revised FTMR (Mann Whitney U Test, z=-12.25, P<0.001). CONCLUSIONS Best practices identified through a systematic review can be applied to create effective reports for clinician use. The lessons learned from evaluating FTMR perceptions and measuring usability can be applied to creating effective reports for clinician use in the context of other implementation science projects.


Author(s):  
Jennifer D. Allen ◽  
Rachel C. Shelton ◽  
Karen M. Emmons ◽  
Laura A. Linnan

There is substantial variability in the implementation of evidence-based interventions across the United States, which leads to inconsistent access to evidence-based prevention and treatment strategies at a population level. Increased dissemination and implementation of evidence-based interventions could result in significant public health gains. While the availability of evidence-based interventions is increasing, study of implementation, adaptation, and dissemination has only recently gained attention in public health. To date, insufficient attention has been given to the issue of fidelity. Consideration of fidelity is necessary to balance the need for internal and external validity across the research continuum. There is also a need for a more robust literature to increase knowledge about factors that influence fidelity, strategies for maximizing fidelity, methods for measuring and analyzing fidelity, and examining sources of variability in implementation fidelity.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Sarah Marshall ◽  
Sarah Taki ◽  
Penny Love ◽  
Yvonne Laird ◽  
Marianne Kearney ◽  
...  

Abstract Background Behavioural interventions for the early prevention of childhood obesity mostly focus on English-speaking populations in high-income countries. Cultural adaptation is an emerging strategy for implementing evidence-based interventions among different populations and regions. This paper describes the initial process of culturally adapting Healthy Beginnings, an evidence-based early childhood obesity prevention program, for Arabic and Chinese speaking migrant mothers and infants in Sydney, Australia. Methods The cultural adaptation process followed the Stages of Cultural Adaptation theoretical model and is reported using the Framework for Reporting Adaptations and Modifications-Enhanced. We first established the adaptation rationale, then considered program underpinnings and the core components for effectiveness. To inform adaptations, we reviewed the scientific literature and engaged stakeholders. Consultations included focus groups with 24 Arabic and 22 Chinese speaking migrant mothers and interviews with 20 health professionals. With input from project partners, bi-cultural staff and community organisations, findings informed cultural adaptations to the content and delivery features of the Healthy Beginnings program. Results Program structure and delivery mode were retained to preserve fidelity (i.e. staged nurse calls with key program messages addressing modifiable obesity-related behaviours: infant feeding, active play, sedentary behaviours and sleep). Qualitative analysis of focus group and interview data resulted in descriptive themes concerning cultural practices and beliefs related to infant obesity-related behaviours and perceptions of child weight among Arabic and Chinese speaking mothers. Based on the literature and local study findings, cultural adaptations were made to recruitment approaches, staffing (bi-cultural nurses and project staff) and program content (modified call scripts and culturally adapted written health promotion materials). Conclusions This cultural adaptation of Healthy Beginnings followed an established process model and resulted in a program with enhanced relevance and accessibility among Arabic and Chinese speaking migrant mothers. This work will inform the future cultural adaptation stages: testing, refining, and trialling the culturally adapted Healthy Beginnings program to assess acceptability, feasibility and effectiveness.


2016 ◽  
Vol 48 (7) ◽  
pp. S133
Author(s):  
Gregory Welk ◽  
S. Chen ◽  
S. Vazou ◽  
L. Lanningham-Foster ◽  
D. Gentile ◽  
...  

2016 ◽  
Vol 22 (4) ◽  
pp. 344-353 ◽  
Author(s):  
Shannon R. Self-Brown ◽  
Melissa C. Osborne ◽  
Whitney Rostad ◽  
Ed Feil

2017 ◽  
Vol 20 (1) ◽  
pp. 43-59 ◽  
Author(s):  
Lisa M. Hagermoser Sanetti ◽  
Kathleen M. Williamson ◽  
Anna C. J. Long ◽  
Thomas R. Kratochwill

Numerous evidence-based classroom management strategies to prevent and respond to problem behavior have been identified, but research consistently indicates teachers rarely implement them with sufficient implementation fidelity. The purpose of this study was to evaluate the effectiveness of implementation planning, a strategy involving logistical intervention implementation planning and identification of implementation barriers, and participant modeling, a strategy involving didactic and in vivo intervention training, on teachers’ implementation of an evidence-based classroom management plan. A randomized multiple treatment embedded within a multiple baseline design across participants was used to assess (a) teachers’ adherence to the classroom management plans and quality of implementation and (b) student disruptive behavior in the classroom immediately and at follow-up. Results indicated that teachers’ adherence and quality increased with both implementation planning and participant modeling, but these improvements were not fully maintained at 1- and 2-month follow-up. A similar pattern in student disruptive behavior was also observed. These findings highlight the need for ongoing implementation support for behavioral interventions in schools. Implications for future research and practice are discussed.


10.2196/14816 ◽  
2020 ◽  
Vol 9 (8) ◽  
pp. e14816
Author(s):  
Bo Wang ◽  
Lynette Deveaux ◽  
Sonja Lunn ◽  
Veronica Dinaj-Koci ◽  
Samiran Ghosh ◽  
...  

Background Sustained implementation of school-based prevention programs is low. Effective strategies are needed to enhance both high-level implementation fidelity and sustainability of prevention programs. Objective This proposed study aims to determine if the provision of either biweekly monitoring and feedback and site-based assistance and mentorship or both to at-risk and moderate-performing teachers with monitoring through an enhanced decision-making platform by the Ministry of Education (MOE) and Ministry of Health (MOH) based on the real-time implementation data will increase national implementation fidelity and result in sustained implementation over time. Methods This study will target government schools including 200 grade 6 teachers in 80 primary schools and 100 junior/middle high school teachers (and their classes) on 12 Bahamian islands. Teacher and school coordinator training will be conducted by the MOE in year 1, followed by an optimization trial among teachers in the capital island. Informed by these results, an implementation intervention will be conducted to train using different levels of educational intensity all at-risk and moderate-performing teachers. Subsequently selected training and implementation strategies will be evaluated for the national implementation of Focus on Youth in the Caribbean and Caribbean Informed Parents and Children Together in years 2 to 5. Results It is hypothesized that a more intensive training and supervision program for at-risk and moderate-performing teachers will enhance their implementation fidelity to the average level of the high-performing group (85%), an HIV prevention program delivered at the national level can be implemented with fidelity in grade 6 and sustained over time (monitored annually), and student outcomes will continue to be highly correlated with implementation fidelity and be sustained over time (assessed annually through grade 9). The proposed study is funded by the National Institute of Child Health and Human Development from August 1, 2018, through May 31, 2023. Conclusions The study will explore several theory-driven implementation strategies to increase sustained teacher implementation fidelity and thereby increase the general public health impact of evidence-based interventions. The proposed project has potential to make significant contributions to advancing school-based HIV prevention research and implementation science and serve as a global model for the Fast Track strategy. International Registered Report Identifier (IRRID) PRR1-10.2196/14816


Sign in / Sign up

Export Citation Format

Share Document