Program Fidelity | ScienceGate

Purpose Two common methods in community settings of assessing program fidelity, a critical implementation component for program effectiveness, are video and audio recordings of sessions. This paper aims to examine how these two methods compared when used for a home-based behavioral parenting-training model (SafeCare®). Design/methodology/approach Twenty-five SafeCare video-recorded sessions between home visitors and parents were scored by trained raters either using the video or audio-only portions of recordings. Sessions were coded using fidelity checklists, with items (n = 33) classified as one of two fidelity aspects, content [delivery of program components (n = 15)], or process [communication and rapport building (n = 11)]. Seven items were considered to overlap between constructs. Items were coded as having been done or not done appropriately. Coders rated items as “technological limitation” when scoring methods hindered coding. Analyses compared percent agreement and disagreement between audio and video coders. Findings Overall agreement between coders was 72.12%. Levels of agreement were higher for content items (M = 80.89%, SD = 19.68) than process items (58.54%, SD = 34.41). Disagreements due to technology limitations among audio coders were noted among 15 items; particularly, higher levels of disagreement were seen among process items (42.42%) than content items (9.64%). Originality/value Compared to video, fidelity monitoring via audio recordings was associated with some loss of process-related fidelity. However, audio recordings could be sufficient with supplements such as participant surveys, to better capture process items. Research should also examine how content and process fidelity relate to changes in family behavior to further inform optimal fidelity monitoring methods for program use.

Download Full-text

Exploring Relationships Between CARE Program Fidelity, Quality, Participant Responsiveness, and Uptake of Mindful Practices

Mindfulness ◽

10.1007/s12671-018-1034-9 ◽

2018 ◽

Vol 10 (5) ◽

pp. 841-853 ◽

Cited By ~ 4

Author(s):

Sebrina L. Doyle ◽

Patricia A. Jennings ◽

Joshua L. Brown ◽

Damira Rasheed ◽

Anna DeWeese ◽

...

Keyword(s):

Care Program ◽

Program Fidelity ◽

Participant Responsiveness ◽

Mindful Practices

Download Full-text

An Embedded Multiple Case Study: Facilitating Uptake of Food Insecurity Screening Initiatives in Low Resource Primary Care Settings

10.21203/rs.3.rs-499136/v1 ◽

2021 ◽

Author(s):

Sabira Taher ◽

Naoko Muramatsu ◽

Angela Odoms-Young ◽

Nadine Peacock ◽

Michael C. Fagen ◽

...

Keyword(s):

Primary Care ◽

Food Insecurity ◽

Multiple Case Study ◽

Food Assistance ◽

Screening Tools ◽

Implementation Barriers ◽

Program Fidelity ◽

Number Of Patients ◽

Multiple Case

Abstract Background Food insecurity (FI), limited access to healthy food, is a social determinant of health linked to poor dietary health and difficulty with disease management. Healthcare experts support the adoption of validated screening tools within primary care clinics to identify and connect FI patients to food resources. Yet, a lack of standard practices limits uptake. The purpose of this study was to understand program processes and outcomes of primary care focused FI screening initiatives that can guide wide-scale program implementation. Methods This was an embedded multiple case study of two primary care-focused initiatives implemented in two diverse health systems in Chicago and Suburban Cook County that routinely screened patients for FI and referred them to onsite food assistance programs. The Consolidated Framework for Implementation Research and an iterative process were used to collect/analyze qualitative data through semi-structured interviews with N = 19 clinical staff. Intended program activities, outcomes, actors, implementation barriers/facilitators and overarching implementation themes were identified as a part of a cross-case analysis. Findings: Programs outcomes included: the number of patients screened and identified as FI; the number of patients referred to and participated in the onsite food assistance program. Overall, neither case achieved intended reach or participation. Limited financial, human and infrastructure support were implementation barriers. Existing community collaborations and clinic-level autonomy were critical facilitators during implementation that contributed to the flexibility of program activities. Programs were tailored to each context to assist in implementation feasibility, but contributed to low program fidelity. Conclusions Programs were highly adaptable and each context enhanced implementation feasibility across settings. These characteristics have the potential to support program uptake in other settings, but should be used with caution to preserve program fidelity and to achieve intended outcomes. A foundational model for the development and testing of standard clinical practice was the product of this study.

Download Full-text

Expanding the Boundaries of TPSR and Empowering Others to Make Their Own Contributions

10.26686/wgtn.12824855 ◽

2020 ◽

Author(s):

Barrie Gordon ◽

Sylvie Beaudoin

Keyword(s):

Professional Development ◽

Social Responsibility ◽

Research Quality ◽

Ongoing Research ◽

Program Fidelity ◽

Geographical Spread ◽

Extensive Range ◽

Growth Method ◽

Personal And Social Responsibility ◽

Quality Professional Development

Purpose: The purpose of this article was to examine the geographical spread of teaching personal and social responsibility (TPSR), the extensive range of new populations and cultures that TPSR has been implemented with, and to consider the resulting challenges of this growth. Method: Information was gathered from published articles, dissertations, professional articles, and program descriptions and systematically analyzed for program fidelity. Results: A total of 31 countries were identified as having some level of TPSR presence, and there was a great deal of diversity in how, where, and to whom the programs are implemented. Discussion: The proliferation of TPSR will continue, and as this occurs, there will be increasing challenges in maintaining fidelity to the model. Conclusion: To meet this challenge, ongoing research, quality professional development, and the growth of communities of TPSR practice will be crucial.

Download Full-text

Promoting Program Fidelity through Peer-Assisted Supervision and Support

The Power of Positive Parenting ◽

10.1093/med-psych/9780190629069.003.0037 ◽

2017 ◽

pp. 405-416

Author(s):

Kerri E. McPherson ◽

Birgit Schroeter

Keyword(s):

Quality Assurance ◽

Parenting Program ◽

Evidence Based ◽

Parenting Interventions ◽

Peer Supervision ◽

Program Fidelity ◽

Supervision Models ◽

Quality Assurance Mechanism ◽

Support Model

This chapter makes the case for the adoption of practitioner supervision as a quality assurance mechanism for the implementation of parenting interventions. This chapter addresses the need for effective and efficient supervision and posttraining support for the evidence-based program workforce to ensure the sustainability of delivery and the ongoing maintenance of program fidelity. Alongside other fidelity mechanisms, supervision can help develop practitioners’ confidence and competence in delivery and promote adherence to intervention protocols. Peer supervision has the potential to be both efficient and effective and may be more acceptable to stakeholders than traditional hierarchical supervision models. The Peer-Assisted Supervision and Support model is described, and findings describing its acceptability and feasibility to parenting program practitioners are presented.

Download Full-text

Water, Sanitation and Hygiene (WASH) in Schools in Low-Income Countries: A Review of Evidence of Impact

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph16030359 ◽

2019 ◽

Vol 16 (3) ◽

pp. 359 ◽

Cited By ~ 8

Author(s):

Celia McMichael

Keyword(s):

Low Income ◽

Library Science ◽

Low Income Countries ◽

Cochrane Library ◽

Publication Date ◽

Program Fidelity ◽

School Based ◽

Sanitation And Hygiene ◽

Hygiene Promotion ◽

The Impact

Many schools in low-income countries have inadequate access to water facilities, sanitation and hygiene promotion. A systematic review of literature was carried out that aimed to identify and analyse the impact of water, sanitation and hygiene interventions (WASH) in schools in low-income countries. Published peer reviewed literature was systematically screened during March to June 2018 using the databases PubMed, Embase, Web of Science, the Cochrane Library, Science Direct, and Google Scholar. There were no publication date restrictions. Thirty-eight peer reviewed papers were identified that met the inclusion criteria. The papers were analysed in groups, based on four categories of reported outcomes: (i) reduction of diarrhoeal disease and other hygiene-related diseases in school students; (ii) improved WASH knowledge, attitudes and hygiene behaviours among students; (iii) reduced disease burden and improved hygiene behaviours in students’ households and communities; (iv) improved student enrolment and attendance. The typically unmeasured and unreported ‘output’ and/or ‘exposure’ of program fidelity and adherence was also examined. Several studies provide evidence of positive disease-related outcomes among students, yet other assessments did not find statistically significant differences in health or indicated that outcomes are dependent on the nature and context of interventions. Thirteen studies provide evidence of changes in WASH knowledge, attitudes and behaviours, such as hand-washing with soap. Further research is required to understand whether and how school-based WASH interventions might improve hygiene habits and health among wider family and community members. Evidence of the impact of school-based WASH programs in reducing student absence from school was mixed. Ensuring access to safe and sufficient water and sanitation and hygiene promotion in schools has great potential to improve health and education and to contribute to inclusion and equity, yet delivering school-based WASH intervention does not guarantee good outcomes. While further rigorous research will be of value, political will and effective interventions with high program fidelity are also key.

Download Full-text