The Behavioral Recovery Outreach (BRO) Team: A Transitional Care Model for Veterans With Complex Care Needs

In 2012, VA Central Iowa developed a novel program known as the Behavioral Recovery Outreach (BRO) Team to address unmet needs of our aging Veteran population with complex medical, psychological, neurocognitive and behavioral concerns. BRO Teams provide evidence-informed treatments in inpatient VA settings, and transitional care/support post-discharge to ensure successful placement and stability in the community. We will discuss how implementation science informed the expansion of this model from a local pilot to a nationally disseminated program. We will explore the challenges of ensuring program fidelity while fostering innovation and adaptation. Given the challenges of national dissemination, we will highlight the predicted and unforeseen aspects of program evaluation and policy implications. Finally, we will discuss the impacts of the COVID-19 pandemic on delivery of care methods and community-based interactions, as well as how this program has improved the lives and quality of care for this high-risk Veteran population.

Adapting Nutrition Programming for Intergenerational Implementation

Practitioners frequently tailor programming to meet participant characteristics and logistic constraints, or to incorporate diverse participants, such as intergenerational programming. Adapted programming may be responsive but reduce impact on outcomes. With growing interest in and limited availability of intergenerational protocol, implementation science guides program tailoring to ensure that youth and older adults mutually benefit from adapted programming. We integrated guidelines for tailoring interventions (Framework for Reporting Adaptations and Modifications-Expanded: FRAME) and evidence-based intergenerational practice. We illustrate how program fidelity can be supported in intergenerational settings using examples from an adapted USDA-approved preschool nutrition curriculum delivered intergenerationally. Program acceptability, appropriateness, and feasibility were rated favorably by program stakeholders, and observational implementation data suggest fidelity can be maintained using evidence-based intergenerational strategies. Our findings support the potential for protocol developed for one age group to benefit youth and older adults when it is adapted using implementation and intergenerational guidelines.

Evaluating Delivery of a CBT-Based Group Intervention for Schoolchildren With Emotional Problems: Examining the Reliability and Applicability of a Video-Based Adherence and Competence Measure

Adherence and competence are essential parts of program fidelity and having adequate measures to assess these constructs is important. The Competence and Adherence Scale for Cognitive Behavioral Therapy (CAS CBT) was developed to evaluate the delivery of cognitive therapies for children with clinical anxiety. The present study is an assessment of the slightly adapted version of the CAS CBT evaluating the delivery of a Cognitive Behavioral Therapy (CBT)-based preventive group intervention: EMOTION: Kids Coping with Anxiety and Depression. This study was part of a Norwegian cluster randomized controlled trial (cRCT) investigating the effectiveness of a transdiagnostic intervention, the EMOTION program—an indicated prevention program targeting anxious and depressive symptoms. The applicability and psychometric properties of the CAS CBT were explored. Results are based on six raters evaluating 239 video-recorded sessions of the EMOTION program being delivered by 68 trained group leaders from different municipal services. Interrater reliability (intraclass correlation coefficients, ICC [3, 1]) indicated fair to good agreement between raters. Internal consistency of the instrument's key domains was calculated using the Omega coefficient which ranged between 0.70 to 0.94. There was a strong association between the two scales Adherence and Competence, and inter-item correlations were high across the items, except for the items rating the adherence to the session goals. Competence and Adherence Scale for Cognitive Behavioral Therapy is a brief measure for use in first-line services, with some promising features for easily assessing program fidelity, but some of the results indicated that the instrument should be improved. Future attention should also be made to adapt the instrument to fit better within a group setting, especially regarding evaluation of session goals. More research on how to adequately evaluate fidelity measures are also warranted.Clinical Trial Registration:www.ClinicalTrials.gov, identifier: NCT02340637.

Fidelity Assessment Checklist Development for Community Nursing Research in Early Childhood

Nurses play an important role in promoting positive childhood development via early interventions intended to support parenting. Despite recognizing the need to deliver vital parenting programs, monitoring fidelity has largely been ignored. Fidelity refers to the degree to which healthcare programs follow a well-defined set of criteria specifically designed for a particular program model. With increasing demands for early intervention programs to be delivered by non-specialists, rigorous yet pragmatic strategies for maintaining fidelity are needed. This paper describes the step-by-step development and evaluation of a program fidelity measure, using the Attachment and Child Health (ATTACH™) parenting program as an exemplar. The overall quality index for program delivery varied between “very good” to “excellent,” with a mean of 4.3/5. Development of checklists like the ATTACH™ fidelity assessment checklist enables the systematic evaluation of program delivery and identification of therapeutic components that enable targeted efforts at improvement. In future, research should examine links between program fidelity and targeted outcomes to ascertain if increased fidelity scores yield more favorable effects of parenting programs.

An Embedded Multiple Case Study: Facilitating Uptake of Food Insecurity Screening Initiatives in Low Resource Primary Care Settings

Background Food insecurity (FI), limited access to healthy food, is a social determinant of health linked to poor dietary health and difficulty with disease management. Healthcare experts support the adoption of validated screening tools within primary care clinics to identify and connect FI patients to food resources. Yet, a lack of standard practices limits uptake. The purpose of this study was to understand program processes and outcomes of primary care focused FI screening initiatives that can guide wide-scale program implementation. Methods This was an embedded multiple case study of two primary care-focused initiatives implemented in two diverse health systems in Chicago and Suburban Cook County that routinely screened patients for FI and referred them to onsite food assistance programs. The Consolidated Framework for Implementation Research and an iterative process were used to collect/analyze qualitative data through semi-structured interviews with N = 19 clinical staff. Intended program activities, outcomes, actors, implementation barriers/facilitators and overarching implementation themes were identified as a part of a cross-case analysis. Findings: Programs outcomes included: the number of patients screened and identified as FI; the number of patients referred to and participated in the onsite food assistance program. Overall, neither case achieved intended reach or participation. Limited financial, human and infrastructure support were implementation barriers. Existing community collaborations and clinic-level autonomy were critical facilitators during implementation that contributed to the flexibility of program activities. Programs were tailored to each context to assist in implementation feasibility, but contributed to low program fidelity. Conclusions Programs were highly adaptable and each context enhanced implementation feasibility across settings. These characteristics have the potential to support program uptake in other settings, but should be used with caution to preserve program fidelity and to achieve intended outcomes. A foundational model for the development and testing of standard clinical practice was the product of this study.

Comparing fidelity monitoring methods in an evidence-based parenting intervention

Purpose Two common methods in community settings of assessing program fidelity, a critical implementation component for program effectiveness, are video and audio recordings of sessions. This paper aims to examine how these two methods compared when used for a home-based behavioral parenting-training model (SafeCare®). Design/methodology/approach Twenty-five SafeCare video-recorded sessions between home visitors and parents were scored by trained raters either using the video or audio-only portions of recordings. Sessions were coded using fidelity checklists, with items (n = 33) classified as one of two fidelity aspects, content [delivery of program components (n = 15)], or process [communication and rapport building (n = 11)]. Seven items were considered to overlap between constructs. Items were coded as having been done or not done appropriately. Coders rated items as “technological limitation” when scoring methods hindered coding. Analyses compared percent agreement and disagreement between audio and video coders. Findings Overall agreement between coders was 72.12%. Levels of agreement were higher for content items (M = 80.89%, SD = 19.68) than process items (58.54%, SD = 34.41). Disagreements due to technology limitations among audio coders were noted among 15 items; particularly, higher levels of disagreement were seen among process items (42.42%) than content items (9.64%). Originality/value Compared to video, fidelity monitoring via audio recordings was associated with some loss of process-related fidelity. However, audio recordings could be sufficient with supplements such as participant surveys, to better capture process items. Research should also examine how content and process fidelity relate to changes in family behavior to further inform optimal fidelity monitoring methods for program use.

Exploring Fidelity in School-Based Mindfulness Programs

A small but growing body of research on school-based mindfulness programs (SBMPs) has demonstrated benefits for students’ cognitive and affective functioning and overall wellbeing. Yet, lack of fidelity in SBMP implementation may diminish these programs’ purported benefits. This commentary presents 4 current challenges that need to be addressed so that questions of whether and how mindfulness improves student functioning can be clarified and implementation of programs can be strengthened and sustained. These challenges include coming to consensus on the definition and intention of mindfulness training, balancing adherence with flexibility in SBMP delivery, determining the role SBMP teachers’ mindfulness experience plays in program fidelity, and delineating distinctive features of mindful pedagogy. Some suggestions for addressing each of these challenges are provided.

Helping women transition out of sex work: study protocol of a mixed-methods process and outcome evaluation of a sex work exiting program

Background For women who want to, exiting sex work can be challenging. Numerous programs strive to help women wanting to exit sex work and secure alternative sources of income by providing targeted support at key moments during the transition, yet few of those initiatives are rigorously evaluated. In 2017 “Exit Doors Here”, a 9-month sex work exiting program based on the critical time intervention (CTI) approach, was developed to provide wrap-around support services (e.g., health, addiction, housing, education, and employment supports) to women wishing to transition towards exiting sex work. Methods We present the design of an evaluation study of Exit Doors Here which combines quantitative and qualitative methods to assess participant recruitment and retention into the program, program fidelity, and relationships with service providers (process evaluation), as well as progress made by participants in terms of strengthening their social support networks and moving closer to achieving their housing, pre-employment (i.e., educational, training and volunteering), and income-related goals, as well as their involvement in sex work (outcome evaluation). Each year for 4 years, between 25 and 30 Exit Doors Here clients will be invited to complete an interviewer-administered questionnaire at the beginning and after completing the program, and to share data from their CTI charts and related documentation. Once a year, program staff and peer workers will be interviewed, and service providers will be surveyed. Discussion Conducting a formative (process) evaluation will allow us to inform program implementation and improve program delivery early on for maximum benefit. The summative (outcome) evaluation will provide much needed evidence on the effectiveness of CTI in supporting a traditionally underserved population to achieve the housing, pre-employment and income-related goals they value, and their progress towards reducing their involvement in, and eventually exiting, sex work.

Evaluation of the Special Olympics Team Wellness health promotion program for individuals with intellectual disabilities

Introduction: Individuals with intellectual disabilities are a known health disparities group. The Team Wellness (TW) health promotion program was developed to provide healthy lifestyle information to target this population. The purpose of this study was to conduct a qualitative program evaluation on Team Wellness. Methods: Interviews were conducted via one-on-one format with program coaches (n = 4, mean age = 25, female = 2, male = 2) and focus group with program athletes (n = 6, mean age = 45, female = 4, male = 2) who completed the TW program. Results: Themes that emerged included: (1) Program Perceptions; (2) TW Support; and (3) Program Feedback. Program perceptions were positive and continued athlete participation was anticipated. Coaches felt prepared to facilitate based on previous experience though program fidelity varied. Conclusion: Study participants enjoyed TW and identified valuable recommendations. Program fidelity and marketing efforts are important for future consideration. Further quantitative assessment is needed to determine the effectiveness the program.