scholarly journals Interactive and Participatory Audit and Feedback (IPAF): theory-based development and multi-site implementation outcomes with specialty clinic staff

2021 ◽  
Vol 2 (1) ◽  
Author(s):  
Edmond Ramly ◽  
Diane R. Lauver ◽  
Andrea Gilmore-Bykovskyi ◽  
Christie M. Bartels

Abstract Background Theory-based implementation strategies, such as audit and feedback (A&F), can improve the adoption of evidence-based practices. However, few strategies have been developed and tested to meet the needs of specialty clinics. In particular, frontline staff can execute cardiovascular disease (CVD) risk reduction protocols, but A&F strategies to support them are not well examined. Our objective was to develop and evaluate a theory-based approach to A&F, Interactive and Participatory A&F (IPAF). Methods We developed IPAF informed by two complementary theories, self-regulation theory (SRT) and self-determination theory (SDT). IPAF applies concepts from these theories to inform (1) what to address with staff to improve rates of best practices (SRT) and (2) how to interact with staff to improve behaviors aligned with best practices (SDT). We promoted IPAF fidelity by developing a semi-structured guide to facilitate staff discussion of target behaviors, perceived barriers, goals, and action plans. We evaluated IPAF in the context of eight quasi-experimental implementations in specialty clinics across two health systems. Following a hybrid type 2 effectiveness-implementation design, we reported intervention outcomes for CVD risk reduction elsewhere. This paper reports implementation outcomes associated with IPAF, focusing on feasibility, appropriateness, acceptability, fidelity, and adoption. We evaluated implementation outcomes using mixed-methods data including electronic health record (EHR) data, team records, and staff questionnaire responses. Results Eighteen staff participated in 99 monthly, individual, synchronous (face-to-face or phone) IPAF sessions during the first 6 months of implementation. Subsequently, we provided over 375 monthly feedback emails. Feasibility data revealed high staff attendance (90–93%) and engagement in IPAF sessions. Staff highly rated questionnaire items about IPAF acceptability. Team records and staff responses demonstrated fidelity of IPAF delivery and receipt. Adoption of target behaviors increased significantly (all P values < 0.05), and adoption or behaviors were maintained for over 24 months. Conclusions We developed and evaluated a theory-based approach to A&F with frontline staff in specialty clinics to improve the implementation of evidence-based interventions. The findings support feasibility, appropriateness, acceptability, and fidelity of IPAF, and staff adoption and maintenance of target behaviors. By evaluating multi-site implementation outcomes, we extended prior research on clinic protocols and A&F beyond primary care settings and providers.

2020 ◽  
Author(s):  
Edmond Ramly ◽  
Diane Lauver ◽  
Andrea Gilmore-Bykovskyi ◽  
Christie M Bartels

Abstract Background: Theory-based implementation strategies, such as audit and feedback (A&F), can improve adoption of evidence-based practices. However, few strategies have been developed and tested to meet the needs of specialty clinics. In particular, frontline staff can execute CVD risk-reduction protocols, but A&F strategies to support them have not been well examined. Our objective was to develop and evaluate a novel A&F strategy, Interactive Participatory A&F (IPAF). Methods: We developed IPAF by combining theories to inform staff goals (Self-Regulation Theory) and address their psychological needs for relatedness, autonomy, and confidence (Self-Determination Theory). We facilitated IPAF fidelity by developing a theory-based facilitation tool: a semi-structured worksheet to guide flexible discussion of target behaviors, perceived barriers, goals, and action plans. We evaluated IPAF in the context of eight quasi-experimental implementations in specialty clinics across two health systems. Following a Hybrid Type 2 effectiveness-implementation design, we reported intervention outcomes for CVD risk-reduction elsewhere. This paper reports implementation outcomes associated with IPAF, focusing on feasibility, acceptability, fidelity, and adoption. We evaluated implementation outcomes using mixed-methods data including Electronic Health Records (EHR) data, team records, IPAF worksheets, and staff questionnaire responses. Results: Eighteen staff participated in 99 monthly, individual, synchronous (face-to-face or by phone) IPAF sessions during the first six months of implementation. Subsequently, we provided over 375 monthly feedback emails. Feasibility data revealed high staff attendance (90-93%) and engagement in IPAF sessions. Staff rated questionnaire items about acceptability of IPAF highly. IPAF records and staff responses demonstrated fidelity of delivery and receipt of IPAF. Adoption of target behaviors increased significantly (all P-values < 0.05) and was maintained for over 24 months. Conclusions: We developed and evaluated an interactive participatory A&F strategy with frontline staff in specialty clinics to improve implementation of evidence-based interventions. The IPAF toolkit combines two complementary theories: Self-Regulation Theory and Self-Determination Theory. Findings support feasibility, acceptability, and fidelity of IPAF, and staff adoption and maintenance of target behaviors. By evaluating multi-site implementation outcomes, we have extended prior research on clinic protocols and A&F beyond primary care settings and providers.


2020 ◽  
Author(s):  
Edmond Ramly ◽  
Diane Lauver ◽  
Andrea Gilmore-Bykovskyi ◽  
Christie M Bartels

Abstract Background: Theory-based implementation strategies, such as audit and feedback (A&F), can improve adoption of evidence-based practices. However, few strategies have been developed and tested to meet the needs of specialty clinics. In particular, frontline staff can execute CVD risk-reduction protocols, but A&F strategies to support them have not been well examined. The objective of this paper is to develop a novel A&F strategy, Interactive Participatory A&F (IPAF), and evaluate as an implementation strategy to support specialty clinic staff. Methods: We developed IPAF by combining theories to inform staff goals (Self-Regulation Theory) and address their psychological needs for relatedness, autonomy, and confidence (Self-Determination Theory). We facilitated IPAF fidelity by developing a theory-based facilitation tool: a semi-structured worksheet to guide flexible discussion of target behaviors, perceived barriers, goals, and action plans. We evaluated IPAF in the context of eight quasi-experimental implementations in specialty clinics across two health systems. Following a Hybrid Type 2 effectiveness-implementation design, we reported intervention outcomes for CVD risk-reduction elsewhere. This paper reports implementation outcomes associated with IPAF, focusing on feasibility, acceptability, fidelity, and adoption. We evaluated implementation outcomes using mixed-methods data including Electronic Health Records (EHR) data, team records, IPAF worksheets, and staff questionnaire responses. Results: Eighteen staff participated in 99 monthly, individual, synchronous (face-to-face or by phone) IPAF sessions during the first six months of implementation. Subsequently, we provided over 375 monthly feedback emails. Feasibility data revealed high staff attendance (90-93%) and engagement in IPAF sessions. Staff rated questionnaire items about acceptability of IPAF highly. IPAF records and staff responses demonstrated fidelity of delivery and receipt of IPAF. Adoption of target behaviors increased significantly (all P-values < 0.05) and was maintained for over 24 months. Conclusions: We developed and evaluated an interactive participatory A&F strategy to improve implementation of evidence-based interventions. The IPAF toolkit combines two complementary theories: Self-Regulation Theory and Self-Determination Theory. Findings support feasibility, acceptability, and fidelity of IPAF, and staff adoption and maintenance of target behaviors. By evaluating multi-site implementation outcomes in specialty clinics with frontline staff, we have extended prior research on clinic protocols and A&F beyond primary care settings and providers.


2021 ◽  
Vol 16 (1) ◽  
Author(s):  
Staci S. Reynolds ◽  
Patricia Woltz ◽  
Edward Keating ◽  
Janice Neff ◽  
Jennifer Elliott ◽  
...  

Abstract Background Central line-associated bloodstream infections (CLABSIs) result in approximately 28,000 deaths and approximately $2.3 billion in added costs to the U.S. healthcare system each year, and yet, many of these infections are preventable. At two large health systems in the southeast United States, CLABSIs continue to be an area of opportunity. Despite strong evidence for interventions to prevent CLABSI and reduce associated patient harm, such as use of chlorhexidine gluconate (CHG) bathing, the adoption of these interventions in practice is poor. The primary objective of this study was to assess the effect of a tailored, multifaceted implementation program on nursing staff’s compliance with the CHG bathing process and electronic health record (EHR) documentation in critically ill patients. The secondary objectives were to examine the (1) moderating effect of unit characteristics and cultural context, (2) intervention effect on nursing staff’s knowledge and perceptions of CHG bathing, and (3) intervention effect on CLABSI rates. Methods A stepped wedged cluster-randomized design was used with units clustered into 4 sequences; each sequence consecutively began the intervention over the course of 4 months. The Grol and Wensing Model of Implementation helped guide selection of the implementation strategies, which included educational outreach visits and audit and feedback. Compliance with the appropriate CHG bathing process and daily CHG bathing documentation were assessed. Outcomes were assessed 12 months after the intervention to assess for sustainability. Results Among the 14 clinical units participating, 8 were in a university hospital setting and 6 were in community hospital settings. CHG bathing process compliance and nursing staff’s knowledge and perceptions of CHG bathing significantly improved after the intervention (p = .009, p = .002, and p = .01, respectively). CHG bathing documentation compliance and CLABSI rates did not significantly improve; however, there was a clinically significant 27.4% decrease in CLABSI rates. Conclusions Using educational outreach visits and audit and feedback implementation strategies can improve adoption of evidence-based CHG bathing practices. Trial registration ClinicalTrials.gov, NCT03898115, Registered 28 March 2019.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kenneth C. Hohmeier ◽  
Chelsea Renfro ◽  
Kea Turner ◽  
Parin Patel ◽  
Estrella Ndrianasy ◽  
...  

Abstract Background First investigated in the 1990s, medication therapy management (MTM) is an evidence-based practice offered by pharmacists to ensure a patient’s medication regimen is individualized to include the safest and most effective medications. MTM has been shown to a) improve quality of patient care, b) reduces health care costs, and c) lead to fewer medication-related adverse effects. However, there has been limited testing of evidence-based, a-priori implementation strategies that support MTM implementation on a large scale. Methods The study has two objectives assessed at the organizational and individual level: 1) to determine the adoption, feasibility, acceptability and appropriateness of a multi-faceted implementation strategy to support the MTM pilot program in Tennessee; and 2) to report on the contextual factors associated with program implementation based on the Consolidated Framework for Implementation Research (CFIR). The overall design of the study was a hybrid type 2 effectiveness-implementation study reporting outcomes of Tennessee state Medicaid’s (TennCare) MTM Pilot program. This paper presents early stage implementation outcomes (e.g., adoption, feasibility, acceptability, appropriateness) and explores implementation barriers and facilitators using the CFIR. The study was assessed at the (a) organizational and (b) individual level. A mixed-methods approach was used including surveys, claims data, and semi-structured interviews. Interview data underwent initial, rapid qualitative analysis to provide real time feedback to TennCare leadership on project barriers and facilitators. Results The total reach of the program from July 2018 through June 2020 was 2033 MTM sessions provided by 17 Medicaid credentialed pharmacists. Preliminary findings suggest participants agreed that MTM was acceptable (μ = 16.22, SD = 0.28), appropriate (μ = 15.33, SD = 0.03), and feasible (μ = 14.72, SD = 0.46). Each of the scales had an excellent level of internal (> 0.70) consistency (feasibility, α = 0.91; acceptability, α = 0.96; appropriateness, α = 0.98;). Eight program participants were interviewed and were mapped to the following CFIR constructs: Process, Characteristics of Individuals, Intervention Characteristics, and Inner Setting. Rapid data analysis of the contextual inquiry allowed TennCare to alter initial implementation strategies during project rollout. Conclusion The early stage implementation of a multi-faceted implementation strategy to support delivery of Tennessee Medicaid’s MTM program was found to be well accepted and appropriate across multiple stakeholders including providers, administrators, and pharmacists. However, as the early stage of implementation progressed, barriers related to relative priority, characteristics of the intervention (e.g., complexity), and workflow impeded adoption. Programmatic changes to the MTM Pilot based on early stage contextual analysis and implementation outcomes had a positive impact on adoption.


2021 ◽  
Vol 16 (1) ◽  
Author(s):  
J. Edward Murrell ◽  
Janell L. Pisegna ◽  
Lisa A. Juckett

Abstract Background Stroke survivors often encounter occupational therapy practitioners in rehabilitation practice settings. Occupational therapy researchers have recently begun to examine the implementation strategies that promote the use of evidence-based occupational therapy practices in stroke rehabilitation; however, the heterogeneity in how occupational therapy research is reported has led to confusion about the types of implementation strategies used in occupational therapy and their association with implementation outcomes. This review presents these strategies and corresponding outcomes using uniform language and identifies the extent to which strategy selection has been guided by theories, models, and frameworks (TMFs). Methods A scoping review protocol was developed to assess the breadth and depth of occupational therapy literature examining implementation strategies, outcomes, and TMFs in the stroke rehabilitation field. Five electronic databases and two peer-reviewed implementation science journals were searched to identify studies meeting the inclusion criteria. Two reviewers applied the inclusion parameters and consulted with a third reviewer to achieve consensus. The 73-item Expert Recommendations for Implementing Change (ERIC) implementation strategy taxonomy guided the synthesis of implementation strategies. The Implementation Outcomes Framework guided the analysis of measured outcomes. Results The initial search yielded 1219 studies, and 26 were included in the final review. A total of 48 out of 73 discrete implementation strategies were described in the included studies. The most used implementation strategies were “distribute educational materials” (n = 11), “assess for readiness and identify barriers and facilitators” (n = 11), and “conduct educational outreach visits” (n = 10). “Adoption” was the most frequently measured implementation outcome, while “cost” was not measured in any included studies. Eleven studies reported findings supporting the effectiveness of their implementation strategy or strategies; eleven reported inconclusive findings, and four found that their strategies did not lead to improved implementation outcomes. In twelve studies, at least partially beneficial outcomes were reported, corresponding with researchers using TMFs to guide implementation strategies. Conclusions This scoping review synthesized implementation strategies and outcomes that have been examined in occupational therapy and stroke rehabilitation. With the growth of the stroke survivor population, the occupational therapy profession must identify effective strategies that promote the use of evidence-based practices in routine stroke care and describe those strategies, as well as associated outcomes, using uniform nomenclature. Doing so could advance the occupational therapy field’s ability to draw conclusions about effective implementation strategies across diverse practice settings.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 733-733
Author(s):  
Lisa Juckett ◽  
Shannon Jarrott ◽  
Jill Naar ◽  
Rachel Scivano ◽  
Alicia Bunger

Abstract Programs that intentionally engage unrelated young and old persons often lead to mutual benefits; however, specific implementation strategies that support the use of evidence-based intergenerational programming in community settings are understudied. With strong demand for training resources among intergenerational program providers, this pilot study examined how a multifaceted training strategy facilitated the implementation of 14 distinct evidence-based intergenerational best practices. Intergenerational programming was implemented with nine staff from two small community sites using three implementation strategies including educational meetings, ongoing consultation, and routine practice reminders. Observational analysis of video recorded intergenerational program sessions indicated that staff adopted an average of 81.7% of intergenerational best practices suggesting the feasibility of implementing IG in community settings. Findings yield valuable insight that can inform training refinements, and selection of strategies for improving implementation. Next steps include aligning specific practices with participant outcomes.


2021 ◽  
Vol 5 (Supplement_1) ◽  
pp. 365-365
Author(s):  
Mary Dolansky ◽  
Anne Pohnert ◽  
Sherry Greenberg

Abstract Background Implementation science is the study of methods to promote the adoption and integration of evidence-based practices into routine health care to improve the quality of care. The purpose of this study was to use Implementation Mapping to guide the implementation of The John A. Hartford evidence-based Age-Friendly Health Systems (AFHS) 4Ms Framework: What Matters, Medications, Mentation, and Mobility. Methods Implementation Mapping, a systematic process for planning implementation strategies, guided the 9-month integration of the 4Ms Framework in the 1,100 MinuteClinics across the US. Implementation Mapping includes five tasks: (1) conduct an implementation needs assessment and identify program adopters and implementers; (2) state adoption and implementation outcomes and performance objectives, identify determinants, and create matrices of change objectives; (3) choose theoretical methods (mechanisms of change) and select or design implementation strategies; (4) produce implementation protocols and materials; and (5) evaluate implementation outcomes. Results The implementation plan, developed by the implementation mapping method, was carried out over 9-months. Seven implementation strategies were identified from the Expert Recommendations for Implementing Change (ERIC) project including the provision of education, electronic health record integration, internal champion facilitation, cues to action, and a dashboard to monitor progress. To date, the implementation mapping has resulted in the adoption of the 4Ms by 1145 providers (37%). Monitoring of the adoption of the 4Ms Framework and consideration of future implementation strategies is ongoing. Conclusions Implementation Mapping provided a systematic process to develop strategies to improve the adoption, implementation, sustainment, and scale-up of the evidence-based 4Ms Framework.


2021 ◽  
Author(s):  
Kenneth C Hohmeier ◽  
Chelsea Renfro ◽  
Kea Turner ◽  
Parin Patel ◽  
Estrella Ndrianasy ◽  
...  

Abstract Background First investigated in the 1990s, medication therapy management (MTM) is an evidence-based practice offered by pharmacists to ensure a patient’s medication regimen is individualized to include the safest and most effective medications. MTM has been shown to a) improve quality of patient care, b) reduces health care costs, and c) lead to fewer medication-related adverse effects. However, there has been limited testing of evidence-based, a-priori implementation strategies that support MTM implementation on a large scale. Methods The study has two objectives assessed at the organizational and individual level: 1) to determine the adoption, feasibility, acceptability and appropriateness of a multi-faceted implementation strategy to support the MTM pilot program in Tennessee; and 2) to report on the contextual factors associated with program implementation based on the Consolidated Framework for Implementation Research (CFIR). The overall design of the study was a hybrid type 2 effectiveness-implementation study reporting outcomes of Tennessee state Medicaid’s (TennCare) MTM Pilot program. This paper presents early stage implementation outcomes (e.g., adoption, feasibility, acceptability, appropriateness) and explores implementation barriers and facilitators using the CFIR. The study was assessed at the (a) organizational and (b) individual level. A mixed-methods approach was used including surveys, claims data, and semi-structured interviews. Interview data underwent initial, rapid qualitative analysis to provide real time feedback to TennCare leadership on project barriers and facilitators. Results The total reach of the program through June 2020 was 2,033 MTM sessions provided by 17 Medicaid credentialed pharmacists. Preliminary findings suggest participants agreed that MTM was acceptable (µ = 16.22, SD = 0.28), appropriate (µ = 15.33, SD = 0.03), and feasible (µ = 14.72, SD = 0.46) (Table 4). Each of the scales had an excellent level of internal (> 0.70) consistency (feasibility, α=0.91; acceptability, α=0.96; appropriateness, α=0.98;). Eight program participants were interviewed and were mapped to the following CFIR constructs: Process, Characteristics of Individuals, Intervention Characteristics, and Inner Setting. Rapid data analysis of the contextual inquiry allowed TennCare to alter initial implementation strategies during project rollout. Conclusion The early stage implementation of a multi-faceted implementation strategy to support delivery of Tennessee Medicaid’s MTM program was found to be well accepted and appropriate across multiple stakeholders including providers, administrators, and pharmacists. However, as the early stage of implementation progressed, barriers related to relative priority, characteristics of the intervention (e.g., complexity), and workflow impeded adoption. Programmatic changes to the MTM Pilot based on early stage contextual analysis and implementation outcomes had a positive impact on adoption.


10.2196/14255 ◽  
2019 ◽  
Vol 21 (9) ◽  
pp. e14255 ◽  
Author(s):  
Cecilie Varsi ◽  
Lise Solberg Nes ◽  
Olöf Birna Kristjansdottir ◽  
Saskia M Kelders ◽  
Una Stenberg ◽  
...  

Background There is growing evidence of the positive effects of electronic health (eHealth) interventions for patients with chronic illness, but implementation of such interventions into practice is challenging. Implementation strategies that potentially impact implementation outcomes and implementation success have been identified. Which strategies are actually used in the implementation of eHealth interventions for patients with chronic illness and which ones are the most effective is unclear. Objective This systematic realist review aimed to summarize evidence from empirical studies regarding (1) which implementation strategies are used when implementing eHealth interventions for patients with chronic illnesses living at home, (2) implementation outcomes, and (3) the relationship between implementation strategies, implementation outcomes, and degree of implementation success. Methods A systematic literature search was performed in the electronic databases MEDLINE, Embase, PsycINFO, Scopus, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, and Cochrane Library. Studies were included if they described implementation strategies used to support the integration of eHealth interventions into practice. Implementation strategies were categorized according to 9 categories defined by the Expert Recommendations for Implementing Change project: (1) engage consumers, (2) use evaluative and iterative strategies, (3) change infrastructure, (4) adapt and tailor to the context, (5) develop stakeholder interrelationships, (6) use financial strategies, (7) support clinicians, (8) provide interactive assistance, and (9) train and educate stakeholders. Implementation outcomes were extracted according to the implementation outcome framework by Proctor and colleagues: (1) acceptability, (2) adoption, (3) appropriateness, (4) cost, (5) feasibility, (6) fidelity, (7) penetration, and (8) sustainability. Implementation success was extracted according to the study authors’ own evaluation of implementation success in relation to the used implementation strategies. Results The implementation strategies management support and engagement, internal and external facilitation, training, and audit and feedback were directly related to implementation success in several studies. No clear relationship was found between the number of implementation strategies used and implementation success. Conclusions This is the first review examining implementation strategies, implementation outcomes, and implementation success of studies reporting the implementation of eHealth programs for patients with chronic illnesses living at home. The review indicates that internal and external facilitation, audit and feedback, management support, and training of clinicians are of importance for eHealth implementation. The review also points to the lack of eHealth studies that report implementation strategies in a comprehensive way and highlights the need to design robust studies focusing on implementation strategies in the future. Trial Registration PROSPERO CRD42018085539; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=85539


Sign in / Sign up

Export Citation Format

Share Document