Developing a tailored implementation action plan for a suicide prevention clinical intervention in an Australian mental health service: A qualitative study using the EPIS framework

Background: Tailoring implementation strategies to local contexts is a promising approach to supporting implementation and sustainment of evidence-based practices in health settings. While there is increasing research on tailored implementation of mental health interventions, implementation research on suicide prevention interventions is limited. This study aimed to evaluate implementation and subsequently develop a tailored action plan to support sustainment of an evidence-based suicide prevention intervention; Collaborative Assessment and Management of Suicidality (CAMS) in an Australian public mental health service. Methods: Approximately 150 mental health staff working within a regional and remote Local Health District in Australia were trained in CAMS. Semi-structured interviews and focus groups with frontline staff and clinical leaders were conducted to examine barriers and facilitators to using CAMS. Data were analysed using a reflexive thematic analysis approach and mapped to the Exploration, Preparation, Implementation and Sustainment (EPIS) framework and followed by stakeholder engagement to design a tailored implementation action plan based on a ‘tailored blueprint’ methodology. Results: A total of 22 barriers to implementing CAMS were identified. Based on the perceived impact on implementation fidelity and the feasibility of addressing identified barriers, six barriers were prioritised for addressing through an implementation action plan. These barriers were mapped to evidence-based implementation strategies and, in collaboration with local health district staff, goals and actionable steps for each strategy were generated. This information was combined into a tailored implementation plan to support the sustainable use of CAMS as part of routine care within this mental health service. Conclusions: This study provides an example of a collaborative approach to tailoring strategies for implementation on a large scale. Novel insights were obtained into the challenges of evaluating the implementation process and barriers to implementing an evidence-based suicide prevention treatment approach within a geographically large and varied mental health service in Australia. Plain language abstract: This study outlines the process of using a collaborative stakeholder engagement approach to develop tailored implementation plans. Using the Exploration Preparation Implementation Sustainment Framework, findings identify the barriers to and strategies for implementing a clinical suicide prevention intervention in an Australian community mental health setting. This is the first known study to use an implementation science framework to investigate the implementation of the clinical suicide prevention intervention (Collaborative Assessment and Management of Suicidality) within a community mental health setting. This work highlights the challenges of conducting implementation research in a dynamic public health service.

Innovations in implementing a health systems response to violence against women in 3 tertiary hospitals of Maharashtra India: Improving provider capacity and facility readiness

Background Violence against women [VAW] is an urgent public health issue and health care providers [HCPs] are in a unique position to respond to such violence within a multi-sectoral health system response. In 2013, the World Health Organization (WHO) published clinical and policy guidelines (henceforth – the Guidelines) for responding to intimate partner violence and sexual violence against women. In this practical implementation report, we describe the adaptation of the Guidelines to train HCPs to respond to violence against women in tertiary health facilities in Maharashtra, India. Methods We describe the strategies employed to adapt and implement the Guidelines, including participatory methods to identify and address HCPs’ motivations and the barriers they face in providing care for women subjected to violence. The adaptation is built on querying health-systems level enablers and obstacles, as well as individual HCPs’ perspectives on content and delivery of training and service delivery. Results The training component of the intervention was delivered in a manner that included creating ownership among health managers who became champions for other health care providers; joint training across cadres to have clear roles, responsibilities and division of labour; and generating critical reflections about how gender power dynamics influence women's experience of violence and their health. The health systems strengthening activities included establishment of standard operating procedures [SOPs] for management of VAW and strengthening referrals to other services. Conclusions In this intervention, standard training delivery was enhanced through participatory, joint and reflexive methods to generate critical reflection about gender, power and its influence on health outcomes. Training was combined with health system readiness activities to create an enabling environment. The lessons learned from this case study can be utilized to scale-up response in other levels of health facilities and states in India, as well as other LMIC contexts. Plain language summary Violence against women affects millions of women globally. Health care providers may be able to support women in various ways, and finding ways to train and support health care providers in low and middle-income countries to provide high-quality care to women affected by violence is an urgent need. The WHO developed Clinical and Policy Guidelines in 2013, which provide guidance on how to improve health systems response to violence against women. We developed and implemented a series of interventions, including training of health care providers and innovations in service delivery, to implement the WHO guidelines for responding to violence against women in 3 tertiary hospitals of Maharashtra, India. The nascent published literature on health systems approaches to addressing violence against women in low and middle-income countries focuses on the impact of these interventions. This practical implementation report focuses on the interventions themselves, describes the processes of developing and adapting the intervention, and thus provides important insights for donors, policy-makers and researchers.

A typology of power in implementation: Building on the exploration, preparation, implementation, sustainment (EPIS) framework to advance mental health and HIV health equity

Background Persistent inequities in HIV health are due, in part, to barriers to successful HIV-related mental health intervention implementation with marginalized groups. Implementation Science (IS) has begun to examine how the field can promote health equity. Lacking is a clear method to analyze how power is generated and distributed through practical implementation processes and how this power can dismantle and/or reproduce health inequity through intervention implementation. The aims of this paper are to (1) propose a typology of power generated through implementation processes, (2) apply this power typology to expand on the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to advance HIV and mental health equity and (3) articulate questions to guide the explicit examination and distribution of power throughout implementation. Methods This paper draws on the work of an Intermediary Purveyor organization implementing trauma-informed care and harm reduction organizational change with HIV service organizations. The expanded framework was developed through analyzing implementation coaching field notes, grant reporting, and evaluation documents, training feedback, partner evaluation interviews, and existing implementation literature. Results The authors identify three types of power working through implementation; (1) discursive power is enacted through defining health-related problems to be targeted by intervention implementation, as well as through health narratives that emerge through implementation; (2) epistemic power influences whose knowledge is valued in decision-making and is recreated through knowledge generation; and (3) material power is created through resource distribution and patterns of access to health resources and acquisition of health benefits provided by the intervention. Decisions across all phases and related to all factors of EPIS influence how these forms of power striate through intervention implementation and ultimately affect health equity outcomes. Conclusions The authors conclude with a set of concrete questions for researchers and practitioners to interrogate power throughout the implementation process. Plain language summary Over the past few years, Implementation Science researchers have committed increased attention to the ways in which the field can more effectively address health inequity. Lacking is a clear method to analyze how implementation processes themselves generate power that has the potential to contribute to health inequity. In this paper, the authors describe and define three types of power that are created and distributed through intervention implementation; discursive power, epistemic power, and material power. The authors then explain how these forms of power shape factors and phases of implementation, using the well-known EPIS (exploration, preparation, implementation, sustainment) framework. The authors draw from their experience working with and Intermediary Purveyor supporting HIV service organizations implementing trauma-informed care and harm reduction organizational change projects. This paper concludes with a set of critical questions that can be used by researchers and practitioners as a concrete tool to analyze the role of power in intervention implementation processes.

Barriers to implementing motivational interviewing in addiction treatment: A nominal group technique process evaluation

Background: The successful implementation of evidence-based practices (EBPs) in real-world settings requires an adaptive approach and ongoing process evaluation and tailoring. Although conducting a needs assessment during the preparation phase of implementation is beneficial, it is challenging to predict all barriers to EBP implementation that may arise over the course of implementation and sustainment. This article describes a process evaluation that identified emergent and persistent barriers that impacted the implementation of an EBP across multiple behavioral health organizations and clinics. Methods: This study was conducted during the first cohort of a cluster randomized controlled trial testing the effectiveness of the Leadership and Organizational Change for Implementation (LOCI) strategy to implement motivational interviewing (MI) in substance use disorder treatment agencies and clinics. We used a modified nominal group technique (NGT) in which clinic leaders identified barriers faced during the implementation process. Barriers were categorized, then ranked and rated according to leaders’ perceptions of each barrier’s influence on implementation. The barriers were then contextualized through individual qualitative interviews. Results: Fifteen barriers were identified, grouped into staff-level barriers, management-level barriers, and implementation program barriers. Time and resistance to MI were rated as the most influential staff-level barriers. Among management-level barriers, time was also rated highest, followed by turnover and external contractual constraints. The most influential implementation barrier was client apprehension of recording for fidelity assessment and feedback. Individual interviews supported these findings and provided suggested adaptations for future implementation efforts. Conclusion: EBP implementation is an ongoing process whereby implementation strategies must be proactively and strategically tailored to address emergent barriers. This research described a process evaluation that was used to identify 15 emergent and/or persistent barriers related to staff, management, and the implementation program. Using implementation strategies that can be tailored and/or adapted to such emergent barriers is critical to implementation effectiveness. Plain Language Summary Unforeseen barriers often arise during the course of implementation. Conducting evaluations during implementation allows for tailoring the implementation strategy. As part of a larger study using the Leadership and Organizational Change for Implementation (LOCI) strategy to implement motivational interviewing (MI), we collected data from the first cohort of LOCI clinic leaders to identify barriers to MI implementation that persisted despite advanced planning and to understand unanticipated barriers that arose during implementation. Leaders identified 15 barriers faced during the implementation process that fell into three categories: staff-level barriers, management-level barriers, and implementation program barriers. The leaders ranked time as the most influential barrier at both the staff and management levels. Staff apprehension, resistance to MI implementation, and staff turnover were also of significant concern to leaders. Future implementation efforts may benefit from conducting a similar process evaluation during the implementation phase.

Determining the influence of intervention characteristics on implementation success requires reliable and valid measures: Results from a systematic review

Background: Despite their inclusion in Rogers’ seminal diffusion of innovations theory, few implementation studies empirically evaluate the role of intervention characteristics. Now, with growing evidence on the role of adaptation in implementation, high-quality measures of characteristics such as adaptability, trialability, and complexity are needed. Only two systematic reviews of implementation measures captured those related to the intervention or innovation and their assessment of psychometric properties was limited. This manuscript reports on the results of eight systematic reviews of measures of intervention characteristics with nuanced data regarding a broad range of psychometric properties. Methods: The systematic review proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and citation searches. Phase II, data extraction, involved coding psychometric information. Phase III, data analysis, involved two trained specialists independently rating each measure using PAPERS (Psychometric And Pragmatic Evidence Rating Scales). Results: Searches identified 16 measures or scales: zero for intervention source, one for evidence strength and quality, nine for relative advantage, five for adaptability, six for trialability, nine for complexity, and two for design quality and packaging. Information about internal consistency and norms was available for most measures, whereas information about other psychometric properties was most often not available. Ratings for psychometric properties fell in the range of “poor” to “good.” Conclusion: The results of this review confirm that few implementation scholars are examining the role of intervention characteristics in behavioral health studies. Significant work is needed to both develop new measures (e.g., for intervention source) and build psychometric evidence for existing measures in this forgotten domain. Plain Language Summary Intervention characteristics have long been perceived as critical factors that directly influence the rate of adopting an innovation. It remains unclear the extent to which intervention characteristics including relative advantage, complexity, trialability, intervention source, design quality and packaging, evidence strength and quality, adaptability, and cost impact implementation of evidence-based practices in behavioral health settings. To unpack the differential influence of these factors, high quality measures are needed. Systematic reviews can identify measures and synthesize the data regarding their quality to identify gaps in the field and inform measure development and testing efforts. Two previous reviews identified measures of intervention characteristics, but they did not provide information about the extent of the existing evidence nor did they evaluate the host of evidence available for identified measures. This manuscript summarizes the results of nine systematic reviews (i.e., one for each of the factors listed above) for which 16 unique measures or scales were identified. The nuanced findings will help direct measure development work in this forgotten domain.

Measures of organizational culture, organizational climate, and implementation climate in behavioral health: A systematic review

Background: Organizational culture, organizational climate, and implementation climate are key organizational constructs that influence the implementation of evidence-based practices. However, there has been little systematic investigation of the availability of psychometrically strong measures that can be used to assess these constructs in behavioral health. This systematic review identified and assessed the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs as defined by the Consolidated Framework for Implementation Research (CFIR) and Ehrhart and colleagues. Methods: Data collection involved search string generation, title and abstract screening, full-text review, construct assignment, and citation searches for all known empirical uses. Data relevant to nine psychometric criteria from the Psychometric and Pragmatic Evidence Rating Scale (PAPERS) were extracted: internal consistency, convergent validity, discriminant validity, known-groups validity, predictive validity, concurrent validity, structural validity, responsiveness, and norms. Extracted data for each criterion were rated on a scale from −1 (“poor”) to 4 (“excellent”), and each measure was assigned a total score (highest possible score = 36) that formed the basis for head-to-head comparisons of measures for each focal construct. Results: We identified full measures or relevant subscales of broader measures for organizational culture ( n = 21), organizational climate ( n = 36), implementation climate ( n = 2), tension for change ( n = 2), compatibility ( n = 6), relative priority ( n = 2), organizational incentives and rewards ( n = 3), goals and feedback ( n = 3), and learning climate ( n = 2). Psychometric evidence was most frequently available for internal consistency and norms. Information about other psychometric properties was less available. Median ratings for psychometric properties across categories of measures ranged from “poor” to “good.” There was limited evidence of responsiveness or predictive validity. Conclusion: While several promising measures were identified, the overall state of measurement related to these constructs is poor. To enhance understanding of how these constructs influence implementation research and practice, measures that are sensitive to change and predictive of key implementation and clinical outcomes are required. There is a need for further testing of the most promising measures, and ample opportunity to develop additional psychometrically strong measures of these important constructs. Plain Language Summary Organizational culture, organizational climate, and implementation climate can play a critical role in facilitating or impeding the successful implementation and sustainment of evidence-based practices. Advancing our understanding of how these contextual factors independently or collectively influence implementation and clinical outcomes requires measures that are reliable and valid. Previous systematic reviews identified measures of organizational factors that influence implementation, but none focused explicitly on behavioral health; focused solely on organizational culture, organizational climate, and implementation climate; or assessed the evidence base of all known uses of a measure within a given area, such as behavioral health–focused implementation efforts. The purpose of this study was to identify and assess the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs that have been used in behavioral health-focused implementation research. We identified 21 measures of organizational culture, 36 measures of organizational climate, 2 measures of implementation climate, 2 measures of tension for change, 6 measures of compatibility, 2 measures of relative priority, 3 measures of organizational incentives and rewards, 3 measures of goals and feedback, and 2 measures of learning climate. Some promising measures were identified; however, the overall state of measurement across these constructs is poor. This review highlights specific areas for improvement and suggests the need to rigorously evaluate existing measures and develop new measures.

Provider self-efficacy in delivering evidence-based psychosocial interventions: A scoping review

Background: Among the many variables that affect implementation of evidence-based interventions in real-world settings, self-efficacy is one of the most important factors at the provider level of the social ecology. Yet, research on the construct of provider self-efficacy remains limited. Objectives: This scoping review was conducted to enhance understanding of the construct of provider self-efficacy and to examine how the construct is defined and measured in the context of implementation of evidence-based mental health interventions. Design: Online databases were used to identify 190 papers published from 1999 to June of 2018 that included search terms for providers, evidence-based, and self-efficacy. To be eligible for the scoping review, papers needed to focus on the self-efficacy of mental health providers to deliver evidence-based psychosocial interventions. A total of 15 publications were included in the review. Results: The construct of provider self-efficacy is not clearly defined but is typically described as confidence to deliver a specific intervention or practice. A range of measures are used to assess provider self-efficacy across both provider and intervention types. Conclusions: Standardized definition and measurement of provider self-efficacy is needed to advance practice and implementation research. Plain language abstract: Provider self-efficacy is known to influence implementation of evidence-based mental health interventions. However, the ways in which provider self-efficacy is defined and measured in implementation research literature is not well understood; furthermore, it is not clear what types of providers and interventions are represented in this literature. This scoping review adds to current research by revealing that there is no agreed upon definition or measure of provider self-efficacy in the context of implementation of evidence-based interventions, and that the research includes multiple types of providers (e.g., social workers, counselors, psychologists) and interventions. Self-efficacy appears to change as a function of training and support. To further research in this area, a common definition and agreed upon measures of this construct are needed.

Patient and provider perception of appropriateness, acceptability, and feasibility of behavioral health home (BHH) core components based on program implementation in an urban, safety-net health system

Background This manuscript evaluates patient and provider perspectives on the core components of a Behavioral Health Home (BHH) implemented in an urban, safety-net health system. The BHH integrated primary care and wellness services (e.g., on-site Nurse Practitioner and Care Manager, wellness groups and tools, population health management) into an existing outpatient clinic for people with serious mental illness (SMI). Methods As the qualitative component of a Hybrid Type I effectiveness-implementation study, semi-structured interviews were conducted with providers and patients 6 months after program implementation, and responses were analyzed using thematic analysis. Valence coding (i.e., positive vs. negative acceptability) was also used to rate interviewees’ transcriptions with respect to their feedback of the appropriateness, acceptability, and feasibility/sustainability of 9 well-described and desirable Integrated Behavioral Health Core components (seven from prior literature and two additional components developed for this intervention). Themes from the thematic analysis were then mapped and organized by each of the 9 components and the degree to which these themes explain valence ratings by component. Results Responses about the team-based approach and universal screening for health conditions had the most positive valence across appropriateness, acceptability, and feasibility/sustainability by both providers and patients. Areas of especially high mismatch between perceived provider appropriateness and measures of acceptability and feasibility/sustainability included population health management and use of evidence-based clinical models to improve physical wellness where patient engagement in specific activities and tools varied. Social and peer support was highly valued by patients while incorporating patient voice was also found to be challenging. Conclusions Findings reveal component-specific challenges regarding the acceptability, feasibility, and sustainability of specific components. These findings may partly explain mixed results from BHH models studied thus far in the peer-reviewed literature and may help provide concrete data for providers to improve BHH program implementation in clinical settings. Plain language abstract Many people with serious mental illness also have medical problems, which are made worse by lack of access to primary care. The Behavioral Health Home (BHH) model seeks to address this by adding primary care access into existing interdisciplinary mental health clinics. As these models are implemented with increasing frequency nationwide and a growing body of research continues to assess their health impacts, it is crucial to examine patient and provider experiences of BHH implementation to understand how implementation factors may contribute to clinical effectiveness. This study examines provider and patient perspectives of acceptability, appropriateness, and feasibility/sustainability of BHH model components at 6–7 months after program implementation at an urban, safety-net health system. The team-based approach of the BHH was perceived to be highly acceptable and appropriate. Although providers found certain BHH components to be highly appropriate in theory (e.g., population-level health management), their acceptability of these approaches as implemented in practice was not as high, and their feedback provides suggestions for model improvements at this and other health systems. Similarly, social and peer support was found to be highly appropriate by both providers and patients, but in practice, at months 6–7, the BHH studied had not yet developed a process of engaging patients in ongoing program operations that was highly acceptable by providers and patients alike. We provide these data on each specific BHH model component, which will be useful to improving implementation in clinical settings of BHH programs that share some or all of these program components.

Application of an antiracism lens in the field of implementation science (IS): Recommendations for reframing implementation research with a focus on justice and racial equity

Background Despite the promise of implementation science (IS) to reduce health inequities, critical gaps and opportunities remain in the field to promote health equity. Prioritizing racial equity and antiracism approaches is critical in these efforts, so that IS does not inadvertently exacerbate disparities based on the selection of frameworks, methods, interventions, and strategies that do not reflect consideration of structural racism and its impacts. Methods Grounded in extant research on structural racism and antiracism, we discuss the importance of advancing understanding of how structural racism as a system shapes racial health inequities and inequitable implementation of evidence-based interventions among racially and ethnically diverse communities. We outline recommendations for explicitly applying an antiracism lens to address structural racism and its manifests through IS. An anti-racism lens provides a framework to guide efforts to confront, address, and eradicate racism and racial privilege by helping people identify racism as a root cause of health inequities and critically examine how it is embedded in policies, structures, and systems that differentially affect racially and ethnically diverse populations. Results We provide guidance for the application of an antiracism lens in the field of IS, focusing on select core elements in implementation research, including: (1) stakeholder engagement; (2) conceptual frameworks and models; (3) development, selection, adaptation of EBIs; (4) evaluation approaches; and (5) implementation strategies. We highlight the need for foundational grounding in antiracism frameworks among implementation scientists to facilitate ongoing self-reflection, accountability, and attention to racial equity, and provide questions to guide such reflection and consideration. Conclusion We conclude with a reflection on how this is a critical time for IS to prioritize focus on justice, racial equity, and real-world equitable impact. Moving IS towards making consideration of health equity and an antiracism lens foundational is central to strengthening the field and enhancing its impact. Plain language abstract There are important gaps and opportunities that exist in promoting health equity through implementation science. Historically, the commonly used frameworks, measures, interventions, strategies, and approaches in the field have not been explicitly focused on equity, nor do they consider the role of structural racism in shaping health and inequitable delivery of evidence-based practices/programs. This work seeks to build off of the long history of research on structural racism and health, and seeks to provide guidance on how to apply an antiracism lens to select core elements of implementation research. We highlight important opportunities for the field to reflect and consider applying an antiracism approach in: 1) stakeholder/community engagement; 2) use of conceptual frameworks; 3) development, selection and adaptation of evidence-based interventions; 4) evaluation approaches; 5) implementation strategies (e.g., how to deliver evidence-based practices, programs, policies); and 6) how researchers conduct their research, with a focus on racial equity. This is an important time for the field of implementation science to prioritize a foundational focus on justice, equity, and real-world impact through the application of an anti-racism lens in their work.

Student, teacher, and caregiver perceptions on implementing mental health interventions in Ugandan schools

Background The vast majority of children and adolescents in low and middle-income countries (LMICs) lack access to interventions for mental health problems. Schools provide a critical platform for evidence-based intervention delivery for young people. However, a significant need exists to understand the implementation context and strategies for delivering school mental health interventions in LMICs. Methods We conducted a focused ethnography to explore students’, teachers’, and caregivers’ perspectives on implementing evidence-based mental health interventions (EBIs) within a widespread violence prevention program in Uganda. Data collection occurred in Kampala, Uganda, using two schools that have previously implemented an evidence-based violence prevention program widely used in Ugandan schools schools, the Good School Toolkit (GST). Trained, local researchers facilitated four focus group discussions (FGDs) with caregivers ( n = 22), four FGDs with teachers ( n = 25), and in-depth interviews with primary school students ( n = 12). Verbatim transcripts were analyzed using a framework analysis approach. Results Participants revealed a school culture that promotes schools’ responsibility to students beyond academics, including positive teacher–student relationships. Participants recommended an implementation process that trains teachers and students in screening and referral, peer group delivery, and is accompanied by a school-wide approach to stigma reduction and mental health literacy. Participants fundamentally agreed that teachers could be trained as intervention facilitators. Conclusions This study highlights the potential advantage of leveraging an existing intervention that already addresses implementation factors, such as school culture, as a fertile platform for implementing interventions for child and adolescent mental health in LMICs. Plain language abstract Despite the growth of implementation research for child and adolescent mental health, the study of implementation science for child and adolescent mental health in low and middle-income countries (LMICs) remains scarce. Schools provide a critical platform for evidence-based intervention delivery for young people. However, a significant need exists to understand the implementation context and strategies for delivering school mental health interventions in LMICs. This study provides rich qualitative data describing the context and influences for the successful implementation of mental health interventions in LMIC schools. We conducted interviews and focus groups with teachers, students, and caregivers to determine their perspectives on implementing evidence-based mental health interventions (EBIs) within a widespread violence prevention program in Uganda. Participants revealed a school culture promoted by the existing program that promotes schools’ responsibility to students beyond academics, including positive teacher–student relationships. Findings suggest the existing program provides fertile ground for the successful implementation of evidence-based mental health interventions in schools.