From Theory to Implementation: Adaptations to a Quality Improvement Initiative According to Implementation Context

As countries continue to invest in quality improvement (QI) initiatives in health facilities, it is important to acknowledge the role of context in implementation. We conducted a qualitative study between February 2019 and January 2020 to explore how a QI initiative was adapted to enable implementation in three facility types: primary health centres, public hospitals and private facilities in Lagos State, Nigeria. Despite a common theory of change, implementation of the initiative needed to be adapted to accommodate the local needs, priorities and organisational culture of each facility type. Across facility types, inadequate human and capital resources constrained implementation and necessitated an extension of the initiative’s duration. In public facilities, the local governance structure was adapted to facilitate coordination, but similar adaptations to governance were not possible for private facilities. Our findings highlight the importance of anticipating and planning for the local adaptation of QI initiatives according to implementation environment.

Process Evaluation of an Online SUpport PRogram for Older Hearing Aid Users Delivered in a Cluster Randomized Controlled Trial

Objectives: To evaluate the process of implementing a web-based support program (SUPR) for hearing aid users in the Dutch dispensing setting in order to allow interpretation of the randomized controlled trial's results (positive effects on hearing-aid related outcomes; no effects on psychosocial outcomes).Design: Measures: context of implementation, recruitment, SUPR's: reach, implementation fidelity, dose delivered, dose received, satisfaction, and benefit. Data collection: quantitative and qualitative.Study Sample: One hundred thirty-eight clients (mean age 68.1 years; 60% male) and 44 dispensers completed questionnaires. Five clients and 6 dispensers participated in interviews and focus groups.Results: Clients and dispensers were generally satisfied with SUPR's usefulness. SUPR-videos were watched by 7–37% of the clients. Around half of the dispensers encouraged clients to watch them or informed them about SUPR. Some clients found the SUPR-materials suboptimal, and changes in personnel and limited dispenser-training were barriers acting on a contextual level.Conclusions: This study identified several factors that contributed to the success of SUPR. Others factors, acting on various levels (e.g., intervention material, dispensers, and implementation context), were suboptimal and may explain the absent psychosocial effects. The identified factors are important to consider in further development of SUPR, and in other web-based support programs.

Disability Data Collection in a Complex Humanitarian Organisation: Lessons from a Realist Evaluation

In recent years, global attention to disability inclusion in humanitarian and development contexts, notably comprising disability inclusion within the Sustainable Development Goals, has significantly increased. As a result, UN agencies and programmes are increasingly seeking to understand and increase the extent to which persons with disabilities are accounted for and included in their efforts to provide life-saving assistance. To explore the effects and effectiveness of such measurement, this paper applies a complexity-informed, realist evaluation methodology to a case study of a single measurement intervention. This intervention, ‘A9’, was the first indicator designed to measure the number of persons with disabilities assisted annually by the United Nations World Food Programme (WFP). Realist logic of analysis combined with complexity theory was employed to generate context-mechanism-outcome configurations (CMOC’s) against which primary interviews and secondary data were analysed. We show that within the complexity of the WFP system, the roll-out of the A9 measurement intervention generated delayed, counter-intuitive and unanticipated effects. In turn, path dependency and emergent behaviours meant that the intervention mechanisms of yesterday were destined to become the implementation context of tomorrow. These findings challenge the current reliance on quantitative data within humanitarian-development disability inclusion efforts and contribute to our understanding of how data can best be leveraged to support inclusion in such contexts.

From randomized control trial to mixed methods: A practical framework for program evaluation based on methodological quality

La evidencia utilizada al tomar decisiones sobre el diseño, implementación y evaluación en los programas de intervención debe ser metodológicamente sólida. Dependiendo del contexto de la intervención, se pueden aplicar diferentes metodologías. Sin embargo, el contexto de la intervención es a menudo inestable y, para adaptarse a las circunstancias cambiantes, se hace necesario modificar el plan original. El marco propuesto en este documento se basa en enfoques que pueden considerarse dos extremos de un continuo (diseños experimentales / cuasiexperimentales y estudios basados en metodología observacional). En condiciones de contexto de intervención inestable, esto permite tomar decisiones desde un enfoque de calidad metodológica en cuanto a diseño, medición y análisis. Las dimensiones estructurales, i.e., las unidades (participantes, usuarios), el tratamiento (actividades del programa), los resultados (incluidas las decisiones sobre los instrumentos a utilizar y la recopilación de datos), el entorno (contexto de implementación) y el tiempo se detallarán como parte del marco práctico. El presente estudio tiene como objetivo especificar el grado de correspondencia / complementariedad entre componentes en estas dimensiones estructurales de la evaluación de un programa desde una perspectiva de complementariedad práctica basada en la calidad metodológica. The evidence used when making decisions about the design, implementation and evaluation in intervention programs should be methodologically sound. Depending on the context of the intervention, different methodologies may apply. Nonetheless, the intervention context is often unstable and, to adapt to changing circumstances, it sometimes becomes necessary to modify the original plan. The framework proposed herein draws on approaches that can be considered two extremes of a continuum (experimental/quasi-experimental designs and studies based on observational methodology). In unstable intervention context conditions, this enables decisions from a methodological quality approach regarding design, measurement, and analysis. Structural dimensions, i.e., units (participants, users), treatment (program activities), outcomes (results, including decisions about the instruments to use and data gathering), setting (implementation context) and time will be detailed as part of the practical framework. The present study aims to specify the degree of correspondence/complementarity between components in these structural dimensions of a program evaluation from a practical complementarity perspective based on methodological quality.

Telemedicine in Intensive Care Units: A Scoping Review. (Preprint)

BACKGROUND The role of telemedicine in intensive care has been increasing steadily. Tele ICU interventions are varied and can be employed in different levels of treatment, often with direct implications for the intensive care processes. While a significant body of primary and secondary literature has been published on the topic, there is a need for broadening the understanding of the organizational factors influencing the effectiveness of telemedical interventions in the ICU. OBJECTIVE This scoping review aims to provide a map of existing evidence on tele ICU interventions, focusing on the analysis of the implementation context and identifying areas for further technological research. METHODS A research protocol outlining the method has been published in JMIR Research Protocols. This review follows the PRISMA extension for scoping reviews (PRISMA-ScR). A core research team was assembled to provide feedback and discuss findings. RESULTS We were able to characterize the context of tele ICU studies and identify three use cases for tele ICU interventions. The first use case is Extending Coverage, which describes interventions aimed at extending the availability of intensive care capabilities. The second use case is Improving Compliance, which includes interventions targeted at improving patient safety, intensive care best practices and quality of care. The third use case, Facilitating Transfer, describes telemedicine interventions targeted toward the management of patient transfers to or from the ICU. CONCLUSIONS The benefits of tele ICU interventions have been well documented for centralized systems aimed at extending critical care capabilities in community setting and improving care compliance in tertiary hospitals. No strong evidence has been found on the reduction of patient transfers following tele ICU intervention. INTERNATIONAL REGISTERED REPORT RR2-10.2196/19695

Co-Creation Approach with Action-Oriented Research Methods to Strengthen “Krachtvoer”; A School-Based Programme to Enhance Healthy Nutrition in Adolescents

In recent years, the nutritional pattern of the Dutch adolescent has cautiously improved. However, progress can be gained if more Dutch adolescents adhere to the nutritional guidelines. School-based initiatives offer opportunities to deal with the unhealthy eating behaviours of adolescents via nutrition educational interventions. In designing and/or re-designing school-based interventions, it is important to enhance optimal context-oriented implementation adaptation by involving the complex adaptive school system. This paper elaborates on the way of dealing with the dynamic implementation context of the educational programme “Krachtvoer” (ENG: “Power food”) for prevocational schools, how the programme can be adapted to each unique implementation context, and how the programme can be progressively kept up to date. Following a co-creation-guided approach with various intersectoral stakeholders within and outside the school setting, action-oriented mixed research methods (i.e., observations, semi-structured interviews, focus group interviews, programme usage monitoring, and questionnaires) constantly provide input to develop the programme and its implementation strategy via continuous micro-process cycles. Successful co-creation of school-based health promotion seems to be dependent on proper intersectoral cooperation between research and practice communities, a national partner network that can provide project-relevant insights and establish capacity building aimed at improving contextual fit, and a time-investment balance in and between sectors.

Ethnography and user-centered design to inform context-driven implementation

Despite pervasive findings pointing to its inextricable role in intervention implementation, context remains poorly understood in implementation science. Existing approaches for describing context (e.g., surveys, interviews) may be narrow in scope or superficial in their elicitation of contextual data. Thus, in-depth and multilevel approaches are needed to meaningfully describe the contexts into which interventions will be implemented. Moreover, many studies assess context without subsequently using contextual information to enhance implementation. To be useful for improving implementation, though, methods are needed to apply contextual information during implementation. In the case example presented in this paper, we embedded an ethnographic assessment of context within a user-centered design approach to describe implementation context and apply that information to promote implementation. We developed a patient-reported outcome measure-based clinical intervention to assess and address the pervasive unmet needs of young adults with cancer: the Needs Assessment & Service Bridge (NA-SB). In this paper, we describe the user-centered design process that we used to anticipate context modifications needed to deliver NA-SB and implementation strategies needed to facilitate its implementation. Our ethnographic contextual inquiry yielded a rich understanding of local implementation context and contextual variation across potential scale-up contexts. Other methods from user-centered design (i.e., translation tables and a design team prototyping workshop) allowed us to translate that information into specifications for NA-SB delivery and a plan for implementation. Embedding ethnographic methods within a user-centered design approach can help us to tailor interventions and implementation strategies to their contexts of use to promote implementation.