The case for prioritizing implementation strategy fidelity measurement: benefits and challenges

Implementation strategies are systematic approaches to improve the uptake and sustainability of evidence-based interventions. They frequently focus on changing provider behavior through the provision of interventions such as training, coaching, and audit-and-feedback. Implementation strategies often impact intermediate behavioral outcomes like provider guideline adherence, in turn improving patient outcomes. Fidelity of implementation strategy delivery is defined as the extent to which an implementation strategy is carried out as it was designed. Implementation strategy fidelity measurement is under-developed and under-reported, with the quality of reporting decreasing over time. Benefits of fidelity measurement include the exploration of the extent to which observed effects are moderated by fidelity, and critical information about Type-III research errors, or the likelihood that null findings result from implementation strategy fidelity failure. Reviews of implementation strategy efficacy often report wide variation across studies, commonly calling for increased implementation strategy fidelity measurement to help explain variations. Despite the methodological benefits of rigorous fidelity measurement, implementation researchers face multi-level challenges and complexities. Challenges include the measurement of a complex variable, multiple data collection modalities with varying precision and costs, and the need for fidelity measurement to change in-step with adaptations. In this position paper, we weigh these costs and benefits and ultimately contend that implementation strategy fidelity measurement and reporting should be improved in trials of implementation strategies. We offer pragmatic solutions for researchers to make immediate improvements like the use of mixed methods or innovative data collection and analysis techniques, the inclusion of implementation strategy fidelity assessment in reporting guidelines, and the staged development of fidelity tools across the evolution of an implementation strategy. We also call for additional research into the barriers and facilitators of implementation strategy fidelity measurement to further clarify the best path forward.

Low Efficacy of Medication Shortage Clinical Decision Support Alerts

Objective We examined clinical decision support (CDS) alerts designed specifically for medication shortages to characterize and assess provider behavior in response to these short-term clinical situations. Materials and Methods We conducted a retrospective analysis of the usage of medication shortage alerts (MSAs) that included at least one alternative medication suggestion and were active for 60 or more days during the 2-year study period, January 1, 2018 to December 31, 2019, in a large health care system. We characterized ordering provider behavior in response to inpatient MSAs. We then developed a linear regression model to predict provider response to alerts using the characteristics of the ordering provider and alert frequency groupings. Results During the study period, there were 67 MSAs in use that focused on 42 distinct medications in shortage. The MSAs suggested an average of 3.9 alternative medications. Adjusting for the different alerts, fellows (p = 0.004), residents (p = 0.03), and physician assistants (p = 0.02) were less likely to accept alerts on average compared with attending physicians. Further, female ordering clinicians (p < 0.001) were more likely to accept alerts on average compared with male ordering clinicians. Conclusion Our findings demonstrate that providers tended to reject MSAs, even those who were sometimes flexible about their responses. The low overall acceptance rate supports the theory that alerts appearing at the time of order entry may have limited value, as they may be presented too late in the decision-making process. Though MSAs are designed to be attention-grabbing and higher impact than traditional CDS, our findings suggest that providers rarely change their clinical decisions when presented with these alerts.

Challenges of the Relative Value Unit Experience in Iran: A Qualitative Study

Background: The Relative Value Unit (RVU) is a value scale and plays a key role in the physician reimbursement system. The health sector has faced challenges such as providers’ dissatisfaction, income disparities, and reduced service quality which is said to be due to improper RVUs. Always there are debates about it. This study aims to identify the challenges of the RVU experience in Iran from the perspective of the service providers, payers and, policymakers. Methods: This qualitative study was conducted in 2020. Data were collected from November 2019 to February 2020. Thirty experts participated in the study and were categorized into four groups: insurance organizations’ managers, surgeons, health economists, and health policymakers. Focus Group Discussions and semi-structured interviews were held to collect data. Content analysis was conducted to analyze data. Results: According to the expert, the challenges of RVU in Iran are classified into five scopes. Financial, payment, macro-organization, regulation, and persuasion scope. Each scope’s result was categorized into main themes and relevant sub-themes. Conclusions: The RVU has an important impact on the health system, provider behavior, and even patients. Paying attention to required infrastructures, decision- makers’ conflict of interests, decrease the Ministry of Health and Medical Education’s authority, and expanding the active role of involved organizations to increase their commitment to the successful implantation of RVU is necessary. Keywords: Relative Value Unit, Challenge, Expert opinion, Qualitative study, Iran.

Integrating Xpert MTB/RIF for TB diagnosis in the private sector: evidence from large-scale pilots in Patna and Mumbai, India

Background Xpert MTB/RIF (Xpert) has been recommended by WHO as the initial diagnostic test for TB and rifampicin-resistance detection. Existing evidence regarding its uptake is limited to public health systems and corresponding resource and infrastructure challenges. It cannot be readily extended to private providers, who treat more than half of India’s TB cases and demonstrate complex diagnostic behavior. Methods We used routine program data collected from November 2014 to April 2017 from large-scale private sector engagement pilots in Mumbai and Patna. It included diagnostic vouchers issued to approximately 150,000 patients by about 1400 providers, aggregated to 18,890 provider-month observations. We constructed three metrics to capture provider behavior with regards to adoption of Xpert and studied their longitudinal variation: (i) Uptake (ordering of test), (ii) Utilization for TB diagnosis, and (iii) Non-adherence to negative results. We estimated multivariate linear regression models to assess heterogeneity in provider behavior based on providers’ prior experience and Xpert testing volumes. Results Uptake of Xpert increased considerably in both Mumbai (from 36 to 60.4%) and Patna (from 12.2 to 45.1%). However, utilization of Xpert for TB diagnosis and non-adherence to negative Xpert results did not show systematic trends over time. In regression models, cumulative number of Xpert tests ordered was significantly associated with Xpert uptake in Patna and utilization for diagnosis in Mumbai (p-value< 0.01). Uptake of Xpert and its utilization for diagnosis was predicted to be higher in high-volume providers compared to low-volume providers and this gap was predicted to widen over time. Conclusions Private sector engagement led to substantial increase in uptake of Xpert, especially among high-volume providers, but did not show strong evidence of Xpert results being integrated with TB diagnosis. Increasing availability and affordability of a technically superior diagnostic tool may not be sufficient to fundamentally change diagnosis and treatment of TB in the private sector. Behavioral interventions, specifically aimed at, integrating Xpert results into clinical decision making of private providers may be required to impact patient-level outcomes.

Overcoming challenges to removing inappropriate penicillin allergy labels: A quality improvement report

Over 3 months, we provided monthly education to internal medicine residents and distributed resources regarding penicillin-allergy history taking. Allergy information in the electronic record was updated more often during the intervention compared to the period before the intervention (16.1% vs 10.9%; P = .02). Education and interdepartmental collaboration have the potential to affect provider behavior.