scholarly journals Process evaluation of a cluster randomised controlled trial to improve bronchiolitis management – a PREDICT mixed-methods study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Libby Haskell ◽  
Emma J. Tavender ◽  
Sharon O’Brien ◽  
Catherine L. Wilson ◽  
Franz E. Babl ◽  
...  

Abstract Background Bronchiolitis is the most common reason for hospitalisation in infants. All international bronchiolitis guidelines recommend supportive care, yet considerable variation in practice continues with infants receiving non-evidence based therapies. We developed six targeted, theory-informed interventions; clinical leads, stakeholder meeting, train-the-trainer, education delivery, other educational materials, and audit and feedback. A cluster randomised controlled trial (cRCT) found the interventions to be effective in reducing use of five non-evidence based therapies in infants with bronchiolitis. This process evaluation paper aims to determine whether the interventions were implemented as planned (fidelity), explore end-users’ perceptions of the interventions and evaluate cRCT outcome data with intervention fidelity data. Methods A pre-specified mixed-methods process evaluation was conducted alongside the cRCT, guided by frameworks for process evaluation of cRCTs and complex interventions. Quantitative data on the fidelity, dose and reach of interventions were collected from the 13 intervention hospitals during the study and analysed using descriptive statistics. Qualitative data identifying perception and acceptability of interventions were collected from 42 intervention hospital clinical leads on study completion and analysed using thematic analysis. Results The cRCT found targeted, theory-informed interventions improved bronchiolitis management by 14.1%. The process evaluation data found variability in how the intervention was delivered at the cluster and individual level. Total fidelity scores ranged from 55 to 98% across intervention hospitals (mean = 78%; SD = 13%). Fidelity scores were highest for use of clinical leads (mean = 98%; SD = 7%), and lowest for use of other educational materials (mean = 65%; SD = 19%) and audit and feedback (mean = 65%; SD = 20%). Clinical leads reflected positively about the interventions, with time constraints being the greatest barrier to their use. Conclusion Our targeted, theory-informed interventions were delivered with moderate fidelity, and were well received by clinical leads. Despite clinical leads experiencing challenges of time constraints, the level of fidelity had a positive effect on successfully de-implementing non-evidence-based care in infants with bronchiolitis. These findings will inform widespread rollout of our bronchiolitis interventions, and guide future practice change in acute care settings. Trial registration Australian and New Zealand Clinical Trials Registry: ACTRN12616001567415.

2019 ◽  
pp. bmjqs-2019-009588 ◽  
Author(s):  
Marie-José Roos-Blom ◽  
Wouter T Gude ◽  
Evert de Jonge ◽  
Jan Jaap Spijkstra ◽  
Sabine N van der Veer ◽  
...  

BackgroundAudit and feedback (A&F) enjoys widespread use, but often achieves only marginal improvements in care. Providing recipients of A&F with suggested actions to overcome barriers (action implementation toolbox) may increase effectiveness.ObjectiveTo assess the impact of adding an action implementation toolbox to an electronic A&F intervention targeting quality of pain management in intensive care units (ICUs).Trial designTwo-armed cluster-randomised controlled trial. Randomisation was computer generated, with allocation concealment by a researcher, unaffiliated with the study. Investigators were not blinded to the group assignment of an ICU.ParticipantsTwenty-one Dutch ICUs and patients eligible for pain measurement.InterventionsFeedback-only versus feedback with action implementation toolbox.OutcomeProportion of patient-shift observations where pain management was adequate; composed by two process (measuring pain at least once per patient in each shift; re-measuring unacceptable pain scores within 1 hour) and two outcome indicators (acceptable pain scores; unacceptable pain scores normalised within 1 hour).Results21 ICUs (feedback-only n=11; feedback-with-toolbox n=10) with a total of 253 530 patient-shift observations were analysed. We found absolute improvement on adequate pain management in the feedback-with-toolbox group (14.8%; 95% CI 14.0% to 15.5%) and the feedback-only group (4.8%; 95% CI 4.2% to 5.5%). Improvement was limited to the two process indicators. The feedback-with-toolbox group achieved larger effects than the feedback-only group both on the composite adequate pain management (p<0.05) and on measuring pain each shift (p<0.001). No important adverse effects have occurred.ConclusionFeedback with toolbox improved the number of shifts where patients received adequate pain management compared with feedback alone, but only in process and not outcome indicators.Trial registration numberNCT02922101.


BMJ Open ◽  
2020 ◽  
Vol 10 (6) ◽  
pp. e033552 ◽  
Author(s):  
April Morrow ◽  
Katherine M Tucker ◽  
Tim J Shaw ◽  
Bonny Parkinson ◽  
Charles Abraham ◽  
...  

IntroductionIn multisite intervention trials, implementation success often varies widely across settings. Process evaluations are crucial to interpreting trial outcomes and understanding contextual factors and causal chains necessary for successful implementation. Lynch syndrome is a hereditary cancer predisposition conferring an increased risk of colorectal, endometrial and other cancer types. Despite systematic screening protocols to identify Lynch syndrome, the condition remains largely underdiagnosed. The Hide and Seek Project (‘HaSP’) is a cluster randomised controlled trial determining the effectiveness of two approaches to improving Lynch syndrome detection at eight Australian hospital networks. To enhance widespread implementation of optimal Lynch syndrome identification, there is a need to understand not only what works, but also why, in what contexts, and at what costs. Here we describe an in-depth investigation of factors influencing successful implementation of procedures evaluated in the HaSP trial.Methods and analysisA mixed-methods, theory-driven process evaluation will be undertaken in parallel to the HaSP trial. Data will include: interviews of Implementation Leads and Lynch syndrome stakeholders, pre–post implementation questionnaires, audio analysis of meetings and focus groups, observation of multidisciplinary team meetings, fidelity checklists and project log analysis. Results will be triangulated and coded, drawing on the Theoretical Domains Framework, Consolidated Framework for Implementation Research and Proctor’s implementation outcomes.Ethics and disseminationUse of a theory-based process evaluation will enhance interpretation and generalisability of HaSP trial findings, and contribute to the implementation research field by furthering understanding of the conditions necessary for implementation success. Ethical approval has been granted and results will be disseminated via publications in peer-reviewed journals and conference presentations. At trial completion, key findings will be fed back to sites to enable refinement of intervention strategies, both in the context of Lynch syndrome and for the possible generalisability of intervention components in other genetic and broader clinical specialties.HaSP trial registration numberAustralian New Zealand Clinical Trials Registry (Identifier: ACTRN12618001072202). Registered 27 June 2018. http://www.ANZCTR.org.au/ACTRN12618001072202.aspx.


Sign in / Sign up

Export Citation Format

Share Document