Using the Medical Research Council (UK) framework for the development and evaluation of randomised controlled trials for complex interventions to improve health

2006 ◽  
Vol 14 (4) ◽  
pp. 233-234 ◽  
Author(s):  
Margaret C Watson
2021 ◽  
Vol 25 (55) ◽  
pp. 1-72
Author(s):  
David P French ◽  
Lisa M Miles ◽  
Diana Elbourne ◽  
Andrew Farmer ◽  
Martin Gulliford ◽  
...  

Background Measurement can affect the people being measured; for example, asking people to complete a questionnaire can result in changes in behaviour (the ‘question–behaviour effect’). The usual methods of conduct and analysis of randomised controlled trials implicitly assume that the taking of measurements has no effect on research participants. Changes in measured behaviour and other outcomes due to measurement reactivity may therefore introduce bias in otherwise well-conducted randomised controlled trials, yielding incorrect estimates of intervention effects, including underestimates. Objectives The main objectives were (1) to promote awareness of how and where taking measurements can lead to bias and (2) to provide recommendations on how best to avoid or minimise bias due to measurement reactivity in randomised controlled trials of interventions to improve health. Methods We conducted (1) a series of systematic and rapid reviews, (2) a Delphi study and (3) an expert workshop. A protocol paper was published [Miles LM, Elbourne D, Farmer A, Gulliford M, Locock L, McCambridge J, et al. Bias due to MEasurement Reactions In Trials to improve health (MERIT): protocol for research to develop MRC guidance. Trials 2018;19:653]. An updated systematic review examined whether or not measuring participants had an effect on participants’ health-related behaviours relative to no-measurement controls. Three new rapid systematic reviews were conducted to identify (1) existing guidance on measurement reactivity, (2) existing systematic reviews of studies that have quantified the effects of measurement on outcomes relating to behaviour and affective outcomes and (3) experimental studies that have investigated the effects of exposure to objective measurements of behaviour on health-related behaviour. The views of 40 experts defined the scope of the recommendations in two waves of data collection during the Delphi procedure. A workshop aimed to produce a set of recommendations that were formed in discussion in groups. Results Systematic reviews – we identified a total of 43 studies that compared interview or questionnaire measurement with no measurement and these had an overall small effect (standardised mean difference 0.06, 95% confidence interval 0.02 to 0.09; n = 104,096, I 2 = 54%). The three rapid systematic reviews identified no existing guidance on measurement reactivity, but we did identify five systematic reviews that quantified the effects of measurement on outcomes (all focused on the question–behaviour effect, with all standardised mean differences in the range of 0.09—0.28) and 16 studies that examined reactive effects of objective measurement of behaviour, with most evidence of reactivity of small effect and short duration. Delphi procedure – substantial agreement was reached on the scope of the present recommendations. Workshop – 14 recommendations and three main aims were produced. The aims were to identify whether or not bias is likely to be a problem for a trial, to decide whether or not to collect further quantitative or qualitative data to inform decisions about if bias is likely to be a problem, and to identify how to design trials to minimise the likelihood of this bias. Limitation The main limitation was the shortage of high-quality evidence regarding the extent of measurement reactivity, with some notable exceptions, and the circumstances that are likely to bring it about. Conclusion We hope that these recommendations will be used to develop new trials that are less likely to be at risk of bias. Future work The greatest need is to increase the number of high-quality primary studies regarding the extent of measurement reactivity. Study registration The first systematic review in this study is registered as PROSPERO CRD42018102511. Funding Funded by the Medical Research Council UK and the National Institute for Health Research as part of the Medical Research Council–National Institute for Health Research Methodology Research Programme.


2021 ◽  
Vol 25 (53) ◽  
pp. 1-52
Author(s):  
David J Beard ◽  
Marion K Campbell ◽  
Jane M Blazeby ◽  
Andrew J Carr ◽  
Charles Weijer ◽  
...  

Background The use of placebo comparisons for randomised trials assessing the efficacy of surgical interventions is increasingly being considered. However, a placebo control is a complex type of comparison group in the surgical setting and, although powerful, presents many challenges. Objectives To provide a summary of knowledge on placebo controls in surgical trials and to summarise any recommendations for designers, evaluators and funders of placebo-controlled surgical trials. Design To carry out a state-of-the-art workshop and produce a corresponding report involving key stakeholders throughout. Setting A workshop to discuss and summarise the existing knowledge and to develop the new guidelines. Results To assess what a placebo control entails and to assess the understanding of this tool in the context of surgery is considered, along with when placebo controls in surgery are acceptable (and when they are desirable). We have considered ethics arguments and regulatory requirements, how a placebo control should be designed, how to identify and mitigate risk for participants in these trials, and how such trials should be carried out and interpreted. The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Surgical placebos might be most appropriate when there is poor evidence for the efficacy of the procedure and a justified concern that results of a trial would be associated with a high risk of bias, particularly because of the placebo effect. Conclusions The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Feasibility work is recommended to optimise the design and implementation of randomised controlled trials. An outline for best practice was produced in the form of the Applying Surgical Placebo in Randomised Evaluations (ASPIRE) guidelines for those considering the use of a placebo control in a surgical randomised controlled trial. Limitations Although the workshop participants involved international members, the majority of participants were from the UK. Therefore, although every attempt was made to make the recommendations applicable to all health systems, the guidelines may, unconsciously, be particularly applicable to clinical practice in the UK NHS. Future work Future work should evaluate the use of the ASPIRE guidelines in making decisions about the use of a placebo-controlled surgical trial. In addition, further work is required on the appropriate nomenclature to adopt in this space. Funding Funded by the Medical Research Council UK and the National Institute for Health Research as part of the Medical Research Council–National Institute for Health Research Methodology Research programme.


2020 ◽  
Vol 34 (5) ◽  
pp. 667-679 ◽  
Author(s):  
Emel Yorganci ◽  
Catherine J Evans ◽  
Halle Johnson ◽  
Stephen Barclay ◽  
Fliss EM Murtagh ◽  
...  

Background: Evaluations of complex interventions compared to usual care provided in palliative care are increasing. Not describing usual care may affect the interpretation of an intervention’s effectiveness, yet how it can be described remains unclear. Aim: To demonstrate the feasibility of using multi-methods to describe usual care provided in randomised controlled trials (RCTs) of complex interventions, shown within a feasibility cluster RCT. Design: Multi-method approach comprising usual care questionnaires, baseline case note review and focus groups with ward staff completed at study end. Thematic analysis of qualitative data, descriptive statistics of quantitative data, followed by methodological triangulation to appraise approach in relation to study aim. Setting/participants: Four general medical wards chosen from UK hospitals. Purposive sampling of healthcare professionals for usual care questionnaires, and focus groups. Review of 20 patients’ notes from each ward who died during admission or within 100 days of discharge. Results: Twenty-three usual care questionnaires at baseline, two focus groups comprising 20 healthcare professionals and 80 case note reviews. Triangulation of findings resulted in understanding the usual care provided to the targeted population in terms of context, structures, processes and outcomes for patients, families and healthcare professionals. Usual care was described, highlighting (1) similarities and embedded practices, (2) heterogeneity and (3) subtle changes in care during the trial within and across sites. Conclusions: We provide a feasible approach to defining usual care that can be practically adopted in different settings. Understanding usual care enhances the reliability of tested complex interventions, and informs research and policy priorities.


2014 ◽  
Vol 2014 ◽  
pp. 1-10 ◽  
Author(s):  
Rajalakshmi Lakshman ◽  
Simon Griffin ◽  
Wendy Hardeman ◽  
Annie Schiff ◽  
Ann Louise Kinmonth ◽  
...  

Introduction. We describe our experience of using the Medical Research Council framework on complex interventions to guide the development and evaluation of an intervention to prevent obesity by modifying infant feeding behaviours.Methods. We reviewed the epidemiological evidence on early life risk factors for obesity and interventions to prevent obesity in this age group. The review suggested prevention of excess weight gain in bottle-fed babies and appropriate weaning as intervention targets; hence we undertook systematic reviews to further our understanding of these behaviours. We chose theory and behaviour change techniques that demonstrated evidence of effectiveness in altering dietary behaviours. We subsequently developed intervention materials and evaluation tools and conducted qualitative studies with mothers (intervention recipients) and healthcare professionals (intervention deliverers) to refine them. We developed a questionnaire to assess maternal attitudes and feeding practices to understand the mechanism of any intervention effects.Conclusions. In addition to informing development of our specific intervention and evaluation materials, use of the Medical Research Council framework has helped to build a generalisable evidence base for early life nutritional interventions. However, the process is resource intensive and prolonged, and this should be taken into account by public health research funders. This trial is registered with ISRTCN:20814693Baby Milk Trial.


Sign in / Sign up

Export Citation Format

Share Document