scholarly journals The methodological quality of individual participant data meta-analysis on intervention effects: systematic review

BMJ ◽  
2021 ◽  
pp. n736
Author(s):  
Huan Wang ◽  
Yancong Chen ◽  
Yali Lin ◽  
Julius Abesig ◽  
Irene XY Wu ◽  
...  

Abstract Objective To assess the methodological quality of individual participant data (IPD) meta-analysis and to identify areas for improvement. Design Systematic review. Data sources Medline, Embase, and Cochrane Database of Systematic Reviews. Eligibility criteria for selecting studies Systematic reviews with IPD meta-analyses of randomised controlled trials on intervention effects published in English. Results 323 IPD meta-analyses covering 21 clinical areas and published between 1991 and 2019 were included: 270 (84%) were non-Cochrane reviews and 269 (84%) were published in journals with a high impact factor (top quarter). The IPD meta-analyses showed low compliance in using a satisfactory technique to assess the risk of bias of the included randomised controlled trials (43%, 95% confidence interval 38% to 48%), accounting for risk of bias when interpreting results (40%, 34% to 45%), providing a list of excluded studies with justifications (32%, 27% to 37%), establishing an a priori protocol (31%, 26% to 36%), prespecifying methods for assessing both the overall effects (44%, 39% to 50%) and the participant-intervention interactions (31%, 26% to 36%), assessing and considering the potential of publication bias (31%, 26% to 36%), and conducting a comprehensive literature search (19%, 15% to 23%). Up to 126 (39%) IPD meta-analyses failed to obtain IPD from 90% or more of eligible participants or trials, among which only 60 (48%) provided reasons and 21 (17%) undertook certain strategies to account for the unavailable IPD. Conclusions The methodological quality of IPD meta-analyses is unsatisfactory. Future IPD meta-analyses need to establish an a priori protocol with prespecified data syntheses plan, comprehensively search the literature, critically appraise included randomised controlled trials with appropriate technique, account for risk of bias during data analyses and interpretation, and account for unavailable IPD.

2021 ◽  
Vol 5 (1) ◽  
pp. e001129
Author(s):  
Bill Stevenson ◽  
Wubshet Tesfaye ◽  
Julia Christenson ◽  
Cynthia Mathew ◽  
Solomon Abrha ◽  
...  

BackgroundHead lice infestation is a major public health problem around the globe. Its treatment is challenging due to product failures resulting from rapidly emerging resistance to existing treatments, incorrect treatment applications and misdiagnosis. Various head lice treatments with different mechanism of action have been developed and explored over the years, with limited report on systematic assessments of their efficacy and safety. This work aims to present a robust evidence summarising the interventions used in head lice.MethodThis is a systematic review and network meta-analysis which will be reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses statement for network meta-analyses. Selected databases, including PubMed, Embase, MEDLINE, Web of Science, CINAHL and Cochrane Central Register of Controlled Trials will be systematically searched for randomised controlled trials exploring head lice treatments. Searches will be limited to trials published in English from database inception till 2021. Grey literature will be identified through Open Grey, AHRQ, Grey Literature Report, Grey Matters, ClinicalTrials.gov, WHO International Clinical Trials Registry and International Standard Randomised Controlled Trials Number registry. Additional studies will be sought from reference lists of included studies. Study screening, selection, data extraction and assessment of methodological quality will be undertaken by two independent reviewers, with disagreements resolved via a third reviewer. The primary outcome measure is the relative risk of cure at 7 and 14 days postinitial treatment. Secondary outcome measures may include adverse drug events, ovicidal activity, treatment compliance and acceptability, and reinfestation. Information from direct and indirect evidence will be used to generate the effect sizes (relative risk) to compare the efficacy and safety of individual head lice treatments against a common comparator (placebo and/or permethrin). Risk of bias assessment will be undertaken by two independent reviewers using the Cochrane Risk of Bias tool and the certainty of evidence assessed using the Grading of Recommendations, Assessment, Development and Evaluations guideline for network meta-analysis. All quantitative analyses will be conducted using STATA V.16.DiscussionThe evidence generated from this systematic review and meta-analysis is intended for use in evidence-driven treatment of head lice infestations and will be instrumental in informing health professionals, public health practitioners and policy-makers.PROSPERO registration numberCRD42017073375.


2016 ◽  
Vol 34 (5) ◽  
pp. 342-348 ◽  
Author(s):  
Min Deng ◽  
Xu-Feng Wang

Objective Mild cognitive impairment (MCI) is a pre-dementia state; 5–10% of cases per year will evolve into dementia. MCI can be amnestic (AMCI) or non-amnestic. AMCI is associated with a higher risk of progression. In recent years, interest in acupuncture as a potential treatment for AMCI has grown. The aim of this meta-analysis was to estimate the clinical effectiveness and safety of acupuncture for AMCI. Methods Randomised controlled trials (RCTs) of acupuncture versus medical treatment for AMCI were identified using the following databases from inception to July 2015: PubMed; Medline; CENTRAL; Chinese Scientific Journal Database; The Chinese Acupuncture Trials Register; China National Knowledge Infrastructure (CNKI); and Wanfang database. Data were extracted from RCTs meeting the inclusive criteria according to Cochrane methods. Meta-analyses were conducted using Rev Man V.5.3 software. Results Five trials involving 568 subjects were included. Meta-analysis showed that participants receiving acupuncture had better outcomes than those receiving nimodipine with greater clinical efficacy rates (odds ratio (OR) 1.78, 95% CI 1.19 to 2.65; p<0.01), mini-mental state examination (MMSE) scores (mean difference (MD) 0.99, 95% CI 0.71 to 1.28; p<0.01), and picture recognition score (MD 2.12, 95% CI 1.48 to 2.75; p<0.01). Meta-analysis also showed acupuncture in conjunction with nimodipine significantly improved MMSE scores (MD 1.09, 95% CI 0.29 to 1.89; p<0.01) compared to nimodipine alone. Three trials reported adverse events. Methodological quality of the included studies was judged to be generally poor. Conclusions Acupuncture appears effective for AMCI when used as an alternative or adjunctive treatment; however, caution must be exercised given the low methodological quality of included trials. Further, more rigorously designed studies are needed.


BMJ ◽  
2019 ◽  
pp. l1842 ◽  
Author(s):  
Mari Imamura ◽  
Jemma Hudson ◽  
Sheila A Wallace ◽  
Graeme MacLennan ◽  
Michal Shimonovich ◽  
...  

Abstract Objectives To compare the effectiveness and safety of surgical interventions for women with stress urinary incontinence. Design Systematic review and network meta-analysis. Eligibility criteria for selecting studies Randomised controlled trials evaluating surgical interventions for the treatment of stress urinary incontinence in women. Methods Identification of relevant randomised controlled trials from Cochrane reviews and the Cochrane Incontinence Specialised Register (searched May 2017), which contains trials identified from the Cochrane Central Register of Controlled Trials (CENTRAL), Medline, Medline In-Process, Medline Epub Ahead of Print, CINAHL, ClinicalTrials.gov, and WHO ICTRP. The reference lists of relevant articles were also searched. Primary outcomes were “cure” and “improvement” at 12 months, analysed by means of network meta-analyses, with results presented as the surface under the cumulative ranking curve (SUCRA). Adverse events were analysed using pairwise meta-analyses. Risk of bias was assessed using the Cochrane risk of bias tool. The quality of evidence for network meta-analysis was assessed using the GRADE approach. Results 175 randomised controlled trials assessing a total of 21 598 women were included. Most studies had high or unclear risk across all risk of bias domains. Network meta-analyses were based on data from 105 trials that reported cure and 120 trials that reported improvement of incontinence symptoms. Results showed that the interventions with highest cure rates were traditional sling, retropubic midurethral sling (MUS), open colposuspension, and transobturator MUS, with rankings of 89.4%, 89.1%, 76.7%, and 64.1%, respectively. Compared with retropubic MUS, the odds ratio of cure for traditional sling was 1.06 (95% credible interval 0.62 to 1.85), for open colposuspension was 0.85 (0.54 to 1.33), and for transobtrurator MUS was 0.74 (0.59 to 0.92). Women were also more likely to experience an improvement in their incontinence symptoms after receiving retropubic MUS or transobturator MUS compared with other surgical procedures. In particular, compared with retropubic MUS, the odds ratio of improvement for transobturator MUS was 0.76 (95% credible interval 0.59 to 0.98), for traditional sling was 0.69 (0.39 to 1.26), and for open colposuspension was 0.65 (0.41 to 1.02). Quality of evidence was moderate for retropubic MUS versus transobturator MUS and low or very low for retropubic MUS versus the other two interventions. Data on adverse events were available mainly for mesh procedures, indicating a higher rate of repeat surgery and groin pain but a lower rate of suprapubic pain, vascular complications, bladder or urethral perforation, and voiding difficulties after transobturator MUS compared with retropubic MUS. Data on adverse events for non-MUS procedures were sparse and showed wide confidence intervals. Long term data were limited. Conclusions Retropubic MUS, transobturator MUS, traditional sling, and open colposuspension are more effective than other procedures for stress urinary incontinence in the short to medium term. Data on long term effectiveness and adverse events are, however, limited, especially around the comparative adverse events profiles of MUS and non-MUS procedures. A better understanding of complications after surgery for stress urinary incontinence is imperative. Systematic review registration PROSPERO CRD42016049339.


2017 ◽  
Vol 48 (7) ◽  
pp. 1068-1083 ◽  
Author(s):  
A. P. Bailey ◽  
S. E. Hetrick ◽  
S. Rosenbaum ◽  
R. Purcell ◽  
A. G. Parker

AbstractWe aimed to establish the treatment effect of physical activity for depression in young people through meta-analysis. Four databases were searched to September 2016 for randomised controlled trials of physical activity interventions for adolescents and young adults, 12–25 years, experiencing a diagnosis or threshold symptoms of depression. Random-effects meta-analysis was used to estimate the standardised mean difference (SMD) between physical activity and control conditions. Subgroup analysis and meta-regression investigated potential treatment effect modifiers. Acceptability was estimated using dropout. Trials were assessed against risk of bias domains and overall quality of evidence was assessed using GRADE criteria. Seventeen trials were eligible and 16 provided data from 771 participants showing a large effect of physical activity on depression symptoms compared to controls (SMD = −0.82, 95% CI = −1.02 to −0.61, p < 0.05, I2 = 38%). The effect remained robust in trials with clinical samples (k = 5, SMD = −0.72, 95% CI = −1.15 to −0.30), and in trials using attention/activity placebo controls (k = 7, SMD = −0.82, 95% CI = −1.05 to −0.59). Dropout was 11% across physical activity arms and equivalent in controls (k = 12, RD = −0.01, 95% CI = −0.04 to 0.03, p = 0.70). However, the quality of RCT-level evidence contributing to the primary analysis was downgraded two levels to LOW (trial-level risk of bias, suspected publication bias), suggesting uncertainty in the size of effect and caution in its interpretation. While physical activity appears to be a promising and acceptable intervention for adolescents and young adults experiencing depression, robust clinical effectiveness trials that minimise risk of bias are required to increase confidence in the current finding. The specific intervention characteristics required to improve depression remain unclear, however best candidates given current evidence may include, but are not limited to, supervised, aerobic-based activity of moderate-to-vigorous intensity, engaged in multiple times per week over eight or more weeks. Further research is needed. (Registration: PROSPERO-CRD 42015024388).


2013 ◽  
Vol 31 (4) ◽  
pp. 368-374 ◽  
Author(s):  
Huijuan Cao ◽  
Yuyi Wang ◽  
Dennis Chang ◽  
Li Zhou ◽  
Jianping Liu

Background Vascular mild cognitive impairment (VMCI) is the most common type of vascular cognitive impairment induced by cerebrovascular disease. No effective medicines are currently available for VMCI. Objective To assess the effectiveness and safety of acupuncture for VMCI. Methods Seven electronic databases were searched for randomised controlled trials which investigated the effects of acupuncture compared with no treatment, placebo or conventional therapies on cognitive function or other clinical outcomes in patients with VMCI. The quality of the trials selected was evaluated according to the ‘risk of bias’ assessment provided by the Cochrane Handbook for Systematic Reviews of Interventions. RevMan V.5.1 software was employed for data analysis. Results Twelve trials with 691 participants were included. The methodological quality of all included trials was unclear and/or they had a high risk of bias. Meta-analysis showed acupuncture in conjunction with other therapies could significantly improve Mini-Mental State Examination scores (mean difference 1.99, 95% CI 1.09 to 2.88, random model, p<0.0001, 6 trials). No included trials mentioned any adverse events of the treatment. Conclusions The current clinical evidence is not of sufficient quality for wider application of acupuncture to be recommended for the treatment of VMCI, and further large, rigorously designed trials are warranted.


2020 ◽  
Author(s):  
Zhiqiang Wang ◽  
Ambrish Singh ◽  
Benny Antony

AbstractTurmeric extracts have been used as a remedy for treating arthritis in traditional medicine. Recent years have witnessed the rise of different extracts from turmeric and randomised clinical trials (RCTs) evaluating the efficacy and safety of these extracts for the treatment of knee osteoarthritis (OA). This planned systematic review and meta-analysis aims to assess the efficacy and safety of turmeric extracts for the treatment of knee OA. Biomedical databases such as PubMed, Scopus, and Embase will be searched for RCTs reporting safety and efficacy of turmeric extracts for the treatment of knee OA. Cochrane risk of bias tool will be used to assess the methodological quality of the included studies, and a meta-analysis will be performed to pool the effect estimates.


2021 ◽  
Author(s):  
Andrew Hill ◽  
Manya Mirchandani ◽  
Leah Ellis ◽  
Victoria Pilkington

Abstract Background Ivermectin is an antiparasitic drug being investigated in clinical trials for the prevention of COVID-19. However, there are concerns about the quality of some of these trials. Objectives To conduct a meta-analysis with randomised controlled trials of ivermectin for the prevention of COVID-19, while controlling for the quality of data. Methods We conducted a sub-group analysis based on the quality of randomised controlled trials evaluating ivermectin for the prevention of COVID-19. Quality was assessed using the Cochrane Risk of Bias measures (RoB 2) and additional checks on raw data, where possible. Results Four studies were included in the meta-analysis. One was rated as being potentially fraudulent, two as having a high risk of bias and one as having some concerns for bias. Ivermectin did not have a significant effect on preventing RT-PCR confirmed COVID-19 infection. Ivermectin had a significant effect on preventing symptomatic COVID-19 infection in one trial with some concerns of bias, but this result was based on post-hoc analysis of a multi-arm study. Conclusions This meta-analysis demonstrates that the currently available randomised trials evaluating ivermectin for the prevention of COVID-19 are insufficient and of poor quality.


2018 ◽  
Vol 95 (1) ◽  
pp. 21-27 ◽  
Author(s):  
Ricardo F Savaris ◽  
Daniele G Fuhrich ◽  
Rui V Duarte ◽  
Sebastian Franik ◽  
Jonathan D C Ross

ObjectiveTo assess the effectiveness and safety of antibiotic regimens used to treat pelvic inflammatory disease (PID).DesignThis is a systematic review and meta-analysis of randomised controlled trials (RCTs). Risk of bias was assessed using the criteria outlined in the Cochrane guidelines. Quality of evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation.Data sourcesEight electronic databases were searched from date of inception up to July 2016. Database searches were complemented by screening of reference lists of relevant studies, trial registers, conference proceeding abstracts and grey literature.Eligibility criteriaRCTs comparing the use of antibiotics with placebo or other antibiotics for the treatment of PID in women of reproductive age, either as inpatient or outpatient treatment.ResultsWe included 37 RCTs (6348 women). The quality of evidence ranged from very low to high, the main limitations being serious risk of bias (due to poor reporting of study methods and lack of blinding), serious inconsistency and serious imprecision. There was no clear evidence of a difference in the rates of cure for mild-moderate or for severe PID for the comparisons of azithromycin versus doxycycline, quinolone versus cephalosporin, nitroimidazole versus no use of nitroimidazole, clindamycin plus aminoglycoside versus quinolone, or clindamycin plus aminoglycoside versus cephalosporin. No clear evidence of a difference between regimens in antibiotic-related adverse events leading to discontinuation of therapy was observed.ConclusionsWe found no conclusive evidence that one regimen of antibiotics was safer or more effective than any other for the treatment of PID, and there was no clear evidence for the use of nitroimidazoles (metronidazole) compared with the use of other drugs with activity against anaerobes. More evidence is needed to assess treatments for women with PID, particularly comparing regimens with or without the addition of nitroimidazoles and the efficacy of azithromycin compared with doxycycline.


BMJ Open ◽  
2019 ◽  
Vol 9 (2) ◽  
pp. e023096 ◽  
Author(s):  
Chuanjin Luo ◽  
Junmao Wen ◽  
Weipeng Sun ◽  
Ting Li ◽  
Xiaojiang Yu ◽  
...  

IntroductionCoronary heart disease (CHD) is the most common cause of death worldwide. Percutaneous coronary intervention (PCI) has been shown to reduce mortality in patients with CHD. However, there are still recurrences of cardiovascular events after PCI. Cardiac rehabilitation (CR) in patients with established CHD is associated with reductions in cardiovascular mortality and hospital admissions, as well as improved quality of life. More and more clinical trials suggest that traditional Chinese exercise (TCE) plays a positive role in patients post-PCI. The primary purposes of the current study are to conduct a network meta-analysis of randomised trials to determine the effects of TCE in patients after PCI, and to separately compare the effects of tai chi, baduanjin and yijinjing on CR after PCI.Methods and analysisStudies will be retrieved from the following databases: PubMed, Embase, Cochrane Library, Chinese National Knowledge Infrastructure, Wanfang Data, Chinese BioMedical Database and Chinese Science and Technology Periodicals Database, from inception to December 2018. We will include randomised controlled trials that are related to the effects of TCE therapies in patients after PCI. The primary outcomes will be all-cause mortality, revascularisations, health-related quality of life and hospitalisations. Two reviewers will independently select eligible articles. For each included article, two reviewers will independently extract the data and assess the risk of bias by using the Cochrane risk of bias tool. Bayesian network meta-analyses will be conducted to pool all treatment effects. The ranking probabilities for the optimal intervention of various treatments (tai chi, baduanjin or yijinjing) will be estimated by the mean ranks and surface under the cumulative ranking curve. The Grading of Recommendations Assessment, Development and Evaluation System will be used to assess the quality of evidence.Ethics and disseminationThe results will be disseminated through peer-reviewed publications. They will provide consolidated evidence to inform clinicians on the potential functions of TCE in CR, and to provide reliable evidence for the application of TCE.Trial registration numberCRD42018088415.


2021 ◽  
Vol 10 (3) ◽  
pp. 1-17
Author(s):  
Laura D Wainwright ◽  
Gillian Haddock ◽  
Charlotte Dunster-Page ◽  
Katherine Berry

Background/Aims Inpatient wards provide an opportunity to intervene with medical, psychological and social care to contain distress and prevent future relapse. However, they have been criticised for an over-reliance on medication and risk management with limited psychosocial interventions. The aim of this study was to investigate clinical trials of psychosocial interventions for inpatients to identify interventions that are effective at improving quality of life, symptoms or patient functioning. Methods An electronic search of six databases was conducted for papers published from 1806 up until February 2017. A total of 18 randomised controlled trials was identified in which outcomes for symptoms, quality of life or functioning were reported. Results Overall, 15 trials showed a statistically significant result for at least one outcome. Seven categories were identified from the 18 studies, at least one in each category was found to be effective for symptoms, quality of life or functioning. The majority were effective (15 out of 18). Conclusions Given that the methodological quality was generally low and number of randomised controlled trials were small, it is difficult to draw definitive conclusions. Recommendations include more and repeated trials using rigorous methods of testing and reporting.


Sign in / Sign up

Export Citation Format

Share Document