scholarly journals How to report E-values for meta-analyses: Recommended improvements and additions to the new GRADE approach

2021 ◽  
Author(s):  
Maya B Mathur ◽  
Tyler VanderWeele

In a recent concept paper (Verbeek et al., 2021), the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) Working Group provides a preliminary proposal to improve its existing guidelines for assessing sensitivity to uncontrolled confounding in meta-analyses of nonrandomized studies. The new proposal centers on reporting the E-value for the meta-analytic mean and on comparing this E-value to a measured “reference confounder” to determine whether residual uncontrolled confounding in the meta-analyzed studies could or could not plausibly explain away the meta-analytic mean. Although we agree that E-value analogs for meta-analyses could be an informative addition to future GRADE guidelines, we suggest improvements to the Verbeek et al. (2021)’s specific proposal regarding: (1) their interpretation of comparisons between the E-value and the strengths of associations of a reference confounder; (2) their characterization of evidence strength in meta-analyses in terms of only the meta-analytic mean; and (3) the possibility of confounding bias that is heterogeneous across studies.

Nutrients ◽  
2020 ◽  
Vol 12 (4) ◽  
pp. 1119 ◽  
Author(s):  
Jorge Pérez-Gómez ◽  
Santos Villafaina ◽  
José Carmelo Adsuar ◽  
Eugenio Merellano-Navarro ◽  
Daniel Collado-Mateo

The purpose of this study was to systematically review the scientific literature about the effects of supplementation with Ashwagandha (Withania somnifera) on maximum oxygen consumption (VO2max), as well as to provide directions for clinical practice. A systematic search was conducted in three electronic databases following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Guidelines (PRISMA). The inclusion criteria were: (a) VO2max data, with means ± standard deviation before and after the supplement intervention, (b) the study was randomized controlled trial (RCT), (c) the article was written in English. The quality of evidence was evaluated according to the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach. A meta-analysis was performed to determine effect sizes. Five studies were selected in the systematic review (162 participants) and four were included in the meta-analysis (142 participants). Results showed a significant enhancement in VO2max in healthy adults and athletes (p = 0.04). The mean difference was 3.00 (95% CI from 0.18 to 5.82) with high heterogeneity. In conclusion, Ashwagandha supplementation might improve the VO2max in athlete and non-athlete people. However, further research is need to confirm this hypothesis since the number of studies is limited and the heterogeneity was high.


2021 ◽  
Vol 7 (8) ◽  
pp. 637
Author(s):  
Shamala Gopal Rajadurai ◽  
Mari Kannan Maharajan ◽  
Sajesh K. Veettil ◽  
Divya Gopinath

The objective of this study was to assess the comparative efficacy and safety of different antifungal agents used for the treatment of oropharyngeal candidiasis (OPC) in adult patients with HIV. A systematic search was performed on the four major databases (Medline, Embase, CENTRAL and Scopus) to identify randomized controlled trials (RCTs) that evaluated the efficacy of antifungal agents in HIV patients with OPC. A network meta-analysis was performed from the data extracted from the selected studies. The agents were ranked according using surface under the cumulative ranking (SUCRA). The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach was used to determine the quality of evidence. A total of 15 trials were included in the quantitative analysis involving the data from a total of 2883 participants. Fluconazole was ranked as the most effective antifungal agent to achieve clinical cure (SUCRA = 0.87) in OPC followed by posaconazole and itraconazole. Posaconazole was ranked the most efficacious agent in achieving mycological cure (SUCRA = 0.81), followed by fluconazole. While nystatin was ranked the safest, the effect estimates of none of the other systemic antifungal agents were significantly higher than fluconazole. Based on the available evidence, fluconazole can be considered as the most effective drug in the treatment of OPC among HIV-infected adults and has a favorable safety profile, followed by posaconazole.


Gerontology ◽  
2021 ◽  
pp. 1-16
Author(s):  
Jane Xu ◽  
Ching S. Wan ◽  
Kiriakos Ktoris ◽  
Esmee M. Reijnierse ◽  
Andrea B. Maier

<b><i>Background:</i></b> Sarcopenia can predispose individuals to falls, fractures, hospitalization, and mortality. The prevalence of sarcopenia depends on the population studied and the definition used for the diagnosis. <b><i>Objective:</i></b> This systematic review and meta-analysis aimed to investigate the association between sarcopenia and mortality and if it is dependent on the population and sarcopenia definition. <b><i>Methods:</i></b> A systematic search was conducted in MEDLINE, EMBASE, and Cochrane from 1 January 2010 to 6 April 2020 for articles relating to sarcopenia and mortality. Articles were included if they met the following criteria – cohorts with a mean or median age ≥18 years and either of the following sarcopenia definitions: Asian Working Group for Sarcopenia (AWGS and AWGS2019), European Working Group on Sarcopenia in Older People (EWGSOP and EWGSOP2), Foundation for the National Institutes of Health (FNIH), International Working Group for Sarcopenia (IWGS), or Sarcopenia Definition and Outcomes Consortium (SDOC). Hazard ratios (HR) and odds ratios (OR) were pooled separately in meta-analyses using a random-effects model, stratified by population (community-dwelling adults, outpatients, inpatients, and nursing home residents). Subgroup analyses were performed for sarcopenia definition and follow-up period. <b><i>Results:</i></b> Out of 3,025 articles, 57 articles were included in the systematic review and 56 in the meta-analysis (42,108 participants, mean age of 49.4 ± 11.7 to 86.6 ± 1.0 years, 40.3% females). Overall, sarcopenia was associated with a significantly higher risk of mortality (HR: 2.00 [95% CI: 1.71, 2.34]; OR: 2.35 [95% CI: 1.64, 3.37]), which was independent of population, sarcopenia definition, and follow-up period in subgroup analyses. <b><i>Conclusions:</i></b> Sarcopenia is associated with a significantly higher risk of mortality, independent of population and sarcopenia definition, which highlights the need for screening and early diagnosis in all populations.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Ran Liu ◽  
Kun Zhang ◽  
Qiu-yu Tong ◽  
Guang-wei Cui ◽  
Wen Ma ◽  
...  

Abstract Background Acupuncture for post-stroke depression (PSD) has been evolving, but uncertainty remains. To assess the existing evidence from randomized clinical trials (RCTs) of acupuncture for PSD, we sought to draw conclusions by synthesizing RCTs. Methods An exhaustive literature search was conducted in seven electronic databases from their inception dates to April 19, 2020, to identify systematic reviews (SRs) and meta-analyses (MAs) on this topic. The primary RCTs included in the SRs/MAs were identified. We also conducted a supplementary search for RCTs published from January 1, 2015, to May 12, 2020. Two reviewers extracted data separately and pooled data using RevMan 5.3 software. The quality of evidence was critically appraised with the Grades of Recommendation, Assessment, Development and Evaluation (GRADE) system. Results A total of 17 RCTs involving 1402 patients were included. Meta-analysis showed that participants who received a combination of acupuncture and conventional treatments exhibited significantly lower scores on the HAM-D17, HAM-D24 and HAM-D (MD, − 5.08 [95% CI, − 6.48 to − 3.67], I2 = 0%), (MD, − 9.72 [95% CI, − 14.54 to − 4.91], I2 = 65%) and (MD, − 2.72 [95% CI, − 3.61 to − 1.82], respectively) than those who received conventional treatment. However, there was no significant difference in acupuncture versus antidepressants in terms of the 17-item, 24-item and HAM-D scales (MD, − 0.43 [95% CI, − 1.61 to 0.75], I2 = 51%), (MD, − 3.09 [95% CI, − 10.81 to 4.63], I2 = 90%) and (MD, − 1.55 [95% CI, − 4.36 to 1.26], I2 = 95%, respectively). For adverse events, acupuncture was associated with fewer adverse events than antidepressants (RR, 0.16 [95% CI, 0.07 to 0.39], I2 = 35%), but there was no significant difference in the occurrence of adverse events between the combination of acupuncture and conventional treatments versus conventional treatments (RR, 0.63 [95% CI, 0.21 to 1.83], I2 = 38%). The quality of evidence was low to very low due to the substantial heterogeneity among the included studies. Conclusions The current review indicates that acupuncture has greater effect on PSD and better safety profile than antidepressants, but high-quality evidence evaluating acupuncture for PSD is still needed.


Diagnostics ◽  
2022 ◽  
Vol 12 (1) ◽  
pp. 199
Author(s):  
Marta Mirando ◽  
Corrado Conti ◽  
Federica Zeni ◽  
Fabio Pedicini ◽  
Antonio Nardone ◽  
...  

(1) Background: Ankle fracture results in pain, swelling, stiffness and strength reduction, leading to an altered biomechanical behavior of the joint during the gait cycle. Nevertheless, a common pattern of kinematic alterations has still not been defined. To this end, we analyzed the literature on instrumental gait assessment after ankle fracture, and its correlation with evaluator-based and patient-reported outcome measures. (2) Methods: We conducted a systematic search, according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines, of articles published from January 2000 to June 2021 in PubMed, Embase and PEDro on instrumental gait assessment after ankle fracture. (3) Results: Several changes in gait occur after ankle fracture, including a reduction in step length, swing time, single support time, stride length, cadence, speed and an earlier foot-off time in the affected side. Additionally, trunk movement symmetry (especially vertical) is significantly reduced after ankle fracture. The instrumental assessments correlate with different clinical outcome measures. (4) Conclusions: Instrumental gait assessment can provide an objective characterization of the gait alterations after ankle fracture. Such assessment is important not only in clinical practice to assess patients’ performance but also in clinical research as a reference point to evaluate existing or new rehabilitative interventions.


2020 ◽  
Author(s):  
Maya B Mathur ◽  
Tyler VanderWeele

We recently suggested new statistical metrics for routine reporting in random-effects meta-analyses to convey evidence strength for scientifically meaningful effects under effect heterogeneity. First, given a chosen threshold of meaningful effect size, we suggested reporting the estimated proportion of true effect sizes above this threshold. Second, we suggested reporting the proportion of effect sizes below a second, possibly symmetric, threshold in the opposite direction from the estimated mean. Our previous methods applied when the true effects are approximately normal, when the number of studies is relatively large, and when the proportion is between approximately 0.15 and 0.85. Here, we additionally describe robust methods for point estimation and inference that perform well under considerably more general conditions, as we validate in an extensive simulation study. The methods are implemented in the R package MetaUtility (function prop_stronger). We describe application of the robust methods to conducting sensitivity analyses for unmeasured confounding in meta-analyses.


2021 ◽  
Author(s):  
Lucas Garcia Santana ◽  
Kimberlly Avelar ◽  
Leandro Silva Marques

ABSTRACT Objectives To investigate the association between the management of mandibular arch perimeter during development of the dentition and its effects on second permanent molar (M2) eruption. Materials and Methods Seven electronic databases were searched without restrictions up to June 2020. Assessment was performed using the Risk Of Bias In Non-randomized Studies of Interventions (ROBINS-I) tool for non-randomized clinical trials (non-RCT). Odds ratio (OR) with 95% confidence intervals was calculated from random-effects meta-analyses. The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) tool was used to assess the certainty of the evidence. Results Five non-RCTs, with serious to moderate risk of bias, were included. A low certainty of evidence indicated that individuals undergoing mandibular arch perimeter management by controlling the position of the first molar had a high prevalence of M2 eruption difficulties. The odds of eruption disorders was 7.5 times higher (OR: 7.57, [3.72, 15.41], P &lt; .001) in treated individuals. Subgroup analysis revealed that appliances that increased the arch perimeter lead to a greater chance of eruption disorders compared to appliances that only maintained the perimeter. The predictive factors for the M2 eruption difficulty were its previous mesioangulation in relation to the first molar (&gt;24°) and the treatment time (&gt;2 years). Conclusions Mandibular arch perimeter management during development of the dentition leads to an increase in the occurrence of M2 eruption difficulties. The identification of possible risk factors as well as the choice of the appropriate appliance type and the monitoring of these individuals seems to be essential to avoid undesirable effects with this therapy.


BMJ Open ◽  
2018 ◽  
Vol 8 (3) ◽  
pp. e017883 ◽  
Author(s):  
Dongmei Xie ◽  
Yulin Liao ◽  
Jirong Yue ◽  
Chao Zhang ◽  
Yanyan Wang ◽  
...  

ObjectiveTo compare the effectiveness of five kinds of selenium supplementation for the treatment of patients with Kashin-Beck disease, and rank these selenium supplementations based on their performance.DesignWe searched for all publications between 1 January 1966 and 31 March 2017 using seven electronic databases. GRADE system to network meta-analyses (NMAs) was applied to rate the quality of the evidence. We conducted a random effects model NMA in STATA 12.1 to determine comparative effectiveness of each intervention. Rankings were obtained by using the surface under the cumulative ranking curve (SUCRA) values and mean ranks.ResultsA total of 15 randomised controlled trials involving 2931 patients were included. After assessment of the overall quality of the evidence, we downgraded our primary outcomes from high to low or very low quality. NMAs showed that all five kinds of selenium supplementation had higher metaphysis X-ray improvement which were superior to placebo. Ranking on efficacy indicated that selenium salt was ranked the highest, followed by sodium selenite + vitamin E, selenium enriched yeast, sodium selenite and then sodium selenite + vitamin C.ConclusionsBased on the results of NMA, all five types of selenium supplements are more effective than placebo and so that selenium supplementation is of help in repairing metaphyseal lesions. Since the overall quality of the evidence was low or very low, the SUCRA values may be misleading and should be considered jointly with the The Grading of Recommendations Assessment, Development and Evaluation (GRADE) confidence in the estimates for each comparison. The quality of the evidence is insufficient to draw a conclusion about what method of selenium supplementation is most effective.PROSPERO registration numberCRD42016051874.


Sign in / Sign up

Export Citation Format

Share Document