scholarly journals Sensitivity analysis for publication bias in meta‐analyses

2020 ◽  
Vol 69 (5) ◽  
pp. 1091-1119 ◽  
Author(s):  
Maya B. Mathur ◽  
Tyler J. VanderWeele
Keyword(s):  
Sensitivity Analysis ◽  
Publication Bias ◽  
Meta Analyses

How to Detect Publication Bias in Psychological Research

2019 ◽  
Vol 227 (4) ◽  
pp. 261-279 ◽  
Author(s):  
Frank Renkewitz ◽  
Melanie Keiner
Keyword(s):  
Publication Bias ◽  
Effect Size ◽  
Statistical Power ◽  
Type I Error ◽  
Psychological Research ◽  
Type I ◽  
True Effect Size ◽  
Questionable Research Practices ◽  
True Effect ◽  
Meta Analyses

Abstract. Publication biases and questionable research practices are assumed to be two of the main causes of low replication rates. Both of these problems lead to severely inflated effect size estimates in meta-analyses. Methodologists have proposed a number of statistical tools to detect such bias in meta-analytic results. We present an evaluation of the performance of six of these tools. To assess the Type I error rate and the statistical power of these methods, we simulated a large variety of literatures that differed with regard to true effect size, heterogeneity, number of available primary studies, and sample sizes of these primary studies; furthermore, simulated studies were subjected to different degrees of publication bias. Our results show that across all simulated conditions, no method consistently outperformed the others. Additionally, all methods performed poorly when true effect sizes were heterogeneous or primary studies had a small chance of being published, irrespective of their results. This suggests that in many actual meta-analyses in psychology, bias will remain undiscovered no matter which detection method is used.

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

scholarly journals Leishmanicidal effects of resveratrol and its derivatives: a systematic review and meta-Analysis

2020 ◽  
Author(s):  
Nasrin Amiri Dashatan ◽  
Marzieh Ashrafmansouri ◽  
Mehdi Koushki ◽  
Nayebali Ahmadi
Keyword(s):  
Systematic Review ◽  
Publication Bias ◽  
Data Extraction ◽  
Meta Analysis ◽  
Sensitivity Analyses ◽  
Protective Effects ◽  
Random Effects Models ◽  
Important Health ◽  
Mean Differences ◽  
Meta Analyses

Abstract Background Leishmaniasis is one of the most important health problems worldwide. The evidence has suggested that resveratrol and its derivatives have anti-leishmanial effects; however, the results are inconsistent and inconclusive. The aim of this study was to assess the effect of resveratrol and its derivatives on the Leishmania viability through a systematic review and meta-analysis of available relevant studies. Methods The electronic databases PubMed, ScienceDirect, Embase, Web of Science and Scopus were queried between October 2000 and April 2020 using a comprehensive search strategy. The eligible articles selected and data extraction conducted by two reviewers. Mean differences of IC50 (concentration leading to reduction of 50% of Leishmania) for each outcome was calculated using random-effects models. Sensitivity analyses and prespecified subgroup were conducted to evaluate potential heterogeneity and the stability of the pooled results. Publication bias was evaluated using the Egger’s and Begg’s tests. We also followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines for this review. Results Ten studies were included in the meta-analysis. We observed that RSV and its derivatives had significant reducing effects on Leishmania viability in promastigote [24.02 µg/ml; (95% CI 17.1, 30.8); P < 0.05; I2 = 99.8%; P heterogeneity = 0.00] and amastigote [18.3 µg/ml; (95% CI 13.5, 23.2); P < 0.05; I2 = 99.6%; P heterogeneity = 0.00] stages of Leishmania. A significant publication bias was observed in the meta-analysis. Sensitivity analyses showed a similar effect size while reducing the heterogeneity. Subgroup analysis indicated that the pooled effects of leishmanicidal of resveratrol and its derivatives were affected by type of stilbenes and Leishmania species. Conclusions Our findings clearly suggest that the strategies for the treatment of leishmaniasis should be focused on natural products such as RSV and its derivatives. Further study is needed to identify the mechanisms mediating this protective effects of RSV and its derivatives in leishmaniasis.

scholarly journals Is Replication Possible without Fidelity?

2021 ◽  
Author(s):  
Michelle Renee Ellefson ◽  
Daniel Oppenheimer
Keyword(s):  
Publication Bias ◽  
Effect Size ◽  
Experimental Psychology ◽  
Intervention Science ◽  
Experimental Protocols ◽  
Meta Analyses

Failure of replication attempts in experimental psychology might extend beyond p-hacking, publication bias or hidden moderators; reductions in experimental power can be caused by violations of fidelity to a set of experimental protocols. In this paper, we run a series of simulations to systematically explore how manipulating fidelity influences effect size. We find statistical patterns that mimic those found in ManyLabs style replications and meta-analyses, suggesting that fidelity violations are present in many replication attempts in psychology. Scholars in intervention science, medicine, and education have developed methods of improving and measuring fidelity, and as replication becomes more mainstream in psychology, the field would benefit from adopting such approaches as well.

scholarly journals Comparing Bayesian Posterior Passing with Meta-analysis

2020 ◽  
Author(s):  
Joshua Pritsker
Keyword(s):  
Publication Bias ◽  
Fixed Effects ◽  
Meta Analysis ◽  
Future Research ◽  
Meta Analyses

Brand, von der Post, Ounsley, and Morgan (2019) introduced Bayesian posterior passing as an alternative to traditional meta-analyses. In this commentary I relate their procedure to traditional meta-analysis, showing that posterior passing is equivalent to fixed effects meta-analysis. To overcome the limitations of simple posterior passing, I introduce improved posterior passing methods to account for heterogeneity and publication bias. Additionally, practical limitations of posterior passing and the role that it can play in future research are discussed.

scholarly journals Global Burden of Anxiety and Depression among Cystic Fibrosis Patient: Systematic Review and Meta-Analysis

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Mistire Teshome Guta ◽  
Tiwabwork Tekalign ◽  
Nefsu Awoke ◽  
Robera Olana Fite ◽  
Getahun Dendir ◽  
...  
Keyword(s):  
Cystic Fibrosis ◽  
North America ◽  
Publication Bias ◽  
Meta Analysis ◽  
Systemic Review ◽  
Anxiety And Depression ◽  
Close Monitoring ◽  
The World ◽  
Trim And Fill ◽  
Meta Analyses

Aims. This systemic review and meta-analysis were aimed at determining the level of anxiety and depression among cystic fibrosis patients in the world. Methods. We conducted a systematic search of published studies from PubMed, EMBASE, MEDLINE, Cochrane, Scopus, Web of Science, CINAHL, and manually on Google Scholar. This meta-analysis follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The quality of studies was assessed by the modified Newcastle-Ottawa Scale (NOS). Meta-analysis was carried out using a random-effects method using the STATA™ Version 14 software. Trim and fill analysis was done to correct the presence of significant publication bias. Result. From 419,820 obtained studies, 26 studies from 2 different parts of the world including 9766. The overall global pooled prevalence of anxiety and depression after correction for publication bias by trim and fill analysis was found to be 24.91(95% CI: 20.8-28.9) for anxiety. The subgroup analyses revealed with the lowest prevalence, 23.59%, (95% CI: 8.08, 39.09)) in North America and the highest, 26.77%, (95% CI: 22.5, 31.04) seen in Europe for anxiety and with the highest prevalence, 18.67%, (95% CI: 9.82, 27.5) in North America and the lowest, 13.27%, (95% CI: -10.05, 16.5) seen in Europe for depression. Conclusion. The global prevalence of anxiety and depression among cystic fibrosis patients is common. Therefore, close monitoring of the patient, regularly screening for anxiety and depression, and appropriate prevention techniques is recommended.

scholarly journals Association Between MTHFR Polymorphisms and the Risk of Essential Hypertension: An Updated Meta-analysis

2021 ◽  
Vol 12 ◽  
Author(s):  
Hao Meng ◽  
Shaoyan Huang ◽  
Yali Yang ◽  
Xiaofeng He ◽  
Liping Fei ◽  
...  
Keyword(s):  
Sensitivity Analysis ◽  
Essential Hypertension ◽  
Methylenetetrahydrofolate Reductase ◽  
Meta Analysis ◽  
Mthfr C677t ◽  
Cochrane Library ◽  
Mthfr Polymorphisms ◽  
Southeast Asians ◽  
Increased Risk ◽  
Meta Analyses

Background: Since the 1990s, there have been a lot of research on single-nucleotide polymorphism (SNP) and different diseases, including many studies on 5,10-methylenetetrahydrofolate reductase (MTHFR) polymorphism and essential hypertension (EH). Nevertheless, their conclusions were controversial. So far, six previous meta-analyses discussed the internal relationship between the MTHFR polymorphism and EH, respectively. However, they did not evaluate the credibility of the positive associations. To build on previous meta-analyses, we updated the literature by including previously included papers as well as nine new articles, improved the inclusion criteria by also considering the quality of the papers, and applied new statistical techniques to assess the observed associations. Objectives: This study aims to explore the degree of risk correlation between two MTHFR polymorphisms and EH. Methods: PubMed, EMBASE, the Cochrane Library, CNKI, and Wan Fang electronic databases were searched to identify relevant studies. We evaluated the relation between the MTHFR C677T (rs1801133) and A1298C (rs1801131) polymorphisms and EH by calculating the odds ratios (OR) as well as 95% confidence intervals (CI). Here we used subgroup analysis, sensitivity analysis, cumulative meta-analysis, assessment of publication bias, meta-regression meta, False-positive report probability (FPRP), Bayesian false discovery probability (BFDP), and Venice criterion. Results: Overall, harboring the variant of MTHFR C677T was associated with an increased risk of EH in the overall populations, East Asians, Southeast Asians, South Asians, Caucasians/Europeans, and Africans. After the sensitivity analysis, positive results were found only in the overall population (TT vs. CC: OR = 1.14, 95% CI: 1.00–1.30, Ph = 0.032, I2 = 39.8%; TT + TC vs. CC: OR = 1.15, 95% CI: 1.01–1.29, Ph = 0.040, I2 = 38.1%; T vs. C: OR = 1.14, 95% CI: 1.04–1.25, Ph = 0.005, I2 = 50.2%) and Asian population (TC vs. CC: OR = 1.14, 95% CI: 1.01–1.28, Ph = 0.265, I2 = 16.8%; TT + TC vs. CC: OR = 1.17, 95% CI: 1.04–1.30, Ph = 0.105, I2 = 32.9%; T vs. C: OR = 1.10, 95% CI: 1.02–1.19, Ph = 0.018, I2 = 48.6%). However, after further statistical assessment by FPRP, BFDP, and Venice criteria, the positive associations reported here could be deemed to be false-positives and present only weak evidence for a causal relationship. In addition, when we performed pooled analysis and sensitivity analysis on MTHFR A1298C; all the results were negative. Conclusion: The positive relationships between MTHFR C677T and A1298C polymorphisms with the susceptibility to present with hypertension were not robust enough to withstand statistical interrogation by FPRP, BFDP, and Venice criteria. Therefore, these SNPs are probably not important in EH etiology.

Sign in / Sign up

Export Citation Format

Share Document