An Application of Gibbs Sampling to Estimation in Meta-Analysis: Accounting for Publication Bias

There is a widespread concern that published results in most disciplines are highly biased in favor of statistically significant outcomes. We propose a model to explicitly account for publication bias using a weight function that describes the probability of publication for a particular study in terms of a selection parameter. A Bayesian analysis of this model using flat priors on both the parameter of interest and the selection parameter is carried out using Gibbs sampling to calculate the posterior distributions of interest. The model is studied in detail for the case of a single observed result and then extended to provide a method for interpreting meta-analyses. We consider models in which the probability of publication for a study might depend on other characteristics of the study—in particular, the size of the study. Finally, we apply our model to a published meta-analysis which examined the effect of coaching on scores on the SAT.

Download Full-text

Identification of and Correction for Publication Bias: Comment

10.31222/osf.io/dh87m ◽

2019 ◽

Author(s):

Amanda Kvarven ◽

Eirik Strømland ◽

Magnus Johannesson

Keyword(s):

Publication Bias ◽

False Positive ◽

Large Scale ◽

Meta Analysis ◽

False Positive Rate ◽

Effect Sizes ◽

Replication Studies ◽

Moderate Reduction ◽

Positive Rate ◽

Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

Download Full-text

Leishmanicidal effects of resveratrol and its derivatives: a systematic review and meta-Analysis

10.21203/rs.3.rs-25274/v1 ◽

2020 ◽

Author(s):

Nasrin Amiri Dashatan ◽

Marzieh Ashrafmansouri ◽

Mehdi Koushki ◽

Nayebali Ahmadi

Keyword(s):

Systematic Review ◽

Publication Bias ◽

Data Extraction ◽

Meta Analysis ◽

Sensitivity Analyses ◽

Protective Effects ◽

Random Effects Models ◽

Important Health ◽

Mean Differences ◽

Meta Analyses

Abstract Background Leishmaniasis is one of the most important health problems worldwide. The evidence has suggested that resveratrol and its derivatives have anti-leishmanial effects; however, the results are inconsistent and inconclusive. The aim of this study was to assess the effect of resveratrol and its derivatives on the Leishmania viability through a systematic review and meta-analysis of available relevant studies. Methods The electronic databases PubMed, ScienceDirect, Embase, Web of Science and Scopus were queried between October 2000 and April 2020 using a comprehensive search strategy. The eligible articles selected and data extraction conducted by two reviewers. Mean differences of IC50 (concentration leading to reduction of 50% of Leishmania) for each outcome was calculated using random-effects models. Sensitivity analyses and prespecified subgroup were conducted to evaluate potential heterogeneity and the stability of the pooled results. Publication bias was evaluated using the Egger’s and Begg’s tests. We also followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines for this review. Results Ten studies were included in the meta-analysis. We observed that RSV and its derivatives had significant reducing effects on Leishmania viability in promastigote [24.02 µg/ml; (95% CI 17.1, 30.8); P < 0.05; I2 = 99.8%; P heterogeneity = 0.00] and amastigote [18.3 µg/ml; (95% CI 13.5, 23.2); P < 0.05; I2 = 99.6%; P heterogeneity = 0.00] stages of Leishmania. A significant publication bias was observed in the meta-analysis. Sensitivity analyses showed a similar effect size while reducing the heterogeneity. Subgroup analysis indicated that the pooled effects of leishmanicidal of resveratrol and its derivatives were affected by type of stilbenes and Leishmania species. Conclusions Our findings clearly suggest that the strategies for the treatment of leishmaniasis should be focused on natural products such as RSV and its derivatives. Further study is needed to identify the mechanisms mediating this protective effects of RSV and its derivatives in leishmaniasis.

Download Full-text

Comparing Bayesian Posterior Passing with Meta-analysis

10.31234/osf.io/ke9wn ◽

2020 ◽

Author(s):

Joshua Pritsker

Keyword(s):

Publication Bias ◽

Fixed Effects ◽

Meta Analysis ◽

Future Research ◽

Meta Analyses

Brand, von der Post, Ounsley, and Morgan (2019) introduced Bayesian posterior passing as an alternative to traditional meta-analyses. In this commentary I relate their procedure to traditional meta-analysis, showing that posterior passing is equivalent to fixed effects meta-analysis. To overcome the limitations of simple posterior passing, I introduce improved posterior passing methods to account for heterogeneity and publication bias. Additionally, practical limitations of posterior passing and the role that it can play in future research are discussed.

Download Full-text

Global Burden of Anxiety and Depression among Cystic Fibrosis Patient: Systematic Review and Meta-Analysis

International Journal of Chronic Diseases ◽

10.1155/2021/6708865 ◽

2021 ◽

Vol 2021 ◽

pp. 1-9

Author(s):

Mistire Teshome Guta ◽

Tiwabwork Tekalign ◽

Nefsu Awoke ◽

Robera Olana Fite ◽

Getahun Dendir ◽

...

Keyword(s):

Cystic Fibrosis ◽

North America ◽

Publication Bias ◽

Meta Analysis ◽

Systemic Review ◽

Anxiety And Depression ◽

Close Monitoring ◽

The World ◽

Trim And Fill ◽

Meta Analyses

Aims. This systemic review and meta-analysis were aimed at determining the level of anxiety and depression among cystic fibrosis patients in the world. Methods. We conducted a systematic search of published studies from PubMed, EMBASE, MEDLINE, Cochrane, Scopus, Web of Science, CINAHL, and manually on Google Scholar. This meta-analysis follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The quality of studies was assessed by the modified Newcastle-Ottawa Scale (NOS). Meta-analysis was carried out using a random-effects method using the STATA™ Version 14 software. Trim and fill analysis was done to correct the presence of significant publication bias. Result. From 419,820 obtained studies, 26 studies from 2 different parts of the world including 9766. The overall global pooled prevalence of anxiety and depression after correction for publication bias by trim and fill analysis was found to be 24.91(95% CI: 20.8-28.9) for anxiety. The subgroup analyses revealed with the lowest prevalence, 23.59%, (95% CI: 8.08, 39.09)) in North America and the highest, 26.77%, (95% CI: 22.5, 31.04) seen in Europe for anxiety and with the highest prevalence, 18.67%, (95% CI: 9.82, 27.5) in North America and the lowest, 13.27%, (95% CI: -10.05, 16.5) seen in Europe for depression. Conclusion. The global prevalence of anxiety and depression among cystic fibrosis patients is common. Therefore, close monitoring of the patient, regularly screening for anxiety and depression, and appropriate prevention techniques is recommended.

Download Full-text

Effects of the endocrine disruptor vinclozolin in male reproduction: a systematic review and meta-analysis†

Biology of Reproduction ◽

10.1093/biolre/ioab018 ◽

2021 ◽

Author(s):

Mariana Feijó ◽

Roberta V L Martins ◽

Sílvia Socorro ◽

Luísa Pereira ◽

Sara Correia

Keyword(s):

Systematic Review ◽

Publication Bias ◽

Meta Analysis ◽

Endocrine Disrupting Chemicals ◽

Reproductive Organs ◽

Male Reproduction ◽

Mean Differences ◽

Trim And Fill ◽

Meta Analyses ◽

Q Statistic

Abstract Endocrine-disrupting chemicals have become an issue of scientific and public discussion. Vinclozolin (VNZ) is a fungicide that competitively antagonizes the binding of natural androgens to their receptor, disturbing the function of tissues that are sensitive to these hormones, as is the case of the male reproductive organs. A systematic review with meta-analyses of rodent studies was conducted to answer the following question: Does exposure to VNZ affect sperm parameters and testicular/epididymal weight? The methodology was prespecified according to the Cochrane Handbook for Systematic Reviews and PRISMA recommendations. Sixteen articles met the inclusion criteria, comprising a total of 1189 animals. The risk of publication bias was assessed using the Trim and Fill adjustment, funnel plot, and Egger regression test. Heterogeneity and inconsistency across the findings were tested using the Q-statistic and I2 of Higgins, respectively. Sensitivity was also analyzed. Statistical analysis was performed on Comprehensive Meta-Analysis software (Version 2.0), using random models and weighted mean differences along with a 95% confidence interval. Sperm motility, counts, daily sperm production (evidence of publication bias), and epididymis weight were decreased in VNZ-treated animals. Exposure length and dose, as well as the time point of exposure, influenced the obtained results. Despite the moderate/high heterogeneity observed, the sensitivity analysis overall demonstrated the robustness of the findings. The quality scores of the included studies were superior to 4 in a total of 9, then classified as good. The obtained data corroborate the capability of VNZ exposure to disrupt spermatogenic output and compromise male fertility.

Download Full-text

Is grey literature essential for a better control of publication bias in psychiatry? An example from three meta-analyses of schizophrenia

European Psychiatry ◽

10.1016/j.eurpsy.2005.03.011 ◽

2005 ◽

Vol 20 (8) ◽

pp. 550-553 ◽

Cited By ~ 31

Author(s):

José Luis R. Martin ◽

Víctor Pérez ◽

Montse Sacristán ◽

Enric Álvarez

Keyword(s):

Publication Bias ◽

Systematic Reviews ◽

Meta Analysis ◽

Grey Literature ◽

Risk Of Bias ◽

Medical Databases ◽

Study Results ◽

Heterogeneous Nature ◽

Meta Analyses ◽

Literature Material

AbstractSystematic reviews in mental health have become useful tools for health professionals in view of the massive amount and heterogeneous nature of biomedical information available today. In order to determine the risk of bias in the studies evaluated and to avoid bias in generalizing conclusions from the reviews it is therefore important to use a very strict methodology in systematic reviews. One bias which may affect the generalization of results is publication bias, which is determined by the nature and direction of the study results. To control or minimize this type of bias, the authors of systematic reviews undertake comprehensive searches of medical databases and expand on the findings, often undertaking searches of grey literature (material which is not formally published). This paper attempts to show the consequences (and risk) of generalizing the implications of grey literature in the control of publication bias, as was proposed in a recent systematic work. By repeating the analyses for the same outcome from three different systematic reviews that included both published and grey literature our results showed that confusion between grey literature and publication bias may affect the results of a concrete meta-analysis.

Download Full-text

Altered central and blood glutathione in Alzheimer Disease and Mild Cognitive Impairment: a meta-analysis

10.21203/rs.3.rs-430047/v1 ◽

2021 ◽

Author(s):

Jinghan J Chen ◽

Mathura Thiyagarajah ◽

Jianmeng Song ◽

Clara Chen ◽

Nathan Herrmann ◽

...

Keyword(s):

Cognitive Impairment ◽

Mild Cognitive Impairment ◽

Alzheimer Disease ◽

Publication Bias ◽

Subgroup Analysis ◽

Meta Analysis ◽

Random Effects Models ◽

Mean Differences ◽

Meta Analyses

Abstract Background: Increasing evidence implicates oxidative stress (OS) in Alzheimer Disease (AD) and Mild Cognitive Impairment (MCI). Depletion of the brain antioxidant glutathione (GSH) may be important in OS-mediated neurodegeneration, though studies of post-mortem brain GSH changes in AD have been inconclusive. Recent in vivo measurements of brain and blood GSH may shed light on GSH changes earlier in the disease.Aim: To quantitatively review in vivo GSH in AD and MCI compared to healthy controls (HC) using meta-analyses. Method: Studies with in vivo brain or blood GSH levels in MCI or AD with a HC group were identified using Medline, PsychInfo, and Embase (1947-June 2020). Standardized mean differences (SMD) and 95% confidence intervals (CI) were calculated for outcomes using random effects models. Outcome measures included brain GSH (Meshcher-Garwood Point Resolved Spectroscopy (MEGA-PRESS) versus non-MEGA-PRESS), and blood GSH (intracellular versus extracellular) in AD and MCI. The Q statistic and Egger’s test were used to assess heterogeneity and risk of publication bias, respectively. Results: For brain GSH, 4 AD (AD=135, HC=223) and 4 MCI (MCI=213, HC=211) studies were included. For blood GSH, 26 AD (AD=1203, HC=1135) and 7 MCI (MCI=434, HC=408) studies were included. Brain GSH overall did not differ in AD or MCI compared to HC; however, the subgroup of studies using MEGA-PRESS reported lower brain GSH in AD (SMD [95%CI] -1.45 [-1.83, -1.06], p<0.001) and MCI (-1.15 [-1.71, -0.59], z=4.0, p<0.001). AD had lower intracellular and extracellular blood GSH overall (-1.10 [-1.58, -0.62], z=4.46, p<0.001). In a subgroup analysis, intracellular GSH was lower in MCI (-0.66 [-1.11, -0.21], p=0.025). Heterogeneity was observed throughout (I2 >85%) and not fully accounted by subgroup analysis. Egger’s test indicated risk of publication bias.Conclusion: Blood intracellular GSH decrease is seen in MCI, while both intra- and extracellular decreases were seen in AD. Brain GSH is decreased in AD and MCI in subgroup analysis. Potential bias and heterogeneity suggest the need for measurement standardization and additional studies to explore sources of heterogeneity.

Download Full-text

Concordance and incongruence in preclinical anxiety models: systematic review and meta-analyses

10.1101/020701 ◽

2015 ◽

Cited By ~ 1

Author(s):

Farhan Mohammad ◽

Joses Ho ◽

Jia Hern Woo ◽

Chun Lei Lim ◽

Dennis Jun Jie Poon ◽

...

Keyword(s):

Systematic Review ◽

Publication Bias ◽

Social Isolation ◽

Gene Knockout ◽

Meta Analysis ◽

Receptor Gene ◽

List Type ◽

Clinical Use ◽

Defense Behavior ◽

Meta Analyses

AbstractRodent defense behavior assays have been widely used as preclinical models of anxiety to study possibly therapeutic anxiety-reducing interventions. However, some proposed anxiety-modulating factors—genes, drugs and stressors—have had discordant effects across different studies. To reconcile the effect sizes of purported anxiety factors, we conducted systematic review and meta-analyses of the literature on ten anxiety-linked interventions, as examined in the elevated plus maze, open field and light-dark box assays. Diazepam, 5-HT1A receptor gene knockout and overexpression, SERT gene knockout and overexpression, pain, restraint, social isolation, corticotropin-releasing hormone and Crhr1 were selected for review. Eight interventions had statistically significant effects on rodent anxiety, while Htr1a overexpression and Crh knockout did not. Evidence for publication bias was found in the diazepam, Htt knockout, and social isolation literatures. The Htr1a and Crhr1 results indicate a disconnect between preclinical science and clinical research. Furthermore, the meta-analytic data confirmed that genetic SERT anxiety effects were paradoxical in the context of the clinical use of SERT inhibitors to reduce anxiety.HighlightsMeta-analysis shows eight rodent anxiety factors have at least moderate effects.Publication bias affects four of the anxiety interventions.Preclinical rodent anxiety results appear disconnected from clinical efforts.Serotonin transporter gene lesion effects are paradoxical with reuptake inhibitors clinical use.

Download Full-text

A Series of Meta-Analytic Tests of the Efficacy of Long-Term Psychoanalytic Psychotherapy

European Psychologist ◽

10.1027/1016-9040/a000385 ◽

2020 ◽

Vol 25 (1) ◽

pp. 51-72 ◽

Cited By ~ 4

Author(s):

Christian Franz Josef Woll ◽

Felix D. Schönbrodt

Keyword(s):

Mental Disorders ◽

Publication Bias ◽

Psychiatric Symptoms ◽

Meta Analysis ◽

Research Process ◽

Open Science ◽

Effect Sizes ◽

Psychoanalytic Psychotherapy ◽

Meta Analyses

Abstract. Recent meta-analyses come to conflicting conclusions about the efficacy of long-term psychoanalytic psychotherapy (LTPP). Our first goal was to reproduce the most recent meta-analysis by Leichsenring, Abbass, Luyten, Hilsenroth, and Rabung (2013) who found evidence for the efficacy of LTPP in the treatment of complex mental disorders. Our replicated effect sizes were in general slightly smaller. Second, we conducted an updated meta-analysis of randomized controlled trials comparing LTPP (lasting for at least 1 year and 40 sessions) to other forms of psychotherapy in the treatment of complex mental disorders. We focused on a transparent research process according to open science standards and applied a series of elaborated meta-analytic procedures to test and control for publication bias. Our updated meta-analysis comprising 191 effect sizes from 14 eligible studies revealed small, statistically significant effect sizes at post-treatment for the outcome domains psychiatric symptoms, target problems, social functioning, and overall effectiveness (Hedges’ g ranging between 0.24 and 0.35). The effect size for the domain personality functioning (0.24) was not significant ( p = .08). No signs for publication bias could be detected. In light of a heterogeneous study set and some methodological shortcomings in the primary studies, these results should be interpreted cautiously. In conclusion, LTPP might be superior to other forms of psychotherapy in the treatment of complex mental disorders. Notably, our effect sizes represent the additional gain of LTPP versus other forms of primarily long-term psychotherapy. In this case, large differences in effect sizes are not to be expected.

Download Full-text

The Prevalence of Allergic Rhinitis among Iranian Children: A Systematic Review and Meta-Analysis

Endocrine Metabolic & Immune Disorders - Drug Targets ◽

10.2174/1871530319666190515100735 ◽

2020 ◽

Vol 20 (2) ◽

pp. 189-197

Author(s):

Rasoul N. Kalmarzi ◽

Pedram Ataee ◽

Asadollah Fathollahpour ◽

Masoud Behzadifar ◽

Maryam Moradi ◽

...

Keyword(s):

Systematic Review ◽

Allergic Rhinitis ◽

Children And Adolescents ◽

Publication Bias ◽

Meta Analysis ◽

Scientific Information ◽

Educational Strategies ◽

Common Chronic Disease ◽

Iranian Children ◽

Meta Analyses

Background: The prevalence of allergic rhinitis in the world is 10-15%, and it is currently the most common chronic disease among children. There is no comprehensive statistics about the prevalence of allergic rhinitis among Iranian children, therefore, this systematic review and metaanalysis was conducted to evaluate the prevalence of allergic rhinitis among the Iranian children. Methods: The present study was conducted based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. The data was collected using key words including allergic rhinitis, prevalence, epidemiology, child OR children, pediatrics and Iran, in international databases including PubMed, Scopus, Web of Science, Cochrane, Embase, and three national databases including Magiran, Iran Medex, and Scientific Information Databank (SID) till December 2018. The STROBE checklist was used for quality assessment. The data were analyzed using STATA software version 12.1. Results: The prevalence of allergic rhinitis in children and adolescents were 18% (99.7% CI: 10-28% with publication bias of 0.174) and 25% (99.8% CI: 17-33 with publication bias of 0.617) respectively. The prevalence of allergic rhinitis in males was estimated to be 27% (99.4% CI: 17-36) with publication bias of 0.538 and in females was 23% (99.4% CI: 14-31) with publication bias of 0.926. Conclusion: The prevalence of allergic rhinitis is approximately high among Iranian children and adolescents; thus, educational strategies should be considered to decrease the prevalence of this disease in Iran.

Download Full-text