scholarly journals Assessing robustness against potential publication bias in coordinate based fMRI meta-analyses using the Fail-Safe N

2017 ◽  
Author(s):  
Freya Acar ◽  
Ruth Seurinck ◽  
Simon B. Eickhoff ◽  
Beatrijs Moerkerke
Keyword(s):  
Publication Bias ◽  
Meta Analysis ◽  
Popular Approach ◽  
Analytical Results ◽  
Research Findings ◽  
Meta Analyses ◽  
Fail Safe ◽  
File Drawer ◽  
Cluster Level ◽  
File Drawer Effect

AbstractThe importance of integrating research findings is incontrovertible and coordinate based meta-analyses have become a popular approach to combine results of fMRI studies when only peaks of activation are reported. Similar to classical meta-analyses, coordinate based meta-analyses may be subject to different forms of publication bias which impacts results and possibly invalidates findings. We develop a tool that assesses the robustness to potential publication bias on cluster level. We investigate the possible influence of the file-drawer effect, where studies that do not report certain results fail to get published, by determining the number of noise studies that can be added to an existing fMRI meta-analysis before the results are no longer statistically significant. In this paper we illustrate this tool through an example and test the effect of several parameters through extensive simulations. We provide an algorithm for which code is freely available to generate noise studies and enables users to determine the robustness of meta-analytical results.

scholarly journals Estimating the prevalence of missing experiments in a neuroimaging meta-analysis

2017 ◽  
Author(s):  
Pantelis Samartsidis ◽  
Silvia Montagna ◽  
Angela R. Laird ◽  
Peter T. Fox ◽  
Timothy D. Johnson ◽  
...  
Keyword(s):  
Count Data ◽  
Meta Analysis ◽  
Human Connectome Project ◽  
Meta Analyses ◽  
File Drawer ◽  
Coordinate Data ◽  
File Drawer Effect ◽  
Modelling Approach ◽  
File Drawer Problem

AbstractCoordinate-based meta-analyses (CBMA) allow researchers to combine the results from multiple fMRI experiments with the goal of obtaining results that are more likely to generalise. However, the interpretation of CBMA findings can be impaired by the file drawer problem, a type of publications bias that refers to experiments that are carried out but are not published. Using foci per contrast count data from the BrainMap database, we propose a zero-truncated modelling approach that allows us to estimate the prevalence of non-significant experiments. We validate our method with simulations and real coordinate data generated from the Human Connectome Project. Application of our method to the data from BrainMap provides evidence for the existence of a file drawer effect, with the rate of missing experiments estimated as at least 6 per 100 reported.

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

Emotional intelligence, Personality Variables and Career Adaptability: A Systematic Review and Meta-analysis

2021 ◽  
pp. 097226292198987
Author(s):  
Sakshi Vashisht ◽  
Poonam Kaushal ◽  
Ravi Vashisht
Keyword(s):  
Systematic Review ◽  
Emotional Intelligence ◽  
Publication Bias ◽  
Meta Analysis ◽  
Career Adaptability ◽  
Personality Variables ◽  
Regression Test ◽  
Size Measure ◽  
Fail Safe ◽  
The Relationship

This study conducted a systematic review and meta-analysis to examine the relationship between emotional intelligence, personality variables (Big V personality traits, self-esteem, self-efficacy, optimism and proactive personality) and career adaptability of students. Data were coded on CMA software version 3.0. Product–moment correlation coefficient (r) was considered as the effect size measure for this study. Publication bias was assessed using Egger’s regression test along with Orwin’s fail-safe N, but no significant publication bias was detected. From the results of 54 studies, it was found that all variables of the study had meta-analytic correlation with career adaptability of students. For heterogeneity, subgroup analysis was conducted, and significant differences were found.

scholarly journals Leishmanicidal effects of resveratrol and its derivatives: a systematic review and meta-Analysis

2020 ◽  
Author(s):  
Nasrin Amiri Dashatan ◽  
Marzieh Ashrafmansouri ◽  
Mehdi Koushki ◽  
Nayebali Ahmadi
Keyword(s):  
Systematic Review ◽  
Publication Bias ◽  
Data Extraction ◽  
Meta Analysis ◽  
Sensitivity Analyses ◽  
Protective Effects ◽  
Random Effects Models ◽  
Important Health ◽  
Mean Differences ◽  
Meta Analyses

Abstract Background Leishmaniasis is one of the most important health problems worldwide. The evidence has suggested that resveratrol and its derivatives have anti-leishmanial effects; however, the results are inconsistent and inconclusive. The aim of this study was to assess the effect of resveratrol and its derivatives on the Leishmania viability through a systematic review and meta-analysis of available relevant studies. Methods The electronic databases PubMed, ScienceDirect, Embase, Web of Science and Scopus were queried between October 2000 and April 2020 using a comprehensive search strategy. The eligible articles selected and data extraction conducted by two reviewers. Mean differences of IC50 (concentration leading to reduction of 50% of Leishmania) for each outcome was calculated using random-effects models. Sensitivity analyses and prespecified subgroup were conducted to evaluate potential heterogeneity and the stability of the pooled results. Publication bias was evaluated using the Egger’s and Begg’s tests. We also followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines for this review. Results Ten studies were included in the meta-analysis. We observed that RSV and its derivatives had significant reducing effects on Leishmania viability in promastigote [24.02 µg/ml; (95% CI 17.1, 30.8); P < 0.05; I2 = 99.8%; P heterogeneity = 0.00] and amastigote [18.3 µg/ml; (95% CI 13.5, 23.2); P < 0.05; I2 = 99.6%; P heterogeneity = 0.00] stages of Leishmania. A significant publication bias was observed in the meta-analysis. Sensitivity analyses showed a similar effect size while reducing the heterogeneity. Subgroup analysis indicated that the pooled effects of leishmanicidal of resveratrol and its derivatives were affected by type of stilbenes and Leishmania species. Conclusions Our findings clearly suggest that the strategies for the treatment of leishmaniasis should be focused on natural products such as RSV and its derivatives. Further study is needed to identify the mechanisms mediating this protective effects of RSV and its derivatives in leishmaniasis.

scholarly journals Comparing Bayesian Posterior Passing with Meta-analysis

2020 ◽  
Author(s):  
Joshua Pritsker
Keyword(s):  
Publication Bias ◽  
Fixed Effects ◽  
Meta Analysis ◽  
Future Research ◽  
Meta Analyses

Brand, von der Post, Ounsley, and Morgan (2019) introduced Bayesian posterior passing as an alternative to traditional meta-analyses. In this commentary I relate their procedure to traditional meta-analysis, showing that posterior passing is equivalent to fixed effects meta-analysis. To overcome the limitations of simple posterior passing, I introduce improved posterior passing methods to account for heterogeneity and publication bias. Additionally, practical limitations of posterior passing and the role that it can play in future research are discussed.

scholarly journals Global Burden of Anxiety and Depression among Cystic Fibrosis Patient: Systematic Review and Meta-Analysis

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Mistire Teshome Guta ◽  
Tiwabwork Tekalign ◽  
Nefsu Awoke ◽  
Robera Olana Fite ◽  
Getahun Dendir ◽  
...  
Keyword(s):  
Cystic Fibrosis ◽  
North America ◽  
Publication Bias ◽  
Meta Analysis ◽  
Systemic Review ◽  
Anxiety And Depression ◽  
Close Monitoring ◽  
The World ◽  
Trim And Fill ◽  
Meta Analyses

Aims. This systemic review and meta-analysis were aimed at determining the level of anxiety and depression among cystic fibrosis patients in the world. Methods. We conducted a systematic search of published studies from PubMed, EMBASE, MEDLINE, Cochrane, Scopus, Web of Science, CINAHL, and manually on Google Scholar. This meta-analysis follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The quality of studies was assessed by the modified Newcastle-Ottawa Scale (NOS). Meta-analysis was carried out using a random-effects method using the STATA™ Version 14 software. Trim and fill analysis was done to correct the presence of significant publication bias. Result. From 419,820 obtained studies, 26 studies from 2 different parts of the world including 9766. The overall global pooled prevalence of anxiety and depression after correction for publication bias by trim and fill analysis was found to be 24.91(95% CI: 20.8-28.9) for anxiety. The subgroup analyses revealed with the lowest prevalence, 23.59%, (95% CI: 8.08, 39.09)) in North America and the highest, 26.77%, (95% CI: 22.5, 31.04) seen in Europe for anxiety and with the highest prevalence, 18.67%, (95% CI: 9.82, 27.5) in North America and the lowest, 13.27%, (95% CI: -10.05, 16.5) seen in Europe for depression. Conclusion. The global prevalence of anxiety and depression among cystic fibrosis patients is common. Therefore, close monitoring of the patient, regularly screening for anxiety and depression, and appropriate prevention techniques is recommended.

118 The Use of Meta-analysis in Companion Animal Research

2021 ◽  
Vol 99 (Supplement_3) ◽  
pp. 62-62
Author(s):  
Emma N Bermingham
Keyword(s):  
Body Size ◽  
Statistical Analysis ◽  
Meta Analysis ◽  
Energy Requirements ◽  
Specific Question ◽  
Research Findings ◽  
Adult Cat ◽  
Number Of Publications ◽  
Meta Analyses ◽  
The Three Rs

Abstract In a world of the “Three Rs” (replace, reduce and refine), combined with more research published via open access research journals, there is increasing interest in the statistical analysis of existing literature. Meta-analysis – the combination of multiple studies, can be used to get better oversight into a specific question of interest. Additionally, it can be used to identify gaps in knowledge. For example, while there are a number of publications investigating energy requirements in adult cat and dog, few studies assess older animals. Similarly, in the dog, there is a lack of literature around dogs at the extremes of body size (i.e. giant and toy breeds). Herein, we describe several published examples that have been used to determine energy requirements of cats and dogs, and more recently, the impacts of diet on the microbiome of the cat and dog. This includes the use of Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines, research findings and general findings related to research design and quality.

Effects of the endocrine disruptor vinclozolin in male reproduction: a systematic review and meta-analysis†

2021 ◽  
Author(s):  
Mariana Feijó ◽  
Roberta V L Martins ◽  
Sílvia Socorro ◽  
Luísa Pereira ◽  
Sara Correia
Keyword(s):  
Systematic Review ◽  
Publication Bias ◽  
Meta Analysis ◽  
Endocrine Disrupting Chemicals ◽  
Reproductive Organs ◽  
Male Reproduction ◽  
Mean Differences ◽  
Trim And Fill ◽  
Meta Analyses ◽  
Q Statistic

Abstract Endocrine-disrupting chemicals have become an issue of scientific and public discussion. Vinclozolin (VNZ) is a fungicide that competitively antagonizes the binding of natural androgens to their receptor, disturbing the function of tissues that are sensitive to these hormones, as is the case of the male reproductive organs. A systematic review with meta-analyses of rodent studies was conducted to answer the following question: Does exposure to VNZ affect sperm parameters and testicular/epididymal weight? The methodology was prespecified according to the Cochrane Handbook for Systematic Reviews and PRISMA recommendations. Sixteen articles met the inclusion criteria, comprising a total of 1189 animals. The risk of publication bias was assessed using the Trim and Fill adjustment, funnel plot, and Egger regression test. Heterogeneity and inconsistency across the findings were tested using the Q-statistic and I2 of Higgins, respectively. Sensitivity was also analyzed. Statistical analysis was performed on Comprehensive Meta-Analysis software (Version 2.0), using random models and weighted mean differences along with a 95% confidence interval. Sperm motility, counts, daily sperm production (evidence of publication bias), and epididymis weight were decreased in VNZ-treated animals. Exposure length and dose, as well as the time point of exposure, influenced the obtained results. Despite the moderate/high heterogeneity observed, the sensitivity analysis overall demonstrated the robustness of the findings. The quality scores of the included studies were superior to 4 in a total of 9, then classified as good. The obtained data corroborate the capability of VNZ exposure to disrupt spermatogenic output and compromise male fertility.

The Identification and Prevention of Publication Bias in the Social Sciences and Economics

2011 ◽  
Vol 231 (5-6) ◽  
Author(s):  
Bernd Weiß ◽  
Michael Wagner
Keyword(s):  
Social Sciences ◽  
Missing Data ◽  
Publication Bias ◽  
Meta Analysis ◽  
Statistical Significance ◽  
Empirical Studies ◽  
Systematic Research ◽  
Research Results ◽  
The Social ◽  
Research Findings

SummarySystematic research reviews have become essential in all empirical sciences. However, the validity of research syntheses is threatened by the fact that not all studies on a given topic can be summarized. Research reviews may suffer from missing data, and this is especially crucial in those cases where the selectivity of studies and their findings affects the summarized result. So-called publication bias is a type of missing data and a phenomenon that jeopardizes the validity of systematic or quantitative, as well as narrative, reviews. Publication bias exists if the preparation, submission or publication of research findings depend on characteristics of just these research results, e. g. their direction or statistical significance. This article describes methods to identify publication bias in the context of meta-analysis. It also reviews empirical studies on the prevalence of publication bias, especially in the social and economic sciences, where publication bias also seems to be prevalent. Several proposals to prevent publication bias are discussed.

Is grey literature essential for a better control of publication bias in psychiatry? An example from three meta-analyses of schizophrenia

2005 ◽  
Vol 20 (8) ◽  
pp. 550-553 ◽  
Author(s):  
José Luis R. Martin ◽  
Víctor Pérez ◽  
Montse Sacristán ◽  
Enric Álvarez
Keyword(s):  
Publication Bias ◽  
Systematic Reviews ◽  
Meta Analysis ◽  
Grey Literature ◽  
Risk Of Bias ◽  
Medical Databases ◽  
Study Results ◽  
Heterogeneous Nature ◽  
Meta Analyses ◽  
Literature Material

AbstractSystematic reviews in mental health have become useful tools for health professionals in view of the massive amount and heterogeneous nature of biomedical information available today. In order to determine the risk of bias in the studies evaluated and to avoid bias in generalizing conclusions from the reviews it is therefore important to use a very strict methodology in systematic reviews. One bias which may affect the generalization of results is publication bias, which is determined by the nature and direction of the study results. To control or minimize this type of bias, the authors of systematic reviews undertake comprehensive searches of medical databases and expand on the findings, often undertaking searches of grey literature (material which is not formally published). This paper attempts to show the consequences (and risk) of generalizing the implications of grey literature in the control of publication bias, as was proposed in a recent systematic work. By repeating the analyses for the same outcome from three different systematic reviews that included both published and grey literature our results showed that confusion between grey literature and publication bias may affect the results of a concrete meta-analysis.

Sign in / Sign up

Export Citation Format

Share Document