Meta-analysis and the Scientific Method

2017 ◽  
pp. 43-50
Author(s):  
Ton J. Cleophas ◽  
Aeilko H. Zwinderman
1989 ◽  
Vol 5 (4) ◽  
pp. 521-536 ◽  
Author(s):  
Thomas C. Chalmers ◽  
Peg Hewett ◽  
Dinah Reitman ◽  
Henry S. Sacks

Technology assessment involves application of the scientific method to the practice of medicine. Finding all of the assessment reports in a given field is not an easy task. Proper evaluation of those assessments requires the conduct of a prospective experiment in which the sources and results are blinded when the choice is made of papers to exclude and to include, and the process should be carried in duplicate. There are several available data bases for carrying out the search, but because of problems they should be supplemented by reference to the bibliographies of pertinent published articles. Clinical trials included in meta-analyses should be graded by quality and thus facilitate sensitivity analyses. Attention must be paid to the possibility of publication bias. Finally, the advent of meta-analysis makes it desirable to begin randomized controlled trials in areas of uncertainty, even when there is no possibility that individual investigators will encounter enough patients to draw valid conclusions.


2020 ◽  
Author(s):  
Robert A. Hahn ◽  
Steven M. Teutsch

AbstractFailure to routinely assess the state of knowledge as new studies accumulate results in 1) non-use of effective interventions, 2) continued use of ineffective or harmful interventions, and 3) unnecessary research. We use a published cumulative meta-analysis of interventions to reduce the harms of acute myocardial infarctions (1966-1992), and applied population attributable risk to assess the mortality consequences of the failure to cumulatively assess the state of knowledge. Failure to use knowledge that would have been available with cumulative meta-analysis may have resulted in annual estimated mortality: 41,000 deaths from non-use of intravenous dilators, 35,000 deaths from non-use of aspirin, and 37,000 deaths annually from non-use of ß-blockers. Continued use of Class 1 anti-arrhythmic drugs, which would have been found to be harmful in 1981, resulted 39,000 deaths annually. Failure to routinely update the state knowledge can have large health consequences. The process of building knowledge and practice in medicine and public health needs fundamental revision.


CHEST Journal ◽  
2000 ◽  
Vol 118 (3) ◽  
pp. 832-834 ◽  
Author(s):  
Rodrigo Arriagada ◽  
Jean-Pierre Pignon

Author(s):  
Rubén López-Nicolás ◽  
José Antonio López-López ◽  
María Rubio-Aparicio ◽  
Julio Sánchez-Meca

AbstractMeta-analysis is a powerful and important tool to synthesize the literature about a research topic. Like other kinds of research, meta-analyses must be reproducible to be compliant with the principles of the scientific method. Furthermore, reproducible meta-analyses can be easily updated with new data and reanalysed applying new and more refined analysis techniques. We attempted to empirically assess the prevalence of transparency and reproducibility-related reporting practices in published meta-analyses from clinical psychology by examining a random sample of 100 meta-analyses. Our purpose was to identify the key points that could be improved, with the aim of providing some recommendations for carrying out reproducible meta-analyses. We conducted a meta-review of meta-analyses of psychological interventions published between 2000 and 2020. We searched PubMed, PsycInfo and Web of Science databases. A structured coding form to assess transparency indicators was created based on previous studies and existing meta-analysis guidelines. We found major issues concerning: completely reproducible search procedures report, specification of the exact method to compute effect sizes, choice of weighting factors and estimators, lack of availability of the raw statistics used to compute the effect size and of interoperability of available data, and practically total absence of analysis script code sharing. Based on our findings, we conclude with recommendations intended to improve the transparency, openness, and reproducibility-related reporting practices of meta-analyses in clinical psychology and related areas.


2021 ◽  
Author(s):  
Rubén López-Nicolás ◽  
José A López-López ◽  
María Rubio Aparicio ◽  
Julio Sánchez-Meca

Meta-analysis is a powerful and important tool to synthesize the literature about a research topic. Like other kinds of research, meta-analyses must be reproducible to be compliant with the principles of the scientific method. Furthermore, reproducible meta-analyses can be easily updated with new data and reanalysed applying new and more refined analysis techniques. We attempted to empirically assess the prevalence of transparency and reproducibility-related reporting practices in published meta-analyses from clinical psychology by examining a random sample of 100 meta-analyses. Our purpose was to identify the key points that could be improved with the aim to provide some recommendations to carry out reproducible meta-analyses. We conducted a meta-review of meta-analyses of psychological interventions published between 2000 and 2019. We searched PubMed, PsycInfo and Web of Science databases. A structured coding form to assess transparency indicators was created based on previous studies and existing meta-analysis guidelines. We found major issues concerning: completely reproducible search procedures report, specification of the exact method to compute effect sizes, choice of weighting factors and estimators, lack of availability of the raw statistics used to compute the effect size and of interoperability of available data, and practically total absence of analysis script code sharing. Based on our findings, we conclude with recommendations intended to improve the transparency, openness and reproducibility-related reporting practices of meta-analyses in clinical psychology and related areas.


2021 ◽  
Author(s):  
Yali Wei ◽  
Yan Meng ◽  
Na Li ◽  
Qian Wang ◽  
Liyong Chen

The purpose of the systematic review and meta-analysis was to determine if low-ratio n-6/n-3 long-chain polyunsaturated fatty acid (PUFA) supplementation affects serum inflammation markers based on current studies.


Sign in / Sign up

Export Citation Format

Share Document