Understanding and Appraising Systematic Reviews and Meta-Analysis

2017 ◽  
Vol 41 (5) ◽  
pp. 317-326 ◽  
Author(s):  
Neeti Mittal ◽  
Manoj Goyal ◽  
Parteek K Mittal

Systematic reviews and meta-analysis seek to answer a pre-framed research question to lead to a valid answer through a systematic, explicit and reproducible method of locating; identifying, including and appraising appropriate trials. The results are synthesized considering the methodological rigor of included trials. While the meta-analysis quantitatively pools the results from individual included studies, the systematic review summarizes the findings as qualitative conclusions. These reviews are crux of evidence based dentistry for various stake-holders, i.e., clinicians, researchers and policy-makers. Although the meticulous methodology of systematic review and meta-analysis minimizes the elements of bias, yet the validity and reliability of their findings should be explored prior to translating their conclusions to practice. The goal of this paper is to familiarize readers with rationale, conduct and appraisal of systematic review and meta-analysis. Further, guidance is provided on tracing potential elements of bias in the review to enable readers to judge the quality of evidence generated from the review.

BMJ Open ◽  
2019 ◽  
Vol 9 (3) ◽  
pp. e027218 ◽  
Author(s):  
Johanna Katharina Hohls ◽  
Hans-Helmut König ◽  
Eleanor Quirke ◽  
André Hajek

IntroductionEvidence from individual longitudinal studies suggests that anxiety and depression may impact quality of life. However, systematic reviews synthesising current evidence have mainly focused on specific samples. Thus, the aim of this study is to synthesise evidence from longitudinal studies on the association between anxiety, depression and quality of life in a systematic review.Methods and analysisA systematic review of evidence from longitudinal studies analysing the association between anxiety, depression and quality of life will be conducted, taking into account the current Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines. Several electronic databases from relevant fields of research (PubMed, PsycINFO, PSYNDEX, EconLit, NHS EED) will be searched in September 2018 using defined search terms, with an updated search planned. Moreover, reference lists of included studies will be searched manually. Study eligibility will be appraised in a two-step process against pre-defined inclusion/exclusion criteria. Primarily, information on study design and assessment, statistical methods, participant characteristics as well as results regarding our research question will be extracted. The quality of included studies will be assessed using an appropriate tool. Study selection, data extraction and assessment of study quality will be performed by two reviewers. Disagreements will be resolved through discussion or by inclusion of a third party. Results will be synthesised narratively in text and tables. Depending on the number and heterogeneity of the studies included, a meta-analysis will be performed.Ethics and disseminationAs no primary data will be collected, approval from an ethics committee is not required. Results will be disseminated through conference presentations and publication in a peer-reviewed, scientific journal.PROSPERO registration numberCRD42018108008.


BMJ Open ◽  
2021 ◽  
Vol 11 (10) ◽  
pp. e045819
Author(s):  
Jinhui Ma ◽  
Megan Cheng ◽  
Lehana Thabane ◽  
Caihong Ma ◽  
Ning Zhang ◽  
...  

IntroductionThe aetiology of sleep disruptions is unknown, but hormonal fluctuations during the menstrual cycle, pregnancy and menopause have been shown to potentially affect how well a woman sleeps. The aim of this systematic review was to investigate whether hormonal contraceptives are associated with a decreased quality of sleep and increased sleep duration in women of reproductive age.MethodsThis review will analyse data from randomised controlled trials or non-randomised comparative studies investigating the association between hormonal contraceptives and sleep outcomes among women of reproductive age. Reviews addressing the same research question with similar eligibility criteria will be included. A literature search will be performed using the MEDLINE, Embase and Cochrane Central Register of Controlled Trials databases from inception to 7 March 2021. The Cochrane Collaboration’s Risk of Bias for Randomised Trials V.2.0 and The Risk of Bias for Non-randomised Studies of Interventions tool will be used to assess risk of bias for each outcome in eligible studies. Two reviewers will independently assess eligibility of studies and risk of bias and extract the data. All extracted data will be presented in tables and narrative form. For sleep measures investigated by two or more studies with low heterogeneity, we will conduct random-effects meta-analysis to estimate the magnitude of the overall effect of hormonal contraceptives. If studies included in this systematic review form a connected network, a network meta-analysis will be conducted to estimate the comparative effect of different contraceptives. The Grading of Recommendations, Assessment, Development, and Evaluation approach will be used to summarise the quality of evidence. Our protocol follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols 2015 guidelines.Ethics and disseminationEthics approval is not required as data were sourced from previously reported studies. The findings of this review will be published in a peer-reviewed journal and presented at relevant conferences.PROSPERO registration numberCRD42020199958.


2020 ◽  
Author(s):  
Tahereh Mokhtarian-Gilani ◽  
Nourossadat kariman ◽  
Hamid Sharif-Nia ◽  
Mahbobeh Ahmadi-Doulabi ◽  
Malihe Nasiri

Abstract Background:The postpartum quality of life refers to women's understanding of their standing in the postpartum crisis that differs depending on their health status, social support, cultural status and values, attitudes, goals and standards. The present systematic review will identify, describe, and critically assess the psychometric properties of postpartum quality of life questionnaires.Methods/Design:A systematic review will be conducted in databases including PubMed, Embase, Scopus, Web of Science, PsycINFO, and CINAHL from January 2000 to January 2020. The psychometric properties (validity and reliability) of the instruments used in the primary studies will be assessed, and the selection, methodological quality assessment and data extraction processes of the studies will be independently assessed by two reviewers with expertise in conducting systematic reviews, so as to minimize potential personal bias. Eligible resources are selected after any lack of consensus is put to debate.The risk of bias is assessed using the COSMIN RISK of Bias checklist, and to evaluate the quality of the studies, the protocol is written based on the PRISMA-P1 standards. The results of the studies will be judged based on good measurement properties, and the results of all the studies are qualitatively summarized to produce a reference for the general quality of the results. The general quality of the evidence will be determined using a modified GRADE method.Discussion:This study assessed the psychometric properties of questionnaires used for assessing postpartum quality of life and its results can be used to identify the most appropriate tool for health applications in measuring postpartum quality of life. Systematic review registration: reference number in PROSPRO CRD42020166301


2020 ◽  
pp. 219256822090681 ◽  
Author(s):  
Muthu Sathish ◽  
Ramakrishnan Eswar

Study Design: Systematic review. Objectives: To assess the methodological quality of systematic reviews and meta-analyses in spine surgery over the past 2 decades. Materials and Methods: We conducted independent and in duplicate systematic review of the published systematic reviews and meta-analyses between 2000 and 2019 from PubMed Central and Cochrane Database pertaining to spine surgery involving surgical intervention. We searched bibliographies to identify additional relevant studies. Methodological quality was evaluated with AMSTAR score and graded with AMSTAR 2 criteria. Results: A total of 96 reviews met the eligibility criteria, with mean AMSTAR score of 7.51 (SD = 1.98). Based on AMSTAR 2 criteria, 13.5% (n = 13) and 18.7% (n = 18) of the studies had high and moderate level of confidence of results, respectively, without any critical flaws. A total of 29.1% (n = 28) of the studies had at least 1 critical flaw and 38.5% (n = 37) of the studies had more than 1 critical flaw, so that their results have low and critically low confidence, respectively. Failure to analyze the conflict of interest of authors of primary studies included in review and lack of list of excluded studies with justification were the most common critical flaw. Regression analysis demonstrated that studies with funding and studies published in recent years were significantly associated with higher methodological quality. Conclusion: Despite improvement in methodological quality of systematic reviews and meta-analyses in spine surgery in current decade, a substantial proportion continue to show critical flaws. With increasing number of review articles in spine surgery, stringent measures must be taken to adhere to methodological quality by following PRISMA and AMSTAR guidelines to attain higher standards of evidence in published literature.


2017 ◽  
Vol 11 (1) ◽  
pp. 15-30 ◽  
Author(s):  
Debajyoti Pati ◽  
Lesa N. Lorusso

This article provides a step-by-step approach to conducting and reporting systematic literature reviews (SLRs) in the domain of healthcare design and discusses some of the key quality issues associated with SLRs. SLR, as the name implies, is a systematic way of collecting, critically evaluating, integrating, and presenting findings from across multiple research studies on a research question or topic of interest. SLR provides a way to assess the quality level and magnitude of existing evidence on a question or topic of interest. It offers a broader and more accurate level of understanding than a traditional literature review. A systematic review adheres to standardized methodologies/guidelines in systematic searching, filtering, reviewing, critiquing, interpreting, synthesizing, and reporting of findings from multiple publications on a topic/domain of interest. The Cochrane Collaboration is the most well-known and widely respected global organization producing SLRs within the healthcare field and a standard to follow for any researcher seeking to write a transparent and methodologically sound SLR. Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA), like the Cochrane Collaboration, was created by an international network of health-based collaborators and provides the framework for SLR to ensure methodological rigor and quality. The PRISMA statement is an evidence-based guide consisting of a checklist and flowchart intended to be used as tools for authors seeking to write SLR and meta-analyses.


2014 ◽  
Vol 34 (5) ◽  
pp. 737-742 ◽  
Author(s):  
Emily S Sena ◽  
Gillian L Currie ◽  
Sarah K McCann ◽  
Malcolm R Macleod ◽  
David W Howells

The use of systematic review and meta-analysis of preclinical studies has become more common, including those of studies describing the modeling of cerebrovascular diseases. Empirical evidence suggests that too many preclinical experiments lack methodological rigor, and this leads to inflated treatment effects. The aim of this review is to describe the concepts of systematic review and meta-analysis and consider how these tools may be used to provide empirical evidence to spur the field to improve the rigor of the conduct and reporting of preclinical research akin to their use in improving the conduct and reporting of randomized controlled trials in clinical research. As with other research domains, systematic reviews are subject to bias. Therefore, we have also suggested guidance for their conduct, reporting, and critical appraisal.


2019 ◽  
Vol 2 (2) ◽  
pp. 50-57
Author(s):  
Amanda Yang Shen ◽  
Robert S Ware ◽  
Tom J O'Donohoe ◽  
Jason Wasiak

Background: An increasing number of systematic reviews are published on an annual basis. Although perusal of the full text of articles is preferable, abstracts are sometimes relied upon to guide clinical decisions. Despite this, the abstracts of systematic reviews have historically been poorly reported. We evaluated the reporting quality of systematic review abstracts within hand and wrist pathology literature. Methods: We searched MEDLINE®, EMBASE and Cochrane Library from inception to December 2017 for systematic reviews in hand and wrist pathology using the 12-item PRISMA-A checklist to assess abstract reporting quality. Results: A total of 114 abstracts were included. Most related to fracture (38%) or arthritis (17%) management. Forty-seven systematic reviews (41%) included meta-analysis. Mean PRISMA-A score was 3.6/12 with Cochrane reviews having the highest mean score and hand-specific journals having the lowest. Abstracts longer than 300 words (mean difference [MD]: 1.43, 95% CI [0.74, 2.13]; p <0.001) and systematic reviews with meta-analysis (MD: 0.64, 95% CI [0.05, 1.22]; p = 0.034) were associated with higher scores. Unstructured abstracts were associated with lower scores (MD: –0.65, 95% CI [–1.28, –0.02]; p = 0.044). A limitation of this study is the possible exclusion of relevant studies that were not published in the English language. Conclusion: Abstracts of systematic reviews pertaining to hand and wrist pathology have been suboptimally reported as assessed by the PRISMA-A checklist. Improvements in reporting quality could be achieved by endorsement of PRISMA-A guidelines by authors and journals, and reducing constraints on abstract length.


2020 ◽  
Author(s):  
Alireza Bagherzadeh Karimi ◽  
Asghar Elmi ◽  
Mojgan Mirghafourvand ◽  
Roghyeh Baghervand Navid

Abstract Background: The rate of cesarean section is increasing in all over the world with different drafts in various countries. This growth increases unpleasant outcomes of delivery. Recent studies explained the benefits of date palm fruit on labor process improvement. Date fruit can be considered as a factor for increasing vaginal delivery and also reducing the frequency of caesarean section in order to prevent its great complications. This systematic review has been designed to review clinical studies that investigate the effects of date palm fruit on labor outcomes (duration of labor stages, bishop score, and frequency of cesarean section) compared with routine cares. Methods: This study was performed in 2019. Required data has been collected from electronic databases and manual searches. All randomized clinical trials evaluating the effects of date palm fruit on labor and delivery that were published from January 2000 to August 2019 in English and Persian languages, were incorporated in this systematic review. The methodological quality of the included studies was evaluated according to the risk of bias assessment of Cochrane handbook of systematic reviews, and were then reported using Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. Results: Eight studies were included in the qualitative and quantitative synthesis. Meta-Analysis showed that date fruit consumption can significantly reduce active phase of labor (three trials with 380 participants; (MD= -109.3, 95%CI (-196.32, -22.29; I2=89%), P=0.01), and also it can significantly improve the bishop score (two trials with 320 participants; MD = 2.45, 95%CI (1.87, 3.04; I2=0%), P<0.00001). Date fruit consumption had no effects on the duration of first, second, and third stages of labor, and the frequency of cesarean section. Conclusion: Date can reduce the duration of active phase and improve the bishop score; however, due to from the low to mediate quality of the studies; it seems that the other studies are needed to prove these results better than this.


2008 ◽  
Vol 5;12 (5;9) ◽  
pp. 819-850
Author(s):  
Laxmaiah Manchikanti

Observational studies provide an important source of information when randomized controlled trials (RCTs) cannot or should not be undertaken, provided that the data are analyzed and interpreted with special attention to bias. Evidence-based medicine (EBM) stresses the examination of evidence from clinical research and describes it as a shift in medical paradigm, in contrast to intuition, unsystematic clinical experience, and pathophysiologic rationale. While the importance of randomized trials has been created by the concept of the hierarchy of evidence in guiding therapy, much of the medical research is observational. The reporting of observational research is often not detailed and clear enough with insufficient quality and poor reporting, which hampers the assessment of strengths and weaknesses of the study and the generalizability of the mixed results. Thus, in recent years, progress and innovations in health care are measured by systematic reviews and meta-analyses. A systematic review is defined as, “the application of scientific strategies that limit bias by the systematic assembly, clinical appraisal, and synthesis of all relevant studies on a specific topic.” Meta-analysis usually is the final step in a systematic review. Systematic reviews and meta-analyses are labor intensive, requiring expertise in both the subject matter and review methodology, and also must follow the rules of EBM which suggests that a formal set of rules must complement medical training and common sense for clinicians to integrate the results of clinical research effectively. While expertise in the review methods is important, the expertise in the subject matter and technical components is also crucial. Even though, systematic reviews and meta-analyses, specifically of RCTs, have exploded, the quality of the systematic reviews is highly variable and consequently, the opinions reached of the same studies are quite divergent. Numerous deficiencies have been described in methodologic assessment of the quality of the individual articles. Consequently, observational studies can provide an important complementary source of information, provided that the data are analyzed and interpreted in the context of confounding bias to which they are prone. Appropriate systematic reviews of observational studies, in conjunction with RCTs, may provide the basis for elimination of a dangerous discrepancy between the experts and the evidence. Steps in conducting systematic reviews of observational studies include planning, conducting, reporting, and disseminating the results. MOOSE, or Meta-analysis of Observational Studies in Epidemiology, a proposal for reporting contains specifications including background, search strategy, methods, results, discussion, and conclusion. Use of the MOOSE checklist should improve the usefulness of meta-analysis for authors, reviewers, editors, readers, and decision-makers. This manuscript describes systematic reviews and meta-analyses of observational studies. Authors frequently utilize RCTs and observational studies in one systematic review; thus, they should also follow the reporting standards of the Quality of Reporting of Meta-analysis (QUOROM) statement, which also provides a checklist. A combined approach of QUOROM and MOOSE will improve reporting of systematic reviews and lead to progress and innovations in health care. Key words: Observational studies, evidence-based medicine, systematic reviews, metaanalysis, randomized trials, case-control studies, cross-sectional studies, cohort studies, confounding bias, QUOROM, MOOSE


Sign in / Sign up

Export Citation Format

Share Document