scholarly journals A Reporting Quality Assessment of Systematic Reviews and Meta-Analyses in Sports Physical Therapy: A Review of Reviews

Healthcare ◽  
2021 ◽  
Vol 9 (10) ◽  
pp. 1368
Author(s):  
Sung-Hyoun Cho ◽  
In-Soo Shin

This review of reviews aimed to evaluate the reporting quality of published systematic reviews and meta-analyses in the field of sports physical therapy using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. This review of reviews included a literature search; in total, 2047 studies published between January 2015 and December 2020 in the top three journals related to sports physical therapy were screened. Among the 125 identified articles, 47 studies on sports physical therapy were included in the analysis (2 systematic reviews and 45 meta-analyses). There were several problems areas, including a lack of reporting for key components of the structured summary (10/47, 21.3%), protocol and registration (18/47, 38.3%), risk of bias in individual studies (28/47, 59.6%), risk of bias across studies (24/47, 51.1%), effect size and variance calculations (5/47, 10.6%), additional analyses (25/47, 53.2%), and funding (10/47, 21.3%). The quality of the reporting of systematic reviews and meta-analyses of studies on sports physical therapy was low to moderate. For better evidence-based practice in sports physical therapy, both authors and readers should examine assumptions in more detail, and report valid and adequate results. The PRISMA guideline should be used more extensively to improve reporting practices in sports physical therapy.

2020 ◽  
Vol 2020 ◽  
pp. 1-19
Author(s):  
Zipan Lyu ◽  
Zhongyu Huang ◽  
Fengbin Liu ◽  
Zhengkun Hou

Objective. To access the methodological and reporting quality of systematic reviews (SRs)/meta-analyses (MAs) about Chinese medical treatment for gastroesophageal reflux disease (GERD). Methods. The PubMed, Wanfang Data, China National Knowledge Infrastructure (CNKI), Chinese Science and Technology Periodical Database (VIP), Chinese Biomedical (CBM), Web of Science, and Cochrane Library databases were searched from inception to June 2020. Two researchers independently screened the literature considering the eligibility criteria. Overview Quality Assessment Questionnaire (OQAQ), Assessment of Multiple Systematic Reviews 2 (AMSTAR 2), and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were used to assess the methodological and reporting quality of the included reports. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) system was used to evaluate the level of evidence in each report. Results. Thirty-three SRs/MAs met the inclusion criteria. The OQAQ results showed that defects in the methodological quality of 17/32 reports were major, with scores of 3 points. Analyzing a single item as the object, search strategies (item 2), and risk of bias in individual studies (item 4) was considered poor. The AMSTAR 2 results showed that 25.4% of the items were not reported, and 7.8% of the items were only partially reported. The overall assessment of AMSTAR 2 showed the majority of systematic reviews and meta-analyses were of low/very low (31/33, 93.9%) methodological quality, with a lack of protocol registration and excluded study list. The PRISMA results showed that 19.9% of items were not reported, and 15.2% of items were only partially reported, due to a lack of protocol registration and study selection methods. The methodological and reporting quality of the included studies was generally poor. Evidence evaluation with GRADE showed that most (31/33) of the included studies had low or very low levels of evidence. Conclusion. The methodological and reporting quality of SRs/MAs about Chinese medical treatment for GERD is generally poor. The main problems included incomplete search strategies, risk of bias in individual studies, the lack of protocol registration and excluded study list, and incorrect study selection methods.


2021 ◽  
Vol 8 ◽  
Author(s):  
Jinke Huang ◽  
Xiaohui Qin ◽  
Min Shen ◽  
Yanjuan Xu ◽  
Yong Huang

Background: Tai chi (TC) is a popular form of exercise among adults with chronic heart failure (CHF), yet services are greatly underutilized. The aim of the current study was to identify and summarize the existing evidence and to systematically determine the clinical effectiveness of Tai Chi in the management of CHF using a systematic overview.Methods: Both English and Chinese databases were searched for systematic reviews (SRs)/meta-analyses (MAs) on TC for CHF from their inception to June 2020. The methodological quality, reporting quality, and risk of bias of SRs/MAs were assessed using Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist, and Risk of Bias in Systematic reviews (ROBIS), respectively. The evidence quality of outcome measures was assessed by the Grades of Recommendations, Assessment, Development and Evaluation (GRADE).Results: Six SRs/MAs using a quantitative synthesis to assess various outcomes of TC in CHF were included in this overview. The methodological quality, reporting quality and risk of bias of the SRs/MAs and the evidence quality of the outcome measures are generally unsatisfactory. The limitations of the past SRs/MAs included the lack of either the protocol or registration, the list of excluded studies, and the computational details of meta-analysis were inadequately reported. The critical problems were that qualitative data synthesis relied on trials with small sample sizes and critical low quality.Conclusions: TC may be a promising complementary treatment for CHF. However, further rigorous and comprehensive SRs/MAs and RCTs are required to provide robust evidence for definitive conclusions.


2021 ◽  
Vol 12 ◽  
Author(s):  
Jie Zhang ◽  
Qianying Yu ◽  
Li Peng ◽  
Yuesi Qin ◽  
Mingyi Jing ◽  
...  

Background: In recent years, systematic reviews/meta-analyses (SRs/MAs) of Chinese herbal medicine (CHM) for psoriasis have continuously emerged. Their methods and evidence quality, however, are yet to be evaluated, and whether their conclusions can provide clinicians with reliable evidence is still debatable.Objectives: This overview aims to evaluate the methodological quality, risk of bias, and reporting quality of relevant SRs/MAs, as well as the current evidence of CHM for treating psoriasis.Methods: We searched nine electronic databases from their respective time of establishment to January 20, 2021, as well as the reference lists of the included SRs/MAs, protocol registries, and gray literature. Two reviewers independently used the following: A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, Risk of Bias in Systematic Reviews (ROBIS), the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA), and Grades of Recommendations, Assessment, Development and Evaluation (GRADE) to evaluate the methodological quality, risk of bias, reporting quality, and evidence quality of the included SRs/MAs.Results: This review included 14 SRs/MAs involving 45 outcomes, of which 12 (85.71%) SRs/MAs had a very low quality evaluated by AMSTAR 2 and 7 (50.00%) SRs/MAs had a high risk of bias assessed by ROBIS. The protocol and registration and funding statements were the major reporting flaws according to the PRISMA checklist. The evaluation with the GRADE system demonstrated no outcome of high-quality evidence, and inconsistent efficacy evaluations were found in this overview. Only 15 (33.33%) outcomes were moderate-quality evidence, supporting the claim that CHM plus Western medicine (WM) was superior to WM. Generally low quality of evidence showed no difference in the incidence of adverse events between the combined therapy and WM. However, the conclusion that CHM was superior to WM cannot be drawn due to the inconsistent results.Conclusion: Despite that CHM has the potential benefit and safety in the adjuvant treatment of psoriasis, the conclusion should be treated with caution because of the generally low quality of methodology and evidence. In the future, high-quality randomized controlled trials (RCTs) should be carried out, and the quality of relevant SRs should also be improved to promote their clinical application.


Author(s):  
Evelien Gielen ◽  
David Beckwée ◽  
Andreas Delaere ◽  
Sandra De Breucker ◽  
Maurits Vandewoude ◽  
...  

Abstract Context Sarcopenia is a progressive and generalized skeletal muscle disorder associated with an increased risk of adverse outcomes such as falls, disability, and death. The Belgian Society of Gerontology and Geriatrics has developed evidence-based guidelines for the prevention and treatment of sarcopenia. This umbrella review presents the results of the Working Group on Nutritional Interventions. Objective The aim of this umbrella review was to provide an evidence-based overview of nutritional interventions targeting sarcopenia or at least 1 of the 3 sarcopenia criteria (ie, muscle mass, muscle strength, or physical performance) in persons aged ≥ 65 years. Data sources Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, the PubMed and Web of Science databases were searched for systematic reviews and meta-analyses reporting the effect of nutritional supplementation on sarcopenia or muscle mass, strength, or physical performance. Data extraction Two authors extracted data on the key characteristics of the reviews, including participants, treatment, and outcomes. Methodological quality of the reviews was assessed using the product A Measurement Tool to Assess Systematic Reviews. Three authors synthesized the extracted data and generated recommendations on the basis of an overall synthesis of the effects of each intervention. Quality of evidence was rated with the Grading of Recommendations Assessment, Development and Evaluation approach. Data analysis A total of 15 systematic reviews were included. The following supplements were examined: proteins, essential amino acids, leucine, β-hydroxy-β-methylbutyrate, creatine, and multinutrient supplementation (with or without physical exercise). Because of both the low amount and the low to moderate quality of the reviews, the level of evidence supporting most recommendations was low to moderate. Conclusions Best evidence is available to recommend leucine, because it has a significant effect on muscle mass in elderly people with sarcopenia. Protein supplementation on top of resistance training is recommended to increase muscle mass and strength, in particular for obese persons and for ≥ 24 weeks. Effects on sarcopenia as a construct were not reported in the included reviews.


Neurosurgery ◽  
2020 ◽  
Vol 87 (3) ◽  
pp. 435-441 ◽  
Author(s):  
Victor M Lu ◽  
Christopher S Graffeo ◽  
Avital Perry ◽  
Michael J Link ◽  
Fredric B Meyer ◽  
...  

Abstract Systematic reviews and meta-analyses in the neurosurgical literature have surged in popularity over the last decade. It is our concern that, without a renewed effort to critically interpret and appraise these studies as high or low quality, we run the risk of the quality and value of evidence-based medicine in neurosurgery being misinterpreted. Correspondingly, we have outlined 4 major domains to target in interpreting neurosurgical systematic reviews and meta-analyses based on the lessons learned by a collaboration of clinicians and academics summarized as 4 pearls. The domains of (1) heterogeneity, (2) modeling, (3) certainty, and (4) bias in neurosurgical systematic reviews and meta-analyses were identified as aspects in which the authors’ approaches have changed over time to improve robustness and transparency. Examples of how and why these pearls were adapted were provided in areas of cranial neuralgia, spine, pediatric, and neuro-oncology to demonstrate how neurosurgical readers and writers may improve their interpretation of these domains. The incorporation of these pearls into practice will empower neurosurgical academics to effectively interpret systematic reviews and meta-analyses, enhancing the quality of our evidence-based medicine literature while maintaining a critical focus on the needs of the individual patients in neurosurgery.


2015 ◽  
Vol 2015 ◽  
pp. 1-8 ◽  
Author(s):  
Xiaoxia Zhang ◽  
Hui Wang ◽  
Yanxu Chang ◽  
Yuefei Wang ◽  
Xiang Lei ◽  
...  

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA).Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA.Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored.Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.


2018 ◽  
Vol 157 (04) ◽  
pp. 392-399
Author(s):  
Sebastian Scheidt ◽  
Patrick Vavken ◽  
Cornelius Jacobs ◽  
Sebastian Koob ◽  
Davide Cucchi ◽  
...  

AbstractThe rising number of medical publications makes it difficult to keep up-to-date on scientific knowledge. In recent years, reviews in the form of narrative or systematic publications and meta-analyses have increased. These can only be interpreted and evaluated if the reader understands the techniques used. This review article describes the differences between narrative and systematic reviews, together with the characteristics of meta-analysis, and discusses their interpretation. The concept of systematic reviews and meta-analysis includes a systematic literature search and summary, together with an appraisal of the quality of the publications. Systematic reviews are often considered to be original studies due to their structure and ability to reduce bias.


2021 ◽  
Vol 8 ◽  
Author(s):  
Min Shen ◽  
Jinke Huang ◽  
Tao Qiu

Background: To systematically appraise and synthesize evidence, we conducted an overview of systematic reviews/meta-analyses (SRs/MAs) on acupuncture for stable angina pectoris (SAP).Methods: Eight databases were searched for SRs/MAs of acupuncture on SAP. The methodological quality, reporting quality, and evidence quality were evaluated by Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist, and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system, respectively.Results: A total of seven published SRs/MAs met the inclusion criteria. According to the evaluation results of AMSTAR-2, two studies were considered as of moderate quality; the remaining five were considered as of very low quality. According to the evaluation results of the PRISMA checklist, only one study reported the checklist in its entirety, while others had reporting deficiencies. According to GRADE, a total of 18 outcome indicators extracted from the included studies were evaluated. The evidence quality was very low in three, low in three, moderate in eight, and high in four.Conclusion: Acupuncture may be beneficial for SAP from the currently published evidence. However, this conclusion must be interpreted cautiously due to the generally low methodological quality, reporting quality, and evidence quality of the included studies. More rigorous, more standardized and comprehensive SRs/MAs are needed to provide strong evidence for convincing conclusions.


Sign in / Sign up

Export Citation Format

Share Document