scholarly journals A Methodological and Reporting Quality Assessment of Systematic Reviews/Meta-Analyses about Chinese Medical Treatment for Gastroesophageal Reflux Disease

2020 ◽  
Vol 2020 ◽  
pp. 1-19
Author(s):  
Zipan Lyu ◽  
Zhongyu Huang ◽  
Fengbin Liu ◽  
Zhengkun Hou
Keyword(s):  
Medical Treatment ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
Selection Methods ◽  
Study Selection ◽  
Protocol Registration ◽  
Meta Analyses

Objective. To access the methodological and reporting quality of systematic reviews (SRs)/meta-analyses (MAs) about Chinese medical treatment for gastroesophageal reflux disease (GERD). Methods. The PubMed, Wanfang Data, China National Knowledge Infrastructure (CNKI), Chinese Science and Technology Periodical Database (VIP), Chinese Biomedical (CBM), Web of Science, and Cochrane Library databases were searched from inception to June 2020. Two researchers independently screened the literature considering the eligibility criteria. Overview Quality Assessment Questionnaire (OQAQ), Assessment of Multiple Systematic Reviews 2 (AMSTAR 2), and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were used to assess the methodological and reporting quality of the included reports. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) system was used to evaluate the level of evidence in each report. Results. Thirty-three SRs/MAs met the inclusion criteria. The OQAQ results showed that defects in the methodological quality of 17/32 reports were major, with scores of 3 points. Analyzing a single item as the object, search strategies (item 2), and risk of bias in individual studies (item 4) was considered poor. The AMSTAR 2 results showed that 25.4% of the items were not reported, and 7.8% of the items were only partially reported. The overall assessment of AMSTAR 2 showed the majority of systematic reviews and meta-analyses were of low/very low (31/33, 93.9%) methodological quality, with a lack of protocol registration and excluded study list. The PRISMA results showed that 19.9% of items were not reported, and 15.2% of items were only partially reported, due to a lack of protocol registration and study selection methods. The methodological and reporting quality of the included studies was generally poor. Evidence evaluation with GRADE showed that most (31/33) of the included studies had low or very low levels of evidence. Conclusion. The methodological and reporting quality of SRs/MAs about Chinese medical treatment for GERD is generally poor. The main problems included incomplete search strategies, risk of bias in individual studies, the lack of protocol registration and excluded study list, and incorrect study selection methods.

scholarly journals The Effects of Tai Chi Exercise Among Adults With Chronic Heart Failure: An Overview of Systematic Review and Meta-Analysis

2021 ◽  
Vol 8 ◽  
Author(s):  
Jinke Huang ◽  
Xiaohui Qin ◽  
Min Shen ◽  
Yanjuan Xu ◽  
Yong Huang
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Tai Chi ◽  
Meta Analysis ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
Quality Reporting ◽  
Evidence Quality ◽  
Meta Analyses

Background: Tai chi (TC) is a popular form of exercise among adults with chronic heart failure (CHF), yet services are greatly underutilized. The aim of the current study was to identify and summarize the existing evidence and to systematically determine the clinical effectiveness of Tai Chi in the management of CHF using a systematic overview.Methods: Both English and Chinese databases were searched for systematic reviews (SRs)/meta-analyses (MAs) on TC for CHF from their inception to June 2020. The methodological quality, reporting quality, and risk of bias of SRs/MAs were assessed using Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist, and Risk of Bias in Systematic reviews (ROBIS), respectively. The evidence quality of outcome measures was assessed by the Grades of Recommendations, Assessment, Development and Evaluation (GRADE).Results: Six SRs/MAs using a quantitative synthesis to assess various outcomes of TC in CHF were included in this overview. The methodological quality, reporting quality and risk of bias of the SRs/MAs and the evidence quality of the outcome measures are generally unsatisfactory. The limitations of the past SRs/MAs included the lack of either the protocol or registration, the list of excluded studies, and the computational details of meta-analysis were inadequately reported. The critical problems were that qualitative data synthesis relied on trials with small sample sizes and critical low quality.Conclusions: TC may be a promising complementary treatment for CHF. However, further rigorous and comprehensive SRs/MAs and RCTs are required to provide robust evidence for definitive conclusions.

scholarly journals Benefits and Safety of Chinese Herbal Medicine in Treating Psoriasis: An Overview of Systematic Reviews

2021 ◽  
Vol 12 ◽  
Author(s):  
Jie Zhang ◽  
Qianying Yu ◽  
Li Peng ◽  
Yuesi Qin ◽  
Mingyi Jing ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
High Quality ◽  
Chinese Herbal ◽  
Evidence Quality ◽  
Meta Analyses ◽  
Quality Evidence

Background: In recent years, systematic reviews/meta-analyses (SRs/MAs) of Chinese herbal medicine (CHM) for psoriasis have continuously emerged. Their methods and evidence quality, however, are yet to be evaluated, and whether their conclusions can provide clinicians with reliable evidence is still debatable.Objectives: This overview aims to evaluate the methodological quality, risk of bias, and reporting quality of relevant SRs/MAs, as well as the current evidence of CHM for treating psoriasis.Methods: We searched nine electronic databases from their respective time of establishment to January 20, 2021, as well as the reference lists of the included SRs/MAs, protocol registries, and gray literature. Two reviewers independently used the following: A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, Risk of Bias in Systematic Reviews (ROBIS), the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA), and Grades of Recommendations, Assessment, Development and Evaluation (GRADE) to evaluate the methodological quality, risk of bias, reporting quality, and evidence quality of the included SRs/MAs.Results: This review included 14 SRs/MAs involving 45 outcomes, of which 12 (85.71%) SRs/MAs had a very low quality evaluated by AMSTAR 2 and 7 (50.00%) SRs/MAs had a high risk of bias assessed by ROBIS. The protocol and registration and funding statements were the major reporting flaws according to the PRISMA checklist. The evaluation with the GRADE system demonstrated no outcome of high-quality evidence, and inconsistent efficacy evaluations were found in this overview. Only 15 (33.33%) outcomes were moderate-quality evidence, supporting the claim that CHM plus Western medicine (WM) was superior to WM. Generally low quality of evidence showed no difference in the incidence of adverse events between the combined therapy and WM. However, the conclusion that CHM was superior to WM cannot be drawn due to the inconsistent results.Conclusion: Despite that CHM has the potential benefit and safety in the adjuvant treatment of psoriasis, the conclusion should be treated with caution because of the generally low quality of methodology and evidence. In the future, high-quality randomized controlled trials (RCTs) should be carried out, and the quality of relevant SRs should also be improved to promote their clinical application.

scholarly journals Quality of the Evidence Supporting the Role of Acupuncture for Stable Angina Pectoris: An Umbrella Review of Systematic Reviews

2021 ◽  
Vol 8 ◽  
Author(s):  
Min Shen ◽  
Jinke Huang ◽  
Tao Qiu
Keyword(s):  
Angina Pectoris ◽  
Systematic Reviews ◽  
Stable Angina ◽  
Methodological Quality ◽  
Reporting Quality ◽  
Stable Angina Pectoris ◽  
Quality Reporting ◽  
Evidence Quality ◽  
Meta Analyses

Background: To systematically appraise and synthesize evidence, we conducted an overview of systematic reviews/meta-analyses (SRs/MAs) on acupuncture for stable angina pectoris (SAP).Methods: Eight databases were searched for SRs/MAs of acupuncture on SAP. The methodological quality, reporting quality, and evidence quality were evaluated by Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist, and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system, respectively.Results: A total of seven published SRs/MAs met the inclusion criteria. According to the evaluation results of AMSTAR-2, two studies were considered as of moderate quality; the remaining five were considered as of very low quality. According to the evaluation results of the PRISMA checklist, only one study reported the checklist in its entirety, while others had reporting deficiencies. According to GRADE, a total of 18 outcome indicators extracted from the included studies were evaluated. The evidence quality was very low in three, low in three, moderate in eight, and high in four.Conclusion: Acupuncture may be beneficial for SAP from the currently published evidence. However, this conclusion must be interpreted cautiously due to the generally low methodological quality, reporting quality, and evidence quality of the included studies. More rigorous, more standardized and comprehensive SRs/MAs are needed to provide strong evidence for convincing conclusions.

P14.71 An assessment of the reporting and methodological quality of meningioma systematic reviews and meta-analyses

2021 ◽  
Vol 23 (Supplement_2) ◽  
pp. ii51-ii52
Author(s):  
A M George ◽  
S Gupta ◽  
S M Keshwara ◽  
M A Mustafa ◽  
C S Gillespie ◽  
...  
Keyword(s):  
Systematic Review ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Meta Analysis ◽  
Neurofibromatosis Type ◽  
Risk Of Bias ◽  
Measurement Tool ◽  
High Quality ◽  
Meta Analyses

Abstract BACKGROUND Systematic reviews and meta-analyses constitute the highest level of research evidence and for a disease with limited clinical trial activity, are often relied upon to help inform clinical practice. This review of reviews evaluates both the reporting & methodological quality of meningioma evidence syntheses. MATERIAL AND METHODS Potentially eligible meningioma reviews published between 1st January 1990 and 31st December 2020 were identified from eight electronic databases. Inclusion required the study to meet the Cochrane guideline definition of a systematic review or meta-analysis. Reviews concerning neurofibromatosis type 2, spinal and pediatric meningiomas were excluded. The reporting and methodological quality of articles were assessed against the following modified guidelines: Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA), A MeaSurement Tool to Assess Systematic Reviews (AMSTAR2) and the Risk of Bias in Systematic Reviews (ROBIS) guidelines. RESULTS 117 systematic reviews were identified, 57 of which included meta-analysis (48.7%). The number of meningioma systematic reviews published each year has increased with 63 studies (53.9%) published between 01/2018 and 12/2020. A median of 17 studies (IQR 9–29) were included per review. Impact factor of journals publishing a systematic review with or without a meta-analysis was similar (median 2.3 vs 1.8, P=0.397). The mean PRISMA scores for systematic reviews with a meta-analysis was 21.11 (SD 4.1, 78% adherence) and without was 13.89 (SD 3.4, 63% adherence). Twenty-nine systematic reviews with meta-analysis (51%) and 11 without meta-analysis (18%) achieved greater than 80% adherence to PRISMA recommendations. Methodological quality assessment using AMSTAR2 revealed one study (0.9%) as high quality whilst 111 (94.8%) studies were graded as critically low. One hundred and two articles (87.2%) did not utilize a comprehensive search strategy as defined by the AMSTAR2 tool. Ninety-nine studies (84.6%) obtained a high level of concern for potential bias as per the ROBIS assessment. One hundred and eight articles (92.3%) failed to present information that a protocol had been established prior to study commencement and 76 articles (65.0%) did not conduct a risk of bias assessment. Across the three tools, domains relating to the establishment of a protocol prior to review commencement and conducting appropriate risk of bias assessments were frequently low scoring. CONCLUSION Overall reporting and methodological quality of meningioma systematic reviews was sub-optimal. Established critical appraisal tools and reporting guidelines should be utilized a priori to assist in producing high-quality systematic reviews.

scholarly journals A Reporting Quality Assessment of Systematic Reviews and Meta-Analyses in Sports Physical Therapy: A Review of Reviews

Healthcare ◽  
2021 ◽  
Vol 9 (10) ◽  
pp. 1368
Author(s):  
Sung-Hyoun Cho ◽  
In-Soo Shin
Keyword(s):  
Physical Therapy ◽  
Systematic Reviews ◽  
Literature Search ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
Evidence Based ◽  
Reporting Practices ◽  
Review Of Reviews ◽  
Meta Analyses

This review of reviews aimed to evaluate the reporting quality of published systematic reviews and meta-analyses in the field of sports physical therapy using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. This review of reviews included a literature search; in total, 2047 studies published between January 2015 and December 2020 in the top three journals related to sports physical therapy were screened. Among the 125 identified articles, 47 studies on sports physical therapy were included in the analysis (2 systematic reviews and 45 meta-analyses). There were several problems areas, including a lack of reporting for key components of the structured summary (10/47, 21.3%), protocol and registration (18/47, 38.3%), risk of bias in individual studies (28/47, 59.6%), risk of bias across studies (24/47, 51.1%), effect size and variance calculations (5/47, 10.6%), additional analyses (25/47, 53.2%), and funding (10/47, 21.3%). The quality of the reporting of systematic reviews and meta-analyses of studies on sports physical therapy was low to moderate. For better evidence-based practice in sports physical therapy, both authors and readers should examine assumptions in more detail, and report valid and adequate results. The PRISMA guideline should be used more extensively to improve reporting practices in sports physical therapy.

Methodological quality and reporting of systematic reviews in hand and wrist pathology

2017 ◽  
Vol 42 (8) ◽  
pp. 852-856 ◽  
Author(s):  
J. Wasiak ◽  
A. Y. Shen ◽  
R. Ware ◽  
T. J. O’Donohoe ◽  
C. M. Faggion
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Reporting Quality ◽  
Assessment Tools ◽  
Cochrane Library ◽  
Measurement Tool ◽  
Level Of Evidence ◽  
Methodological Assessment ◽  
Meta Analyses

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. Level of evidence: I

scholarly journals Methodological Quality Assessment of Systematic Review or Meta-Analysis Using AMSTAR-2: the Long-Term Effectiveness or Efficacy of Opioids for Chronic Non-Cancer Pain

2019 ◽  
Author(s):  
Qian Li ◽  
Ke Deng ◽  
Xiaoyuan Jiang ◽  
Huan Tao ◽  
Hui Liu ◽  
...  
Keyword(s):  
Cancer Pain ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Meta Analysis ◽  
Risk Of Bias ◽  
Cochrane Central Register ◽  
Cochrane Reviews ◽  
Meta Analyses

Abstract Background：Systematic review or meta-analysis, the strong study design of high quality evidence, give inconsistent conclusion of long-term effectiveness or efficacy of opioids for chronic non-cancer pain. We appraised the methodological quality of systematic reviews or meta-analyses. Methods: We found the relevant systematic reviews or meta-analyses by searching Medline, EMBASE, the Cochrane Database of Systematic Reviews, the Cochrane Central Register of Controlled Trials, the International prospective register of systematic reviews, Psyc ARTICLES/OVID, the Chinese Bio-Medical Literature Database, the China National Knowledge Infrastructure, and the Wan Fang Data and VIP Database on March 1st, 2019. The methodological quality was assessed by A Measurement Tool to Assess Systematic Reviews-2(AMSTAR-2). Spearman correlation analysis and non-parametric tests were used to assess the association between quality and factors. Results: Twenty-one systematic reviews or meta-analyses were included in our study. One has no individual study. In terms of methodological quality, twelve reviews were critically low in overall confidence, four reviews were low, two reviews were moderate, two reviews were high. When referring to the systematic reviews or meta-analyses of relatively better methodological quality with more credible results and conclusions, the effectiveness or efficacy of opioids was small to questionable. Cochrane reviews performed better than non-Cochrane reviews in establishing prior protocol (100% vs 17%, P<0.05), providing an excluded studies list (100% vs 50%, P<0.05) and taking risk of bias into account when interpreting the results of the review (100% vs 75%, P<0.05). There was a strong correlation (ρ=0.526, P<0.05) between the impact factor of systematic reviews or meta-analyses in published journals and methodological quality. Conclusion The methodological quality of the included systematic reviews or meta-analyses is far from satisfactory and needs improvement, especially in establishing prior protocol and justifying significant deviations from the protocol, providing an excluded primary studies list, reporting the funding information of primary studies, and assessing the potential impact of risk of bias on individual studies.

scholarly journals Quality of Evidence Supporting the Role of Acupuncture for the Treatment of Irritable Bowel Syndrome

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Jinke Huang ◽  
Mengxiong Lu ◽  
Yijun Zheng ◽  
Jinxin Ma ◽  
Xiangxue Ma ◽  
...  
Keyword(s):  
Irritable Bowel Syndrome ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Reporting Quality ◽  
Current Evidence ◽  
Assessment Development ◽  
Evidence Quality ◽  
Irritable Bowel ◽  
Meta Analyses

Objectives. To systematically collate, appraise, and synthesize the current evidence on acupuncture for irritable bowel syndrome (IBS). Methods. Systematic reviews (SRs)/meta-analyses (MAs) of acupuncture for IBS were searched in eight databases. For quality evaluation of the enrolled studies, Assessment of Multiple Systematic Reviews 2 (AMSTAR-2) was used for methodological quality, Preferred Reporting Item for Systematic Reviews and Meta-Analyses (PRISMA) for reporting quality, and Grading of Recommendations Assessment, Development, and Evaluation (GRADE) for evidence quality. Results. Ten studies were included in our review. According to AMSTAR-2, only one study met all the criteria and was rated as high methodological quality, and the rest were rated as low or very low methodological quality. According to the PRISMA checklist, most of the items were fully reported, with the exception of Q5 (protocol and registration), Q8 (search), and Q27 (funding). With the GRADE system, no outcome measure was rated as high quality. Conclusions. Acupuncture may be a promising therapy for IBS. However, this conclusion must be treated with caution since the quality of SRs/MAs providing evidence is generally low.

Evaluating the quality of systematic reviews and meta-analyses published on direct oral anticoagulants in the past 5 years

2020 ◽  
pp. bmjebm-2019-111326
Author(s):  
Ali Eshaghpour ◽  
Allen Li ◽  
Arshia Pedram Javidan ◽  
Natalie Chen ◽  
Sarah Yang ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Data Extraction ◽  
Oral Anticoagulants ◽  
Direct Oral Anticoagulants ◽  
Reporting Quality ◽  
Treatment And Prevention ◽  
Publication Number ◽  
Meta Analyses

Systematic reviews (SRs) have been reported with increasing frequency as a means of collating studies which may have been performed over different period of times, in different geographical areas and by different groups of investigators. As SRs have become more common, quality metrics such as Assessing the Methodological Quality of Systematic Reviews (AMSTAR) have become available for these reviews. AMSTAR is an 11-point checklist that assesses the methodological and reporting quality of a SR. In clinical practice, direct oral anticoagulants (DOACs) have been increasingly used for the treatment and prevention of both venous and arterial thromboembolism. We sought to evaluate the quality of SRs published on DOACs using the AMSTAR criteria. A comprehensive search of Medline, EMBASE and the Cochrane Database of Systematic Reviews from January 2013 to February 2019 was performed. Two reviewers independently screened titles and abstracts and subsequently full texts for eligibility. Data extraction was also completed in duplicate. Categories of extracted data included AMSTAR rating, journal of publication, year of publication, number of studies included in the SR, reporting adherence to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, number of times the paper was cited and journal impact factor. A total of 3729 articles were identified, of which 250 were eligible for analysis. SR quality was highly variable with mean (SD) AMSTAR score of 5.68/11 (2.21). Reporting adherence to PRISMA guideline correlated with a moderate (5–8) or high quality (9–11) (OR=4.19, p<0.01) AMSTAR score. The methodological quality of DOACs was generally rated to be low-moderate, and improved adherence to AMSTAR methodological practices are strongly recommended.

scholarly journals Acupuncture for the Treatment of Alzheimer's Disease: An Overview of Systematic Reviews

2020 ◽  
Vol 12 ◽  
Author(s):  
Jinke Huang ◽  
Min Shen ◽  
Xiaohui Qin ◽  
Manli Wu ◽  
Simin Liang ◽  
...  
Keyword(s):  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Systematic Reviews ◽  
Methodological Quality ◽  
Risk Of Bias ◽  
High Quality ◽  
Complementary Treatment ◽  
Meta Analyses ◽  
Quality Evidence

Background: Acupuncture may be an effective complementary treatment for Alzheimer's disease (AD). The aim of this study was to summarize the evidence provided by systematic reviews (SRs)/meta-analyses (MAs) on the effect of acupuncture on AD.Methods: Eight electronic databases were searched from their inception until October 19, 2020. The methodological quality, reporting quality, and risk of bias of the included SRs were assessed by the Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2), the Risk of Bias in Systematic Reviews (ROBIS) tool, and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Moreover, the evidence quality of the outcome measures was assessed by the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE).Results: Eleven SRs/MAs met all inclusion criteria. According to the results of the AMSTAR-2, all included reviews were rated critically as being of low quality. With PRISMA, the reporting checklist was relatively complete, but some reporting weaknesses remained in the topics of the protocol and registration, search strategy, risk of bias, additional analyses, and funding. Based on the ROBIS tool, only two SRs/MAs had a low risk of bias. With the GRADE system, no high-quality evidence was found, and only seven outcomes provided moderate-quality evidence. Among the downgraded factors, the risk of bias within the original trials was ranked first, followed by inconsistency, imprecision, and publication bias.Conclusions: Acupuncture is a promising complementary treatment for AD. However, due to the low quality of the SRs/MAs supporting these results, high-quality studies with rigorous study designs and larger samples are needed before widespread recommendations can be made.

Sign in / Sign up

Export Citation Format

Share Document