scholarly journals Reporting quality of Cochrane systematic reviews with Chinese herbal medicines

2019 ◽  
Vol 8 (1) ◽  
Author(s):  
Xuan Zhang ◽  
Qi-Ying Aixinjueluo ◽  
Si-Yao Li ◽  
Lisa-L Song ◽  
Chung-Tai Lau ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Meta Analysis ◽  
Herbal Medicines ◽  
Reporting Quality ◽  
Primary Analysis ◽  
Chinese Herbal Medicines ◽  
Chinese Herbal ◽  
Related Information ◽  
Meta Analyses

Abstract Background Chinese herbal medicines (CHMs) are the major interventions of traditional Chinese medicine (TCM), which are typically administered as either single herbs or formulas. The Cochrane systematic reviews (SRs) of CHMs are essential references for evaluating the efficacy and safety of CHMs interventions; they are expected to be accurate and reliable. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to CHM was adequately reported. Methods The Cochrane Database was systematically searched for all SRs of CHM that were published up to 31 December 2017. The primary analysis was to assess their reporting quality based on 27-item of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) and 9-item of CHM-related information designed according to TCM theory. Descriptive statistics were additionally used to analyze their baseline characteristics. Results A total of 109 Cochrane SRs of CHM were identified from 1999 to 2017. For 27-item of PRISMA, 26 had the reporting compliances higher than 50%, of which 11 were fully reporting (100%). However, for CHM-related information, 65 (59.6%) SRs did not report the specific name of the CHM in the title, 42 (38.5%) lacked TCM-related rationales in the introduction, 62 (56.9%) did not include CHM-related characteristics in the additional analyses, and 77 (70.6%) did not analyze CHM results in terms of TCM-related theories in the discussion. Of 97 SRs that included clinical trials, 38 (39.2%) did not provide the details of composition and dosage of CHMs, 85 (87.6%) did not report the CHM sources, 13 (13.4%) did not provide the dosage form, 95 (97.9%) lacked CHM quality control information, and 57 (58.8%) did not describe details of the controls. For 62 (72.9%) of 85 SRs that included meta-analysis, it was impossible to assess whether meta-analysis had been properly conducted due to inadequate reporting of CHM interventions. Conclusion Although the Cochrane SRs of CHM showed reporting compliance with PRISMA checklist, their reporting quality needs improvement, especially about full reporting of CHM interventions and of TCM-related rationales. Reporting guideline of “PRISMA extension for CHM interventions” should be developed thus to improve their quality.

scholarly journals Reporting quality of systematic reviews with moxibustion

2020 ◽  
Vol 15 (1) ◽  
Author(s):  
Ran Tian ◽  
Xuan Zhang ◽  
Si-Yao Li ◽  
Qi-Ying Aixinjueluo ◽  
Wai Ching Lam ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Meta Analysis ◽  
Safety Evaluation ◽  
Reporting Quality ◽  
Duration Of Treatment ◽  
Primary Analysis ◽  
Related Information ◽  
Baseline Characteristics ◽  
Meta Analyses

Abstract Background Moxibustion is one of the major interventions of Chinese medicine (CM). The systematic reviews (SRs) are essential references for evaluating the efficacy and safety of moxibustion interventions. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to moxibustion was adequately reported. Methods Seven databases (including four English and three Chinese databases) were systematically searched for SRs of moxibustion that were published up to 31 December 2019. The primary analysis was to assess their reporting quality based on 27-item of the Preferred Reporting Items for SRs and Meta-Analyses (PRISMA) and 14-item of moxibustion-related information designed according to CM theory and the STandards for Reporting Interventions in Clinical Trials Of Moxibustion (STRICTOM). Descriptive statistics were also used to analyze their baseline characteristics. Results A total of 97 SRs of moxibustion were identified from 2011 to 2019. For 27-item of PRISMA, except item 5, 8, 16 and 23, the remaining 23 items had the reporting compliances higher than 55%, of which 2 items (item 20 and 26) were fully reporting (100%). However, for moxibustion-related information, 69.1% (67/97) SRs did not provide the specific type of moxibustion, 39.2% (38/97) lacked details regarding the materials, procedure and technique used for moxibustion, 67.0% (65/97) did not report the selection criteria of acupoints for moxibustion, 28.9% (28/97) did not provide the number or duration of treatment sessions, 69.1% (67/97) did not provide any information about safety evaluation, and 94.8% (92/97) SRs did not report the treatment environment. For 51 (55.4%) of 92 SRs that included meta-analysis, it was impossible to assess whether meta-analysis had been properly conducted due to inadequate reporting of moxibustion interventions. Conclusion The reporting quality of SRs of moxibustion need further improvements in terms of adequate reporting of moxibustion interventions and of moxibustion-related rationales. Reporting guideline of “PRISMA extension for moxibustion interventions” should be developed thus to improve their quality.

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Extension for Chinese Herbal Medicines 2020 (PRISMA-CHM 2020)

2020 ◽  
Vol 48 (06) ◽  
pp. 1279-1313 ◽  
Author(s):  
Xuan Zhang ◽  
Ran Tan ◽  
Wai Ching Lam ◽  
Liang Yao ◽  
Xiaoqin Wang ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Herbal Medicines ◽  
Reporting Quality ◽  
Eligibility Criteria ◽  
Title 1 ◽  
Chinese Herbal Medicines ◽  
Chinese Herbal ◽  
Study Characteristics ◽  
Meta Analyses

Chinese Herbal Medicines (CHM) are the most common interventions of traditional Chinese medicine (TCM), typically administered as either single herbs or formulas. Systematic reviews (SRs) are essential references for evaluating the efficacy and safety of CHM treatments accurately and reliably. Unfortunately, the reporting quality of SRs with CHM is not optimal, especially the reporting of CHM interventions and the rationale of why these interventions were selected. To address this problem, a group of TCM clinical experts, methodologists, epidemiologists, and editors has developed a PRISMA extension for CHM interventions (PRISMA-CHM) through a comprehensive process, including registration, literature review, consensus meeting, three-round Delphi survey, and finalization. The PRISMA checklist was extended by introducing the concept of TCM Pattern and the characteristics of CHM interventions. A total of twenty-four items (including sub-items) are included in the checklist, relating to title (1), structured summary (2), rationale (3), objectives (4), eligibility criteria (6), data items (11), synthesis of results (14, 21), additional analyses (16, 23), study characteristics (18), summary of evidence (24), and conclusions (26). Illustrative examples and explanations are also provided. The group hopes that PRISMA-CHM 2020 will improve the reporting quality of SRs of CHM.

scholarly journals Reporting quality of systematic reviews with Moxibustion

2020 ◽  
Author(s):  
Ran Tian ◽  
Xuan Zhang ◽  
Si-Yao Li ◽  
Qi-Ying Aixinjueluo ◽  
Wai Ching Lam ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Meta Analysis ◽  
Safety Evaluation ◽  
Reporting Quality ◽  
Duration Of Treatment ◽  
Primary Analysis ◽  
Related Information ◽  
Baseline Characteristics ◽  
Meta Analyses

Abstract Background: Moxibustion is one of the major interventions of Chinese medicine (CM). The systematic reviews (SRs) are essential references for evaluating the efficacy and safety of moxibustion interventions. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to moxibustion was adequately reported.Methods: Seven Databases (including four English and three Chinese databases) were systematically searched for SRs of moxibustion that were published up to 31 December 2019. The primary analysis was to assess their reporting quality based on 27-item of the Preferred Reporting Items for SRs and Meta-Analyses (PRISMA) and 16-item of moxibustion-related information designed according to CM theory and the STRICTOM (STandards for Reporting Interventions in Clinical Trials Of Moxibustion). Descriptive statistics were also used to analyze their baseline characteristics.Results: A total of 97 SRs of moxibustion were identified from 2011 to 2019. For 27-item of PRISMA, except item 5, 8, 16 and 23, the remaining 23 items had the reporting compliances higher than 50%, of which 2 items (item 20 and 26) were fully reporting (100%). However, for moxibustion-related information, 69.1% (67/97) SRs did not provide the specific type of moxibustion, 39.2% (38/97) lacked details regarding the materials, procedure and technique used for moxibustion, 67.0% (65/97) did not report the selection criteria of acupoints for moxibustion, 28.9% (28/97) did not provide the number or duration of treatment sessions, 69.1% (67/97) did not provide any information about safety evaluation, and 94.8% (92/97) SRs did not report the treatment environment. For 51 (55.4%) of 92 SRs that included meta-analysis, it was impossible to assess whether meta-analysis had been properly conducted due to inadequate reporting of moxibustion interventions.Conclusion: The reporting quality of SRs of moxibustion need further improvements in terms of adequate reporting of moxibustion interventions and of moxibustion-related rationales. Reporting guideline of “PRISMA extension for moxibustion interventions” should be developed thus to improve their quality.

scholarly journals Reporting quality of systematic reviews with Moxibustion

2020 ◽  
Author(s):  
Ran Tian ◽  
Xuan Zhang ◽  
Si-Yao Li ◽  
Qi-Ying Aixinjueluo ◽  
Wai Ching Lam ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Meta Analysis ◽  
Safety Evaluation ◽  
Reporting Quality ◽  
Cochrane Library ◽  
Duration Of Treatment ◽  
Primary Analysis ◽  
Related Information ◽  
Meta Analyses

Abstract Background: Moxibustion is one of the major interventions of Chinese medicine (CM). The systematic reviews (SRs) are essential references for evaluating the efficacy and safety of moxibustion interventions. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to moxibustion was adequately reported.Methods: Five Databases (including Embase, Cochrane Library, MEDLINE, CNKI and VIP) were systematically searched for SRs of moxibustion that were published up to 31 December 2019. The primary analysis was to assess their reporting quality based on 27-item of the Preferred Reporting Items for SRs and Meta-Analyses (PRISMA) and 16-item of moxibustion-related information designed according to CM theory and the STRICTOM (STandards for Reporting Interventions in Clinical Trials Of Moxibustion). Descriptive statistics were also used to analyze their baseline characteristics.Results: A total of 97 SRs of moxibustion were identified from 2011 to 2019. For 27-item of PRISMA, except item 5, 8, 16 and 23, the remaining 23 items had the reporting compliances higher than 50%, of which 2 items (item 20 and 26) were fully reporting (100%). However, for moxibustion-related information, 69.1% (67/97) SRs did not provide the specific type of moxibustion, 39.2% (38/97) lacked details regarding the materials, procedure and technique used for moxibustion, 67.0% (65/97) did not report the selection criteria of acupoints for moxibustion, 28.9% (28/97) did not provide the number or duration of treatment sessions, 69.1% (67/97) did not provide any information about safety evaluation, and 94.8% (92/97) SRs did not report the treatment environment. For 51 (55.4%) of 92 SRs that included meta-analysis, it was impossible to assess whether meta-analysis had been properly conducted due to inadequate reporting of moxibustion interventions.Conclusion: The reporting quality of SRs of moxibustion need further improvements in terms of adequate reporting of moxibustion interventions and of moxibustion-related rationales. Reporting guideline of “PRISMA extension for moxibustion interventions” should be developed thus to improve their quality.

scholarly journals Scoping review of COVID-19-related systematic reviews and meta-analyses: can we really have confidence in their results?

2021 ◽  
pp. postgradmedj-2020-139392
Author(s):  
Rachel Wurth ◽  
Michelle Hajdenberg ◽  
Francisco J Barrera ◽  
Skand Shekhar ◽  
Caroline E Copacino ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Scoping Review ◽  
Meta Analysis ◽  
Internal Validity ◽  
Reporting Quality ◽  
Measurement Tool ◽  
Literature Search Strategy ◽  
Definition Of ◽  
Meta Analyses

AimThe aim of this study was to systematically appraise the quality of a sample of COVID-19-related systematic reviews (SRs) and discuss internal validity threats affecting the COVID-19 body of evidence.DesignWe conducted a scoping review of the literature. SRs with or without meta-analysis (MA) that evaluated clinical data, outcomes or treatments for patients with COVID-19 were included.Main outcome measuresWe extracted quality characteristics guided by A Measurement Tool to Assess Systematic Reviews-2 to calculate a qualitative score. Complementary evaluation of the most prominent published limitations affecting the COVID-19 body of evidence was performed.ResultsA total of 63 SRs were included. The majority were judged as a critically low methodological quality. Most of the studies were not guided by a pre-established protocol (39, 62%). More than half (39, 62%) failed to address risk of bias when interpreting their results. A comprehensive literature search strategy was reported in most SRs (54, 86%). Appropriate use of statistical methods was evident in nearly all SRs with MAs (39, 95%). Only 16 (33%) studies recognised heterogeneity in the definition of severe COVID-19 as a limitation of the study, and 15 (24%) recognised repeated patient populations as a limitation.ConclusionThe methodological and reporting quality of current COVID-19 SR is far from optimal. In addition, most of the current SRs fail to address relevant threats to their internal validity, including repeated patients and heterogeneity in the definition of severe COVID-19. Adherence to proper study design and peer-review practices must remain to mitigate current limitations.

scholarly journals The Effects of Tai Chi Exercise Among Adults With Chronic Heart Failure: An Overview of Systematic Review and Meta-Analysis

2021 ◽  
Vol 8 ◽  
Author(s):  
Jinke Huang ◽  
Xiaohui Qin ◽  
Min Shen ◽  
Yanjuan Xu ◽  
Yong Huang
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Tai Chi ◽  
Meta Analysis ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
Quality Reporting ◽  
Evidence Quality ◽  
Meta Analyses

Background: Tai chi (TC) is a popular form of exercise among adults with chronic heart failure (CHF), yet services are greatly underutilized. The aim of the current study was to identify and summarize the existing evidence and to systematically determine the clinical effectiveness of Tai Chi in the management of CHF using a systematic overview.Methods: Both English and Chinese databases were searched for systematic reviews (SRs)/meta-analyses (MAs) on TC for CHF from their inception to June 2020. The methodological quality, reporting quality, and risk of bias of SRs/MAs were assessed using Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR-2), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist, and Risk of Bias in Systematic reviews (ROBIS), respectively. The evidence quality of outcome measures was assessed by the Grades of Recommendations, Assessment, Development and Evaluation (GRADE).Results: Six SRs/MAs using a quantitative synthesis to assess various outcomes of TC in CHF were included in this overview. The methodological quality, reporting quality and risk of bias of the SRs/MAs and the evidence quality of the outcome measures are generally unsatisfactory. The limitations of the past SRs/MAs included the lack of either the protocol or registration, the list of excluded studies, and the computational details of meta-analysis were inadequately reported. The critical problems were that qualitative data synthesis relied on trials with small sample sizes and critical low quality.Conclusions: TC may be a promising complementary treatment for CHF. However, further rigorous and comprehensive SRs/MAs and RCTs are required to provide robust evidence for definitive conclusions.

scholarly journals Benefits and Safety of Chinese Herbal Medicine in Treating Psoriasis: An Overview of Systematic Reviews

2021 ◽  
Vol 12 ◽  
Author(s):  
Jie Zhang ◽  
Qianying Yu ◽  
Li Peng ◽  
Yuesi Qin ◽  
Mingyi Jing ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Methodological Quality ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
High Quality ◽  
Chinese Herbal ◽  
Evidence Quality ◽  
Meta Analyses ◽  
Quality Evidence

Background: In recent years, systematic reviews/meta-analyses (SRs/MAs) of Chinese herbal medicine (CHM) for psoriasis have continuously emerged. Their methods and evidence quality, however, are yet to be evaluated, and whether their conclusions can provide clinicians with reliable evidence is still debatable.Objectives: This overview aims to evaluate the methodological quality, risk of bias, and reporting quality of relevant SRs/MAs, as well as the current evidence of CHM for treating psoriasis.Methods: We searched nine electronic databases from their respective time of establishment to January 20, 2021, as well as the reference lists of the included SRs/MAs, protocol registries, and gray literature. Two reviewers independently used the following: A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, Risk of Bias in Systematic Reviews (ROBIS), the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA), and Grades of Recommendations, Assessment, Development and Evaluation (GRADE) to evaluate the methodological quality, risk of bias, reporting quality, and evidence quality of the included SRs/MAs.Results: This review included 14 SRs/MAs involving 45 outcomes, of which 12 (85.71%) SRs/MAs had a very low quality evaluated by AMSTAR 2 and 7 (50.00%) SRs/MAs had a high risk of bias assessed by ROBIS. The protocol and registration and funding statements were the major reporting flaws according to the PRISMA checklist. The evaluation with the GRADE system demonstrated no outcome of high-quality evidence, and inconsistent efficacy evaluations were found in this overview. Only 15 (33.33%) outcomes were moderate-quality evidence, supporting the claim that CHM plus Western medicine (WM) was superior to WM. Generally low quality of evidence showed no difference in the incidence of adverse events between the combined therapy and WM. However, the conclusion that CHM was superior to WM cannot be drawn due to the inconsistent results.Conclusion: Despite that CHM has the potential benefit and safety in the adjuvant treatment of psoriasis, the conclusion should be treated with caution because of the generally low quality of methodology and evidence. In the future, high-quality randomized controlled trials (RCTs) should be carried out, and the quality of relevant SRs should also be improved to promote their clinical application.

scholarly journals Quality of Systematic Reviews of the Foods with Function Claims in Japan: Comparative Before- and After-Evaluation of Verification Reports by the Consumer Affairs Agency

Nutrients ◽  
2019 ◽  
Vol 11 (7) ◽  
pp. 1583 ◽  
Author(s):  
Kamioka ◽  
Tsutani ◽  
Origasa ◽  
Yoshizaki ◽  
Kitayuguchi ◽  
...  
Keyword(s):  
Systematic Reviews ◽  
Data Extraction ◽  
Meta Analysis ◽  
Scientific Evidence ◽  
Reporting Quality ◽  
Health Claims ◽  
Scientific Quality ◽  
Before And After ◽  
Product Effectiveness

Background: In Japan, a new type of foods with health claims, called Foods with Function Claims (FFC), was introduced in April 2015 in order to make more products available that are clearly labeled with certain health functions. Regarding substantiating product effectiveness, scientific evidence for the proposed function claims must be explained by systematic reviews (SRs), but the quality of SRs was not clear. The objectives of this review were to assess the quality of SRs based on the FFC registered on the Consumer Affairs Agency (CAA) website in Japan, and to determine whether the CAA’s verification report in 2016 was associated with improvement in the quality of SRs. Methods: We evaluated the reporting quality of each SR by the AMSTAR checklist on methodological quality. We searched the database from 1 April to 31 October 2015 as the before-SR and from 1 July 2017 to 31 January 2018 as the after-SR. Results: Among the 104 SRs reviewed, 96 final products were included: 51 (53.1%) were supplements, 42 (43.8%) were processed foods without supplements, and 3 (3.1%) were fresh foods. Of the 104 SRs, 92 (88.5%) were qualitative reviews (i.e., without meta-analysis) and 12 (11.5%) performed a meta-analysis. The average quality score of before-SRs and after-SRs was 6.2 ± 1.8 and 5.0 ± 1.9, respectively, a statistically significant decrease (p < 0.001). Conclusion: Overall, the methodology and reporting quality of after-SRs based on the FFC were poorer than those of before-SRs. In particular, there were very poor descriptions and/or implementations of study selection and data extraction, search strategy, evaluation methods for risk of bias, assessment of publication bias, and formulating conclusions based on methodological rigor and scientific quality of the included studies.

scholarly journals An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

2015 ◽  
Vol 2015 ◽  
pp. 1-8 ◽  
Author(s):  
Xiaoxia Zhang ◽  
Hui Wang ◽  
Yanxu Chang ◽  
Yuefei Wang ◽  
Xiang Lei ◽  
...  
Keyword(s):  
Unstable Angina ◽  
Systematic Reviews ◽  
Conventional Medicine ◽  
Reporting Quality ◽  
Randomized Controlled ◽  
Danhong Injection ◽  
Statistical Heterogeneity ◽  
Comprehensive Search ◽  
Meta Analyses

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA).Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA.Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored.Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

Sign in / Sign up

Export Citation Format

Share Document