scholarly journals Characteristics of retracted systematic reviews and meta-analyses in the biomedical literature

2020 ◽  
Author(s):  
WANG TAO ◽  
Lei Yong-Hong ◽  
Qin-Rui Xing

Abstract The number of retracted reviews, including systematic reviews and meta-analyses, in the biomedical literature has increased dramatically in recent years. There has not yet been a systematic study to clarify the characteristics of retracted reviews. Present study determined trends in biomedical reviews, particularly with respect to reasons for retraction and geographical origin. Reviews were collated from Medline and Cochrane Library searches. Reasons for retraction were catalogued based on information retrieved via PubMed, Google, and journal websites. A total of 171 retracted non-Cochrane reviews and 439 Cochrane reviews were included. The most common reasons for retraction of non-Cochrane reviews were invalid review (n = 70), error (n = 36), and plagiarism (n = 20). Chinese authors produced a distinctively large number of reviews retracted for a faked review process and most retracted meta-analyses from areas of biochemistry molecular biology, oncology, genetics heredity and etc. Cochrane review retraction reasons included principally updating issues (n = 382), errors (n = 26), and sponsorship policy issues (n = 13). The number of retracted reviews in the biomedical literature, especially from Chinese authors, has surged since 2005. The major reasons for these retractions were related to updating among Cochrane systematic reviews but were related to misconduct among non-Cochrane systematic reviews. The present results highlight the need misconduct prevention measures.

2021 ◽  
Vol 29 (Supplement_1) ◽  
pp. i34-i35
Author(s):  
M Carter ◽  
N Abutheraa ◽  
N Ivers ◽  
J Grimshaw ◽  
S Chapman ◽  
...  

Abstract Introduction Audit and Feedback (A&F) involves measuring data about practice, comparing it with clinical guidelines, professional standards or peer performance, and then feeding back the data to individuals/groups of health professionals to encourage change in practice (if required). A 2012 Cochrane review (1) found A&F was effective in changing health professionals’ behaviour and suggested that the person who delivers the A&F intervention influences its effect. Increasingly, pharmacists work in general practice and often have responsibility for medication review and repeat prescriptions. The effectiveness of pharmacist-led A&F in influencing prescribing behaviour is uncertain. Aim This secondary analysis from an ongoing update of the original Cochrane review aims to identify and describe pharmacist-led A&F interventions and evaluate their impact on prescribing behaviour in general practice compared with no intervention. Methods This sub-review is registered with PROSPERO: CRD42020194355 and complies with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (2). For the updated Cochrane review, the Cochrane Effective Practice and Organization of Care Group searched MEDLINE (1946 to present), EMBASE, CINAHL and Cochrane Library (March 2019) to identify randomised trials featuring A&F interventions. For this sub-review, authors screened titles and abstracts (May 2020) to identify trials involving pharmacist-led A&F interventions in primary care, extracted data, and assessed risk of bias (RoB) in eligible studies. Review results are summarised descriptively. Heterogeneity will be assessed and a random-effects meta-analysis is planned. Publication bias for selected outcomes and the certainty of the body of evidence will be evaluated and presented. Sub-group analyses will be conducted. Results Titles and abstracts of 295 studies identified for inclusion in the Cochrane A&F review update were screened. Eleven studies (all cluster-randomised trials) conducted in 9 countries (Denmark, Italy, Netherlands, Norway, Republic of Ireland, UK, Australia, Malaysia, USA) were identified for inclusion (Figure 1). Six studies had low RoB, two had high risk due to dissimilarities between trial arms at baseline and/or insufficient detail about randomisation, and three studies had unclear RoB. Studies examined the effect of A&F on prescribing for specific conditions (e.g. hypertension), medications (e.g. antibiotics), populations (e.g. patients >70), and prescribing errors (e.g. inappropriate dose). The pharmacist delivering A&F was a colleague of intervention participants in five studies. Pharmacists’ levels of skill and experience varied; seven studies reported details of pharmacist training undertaken for trial purposes. A&F interventions in nine studies demonstrated changes in prescribing, including reductions in errors or inappropriate prescribing according to the study aims and smaller increases in unwanted prescribing compared with the control group. Data analyses are ongoing (results will be available for the conference). Conclusion The preliminary results demonstrate the effectiveness of pharmacist-led A&F interventions in different countries and health systems with influencing prescribing practice to align more closely with guidance. Studies measured different prescribing behaviours; meta-analysis is unlikely to include all 11 studies. Further detailed analysis including feedback format/content/frequency and pharmacist skill level/experience, work-base (external/internal to recipients), will examine the impact of specific features on intervention effectiveness. References 1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012(6):CD000259. 2. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.


2015 ◽  
Vol 10 (2) ◽  
pp. 147
Author(s):  
Saori Wendy Herman

A Review of: Gehanno, J. F., Rollin, L., & Darmoni, S. (2013). Is the coverage of Google Scholar enough to be used alone for systematic reviews. BMC Medical Informatics and Decision Making, 13(1): 7. doi: 10.1186/1472-6947-13-7 Abstract Objective – To determine if Google Scholar (GS) is sensitive enough to be used as the sole search tool for systematic reviews. Design – Citation analysis. Setting – Biomedical literature. Subjects – Original studies included in 29 systematic reviews published in the Cochrane Library or JAMA. Methods – The authors searched MEDLINE for any systematic reviews published in the 2008 and 2009 issues of JAMA or in the July 8, 2009 issue of the Cochrane Database of Systematic Reviews. They chose 29 systematic reviews for the study and included these reviews in a gold standard database created specifically for this project. The authors searched GS for the title of each of the original references for the 29 reviews. They computed and noted the recall of GS for each reference. Main Results – The authors searched GS for 738 original studies with a 100% recall rate. They also made a side discovery of a number of major errors in the bibliographic references. Conclusion – Researchers could use GS as a stand-alone database for systematic reviews or meta-analyses. With a couple improvements to the rate of positive predictive values and advanced search features, GS could become the leading medical bibliographic database. Conclusion – Researchers could use GS as a stand-alone database for systematic reviews or meta-analyses. With a couple improvements to the rate of positive predictive values and advanced search features, GS could become the leading medical bibliographic database.


2017 ◽  
Vol 50 (01) ◽  
pp. 8-16 ◽  
Author(s):  
Yahong Qin ◽  
Liang Yao ◽  
Feifei Shao ◽  
Kehu Yang ◽  
Limin Tian

AbstractHyperthyroidism is a common condition that is associated with increased morbidity and mortality. A number of meta-analyses (MAs) have assessed the therapeutic measures for hyperthyroidism, including antithyroid drugs, surgery, and radioiodine, however, the methodological quality has not been evaluated. This study evaluated the methodological quality and summarized the evidence obtained from MAs of hyperthyroidism treatments for radioiodine, antithyroid drugs, and surgery. We searched the PubMed, EMBASE, Cochrane Library, Web of Science, and Chinese Biomedical Literature Database databases. Two investigators independently assessed the meta-analyses titles and abstracts for inclusion. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. A total of 26 MAs fulfilled the inclusion criteria. Based on the AMSTAR scores, the average methodological quality was 8.31, with large variability ranging from 4 to 11. The methodological quality of English meta-analyses was better than that of Chinese meta-analyses. Cochrane reviews had better methodological quality than non-Cochrane reviews due to better study selection and data extraction, the inclusion of unpublished studies, and better reporting of study characteristics. The authors did not report conflicts of interest in 53.8% meta-analyses, and 19.2% did not report the harmful effects of treatment. Publication bias was not assessed in 38.5% of meta-analyses, and 19.2% did not report the follow-up time. Large-scale assessment of methodological quality of meta-analyses of hyperthyroidism treatment highlighted methodological strengths and weaknesses. Consideration of scientific quality when formulating conclusions should be made explicit. Future meta-analyses should improve on reporting conflict of interest.


2021 ◽  
Author(s):  
Jing Xie ◽  
Xueying Li ◽  
Nan Mao ◽  
Sichong Ren ◽  
junming Fan

Abstract Background: Despite the control measure taken against the coronavirus disease 2019(COVID-19) at global level, the pandemic has started to rebound and transmitted rapidly worldwide due to the delta strain. This strain is more virulent than the original severe acute respiratory syndrome coronavirus 2 virus. The approved vaccines or drugs can reduce mortality; still various efforts are being made to seek a complete cure. Currently, it remains controversial whether angiotensin-converting enzyme inhibitors/angiotensin receptor blockers (ACEIs/ARBs) are useful in managing COVID-19 patients having comorbidities like chronic kidney disease(CKD). Evidence concerning the application of ACEIs/ARBs needs to be established through advanced meta-analyses and systematic reviews.Methods/design:This study is designed following the PRISMA (Preferred Reporting Items of Systematic Reviews and Meta-Analyses). The studies published from December 1, 2019, to August 31, 2021 will be considered. The primary databases such as Cochrane Library, MEDLINE, EMBASE, and Chinese Biomedical Literature Database will be included, and meeting records and grey literature databases will be retrieved to compare at least two terminations or discontinued ACEIs or ARBs in clinical intervention studies. The primary results will include kidney function biomarkers, blood pressure, and long-term mortality or hospital admission severity. Pairwise random effects and meta-analyses will be performed for the selected literature using RevMan (V.5.3). The bias risk evaluation, heterogeneity, consistency, transitivity, and evidence quality will be followed as described in the Cochrane Handbook for Systematic Reviews of Interventions suggestions.Discussion: This review will use a structured and effective method to analyze the effectiveness and security of ACEIs and ARBs in treating COVID-19 patients with CKD. Research results can present valuable evidence for patients, clinicians, researchers, or decision-makers.Systerm review: PROSPERO registration number CRD42021268701.


BMJ Open ◽  
2014 ◽  
Vol 4 (10) ◽  
pp. e005491 ◽  
Author(s):  
Julie B Hansen ◽  
Carsten B Juhl ◽  
Isabelle Boutron ◽  
Peter Tugwell ◽  
Elizabeth A T Ghogomu ◽  
...  

IntroductionThe validity of systematic reviews and meta-analysis depends on methodological quality and unbiased dissemination of trials. Our objective is to evaluate the association of estimates of treatment effects with different bias-related study characteristics in meta-analyses of interventions used for treating pain in osteoarthritis (OA). From the findings, we hope to consolidate guidance on interpreting OA trials in systematic reviews based on empirical evidence from Cochrane reviews.Methods and analysisOnly systematic reviews that compare experimental interventions with sham, placebo or no intervention control will be considered eligible. Bias will be assessed with the risk of bias tool, used according to the Cochrane Collaboration’s recommendations. Furthermore, center status, trial size and funding will be assessed. The primary outcome (pain) will be abstracted from the first appearing forest plot for overall pain in the Cochrane review. Treatment effect sizes will be expressed as standardised mean differences (SMDs), where the difference in mean values available from the forest plots is divided by the pooled SD. To empirically assess the risk of bias in treatment benefits, we will perform stratified analyses of the trials from the included meta-analyses and assess the interaction between trial characteristics and treatment effect. A relevant study-level covariate is defined as one that decreases the between-study variance (τ2, estimated as Tau-squared) as a consequence of inclusion in the mixed effects statistical model.Ethics and disseminationMeta-analyses and randomised controlled trials provide the most reliable basis for treatment of patients with OA, but the actual impact of bias is unclear. This study will systematically examine the methodological quality in OA Cochrane reviews and explore the effect estimates behind possible bias. Since our study does not collect primary data, no formal ethical assessment and informed consent are required.Trial registration numberPROSPERO (CRD42013006924).


2002 ◽  
Vol 18 (4) ◽  
pp. 820-823 ◽  
Author(s):  
Susan Mallett ◽  
Mike Clarke

Objectives: To describe the number of trials and participants in a typical systematic review from The Cochrane Database of Systematic Reviews.Methods: The number of trials in 1,000 Cochrane systematic reviews in issue 1, 2001 of The Cochrane Database of Systematic Reviews was counted for three categories of trial: included trials, ongoing trials, and trials awaiting assessment for inclusion. (The term trial is used in this paper, although a small number of Cochrane reviews include studies that are not trials.) The total number of participants in included trials was extracted from a sample of reviews.Results: A total of 9,778 trials were included in the Cochrane reviews. There were a further 356 ongoing trials and 1,138 trials awaiting assessment for inclusion. A typical review contained six included trials. Forty percent of the reviews listed ongoing trials and/or trials awaiting assessment for inclusion. Based on a sample of 258 reviews, the median number of participants per review was 945 (interquartile range, 313 to 2,511) per review and 118 (interquartile range, 60 to 241) per trial.Conclusion: This report is a descriptive study of the number of trials and participants in a typical Cochrane review from The Cochrane Library, issue 1, 2001.


BMJ Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. e043807
Author(s):  
Jiantong Shen ◽  
Wenming Feng ◽  
Yike Wang ◽  
Qiyuan Zhao ◽  
Billong Laura Flavorta ◽  
...  

IntroductionEfficacy of aliskiren combination therapy with other antihypertensive has been evaluated in the treatment of patients with hypertension in recent systematic reviews. However, most previous reviews only focused on one single health outcome or one setting, none of them made a full summary that assessed the impact of aliskiren combination treatment comprehensively. As such, this umbrella review based on systematic reviews and meta-analyses is aimed to synthesise the evidences on efficacy, safety and tolerability of aliskiren-based therapy for hypertension and related comorbid patients.Methods and analysisA comprehensive search of PubMed, EMBASE, Cochrane Library, CNKI published from inception to August 2020 will be conducted. The selected articles are systematic reviews which evaluated efficacy, safety and tolerability of aliskiren combination therapy. Two reviewers will screen eligible articles, extract data and evaluate quality independently. Any disputes will be resolved by discussion or the arbitration of a third person. The quality of reporting evidence will be assessed using the Assessment of Multiple Systematic Reviews V.2 tool tool. We will take a mixed-methods approach to synthesising the review literatures, reporting summary of findings tables and iteratively mapping the results.Ethics and disseminationEthical approval is not required for the study, as we would only collect data from available published materials. This umbrella review will be also submitted to a peer-reviewed journal for publication after completion.PROSPERO registration numberCRD42020192131.


BMJ Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. e043784
Author(s):  
Naichuan Su ◽  
Michiel van der Linden ◽  
Geert JMG van der Heijden ◽  
Stefan Listl ◽  
Stefan Schandelmaier ◽  
...  

IntroductionSpin is defined as reporting practices that distort the interpretation of results and create misleading conclusions by suggesting more favourable results. Such unjustifiable and misleading misrepresentation may negatively influence the development of further studies, clinical practice and healthcare policies. Spin manifests in various patterns in different sections of publications (titles, abstracts and main texts). The primary aim of this study is to identify reported spin patterns and assess the prevalence of spin in general, and the prevalence of spin patterns reported in biomedical literature based on previously published systematic reviews and literature reviews on spin.Methods and analysisPubMed, EMBASE and SCOPUS will be searched to identify systematic or literature reviews on spin in biomedicine. To improve the comprehensiveness of the search, the snowballing method will be used to broaden the search. The data on spin-related outcomes and characteristics of the included studies will be extracted. The methodological quality of the included studies will be assessed with selective items of the A MeaSurement Tool to Assess systematic Reviews-2 checklist. A new classification scheme for spin patterns will be developed if the classifications of spin patterns identified in the included studies vary. The prevalence of spin and spin patterns will be pooled based on meta-analyses if the classification schemes for spin are comparable across included studies. Otherwise, the prevalence will be described qualitatively. The seriousness of spin patterns will be assessed based on a Delphi consensus study.Ethics and disseminationThis study has been approved by the Academic Centre for Dentistry Amsterdam Ethics Review Committee (2020250). The study will be submitted to a peer-reviewed scientific journal.RegistrationOpen Science Framework: osf.io/hzv6e


2020 ◽  
Vol 2020 (4) ◽  
Author(s):  
Mariano Mascarenhas ◽  
Theodoros Kalampokas ◽  
Sesh Kamal Sunkara ◽  
Mohan S Kamath

Abstract STUDY QUESTION Are systematic reviews published within a 3-year period on interventions in ART concordant in their conclusions? SUMMARY ANSWER The majority of the systematic reviews published within a 3-year period in the field of assisted reproduction on the same topic had discordant conclusions. WHAT IS KNOWN ALREADY Systematic reviews and meta-analyses have now replaced individual randomized controlled trials (RCTs) at the top of the evidence pyramid. There has been a proliferation of systematic reviews and meta-analyses, many of which suffer from methodological issues and provide varying conclusions. STUDY DESIGN, SIZE, DURATION We assessed nine interventions in women undergoing ART with at least three systematic reviews each, published from January 2015 to December 2017. PARTICIPANTS/MATERIALS, SETTING, METHODS The systematic reviews which included RCTs were considered eligible for inclusion. The primary outcome was extent of concordance between systematic reviews on the same topic. Secondary outcomes included assessment of quality of systematic reviews, differences in included studies in meta-analyses covering the same search period, selective reporting and reporting the quality of evidence. MAIN RESULTS AND THE ROLE OF CHANCE Concordant results and conclusions were found in only one topic, with reviews in the remaining eight topics displaying partial discordance. The AMSTAR grading for the majority of the non-Cochrane reviews was critically low whilst it was categorized as high for all of the Cochrane reviews. For three of the nine topics, none of the included systematic reviews assessed the quality of evidence. We were unable to assess selective reporting as most of the reviews did not have a pre-specified published protocol. LIMITATIONS, REASONS FOR CAUTION We were limited by the high proportion of reviews lacking a pre-specified protocol, which made it impossible to assess for selective reporting. Furthermore, many reviews did not specify primary and secondary outcomes which made it difficult to assess reporting bias. All the authors of this review were Cochrane review authors which may introduce some assessment bias. The categorization of the review’s conclusions as beneficial, harmful or neutral was subjective, depending on the tone and wording of the conclusion section of the review. WIDER IMPLICATIONS OF THE FINDINGS The majority of the systematic reviews published within a 3-year period on the same topic in the field of assisted reproduction revealed discordant conclusions and suffered from serious methodological issues, hindering the process of informed healthcare decision-making. STUDY FUNDING/COMPETING INTEREST(S) All the authors are Cochrane authors. M.S.K. is an editorial board member of Cochrane Gynaecology and Fertility group. No grant from funding agencies in the public, commercial or not-for-profit sectors was obtained.


2017 ◽  
Vol 21 (4) ◽  
pp. 766-776 ◽  
Author(s):  
Cuiyu Deng ◽  
Qi Lu ◽  
Bingyan Gong ◽  
Liya Li ◽  
Lianxia Chang ◽  
...  

AbstractObjectiveNumerous systematic reviews of prospective studies on the association of stroke risk with the consumption of various food groups have been published. A review of the evidence across the existing systematic reviews and meta-analyses of prospective studies was conducted to provide an overview of the range and validity of the reported associations of food groups with stroke risk.DesignThe PubMed, EMBASE and Cochrane Library databases were searched for articles published up to September 2015 to identify systematic reviews of prospective studies.ResultsA total of eighteen studies published from 2008 to 2015 were eligible for analysis. Overall, thirteen specific foods were studied for an association with stroke outcome, including nuts, legumes, fruits and vegetables, refined grains, whole grains, dairy products, eggs, chocolate, red and/or processed meat, fish, tea, sugar-sweetened beverages and coffee. Whereas a high consumption of nuts, fruits, vegetables, dairy foods, fish and tea, and moderate consumption of coffee and chocolate demonstrated a protective effect, a high consumption of red and/or processed meat was associated with increased stroke risk. Refined grain, sugar-sweetened beverage, legume, egg and whole grain intake showed no effect on stroke outcome.ConclusionsThe current overview provided a high level of evidence to support the beneficial effect of specific foods on stroke outcome. Clinicians and policy makers could inform clinical practice and policy based on this overview.


Sign in / Sign up

Export Citation Format

Share Document