scholarly journals Towards a New System for the Assessment of the Quality in Care Pathways: An Overview of Systematic Reviews

Author(s):  
Roberto Latina ◽  
Katia Salomone ◽  
Daniela D’Angelo ◽  
Daniela Coclite ◽  
Greta Castellini ◽  
...  

Clinical or care pathways are developed by a multidisciplinary team of healthcare practitioners, based on clinical evidence, and standardized processes. The evaluation of their framework/content quality is unclear. The aim of this study was to describe which tools and domains are able to critically evaluate the quality of clinical/care pathways. An overview of systematic reviews was conducted, according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses, using Medline, Embase, Science Citation Index, PsychInfo, CINAHL, and Cochrane Library, from 2015 to 2020, and with snowballing methods. The quality of the reviews was assessed with Assessment the Methodology of Systematic Review (AMSTAR-2) and categorized with The Leuven Clinical Pathway Compass for the definition of the five domains: processes, service, clinical, team, and financial. We found nine reviews. Three achieved a high level of quality with AMSTAR-2. The areas classified according to The Leuven Clinical Pathway Compass were: 9.7% team multidisciplinary involvement, 13.2% clinical (morbidity/mortality), 44.3% process (continuity-clinical integration, transitional), 5.6% financial (length of stay), and 27.0% service (patient-/family-centered care). Overall, none of the 300 instruments retrieved could be considered a gold standard mainly because they did not cover all the critical pathway domains outlined by Leuven and Health Technology Assessment. This overview shows important insights for the definition of a multiprinciple framework of core domains for assessing the quality of pathways. The core domains should consider general critical aspects common to all pathways, but it is necessary to define specific domains for specific diseases, fast pathways, and adapting the tool to the cultural and organizational characteristics of the health system of each country.

2015 ◽  
Vol 43 (01) ◽  
pp. 25-43 ◽  
Author(s):  
Jing Luo ◽  
Weijiang Song ◽  
Guoyan Yang ◽  
Hao Xu ◽  
Keji Chen

Compound Danshen dripping pill (CDDP) is commonly used to treat coronary heart disease (CHD) in China. However, clinical practice has not been informed by evidence from relevant systematic reviews (SRs). This overview aims at summarizing evidence from SRs on CDDP for the treatment of CHD. We included SRs of randomized controlled trials (RCTs) on CDDP in treating CHD until March 2014 by searching the Cochrane Library, PubMed, EMBASE and four Chinese databases. Data were extracted according to a pre-designed form. We assessed the quality of SRs according to AMSTAR and graded the quality of evidence in the included SRs using the GRADE approach. All data analyses were descriptive. About 13 SRs involving a total of 34,071 participants with angina or acute myocardial infarction (AMI) were included. Few SRs assessed endpoints (5/13, 38.5%) and quality of life (QOL) (4/13, 30.8%). Most of the SRs suggested that CDDP had potential benefits for patients with CHD, such as improving symptoms and electrocardiogram (ECG) results, with few adverse reactions, while benefits in endpoints were unproved. Moreover, the overall quality of evidence in the SRs was poor, ranging from "very low" to "moderate", and most of the included SRs were of "low" (3/13, 23.1%) or "moderate" (9/13, 69.2%) quality with many serious flaws. Current SRs suggested potential benefits of CDDP for the treatment of CHD. However, high-quality evidence is warranted to support the application of CDDP in treating CHD.


2012 ◽  
Vol 130 (6) ◽  
pp. 398-404 ◽  
Author(s):  
Valter Silva ◽  
Antonio José Grande ◽  
Ana Luiza Cabrera Martimbianco ◽  
Rachel Riera ◽  
Alan Pedrosa Viegas Carvalho

CONTEXT AND OBJECTIVE: Healthcare decision-making is complex and should involve healthcare professionals, patients and the best level of evidence. The speed of information production creates barriers against keeping up to date. In this light, methodologists have proposed a new type of study: overviews of systematic reviews (OoRs). The aim here was to introduce and demonstrate the role of OoRs in information synthesis for healthcare professionals, managers, researchers and patients. DESIGN AND SETTING: Time-series study conducted at the Brazilian Cochrane Center, jointly with the Postgraduate Program on Internal Medicine and Therapeutics, Discipline of Emergency Medicine and Evidence-Based Medicine, Department of Medicine, Federal University of São Paulo. METHODS: To show the growth in the numbers of published papers that provide high-level evidence and thus demonstrate the importance of OoRs for synthesis and integration of information, three filters for study designs were applied to two databases. An equation for predicting the expected number of published papers was developed and applied. RESULTS: Over the present decade, the number of randomized controlled trials in Medline might reach 2,863,203 and the number of systematic reviews might reach 174,262. Nine OoRs and 15 OoRs protocols have been published in the Cochrane Library. CONCLUSIONS: With the exponential growth of published papers, as shown in this study, a new type of study directed especially towards healthcare decision-makers was proposed, named "overview of systematic reviews". This could reduce the uncertainties in decision-making and generate a new hierarchy in the pyramid of evidence.


2020 ◽  
Vol 54 ◽  
pp. 66
Author(s):  
Roberto José Bittencourt ◽  
Angelo De Medeiros Stevanato ◽  
Carolina Thomé N. M. Bragança ◽  
Leila Bernarda Donato Gottems ◽  
Gisele O’Dwyer

OBJECTIVE: To present an overview of systematic reviews on throughput interventions to solve the overcrowding of emergency departments. METHODS: Electronic searches for reviews published between 2007 and 2018 were made on PubMed, Cochrane Library, EMBASE, Health Systems Evidence, CINAHL, SciELO, LILACS, Google Scholar and the CAPES periodicals portal. Data of the included studies was extracted into a pre-formatted sheet and their methodological quality was assessed using AMSTAR 2 tool. Eventually, 15 systematic reviews were included for the narrative synthesis. RESULTS: The interventions were grouped into four categories: (1) strengthening of the triage service; (2) strengthening of the ED’s team; (3) creation of new care zones; (4) change in ED’s work processes. All studies observed positive effect on patient’s length of stay, expect for one, which had positive effect on other indicators. According to AMSTAR 2 criteria, eight revisions were considered of high or moderate methodological quality and seven, low or critically low quality. There was a clear improvement in the quality of the studies, with an improvement in focus and methodology after two decades of systematic studies on the subject. CONCLUSIONS: Despite some limitations, the evidence presented on this overview can be considered the cutting edge of current scientific knowledge on the topic.


2021 ◽  
pp. bmjebm-2021-111710
Author(s):  
Rebecca Abbott ◽  
Alison Bethel ◽  
Morwenna Rogers ◽  
Rebecca Whear ◽  
Noreen Orr ◽  
...  

ObjectiveThe academic and scientific community has reacted at pace to gather evidence to help and inform about COVID-19. Concerns have been raised about the quality of this evidence. The aim of this review was to map the nature, scope and quality of evidence syntheses on COVID-19 and to explore the relationship between review quality and the extent of researcher, policy and media interest.Design and settingA meta-research: systematic review of reviews.Information sourcesPubMed, Epistemonikos COVID-19 evidence, the Cochrane Library of Systematic Reviews, the Cochrane COVID-19 Study Register, EMBASE, CINAHL, Web of Science Core Collection and the WHO COVID-19 database, searched between 10 June 2020 and 15 June 2020.Eligibility criteriaAny peer-reviewed article reported as a systematic review, rapid review, overview, meta-analysis or qualitative evidence synthesis in the title or abstract addressing a research question relating to COVID-19. Articles described as meta-analyses but not undertaken as part of a systematic or rapid review were excluded.Study selection and data extractionAbstract and full text screening were undertaken by two independent reviewers. Descriptive information on review type, purpose, population, size, citation and attention metrics were extracted along with whether the review met the definition of a systematic review according to six key methodological criteria. For those meeting all criteria, additional data on methods and publication metrics were extracted.Risk of biasFor articles meeting all six criteria required to meet the definition of a systematic review, AMSTAR-2 ((A MeaSurement Tool to Assess systematic Reviews, version 2.0) was used to assess the quality of the reported methods.Results2334 articles were screened, resulting in 280 reviews being included: 232 systematic reviews, 46 rapid reviews and 2 overviews. Less than half reported undertaking critical appraisal and a third had no reproducible search strategy. There was considerable overlap in topics, with discordant findings. Eighty-eight of the 280 reviews met all six systematic review criteria. Of these, just 3 were rated as of moderate or high quality on AMSTAR-2, with the majority having critical flaws: only a third reported registering a protocol, and less than one in five searched named COVID-19 databases. Review conduct and publication were rapid, with 52 of the 88 systematic reviews reported as being conducted within 3 weeks, and a half published within 3 weeks of submission. Researcher and media interest, as measured by altmetrics and citations, was high, and was not correlated with quality.DiscussionThis meta-research of early published COVID-19 evidence syntheses found low-quality reviews being published at pace, often with short publication turnarounds. Despite being of low quality and many lacking robust methods, the reviews received substantial attention across both academic and public platforms, and the attention was not related to the quality of review methods.InterpretationFlaws in systematic review methods limit the validity of a review and the generalisability of its findings. Yet, by being reported as ‘systematic reviews’, many readers may well regard them as high-quality evidence, irrespective of the actual methods undertaken. The challenge especially in times such as this pandemic is to provide indications of trustworthiness in evidence that is available in ‘real time’.PROSPERO registration numberCRD42020188822.


2020 ◽  
Vol 26 (23) ◽  
pp. 2686-2691 ◽  
Author(s):  
Ioannis Doundoulakis ◽  
Christina Antza ◽  
Haralambos Karvounis ◽  
George Giannakoulas

Background: Anticoagulation in patients with pulmonary embolism. Objective: To identify how non-vitamin K antagonist oral anticoagulants are associated with multiple outcomes in patients with pulmonary embolism. Methods: We performed a systematic search of systematic reviews via multiple electronic databases from inception to August 19th, 2019, without language restriction. Two authors independently extracted data and assessed the methodological quality of the included systematic reviews using the ROBIS tool. Results: We found twelve systematic reviews. Eleven SRs collected their data from randomized clinical trials and one from observational studies. All the included studies were published between 2014 and 2019 in English. The methodological quality of the 12 systematic reviews was low to high. None of the systematic reviews, which are included in our overview of systematic reviews, has evaluated the overall quality of evidence outcome using the Grading of Recommendations Assessments, Development and Evaluation (GRADE) approach. Conclusion: This is the first effort to summarize evidence about non-vitamin K antagonist oral anticoagulants in an overview of systematic reviews focusing exclusively on patients with pulmonary embolism. The evidence suggests that the non-vitamin K antagonist oral anticoagulants seem to be more effective and safer than a dualdrug approach with LMWH- VKA.


BMJ Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. e044472
Author(s):  
Saar Hommes ◽  
Ruben Vromans ◽  
Felix Clouth ◽  
Xander Verbeek ◽  
Ignace de Hingh ◽  
...  

ObjectivesTo assess the communicative quality of colorectal cancer patient decision aids (DAs) about treatment options, the current systematic review was conducted.DesignSystematic review.Data sourcesDAs (published between 2006 and 2019) were identified through academic literature (MEDLINE, Embase, CINAHL, Cochrane Library and PsycINFO) and online sources.Eligibility criteriaDAs were only included if they supported the decision-making process of patients with colon, rectal or colorectal cancer in stages I–III.Data extraction and synthesisAfter the search strategy was adapted from similar systematic reviews and checked by a colorectal cancer surgeon, two independent reviewers screened and selected the articles. After initial screening, disagreements were resolved with a third reviewer. The review was conducted in concordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. DAs were assessed using the International Patient Decision Aid Standards (IPDAS) and Communicative Aspects (CA) checklist.ResultsIn total, 18 DAs were selected. Both the IPDAS and CA checklist revealed that there was a lot of variation in the (communicative) quality of DAs. The findings highlight that (1) personalisation of treatment information in DAs is lacking, (2) outcome probability information is mostly communicated verbally and (3) information in DAs is generally biased towards a specific treatment. Additionally, (4) DAs about colorectal cancer are lengthy and (5) many DAs are not written in plain language.ConclusionsBoth instruments (IPDAS and CA) revealed great variation in the (communicative) quality of colorectal cancer DAs. Developers of patient DAs should focus on personalisation techniques and could use both the IPDAS and CA checklist in the developmental process to ensure personalised health communication and facilitate shared decision making in clinical practice.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Israel Júnior Borges do Nascimento ◽  
Dónal P. O’Mathúna ◽  
Thilo Caspar von Groote ◽  
Hebatullah Mohamed Abdulazeem ◽  
Ishanka Weerasekara ◽  
...  

Abstract Background Navigating the rapidly growing body of scientific literature on the SARS-CoV-2 pandemic is challenging, and ongoing critical appraisal of this output is essential. We aimed to summarize and critically appraise systematic reviews of coronavirus disease (COVID-19) in humans that were available at the beginning of the pandemic. Methods Nine databases (Medline, EMBASE, Cochrane Library, CINAHL, Web of Sciences, PDQ-Evidence, WHO’s Global Research, LILACS, and Epistemonikos) were searched from December 1, 2019, to March 24, 2020. Systematic reviews analyzing primary studies of COVID-19 were included. Two authors independently undertook screening, selection, extraction (data on clinical symptoms, prevalence, pharmacological and non-pharmacological interventions, diagnostic test assessment, laboratory, and radiological findings), and quality assessment (AMSTAR 2). A meta-analysis was performed of the prevalence of clinical outcomes. Results Eighteen systematic reviews were included; one was empty (did not identify any relevant study). Using AMSTAR 2, confidence in the results of all 18 reviews was rated as “critically low”. Identified symptoms of COVID-19 were (range values of point estimates): fever (82–95%), cough with or without sputum (58–72%), dyspnea (26–59%), myalgia or muscle fatigue (29–51%), sore throat (10–13%), headache (8–12%) and gastrointestinal complaints (5–9%). Severe symptoms were more common in men. Elevated C-reactive protein and lactate dehydrogenase, and slightly elevated aspartate and alanine aminotransferase, were commonly described. Thrombocytopenia and elevated levels of procalcitonin and cardiac troponin I were associated with severe disease. A frequent finding on chest imaging was uni- or bilateral multilobar ground-glass opacity. A single review investigated the impact of medication (chloroquine) but found no verifiable clinical data. All-cause mortality ranged from 0.3 to 13.9%. Conclusions In this overview of systematic reviews, we analyzed evidence from the first 18 systematic reviews that were published after the emergence of COVID-19. However, confidence in the results of all reviews was “critically low”. Thus, systematic reviews that were published early on in the pandemic were of questionable usefulness. Even during public health emergencies, studies and systematic reviews should adhere to established methodological standards.


2021 ◽  
Author(s):  
Hossein Motahari-Nezhad ◽  
Márta Péntek ◽  
László Gulácsi ◽  
Zsombor Zrubka

BACKGROUND Digital biomarkers are defined as objective, quantifiable physiological and behavioral data that are collected and measured by means of digital devices such as portables, wearables, implantables or digestibles. For their widespread adoption in publicly financed healthcare systems, it is important to understand how their benefits translate into improved patient outcomes, which is essential for demonstrating their value. OBJECTIVE To assess the quality and strength of evidence of the impact of digital biomarkers on clinical outcomes compared to interventions without digital biomarkers, reported in systematic reviews. METHODS A comprehensive search for 2019-2020 will be conducted in the PubMed and the Cochrane Library using keywords related to digital biomarkers and a filter for systematic reviews. Original full-text English publications of systematic reviews comparing clinical outcomes of interventions with and without digital biomarkers via meta-analysis will be included. The AMSTAR-2 tool will be used to assess the methodological quality of reviews. To assess the quality of evidence, we will evaluate systematic reviews using the GRADE tool. To detect the possible presence of reporting bias, we will record whether the protocol of the systematic reviews was published before the start of the study. A qualitative summary of results by digital biomarker technology and outcome will be provided. RESULTS This protocol was submitted before data collection. The next steps in this review will be initiated after the protocol is accepted for publication. CONCLUSIONS Our study will provide a comprehensive summary of the highest level of evidence available on digital biomarker interventions. Our results will help identify clinical areas where the use of digital biomarkers leads to favorable clinical outcomes. In addition, our findings will highlight areas of evidence gaps where the clinical benefits of digital biomarkers have not yet been demonstrated.


2019 ◽  
Vol 20 (7) ◽  
pp. 926.e1-926.e11 ◽  
Author(s):  
Jason Talevski ◽  
Kerrie M. Sanders ◽  
Gustavo Duque ◽  
Catherine Connaughton ◽  
Alison Beauchamp ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document