scholarly journals Successful incorporation of single reviewer assessments during systematic review screening: development and validation of sensitivity and work-saved of an algorithm that considers exclusion criteria and count

2021 ◽  
Vol 10 (1) ◽  
Author(s):  
Nassr Nama ◽  
Mirna Hennawy ◽  
Nick Barrowman ◽  
Katie O’Hearn ◽  
Margaret Sampson ◽  
...  

Abstract Background Accepted systematic review (SR) methodology requires citation screening by two reviewers to maximise retrieval of eligible studies. We hypothesized that records could be excluded by a single reviewer without loss of sensitivity in two conditions; the record was ineligible for multiple reasons, or the record was ineligible for one or more specific reasons that could be reliably assessed. Methods Twenty-four SRs performed at CHEO, a pediatric health care and research centre in Ottawa, Canada, were divided into derivation and validation sets. Exclusion criteria during abstract screening were sorted into 11 specific categories, with loss in sensitivity determined by individual category and by number of exclusion criteria endorsed. Five single reviewer algorithms that combined individual categories and multiple exclusion criteria were then tested on the derivation and validation sets, with success defined a priori as less than 5% loss of sensitivity. Results The 24 SRs included 930 eligible and 27390 ineligible citations. The reviews were mostly focused on pediatrics (70.8%, N=17/24), but covered various specialties. Using a single reviewer to exclude any citation led to an average loss of sensitivity of 8.6% (95%CI, 6.0–12.1%). Excluding citations with ≥2 exclusion criteria led to 1.2% average loss of sensitivity (95%CI, 0.5–3.1%). Five specific exclusion criteria performed with perfect sensitivity: conference abstract, ineligible age group, case report/series, not human research, and review article. In the derivation set, the five algorithms achieved a loss of sensitivity ranging from 0.0 to 1.9% and work-saved ranging from 14.8 to 39.1%. In the validation set, the loss of sensitivity for all 5 algorithms remained below 2.6%, with work-saved between 10.5% and 48.2%. Conclusions Findings suggest that targeted application of single-reviewer screening, considering both type and number of exclusion criteria, could retain sensitivity and significantly decrease workload. Further research is required to investigate the potential for combining this approach with crowdsourcing or machine learning methodologies.

2017 ◽  
Vol 60 (1) ◽  
pp. 62-88 ◽  
Author(s):  
David O. Francis ◽  
James J. Daniero ◽  
Kristen L. Hovis ◽  
Nila Sathe ◽  
Barbara Jacobson ◽  
...  

Purpose The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health and Psychosocial Instrument databases were searched using relevant vocabulary terms and key terms related to PRO measures and voice. Inclusion and exclusion criteria were developed in consultation with an expert panel. Three independent investigators assessed study methodology using criteria developed a priori. Measurement properties were examined and entered into evidence tables. Results A total of 3,744 studies assessing voice-related constructs were identified. This list was narrowed to 32 PRO measures on the basis of predetermined inclusion and exclusion criteria. Questionnaire measurement properties varied widely. Important thematic deficiencies were apparent: (a) lack of patient involvement in the item development process, (b) lack of robust construct validity, and (c) lack of clear interpretability and scaling. Conclusions PRO measures are a principal means of evaluating treatment effectiveness in voice-related conditions. Despite their prominence, available PRO measures have disparate methodological rigor. Care must be taken to understand the psychometric and measurement properties and the applicability of PRO measures before advocating for their use in clinical or research applications.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Lucas Nepomuceno Barros ◽  
Ricardo Barreira Uchoa ◽  
Juan Alberto Cosquillo Mejia ◽  
Rogean Rodrigues Nunes ◽  
Denise Araujo Silva Nepomuceno Barros ◽  
...  

Abstract Background Right Ventricular Dysfunction (RVD) is the most frequent intraoperative hemodynamic complication in Heart Transplantation (HTx). RVD occurs in 0.04–1.0% of cardiac surgeries with cardiotomy and in 20–50% of HTx, with mortality up to 75%. No consensus has been established for how anesthesiologists should manage RVD, with management methods many times remaining unvalidated. Methods We conducted a systematic review, following PRISMA guidelines, to create an anesthetic protocol to manage RVD in HTx, using databases that include PubMed and Embase, until September 2018 based on inclusion and exclusion criteria. The articles screening for the systematic review were done two independent reviewers, in case of discrepancy, we consulted a third independent reviewer. Based on the systematic review, the anesthetic protocol was developed. The instrument selected to perform the validation of the protocol was AGREE II, for this purpose expert anesthetists were recruited to do this process. The minimum arbitration score for domains validation cutoff of AGREE II is arbitered to 70%. This study was registered at PROSPERO (115600). Results In the systematic review, 152 articles were included. We present the protocol in a flowchart with six steps based on goal-directed therapy, invasive monitoring, and transesophageal echocardiogram. Six experts judged the protocol and validated it. Conclusion The protocol has been validated by experts and new studies are needed to assess its applicability and potential benefits on major endpoints.


2019 ◽  
Vol 4 (5) ◽  
pp. 878-892
Author(s):  
Joseph A. Napoli ◽  
Linda D. Vallino

Purpose The 2 most commonly used operations to treat velopharyngeal inadequacy (VPI) are superiorly based pharyngeal flap and sphincter pharyngoplasty, both of which may result in hyponasal speech and airway obstruction. The purpose of this article is to (a) describe the bilateral buccal flap revision palatoplasty (BBFRP) as an alternative technique to manage VPI while minimizing these risks and (b) conduct a systematic review of the evidence of BBFRP on speech and other clinical outcomes. A report comparing the speech of a child with hypernasality before and after BBFRP is presented. Method A review of databases was conducted for studies of buccal flaps to treat VPI. Using the principles of a systematic review, the articles were read, and data were abstracted for study characteristics that were developed a priori. With respect to the case report, speech and instrumental data from a child with repaired cleft lip and palate and hypernasal speech were collected and analyzed before and after surgery. Results Eight articles were included in the analysis. The results were positive, and the evidence is in favor of BBFRP in improving velopharyngeal function, while minimizing the risk of hyponasal speech and obstructive sleep apnea. Before surgery, the child's speech was characterized by moderate hypernasality, and after surgery, it was judged to be within normal limits. Conclusion Based on clinical experience and results from the systematic review, there is sufficient evidence that the buccal flap is effective in improving resonance and minimizing obstructive sleep apnea. We recommend BBFRP as another approach in selected patients to manage VPI. Supplemental Material https://doi.org/10.23641/asha.9919352


2020 ◽  
Vol 01 ◽  
Author(s):  
Carla Pires ◽  
Ana Fernandes

Background: Natural products are commonly used for treating health problems. These products may be associated with adverse events, which are defined as "noxious and unintended response to a medicinal product" by the European Medicine Agency. Objectives: To identify studies describing at least one adverse event (or with potential to promote an adverse event) related to the use of natural products, as well as to describe the involved product(s) and adverse event(s). Methods: A pre-systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses criteria. Keywords: "natural product(s)" and ["adverse drug reaction(s)" or "adverse effect(s)"]. Screened databases: PubMed, SciELO, DOAJ and Google Scholar. Inclusion criteria: papers describing at least one adverse event associated with the use of natural products and published between 2017 and 2019. Exclusion criteria: Repeated studies, reviews and papers written in other languages than English, Portuguese, French or Spanish. Results: 104 studies were identified (20 PubMed; 0 SciELO; 2 DOAJ; 82 Google Scholar), but only 10 were selected (4 PubMed and 6 Google Scholar): 1 in-vitro study; 2 non-clinical studies, 1 study reporting in-vitro and clinical data and 5 studies were cases reports. Globally, 997 reports of adverse drug reactions with natural products were identified, mainly non-severe cases. Conclusion: Since a limited number of studies was found, we conclude that adverse events due to natural products may be underreported, or natural products may have a good safety profile. This review contributes for assuring the safety of natural products consumers, by evaluating the knowledge/information on the potential adverse events and interactions of these products.


2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Marie-Camille Patoz ◽  
Diego Hidalgo-Mazzei ◽  
Bruno Pereira ◽  
Olivier Blanc ◽  
Ingrid de Chazeron ◽  
...  

Abstract Background Despite an increasing number of available mental health apps in the bipolar disorder field, these tools remain scarcely implemented in everyday practice and are quickly discontinued by patients after downloading. The aim of this study is to explore adherence characteristics of bipolar disorder patients to dedicated smartphone interventions in research studies. Methods A systematic review following PRISMA guidelines was conducted. Three databases (EMBASE, PsychInfo and MEDLINE) were searched using the following keywords: "bipolar disorder" or "mood disorder" or “bipolar” combined with “digital” or “mobile” or “phone” or “smartphone” or “mHealth” or “ehealth” or "mobile health" or “app” or “mobile-health”. Results Thirteen articles remained in the review after exclusion criteria were applied. Of the 118 eligible studies, 39 did not provide adherence characteristics. Among the selected papers, study length, sample size and definition of measures of adherence were strongly heterogeneous. Activity rates ranged from 58 to 91.6%. Conclusion The adherence of bipolar patients to apps is understudied. Standardised measures of adherence should be defined and systematically evaluated in future studies dedicated to these tools.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Ryan Chow ◽  
Eileen Huang ◽  
Allen Li ◽  
Sophie Li ◽  
Sarah Y. Fu ◽  
...  

Abstract Background Postpartum depression (PPD) is a highly prevalent mental health problem that affects parental health with implications for child health in infancy, childhood, adolescence and beyond. The primary aim of this study was to critically appraise available systematic reviews describing interventions for PPD. The secondary aim was to evaluate the methodological quality of the included systematic reviews and their conclusions. Methods An electronic database search of MEDLINE, Embase, and the Cochrane Library from 2000 to 2020 was conducted to identify systematic reviews that examined an intervention for PPD. A Measurement Tool to Assess Systematic Reviews was utilized to independently score each included systematic review which was then critically appraised to better define the most effective therapeutic options for PPD. Results Of the 842 studies identified, 83 met the a priori criteria for inclusion. Based on the systematic reviews with the highest methodological quality, we found that use of antidepressants and telemedicine were the most effective treatments for PPD. Symptoms of PPD were also improved by traditional herbal medicine and aromatherapy. Current evidence for physical exercise and cognitive behavioural therapy in treating PPD remains equivocal. A significant, but weak relationship between AMSTAR score and journal impact factor was observed (p = 0.03, r = 0.24; 95% CI, 0.02 to 0.43) whilst no relationship was found between the number of total citations (p = 0.27, r = 0.12; 95% CI, − 0.09 to 0.34), or source of funding (p = 0.19). Conclusion Overall the systematic reviews on interventions for PPD are of low-moderate quality and are not improving over time. Antidepressants and telemedicine were the most effective therapeutic interventions for PPD treatment.


2021 ◽  
pp. 105566562110131
Author(s):  
Farrukh R. Virani ◽  
Evan C. Chua ◽  
Mary Roz Timbang ◽  
Tsung-yen Hsieh ◽  
Craig W. Senders

Objective: To determine the current applications of 3-dimensional (3D) printing in the care of patients with cleft lip and palate. We also reviewed 3D printing limitations, financial analysis, and future implications. Design: Retrospective systematic review. Methods: Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines were used by 3 independent reviewers. Articles were identified from Cochrane library, Ovid Medline, and Embase. Search terms included 3D printing, 3 dimensional printing, additive manufacturing, rapid prototyping, cleft lip, and cleft palate. Exclusion criteria included articles not in English, animal studies, reviews without original data, oral presentations, abstracts, opinion pieces, and articles without relevance to 3D printing or cleft lip and palate. Main Outcome Measures: Primary outcome measure was the purpose of 3D printing in the care of patients with cleft lip and palate. Secondary outcome measures were cost analysis and clinical outcomes. Results: Eight-four articles were identified, and 39 met inclusion/exclusion criteria. Eleven studies used 3D printing models for nasoalveolar molding. Patient-specific implants were developed via 3D printing in 6 articles. Surgical planning was conducted via 3D printing in 8 studies. Eight articles utilized 3D printing for anatomic models/educational purposes. 3-Dimensional printed models were used for surgical simulation/training in 6 articles. Bioprinting was utilized in 4 studies. Secondary outcome of cost was addressed in 8 articles. Conclusion: 3-Dimensional printing for the care of patients with cleft lip and palate has several applications. Potential advantages of utilizing this technology are demonstrated; however, literature is largely descriptive in nature with few clinical outcome measures. Future direction should be aimed at standardized reporting to include clinical outcomes, cost, material, printing method, and results.


2020 ◽  
Vol 79 (Suppl 1) ◽  
pp. 1464.1-1465
Author(s):  
J. Blaess ◽  
J. Walther ◽  
J. E. Gottenberg ◽  
J. Sibilia ◽  
L. Arnaud ◽  
...  

Background:Rheumatoid arthritis (RA) is the most frequent chronic inflammatory diseases with an incidence of 0.5% to 1%. Therapeutic arsenal of RA has continuously expanded in recent years with the recent therapeutic progress with the arrival of conventional synthetic disease-modifying anti-rheumatic drugs (csDMARDs), biological (bDMARDs) and targeted synthetic (tsDMARDs), JAK inhibitors. However, there are still some unmet needs for patients who do not achieve remission and who continue to worsen despite treatments. Of note, only approximately 40% of patients are ACR70 responders, in most randomized controlled trials. For these patients, finding new therapeutic avenues is challenging.Objectives:The objective of our study was to analyze the whole pipeline of immunosuppressive and immunomodulating drugs evaluated in RA and describe their mechanisms of action and stage of clinical development.Methods:We conducted a systematic review of all drug therapies in clinical development in RA in 17 databases of international clinical trials. Inclusion criterion: study from one of the databases using the keywords “Rheumatoid arthritis” (search date: June 1, 2019). Exclusion criteria: non-drug trials, trials not related to RA or duplicates. We also excluded dietary regimen or supplementations, cellular therapies, NSAIDs, glucorticoids or their derivatives and non-immunosuppressive or non-immunomodulating drugs. For each csDMARD, bDMARD and tsDMARD, we considered the study at the most advanced stage. For bDMARDs, we did not take into account biosimilars.Results:The research identified 4652 trials, of which 242 for 243 molecules met the inclusion and exclusion criteria. The developed molecules belong to csDMARDs (n=21), bDMARDs (n=117), tsDMARDs (n=105).Among the 21 csDMARDs molecules: 8 (38%) has been withdrawn, 4 (19%) are already labelled in RA (hydroxychloroquine, leflunomide, methotrexate and sulfasalazine) and 9 (43%) are in development: 1 (11%) is in phase I/II, 5 (56%) in phase II, 3 (33%) in phase IV.Among the 117 bDMARDs molecules: 69 (59%) has been withdrawn, 9 (8%) are labeled in RA (abatacept, adalimumab, anakinra, certolizumab, etanercept, golimumab, infliximab, rituximab, sarilumab, tocilizumab) and 39 (33%) are in development: 9 (23%) in phase I, 3 (8%) in phase I/II, 21 (54%) in phase II, 5 (12%) are in phase III, 1 (3%) in phase IV. bDMARDs currently under development target B cells (n=4), T cells (n=2), T/B cells costimulation (n=2),TNF alpha (n=2), Interleukine 1 or his receptor (n=3), Interleukine 6 or his receptor (n=7), Interleukine 17 (n=4), Interleukine 23 (n=1), GM-CSF (n=1), other cytokines or chemokines (n=5), integrins or adhesion proteins (n=3), interferon receptor (n=1) and various other targets (n=4).Among the 105 tsDMARDs molecules: 64 (61%) has been withdrawn, 6 (6%) JAK inhibitors, have just been or will probably soon be labelled (baricitinib, filgotinib, peficitinib, tofacitinib and upadacitinib), 35 (33%) are in development: 8 (24%) in phase I, 26 (74%) in phase II, 1 (3%) in phase III and. tsDMARDs currently under development target tyrosine kinase (n=12), janus kinase (JAK) (n=3), sphingosine phostate (n=3), PI3K pathway (n=1), phosphodiesterase-4 (n=3) B cells signaling pathways (n=3) and various other targets (n=10).Conclusion:A total of 242 therapeutic trials involving 243 molecules have been or are being evaluated in RA. This development does not always lead to new treatments since 141 (58%) have already been withdrawn. Hopefully, some of the currently evaluated drugs will contribute to improve the therapeutic management of RA patients, requiring a greater personalization of therapeutic strategies, both in the choice of molecules and their place in therapeutic sequences.Disclosure of Interests:Julien Blaess: None declared, Julia Walther: None declared, Jacques-Eric Gottenberg Grant/research support from: BMS, Pfizer, Consultant of: BMS, Sanofi-Genzyme, UCB, Speakers bureau: Abbvie, Eli Lilly and Co., Roche, Sanofi-Genzyme, UCB, Jean Sibilia: None declared, Laurent Arnaud: None declared, Renaud FELTEN: None declared


2021 ◽  
pp. 026921632110321
Author(s):  
Florence Reedy ◽  
Mark Pearson ◽  
Sarah Greenley ◽  
Joseph Clark ◽  
David C Currow ◽  
...  

Background: In combination with non-pharmacological interventions, opioids may safely reduce chronic breathlessness in patients with severe illness. However, implementation in clinical practice varies. Aim: To synthesise the published literature regarding health professionals’, patients’ and families’ views on the use of opioids for chronic breathlessness, identifying issues which influence implementation in clinical practice. Design: Systematic review and synthesis using the five-stage framework synthesis method. Data sources: Three electronic databases (MEDLINE, Embase via OVID, ASSIA via Proquest) were searched (March 2020) using a predefined search strategy. Studies were also citation chained from key papers. Papers were screened against a priori eligibility criteria. Data were extracted from included studies using the framework synthesis method. Qualitative and quantitative data were synthesised using the pillar process. Included studies were critically appraised using the Mixed-Methods Appraisal Tool. Results: After de-duplication, 843 papers were identified. Following screening, 22 studies were included. Five themes were developed: (i) clinician/patient characteristics, (ii) education/knowledge/experience, (iii) relationship between clinician/family, (iv) clinician/patient fear of opioids and (v) regulatory issues. Conclusions: There are significant barriers and enablers to the use of opioids for the symptomatic reduction of chronic breathlessness based on the knowledge, views and attitudes of clinicians, patients and families. Clinicians’ interactions with patients and their families strongly influences adherence with opioid treatment regimens for chronic breathlessness. Clinicians’, patients’ and families’ knowledge about the delicate balance between benefits and risks is generally poor. Education for all, but particularly clinicians, is likely to be a necessary (but insufficient) factor for improving implementation in practice.


2013 ◽  
Vol 18 (6) ◽  
pp. 100-105 ◽  
Author(s):  
Mariana de Aguiar Bulhões Galvão ◽  
Gladys Cristina Dominguez ◽  
Sérgio Thomaz Tormin ◽  
Alex Akamine ◽  
André Tortamano ◽  
...  

INTRODUCTION: Moyers analysis is widely used for analyzing mixed dentition, however, the accuracy of its theoretical probability tables has been recently questioned. Taking into consideration the fact the mixed dentition analysis is of paramount importance to precisely determine the space needed for alignment of canines and premolars, this research aimed at objectively assessing in the literature such an important step for orthodontic diagnosis. METHODS: A computerized search involving articles published on PubMed and Lilacs between 1990 and September, 2011 was conducted in accordance with the method described in the Cochrane 5.1.0 handbook. RESULTS: The research resulted in a sample composed of 629 articles. The inclusion criteria were: Articles using the Moyers analysis with a sample greater or equal to 40 patients. Conversely, the exclusion criteria were: Dental casts of patients with syndromes or oral cleft, researches conducted with a literature review, only, or clinical case reports and researches conducted before 1990. For this systematic review, 19 articles were selected. CONCLUSION: Based on the literature available, we can conclude that the Moyers mixed dentition analysis must be carefully used, since the majority of the articles analyzed showed that the probability of 75% was not as accurate as expected, leading to the need of adapting the probability levels depending on the study population.


Sign in / Sign up

Export Citation Format

Share Document