scholarly journals Methods used to meta-analyse results from interrupted time series studies: A methodological systematic review protocol

F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 110
Author(s):  
Elizabeth Korevaar ◽  
Amalia Karahalios ◽  
Andrew B. Forbes ◽  
Simon L. Turner ◽  
Steve McDonald ◽  
...  

Background: Systematic reviews are used to inform healthcare decision making. In reviews that aim to examine the effects of organisational, policy change or public health interventions, or exposures, evidence from interrupted time series (ITS) studies may be included. A core component of many systematic reviews is meta-analysis, which is the statistical synthesis of results across studies. There is currently a lack of guidance informing the choice of meta-analysis methods for combining results from ITS studies, and there have been no studies examining the meta-analysis methods used in practice. This study therefore aims to describe current meta-analysis methods used in a cohort of reviews of ITS studies. Methods: We will identify the 100 most recent reviews (published between 1 January 2000 and 11 October 2019) that include meta-analyses of ITS studies from a search of eight electronic databases covering several disciplines (public health, psychology, education, economics). Study selection will be undertaken independently by two authors. Data extraction will be undertaken by one author, and for a random sample of the reviews, two authors. From eligible reviews we will extract details at the review level including discipline, type of interruption and any tools used to assess the risk of bias / methodological quality of included ITS studies; at the meta-analytic level we will extract type of outcome, effect measure(s), meta-analytic methods, and any methods used to re-analyse the individual ITS studies. Descriptive statistics will be used to summarise the data. Conclusions: This review will describe the methods used to meta-analyse results from ITS studies. Results from this review will inform future methods research examining how different meta-analysis methods perform, and ultimately, the development of guidance.

F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 110
Author(s):  
Elizabeth Korevaar ◽  
Amalia Karahalios ◽  
Andrew B. Forbes ◽  
Simon L. Turner ◽  
Steve McDonald ◽  
...  

Background: Systematic reviews are used to inform healthcare decision making. In reviews that aim to examine the effects of organisational, policy change or public health interventions, or exposures, evidence from interrupted time series (ITS) studies may be included. A core component of many systematic reviews is meta-analysis, which is the statistical synthesis of results across studies. There is currently a lack of guidance informing the choice of meta-analysis methods for combining results from ITS studies, and there have been no studies examining the meta-analysis methods used in practice. This study therefore aims to describe current meta-analysis methods used in a cohort of reviews of ITS studies. Methods: We will identify the 100 most recent reviews (published between 1 January 2000 and 11 October 2019) that include meta-analyses of ITS studies from a search of eight electronic databases covering several disciplines (public health, psychology, education, economics). Study selection will be undertaken independently by two authors. Data extraction will be undertaken by one author, and for a random sample of the reviews, two authors. From eligible reviews we will extract details at the review level including discipline, type of interruption and any tools used to assess the risk of bias / methodological quality of included ITS studies; at the meta-analytic level we will extract type of outcome, effect measure(s), meta-analytic methods, and any methods used to re-analyse the individual ITS studies. Descriptive statistics will be used to summarise the data. Conclusions: This review will describe the methods used to meta-analyse results from ITS studies. Results from this review will inform future methods research examining how different meta-analysis methods perform, and ultimately, the development of guidance.


F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 110
Author(s):  
Elizabeth Korevaar ◽  
Amalia Karahalios ◽  
Andrew B. Forbes ◽  
Simon L. Turner ◽  
Steve McDonald ◽  
...  

Background: Systematic reviews are used to inform healthcare decision making. In reviews that aim to examine the effects of organisational, policy change or public health interventions, or exposures, evidence from interrupted time series (ITS) studies may be included. A core component of many systematic reviews is meta-analysis, which is the statistical synthesis of results across studies. There is currently a lack of guidance informing the choice of meta-analysis methods for combining results from ITS studies, and there have been no studies examining the meta-analysis methods used in practice. This study therefore aims to describe current meta-analysis methods used in a cohort of reviews of ITS studies. Methods: We will identify 100 reviews that include meta-analyses of ITS studies from a search of eight electronic databases covering several disciplines (public health, psychology, education, economics). Study selection will be undertaken independently by two authors. Data extraction will be undertaken by one author, and for a random sample of the reviews, two authors. From eligible reviews we will extract details at the review level including discipline and type of interruption; at the meta-analytic level we will extract type of outcome, effect measure(s), meta-analytic methods, and any methods used to re-analyse the individual ITS studies. Descriptive statistics will be used to summarise the data. Conclusions: This review will describe the methods used to meta-analyse results from ITS studies. Results from this review will inform future methods research examining how different meta-analysis methods perform, and ultimately, the development of guidance.


2021 ◽  
Vol 20 ◽  
pp. e211701
Author(s):  
Leticia Tainá de Oliveira Lemes ◽  
Lara Dotto ◽  
Bernardo Antonio Agostini ◽  
Gabriel Kalil Rocha Pereira ◽  
Rafael Sarkis-Onofre

Aim: This study aimed to evaluate how meta-analyses are conducted and reported in dentistry. Methods: We conducted a search to identify dentistry-related Systematic Reviews (SRs) indexed in PubMed in 2017 (from January 01 until December 31) and published in the English language. We included only SRs reporting at least one meta-analysis. The study selection followed the 4-phase flow set forth in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement (PRISMA), and it was independently conducted by two researchers. Data extraction was performed by one of three reviewers, and data related to conducting and reporting of the meta-analysis were collected. Descriptive data analysis was performed summarizing frequencies for categorical items or median and interquartile range for continuous data. Results: We included 214 SRs with meta-analyses. Most of the studies reported in the title that a meta-analysis was conducted. We identified three critical flaws in the included studies: Ninety (90) meta-analyses (43.1%) did not specify the primary outcome; most of the meta-analyses reported that a measure of statistical heterogeneity was used to justify the use of a fixed-effect or random-effects meta-analysis model (n=114, 58.5%); and a great part did not assess publication bias (n=106, 49.5%). Conclusion: We identified deficiencies in the reporting and conduct of meta-analysis in dentistry, suggesting that there is room for improvement. Educational approaches are necessary to improve the quality of such analyses and to avoid biased and imprecise results.


BMJ Open ◽  
2018 ◽  
Vol 8 (12) ◽  
pp. e022797 ◽  
Author(s):  
Xiang-Dong Wu ◽  
Meng-Meng Liu ◽  
Ya-Ying Sun ◽  
Zhi-Hu Zhao ◽  
Quan Zhou ◽  
...  

IntroductionJoint arthroplasty is a particularly complex orthopaedic surgical procedure performed on joints, including the hip, knee, shoulder, ankle, elbow, wrist and even digit joints. Increasing evidence from volume–outcomes research supports the finding that patients undergoing joint arthroplasty in high-volume hospitals or by high-volume surgeons achieve better outcomes, and minimum case load requirements have been established in some areas. However, the relationships between hospital/surgeon volume and outcomes in patients undergoing arthroplasty are not fully understood. Furthermore, whether elective arthroplasty should be restricted to high-volume hospitals or surgeons remains in dispute, and little is known regarding where the thresholds should be set for different types of joint arthroplasties.Methods and analysesThis is a protocol for a suite of systematic reviews and dose–response meta-analyses, which will be amended and updated in conjunction with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols. Electronic databases, including PubMed and Embase, will be searched for observational studies examining the relationship between the hospital or surgeon volume and clinical outcomes in adult patients undergoing primary or revision of joint arthroplasty. We will use records management software for study selection and a predefined standardised file for data extraction and management. Quality will be assessed using the Newcastle-Ottawa Scale, and the meta-analysis, subgroup analysis and sensitivity analysis will be performed using Stata statistical software. Once the volume–outcome relationships are established, we will examine the potential non-linear relationships between hospital/surgeon volume and outcomes and detect whether thresholds or turning points exist.Ethics and disseminationEthical approval is not required, because these studies are based on aggregated published data. The results of this suite of systematic reviews and meta-analyses will be submitted to peer-reviewed journals for publication.PROSPERO registration numberCRD42017056639.


Medicina ◽  
2021 ◽  
Vol 58 (1) ◽  
pp. 1
Author(s):  
Hye Won Lee ◽  
Lin Ang ◽  
Jung Tae Kim ◽  
Myeong Soo Lee

Background and Objectives: This review aimed to provide an updated review of evidence regarding the effects of aromatherapy in relieving symptoms of burn injuries, focusing on pain and physiological distress. Materials and Methods: Fifteen databases (including five English databases, four Korean medical databases, and four Iranian databases) and trial registries were searched for studies published between their dates of inception and July 2021. Two review authors individually performed study selection, data extraction, and risk of bias assessment, and any discrepancies were solved by a third review author. Results: Eight RCTs met our inclusion criteria and were analyzed in this updated systematic review. Our meta-analyses revealed that inhaled aromatherapy plus routine care showed beneficial effects in relieving pain after dressing, as compared to placebo plus routine care (p < 0.00001) and routine care alone (p = 0.02). Additionally, inhaled aromatherapy plus routine care (p < 0.00001) and aromatherapy massage plus routine care (p < 0.0001) also showed superior effects in calming anxiety, as compared to routine care alone. None of the included studies reported on AEs. Overall, the risk of bias across the studies was concerning. Conclusions: This updated review and synthesis of the studies had brought a more detailed understanding of the potential application of aromatherapy for easing the pain and anxiety of burn patients.


2019 ◽  
Vol 20 (2) ◽  
pp. 305-318
Author(s):  
Rachael Vriezen ◽  
Jan M. Sargeant ◽  
Ellen Vriezen ◽  
Charlotte B. Winder ◽  
Annette M. O'Connor

AbstractTo implement effective stewardship in food animal production, it is essential that producers and veterinarians are aware of preventive interventions to reduce illness in livestock. Systematic reviews and meta-analyses (SR/MA) provide transparent, replicable, and quality-assessed overviews. At present, it is unknown how many SR/MA evaluate preventive antibiotic use or management practices aimed at reducing disease risk in animal agriculture. Further, the quality of existing reviews is unknown. Our aim was to identify reviews investigating these topics and to provide an assessment of their quality. Thirty-eight relevant reviews were identified. Quality assessment was based on the AMSTAR 2 framework for the critical appraisal of systematic reviews. The quality of most of the reviews captured was classified as critically low (84.2%, n = 32/38), and only a small percentage of the evaluated reviews did not contain critical weaknesses (7.9%, n = 3/38). Particularly, a small number of reviews reported the development of an a priori protocol (15.8%, n = 6/38), and few reviews stated that key review steps were conducted in duplicate (study selection/screening: 26.3%, n = 10/38; data extraction: 15.8%, n = 6/38). The development of high-quality reviews summarizing evidence on approaches to antibiotic reduction is essential, and thus greater adherence to quality conduct guidelines for synthesis research is crucial.


BMJ Open ◽  
2019 ◽  
Vol 9 (10) ◽  
pp. e030472 ◽  
Author(s):  
Jean Joel Bigna ◽  
Joel Noutakdie Tochie ◽  
Dahlia Noelle Tounouga ◽  
Anne Olive Bekolo ◽  
Nadia S Ymele ◽  
...  

IntroductionTo set priorities for public health policy, funding for public health interventions, and healthcare planning which will ultimately contribute in bending the burden of toxoplasmosis towards maternal and neonatal health, it is necessary to have accurate data on the prevalence of toxoplasmosis in pregnancy. Therefore, we aimed to estimate the seroprevalence ofToxoplasma gondiiinfection in pregnant women by countries, WHO regions and globally.Methods and analysisWe will search multiple databases to identify studies that reported the prevalence (or enough data to compute this estimate) ofToxoplasma gondiiin the global population of pregnant women up till December 31, 2018 without any language restrictions. Study selection, data extraction and risk of bias assessment will be conducted independently by three pairs of investigators. For each country, we will estimate the prevalence based on empirical studies if there is either one nationally representative study, or two or more not nationally representative studies. Then, we will perform a country-specific random-effects meta-analyses. The heterogeneity will be evaluated using the χ² test on Cochrane’s Q statistic and quantified with H and I² statistics. For countries with one or no empirical studies or where the meta-analysis will result in a wide CI of 0%–100%, we will predict the country’s prevalence by using a Bayesian generalised non-linear multilevel model. The model will have a hierarchical structure in which estimates for each country will be informed by its own data, if available, or by data from other countries in the same WHO region.Ethics and disseminationSince this study will be based on published data, it does not require any ethical approval. Its findings will be published in a scientific peer-reviewed journal. They will also be presented at scientific conferences and to relevant public health sectors.PROSPERO registration numberCRD42019125572.


BMJ Open ◽  
2021 ◽  
Vol 11 (12) ◽  
pp. e054479
Author(s):  
Qing-Hua Chen ◽  
Yu-Ling Li ◽  
Yi-Ru Hu ◽  
Wan-Yuan Liang ◽  
Bin Zhang

IntroductionSuicide is a serious problem worldwide and 90% cases are associated with pre-existing or underlying mental illness. As a common treatment for depressive symptoms that suicidal people may receive, selective serotonin reuptake inhibitors (SSRIs) have been linked to a possible increase in suicide rates. Studies focusing on SSRIs and suicide have produced inconsistent results, suggesting that use of SSRIs decreases, increases, has no effect on suicide rates, or that the effect of SSRIs on suicide is age-dependent. This protocol of network meta-analysis aims to precisely evaluate the time effects of SSRIs by observing weekly changes of suicidality in the first 2 months of the treatment, and consequently, to explore whether the effect of the SSRIs on suicide varies depending on the stages of the treatment; if so, we will identify the turning point.Methods and analysisWe will search in the following databases: PubMed, Web of science, China National Knowledge Infrastructure and Wanfang Data, from dates of inception to 9 July 2021, with language restricted to English and Chinese. Studies focusing on the time effect of SSRIs on suicide will be retrieved. Then, the study selection process will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guideline, and the quality assessment will be conducted with Cochrane Collaboration’s tool. Two researchers will work independently on data extraction using a standardised data extraction spreadsheet. Any disagreement between two researchers will be discussed and determined by a third researcher.Ethics and disseminationThis work does not require ethics approval as it will be based on published studies. This review will be published in peer-reviewed journals.PROSPERO registration numberCRD42021244779.


BMJ Open ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. e031442
Author(s):  
Carole Lunny ◽  
Cynthia Ramasubbu ◽  
Savannah Gerrish ◽  
Tracy Liu ◽  
Douglas M Salzwedel ◽  
...  

IntroductionGuidelines are systematically developed recommendations to assist practitioner and patient decisions about treatments for clinical conditions. High quality and comprehensive systematic reviews and ‘overviews of systematic reviews’ (overviews) represent the best available evidence. Many guideline developers, such as the WHO and the Australian National Health and Medical Research Council, recommend the use of these research syntheses to underpin guideline recommendations. We aim to evaluate the impact and use of systematic reviews with and without pairwise meta-analysis or network meta-analyses (NMAs) and overviews in clinical practice guideline (CPG) recommendations.Methods and analysisCPGs will be retrieved from Turning Research Into Practice and Epistemonikos (2017–2018). The retrieved citations will be sorted randomly and then screened sequentially by two independent reviewers until 50 CPGs have been identified. We will include CPGs that provide at least two explicit recommendations for the management of any clinical condition. We will assess whether reviews or overviews were cited in a recommendation as part of the development process for guidelines. Data extraction will be done independently by two authors and compared. We will assess the risk of bias by examining how each guideline developed clinical recommendations. We will calculate the number and frequency of citations of reviews with or without pairwise meta-analysis, reviews with NMAs and overviews, and whether they were systematically or non-systematically developed. Results will be described, tabulated and categorised based on review type (reviews or overviews). CPGs reporting the use of the Grading of Recommendations, Assessment, Development and Evaluation approach will be compared with those using a different system, and pharmacological versus non-pharmacological CPGs will be compared.Ethics and disseminationNo ethics approval is required. We will present at the Cochrane Colloquium and the Guidelines International Network conference.


2022 ◽  
pp. rapm-2021-102981
Author(s):  
Rachel H McGregor ◽  
Freda M Warner ◽  
Lukas D Linde ◽  
Jacquelyn J Cragg ◽  
Jill A Osborn ◽  
...  

BackgroundIn an attempt to aggregate observations from clinical trials, several meta-analyses have been published examining the effectiveness of systemic, non-opioid, pharmacological interventions to reduce the incidence of chronic postsurgical pain.ObjectiveTo inform the design and reporting of future studies, the purpose of our study was to examine the quality of these meta-analyses.Evidence reviewWe conducted an electronic literature search in Embase, MEDLINE, and the Cochrane Database of Systematic Reviews. Published meta-analyses, from the years 2010 to 2020, examining the effect of perioperative, systemic, non-opioid pharmacological treatments on the incidence of chronic postsurgical pain in adult patients were identified. Data extraction focused on methodological details. Meta-analysis quality was assessed using the A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR 2) critical appraisal tool.FindingsOur search yielded 17 published studies conducting 58 meta-analyses for gabapentinoids (gabapentin and pregabalin), ketamine, lidocaine, non-steroidal anti-inflammatory drugs, and mexiletine. According to AMSTAR 2, 88.2% of studies (or 15/17) were low or critically low in quality. The most common critical element missing was an analysis of publication bias. Trends indicated an improvement in quality over time and association with journal impact factor.ConclusionsWith few individual trials adequately powered to detect treatment effects, meta-analyses play a crucial role in informing the perioperative management of chronic postsurgical pain. In light of this inherent value and despite a number of attempts, high-quality meta-analyses are still needed.PROSPERO registration numberCRD42021230941.


Sign in / Sign up

Export Citation Format

Share Document