scholarly journals Reporting standards for literature searches and report inclusion criteria: Making research syntheses more transparent and easy to replicate

2016 ◽  
Author(s):  
Hannah Moshontz
Keyword(s):  
Literature Search ◽  
Meta Analysis ◽  
Research Synthesis ◽  
Search Strategies ◽  
Reference Database ◽  
Synthesis Methods ◽  
Reporting Standards ◽  
Inclusion Criteria ◽  
Literature Searches ◽  
Made In

A complete description of the literature search, including the criteria used for the inclusion of reports after they have been located, used in a research synthesis or meta-analysis is critical if subsequent researchers are to accurately evaluate and reproduce a synthesis' methods and results. Based on previous guidelines and new suggestions, we present a set of focused and detailed standards for reporting the methods used in a literature search. The guidelines cover five search strategies: reference database searches, journal and bibliography searches, searches of the reference lists of reports, citation searches, and direct contact searches. First, we bring together all the unique recommendations made in existing guidelines for research synthesis. Second, we identify gaps in reporting standards for search strategies. Third, we address these gaps by providing new reporting recommendations. Our hope is to facilitate successful evaluation and replication of research synthesis results.

scholarly journals Impact of Non-Confinement Accommodation on Farrowing Performance: A Systematic Review and Meta-Analysis of Farrowing Crates Versus Pens

Animals ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. 957 ◽  
Author(s):  
Dannielle Glencorse ◽  
Kate Plush ◽  
Susan Hazel ◽  
Darryl D’Souza ◽  
Michelle Hebart
Keyword(s):  
Systematic Review ◽  
Relative Risk ◽  
Web Of Science ◽  
Meta Analysis ◽  
Inclusion Criteria ◽  
Literature Searches ◽  
Piglet Mortality ◽  
Partial Confinement ◽  
Meta Analyses ◽  
Piglet Survival

There are conflicting reports regarding the effect of farrowing house accommodation on piglet performance. The aim of this investigation was to use a systematic review and meta-analyses to summarise the results of publications that focused on direct comparisons between full confinement conventional crates and various designs of loose-housed farrowing pens from loading until weaning. Literature searches in Scopus, BIOSIS Previews, Cab Abstracts, and Web of Science identified 6695 articles. Twenty-two publications were retained for the systematic review and individual meta-analyses after screening for inclusion criteria. The random effects meta-analyses were performed on crate versus pen for number of piglets born alive, number of stillborn piglets, pre-weaning mortality, and number of piglets weaned. Additionally, the modifiers of confinement length (no confinement from loading until weaning or partial confinement for shorter periods of time in the early stages post parturition), enrichment (no enrichment or enrichment provided), and pen size (small, medium, or large) were examined. There was a 14% increase in the relative risk of piglet mortality in farrowing pens when they were compared with crates (p = 0.0015). The number of stillborns per litter was not different between the pen and crate. However, when providing enrichment in the pens, there was an increase in stillborns within farrowing crates versus pens (p = 0.009). There was no overall effect on piglets that were born alive or number weaned. As there is no difference between piglets born alive and mortality is significantly higher in farrowing pens, a reduction in the number of piglets weaned was expected but not observed, which was possibly due to the lack of weaning details provided in the publications. This was the first systematic review and meta-analysis conducted on the performance of farrowing accommodation and identified that farrowing pens do compromise post-natal piglet survival. Future efforts should focus on improving sow comfort in the farrowing crate to maximize both piglet and sow welfare.

scholarly journals Comparative clinical trials in psychotherapy: Have large effects been replicated?

2020 ◽  
Vol 29 ◽  
Author(s):  
Nickolas D. Frost ◽  
Thomas W. Baskin ◽  
Bruce E. Wampold
Keyword(s):  
Clinical Trials ◽  
Treatment Efficacy ◽  
Literature Search ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Depression And Anxiety ◽  
Inclusion Criteria ◽  
Average Quality ◽  
Meta Analyses

Abstract Aims The purpose of this review is to examine the replication attempts of psychotherapy clinical trials for depression and anxiety. We focus specifically on replications of trials that exhibit large differences between psychotherapies. The replicability of these trials is especially important for meta-analysis, where the inclusion of false-positive trials can lead to erroneous conclusions about treatment efficacy. Methods Standard replication criteria were developed to distinguish direct from conceptual replication methodologies. Next, an exhaustive literature search was conducted for published meta-analyses of psychotherapy comparisons. Trials that exhibited large effects (d > 0.8) were culled from these meta-analyses. For each trial, a cited replication was conducted to determine if the trial had been subsequently replicated by either ‘direct’ or ‘conceptual’ methods. Finally, a broader search was conducted to examine the extent of replication efforts in the psychotherapy literature overall. Results In the meta-analytic search, a total of N = 10 meta-analyses met the inclusion criteria. From these meta-analyses, N = 12 distinct trials exhibited large effect sizes. The meta-analyses containing more than two large effect trials reported evidence for treatment superiority. A cited replication search yielded no direct replication attempts (N = 0) for the trials with large effects, and N = 4 conceptual replication attempts of average or above average quality. However, of these four attempts, only two partially corroborated the results from their original trial. Conclusion Meta-analytic reviews are influenced by trials with large effects, and it is not uncommon for these reviews to contain several such trials. Since we find no evidence that trials with such large effects are directly replicable, treatment superiority conclusions from these reviews are highly questionable. To enhance the quality of clinical science, the development of authoritative replication criteria for clinical trials is needed. Moreover, quality benchmarks should be considered before trials are included in a meta-analysis, or replications are attempted.

Cisplatin-associated nephrotoxicity in clinical trials using serum creatinine (SCr) versus calculated glomerular filtration rate (GFR) as inclusion criterion: A meta-analysis.

2013 ◽  
Vol 31 (6_suppl) ◽  
pp. 272-272
Author(s):  
Arati Dahal ◽  
Brandon Kyle Bellows ◽  
Guru Sonpavde ◽  
Matt D. Galsky ◽  
Neeraj Agarwal
Keyword(s):  
Renal Function ◽  
Fixed Effects ◽  
Literature Search ◽  
Meta Analysis ◽  
Indirect Comparison ◽  
Inclusion Criteria ◽  
Who Grade ◽  
Increased Risk ◽  
Grade 3 ◽  
Re Methods

272 Background: Treatment with cisplatin (CIS) is associated with increased risk of nephrotoxicity and SCr is commonly used to screen patients for renal dysfunction prior to enrollment in trials using CIS. However, GFR is known to better estimate renal function than SCr. The objective of this trial-level meta-analysis was to indirectly compare incidence of WHO grade ≥3 nephrotoxicity associated with CIS therapy when renal function was assessed using SCr vs. calculated GFR during screening for these trials. Methods: A PubMed literature search was used to identify randomized trials comparing treatment regimens including CIS to those without CIS. Studies were included if they were performed between 1990 and 2005, reported SCr or GFR as inclusion criteria, and reported WHO grade ≥3 nephrotoxic events for both the CIS and non-CIS treatment arms. Studies were excluded if they were review articles, observational, phase 1, non-randomized, did not have a comparator group, or were not reported in English. Inverse variance weighted fixed effects (FE) and random effects (RE) methods were used to estimate the relative risk (RR) associated with CIS vs. non-CIS containing regimens with sub-group analyses of studies using SCr, GFR, and either SCr or GFR for screening. Results: The literature search identified 2359 studies. After exclusion criteria, 549 were reviewed and 24 studies (N=5524 patients) met all inclusion criteria for analysis. Of these, 16 studies used SCr (N=3955), 3 used GFR (N=692), and 5 used SCr or GFR (N=877) for screening. Overall incidence proportion of nephrotoxicity was higher for CIS vs. non-CIS regimens (2.1% vs. 0.7%). Overall RR for CIS vs. non-CIS regimens was 2.49 (95%CI 1.37-4.51, p=0.003). In sub-group analyses, the RR was 2.63 (95%CI 1.29-5.39, p=0.008) for SCr compared to 2.39 (95%CI 0.53-10.64, p=0.26) for GFR and 2.03 (95%CI 0.46-9.02, p=0.35) for either SCr or GFR. The RRs did not differ between the FE and RE methods. Conclusions: This indirect comparison meta-analysis shows CIS is associated with a higher likelihood of nephrotoxicity vs. non-CIS regimens, and may be higher when SCr is used instead of GFR as eligibility criteria.

scholarly journals The effects of Rhodiola Rosea supplementation on depression, anxiety and mood – A Systematic Review

2020 ◽  
Vol 3 (1) ◽  
pp. 72-82
Author(s):  
Fanaras Konstantinos ◽  
Reinhard Heun
Keyword(s):  
Systematic Review ◽  
Randomized Controlled Trials ◽  
Rhodiola Rosea ◽  
Depression Symptoms ◽  
Controlled Trials ◽  
Inclusion Criteria ◽  
Randomized Controlled ◽  
Moderate Depression ◽  
Literature Searches ◽  
Made In

AbstractObjectivesRhodiola rosea is an adaptogen herb from the Crassulaceae family, which has been vastly used in the Russian and Chinese medicine. The herb is used against depression, anxiety, mental and physical fatigue and to promote overall health. In this systematic review, we examined the effects of R. rosea on depression, anxiety and mood, as these are the most relevant to mental health.MethodsLiterature searches were made in PubMed using the term ‘Rhodiola rosea’. Inclusion criteria were: Randomized controlled trials using interventions of R. rosea on any type of participants, while focusing on the effects of the intervention on depression, anxiety or mood. Mixed interventions of R. rosea with other herbs were excluded. Studies not published in English or Greek were excluded.ResultsA total of 39 randomized controlled trials were identified and their abstract was screened. After screening, a total of 17 papers were excluded because they were focusing on irrelevant outcomes. The full text of the remaining 22 papers was read and an additional 17 papers were excluded. These papers were excluded because they were eventually not focusing on our main outcome or they were using R. rosea interventions with other herbs. In the end, a total of 5 papers (n = 327 participants) were found eligible for our systematic review. In these studies, R. rosea seems to improve the symptoms of mild to moderate depression, symptoms of mild anxiety and to enhance mood. The last date of our search was October 13, 2019.ConclusionRhodiola rosea supplementation may alleviate symptoms of mild to moderate depression and mild anxiety, while it may also enhance mood. The findings of our review are not definite due to the lack of available experimental data. Randomized controlled trials with a low risk of bias are needed to further study the herb.

Meta-Analysis in Health and Risk Messaging

2017 ◽  
Author(s):  
Simon Zebregs ◽  
Gert-Jan de Bruijn
Keyword(s):  
Meta Analysis ◽  
Empirical Studies ◽  
Research Synthesis ◽  
Basic Knowledge ◽  
Inclusion Criteria ◽  
Clear Cut ◽  
Analytical Research ◽  
Meta Analyses ◽  
Quality Assessments ◽  
Selection Of

Meta-analyses are becoming increasingly popular in the field of health and risk communication—meta-analyses allow for more precise estimations of the magnitude of effects and the robustness of those effects across empirical studies in a particular domain. Despite its popularity, most scholars are not trained in the basic methods involved with meta-analyses. There are advantages to meta-analysis in comparison to other forms of research synthesis. An overview of the methods involved in conducting and reporting meta-analytical research is helpful. However, the methods involved with meta-analyses are not as clear-cut as they may first appear. Numerous issues must be considered and various arbitrary decisions are required during the process. These issues and decisions relate to various topics such as inclusion criteria, the selection of sources, quality assessments for eligible studies, and publication bias. Basic knowledge of these issues and decisions is important for interpreting the outcomes of a meta-analysis correctly.

An Empirical Review of Research and Reporting Practices in Psychological Meta-Analyses

2020 ◽  
Vol 24 (3) ◽  
pp. 195-209
Author(s):  
Richard E. Hohn ◽  
Kathleen L. Slaney ◽  
Donna Tafreshi
Keyword(s):  
Meta Analysis ◽  
Reporting Standards ◽  
Exclusion Criteria ◽  
Research Practices ◽  
Reporting Practices ◽  
Reporting Decisions ◽  
Research Findings ◽  
State Of Research ◽  
Meta Analyses ◽  
Made In

As meta-analytic studies have come to occupy a sizable contingent of published work in the psychological sciences, clarity in the research and reporting practices of such work is crucial to the interpretability and reproducibility of research findings. The present study examines the state of research and reporting practices within a random sample of 384 published psychological meta-analyses across several important dimensions (e.g., search methods, exclusion criteria, statistical techniques). In addition, we surveyed the first authors of the meta-analyses in our sample to ask them directly about the research practices employed and reporting decisions made in their studies, including the assessments and procedures they conducted and the guidelines or materials they relied on. Upon cross-validating the first author responses with what was reported in their published meta-analyses, we identified numerous potential gaps in reporting and research practices. In addition to providing a survey of recent reporting practices, our findings suggest that (a) there are several research practices conducted by meta-analysts that are ultimately not reported; (b) some aspects of meta-analysis research appear to be conducted at disappointingly low rates; and (c) the adoption of the reporting standards, including the Meta-Analytic Reporting Standards (MARS), has been slow to nonexistent within psychological meta-analytic research.

scholarly journals Associations of tobacco retailer density and proximity with adult tobacco use behaviours and health outcomes: a meta-analysis

2021 ◽  
pp. tobaccocontrol-2021-056717
Author(s):  
Joseph G L Lee ◽  
Amanda Y Kong ◽  
Kerry B Sewell ◽  
Shelley D Golden ◽  
Todd B Combs ◽  
...  
Keyword(s):  
Health Outcomes ◽  
Tobacco Use ◽  
Data Extraction ◽  
Meta Analysis ◽  
Grey Literature ◽  
Inclusion Criteria ◽  
Data Synthesis ◽  
Literature Searches ◽  
Adult Participants ◽  
Study Selection

ObjectiveWe sought to conduct a systematic review and meta-analysis of evidence to inform policies that reduce density and proximity of tobacco retailers.Data sourcesTen databases were searched on 16 October 2020: MEDLINE via PubMed, PsycINFO, Global Health, LILACS, Embase, ABI/Inform, CINAHL, Business Source Complete, Web of Science and Scopus, plus grey literature searches using Google and the RAND Publication Database.Study selectionIncluded studies used inferential statistics about adult participants to examine associations between tobacco retailer density/proximity and tobacco use behaviours and health outcomes. Of 7373 studies reviewed by independent coders, 37 (0.5%) met inclusion criteria.Data extractionEffect sizes were converted to a relative risk reduction (RRR) metric, indicating the presumed reduction in tobacco use outcomes based on reducing tobacco retailer density and decreasing proximity.Data synthesisWe conducted a random effects meta-analysis and examined heterogeneity across 27 studies through subgroup analyses and meta-regression. Tobacco retailer density (RRR=2.55, 95% CI 1.91 to 3.19, k=155) and proximity (RRR=2.38, 95% CI 1.39 to 3.37, k=100) were associated with tobacco use behaviours. Pooled results including both density and proximity found an estimated 2.48% reduction in risk of tobacco use from reductions in tobacco retailer density and proximity (RRR=2.48, 95% CI 1.95 to 3.02, k=255). Results for health outcomes came from just two studies and were not significant. Considerable heterogeneity existed.ConclusionsAcross studies, lower levels of tobacco retailer density and decreased proximity are associated with lower tobacco use. Reducing tobacco supply by limiting retailer density and proximity may lead to reductions in tobacco use. Policy evaluations are needed.

scholarly journals Hyperhomocysteinemia and Ischemic Stroke: A Potential Dose-Response Association—A Systematic Review and Meta-analysis

TH Open ◽  
2021 ◽  
Vol 05 (03) ◽  
pp. e420-e437
Author(s):  
Marte Holmen ◽  
Anne-Mette Hvas ◽  
Johan F. H. Arendt
Keyword(s):  
Ischemic Stroke ◽  
Dose Response ◽  
Meta Analysis ◽  
Adult Population ◽  
Response Analysis ◽  
Inclusion Criteria ◽  
Unique Identifier ◽  
Literature Searches ◽  
Increased Risk ◽  
Nonlinear Association

Abstract Background and Purpose Previous studies suggest an association between increased homocysteine (Hcy) and risk of ischemic stroke. Yet, it remains unknown whether a dose-response association exists between Hcy levels and risk of ischemic stroke. Methods Systematic literature searches were performed in PubMed, Embase, Scopus, and Web of Science. Inclusion criteria were studies investigating ischemic stroke risk in an adult population with measured Hcy levels. We computed odds ratios (ORs) for a 5 µmol/L increase in Hcy levels using a random effects meta-analysis. Results In total, 108 studies met the inclusion criteria of which 22 were rated as high-quality studies, and 20 studies included a dose-response analysis. Hcy levels were analyzed either as a continuous or categorical variable. The majority of the studies found an increased risk of ischemic stroke when comparing the highest-to-lowest Hcy strata. A graded association was observed over the Hcy strata, indicating a dose-response association, with the most apparent effect when Hcy levels exceeded approximately 15 µmol/L. No studies explored a potential nonlinear association between Hcy levels and ischemic stroke. Six studies were included in a meta-analysis, showing an OR of 1.43 (95% confidence interval [CI]: 1.28–1.61) per 5 µmol/L increase in Hcy levels. Conclusion This review and meta-analysis indicate a dose-response association between Hcy levels and ischemic stroke. An evident increase in effect measures was observed when Hcy levels exceeded 15 µmol/L, indicating a nonlinear association between ischemic stroke and Hcy levels. This nonlinear association warrants further study.This study is registered with clinical trial ( https://www.crd.york.ac.uk/prospero/ ; unique identifier: CRD42019130371).

Prognostic disclosure: A scoping review on communication guidelines and their application in oncology.

2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24107-e24107
Author(s):  
Julie R Bloom ◽  
Deborah Catherine Marshall ◽  
Carlos Rodriguez-Russo ◽  
Emily J Martin ◽  
Joshua Adam Jones ◽  
...  
Keyword(s):  
Scoping Review ◽  
Patient Reported Outcomes ◽  
Meta Analysis ◽  
Core Competency ◽  
Supporting Evidence ◽  
Inclusion Criteria ◽  
Literature Searches ◽  
Scoping Reviews ◽  
Patient Reported ◽  
Randomized Control

e24107 Background: Prognostic disclosure is essential to informed decision making in oncology, yet many oncologists are unsure how to successfully facilitate this discussion. This scoping review determines what prognostic communication guidelines exist, compares and contrasts these guidelines and explores the supporting evidence. Methods: A protocol was created using the Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols extension for Scoping Reviews. Comprehensive literature searches of MEDLINE, EMBASE, PsychINFO, and Cochrane CENTRAL were performed to identify relevant publications between 1971 and 2020. Results: In total, 1532 articles were identified, of which 78 met inclusion criteria and contained 5 communication guidelines. Three guidelines have been validated in randomized control trials (Serious Illness Conversation Guide (SICG), The Four Habits Model and ADAPT) and demonstrated improved patient reported outcomes and objective communication measures. Among guidelines’ core principles, 3 concepts are common to all: patient’s understanding and preference, prognosis, and responding to emotion. Conclusions: Communicating prognosis is a core competency skill in cancer care, yet remains underprioritized in training and practice. This review highlights available models and acknowledges areas in need of further understanding including how to maintain learned communication skills for lifelong practice.[Table: see text]

scholarly journals Reporting standards for literature searches and report inclusion criteria: making research syntheses more transparent and easy to replicate

2014 ◽  
Vol 6 (1) ◽  
pp. 87-95 ◽  
Author(s):  
Kayla M. Atkinson ◽  
Alison C. Koenka ◽  
Carmen E. Sanchez ◽  
Hannah Moshontz ◽  
Harris Cooper
Keyword(s):  
Reporting Standards ◽  
Inclusion Criteria ◽  
Literature Searches
Sign in / Sign up

Export Citation Format

Share Document