Path Analysis of RCT Recruitment: Secondary Analysis of Results from a Systematic Review

Author(s):  
Nicole Jochym ◽  
Lisa Y. Lin ◽  
Jon F. Merz

We examine recruitment processes for 71 pragmatic and comparative effectiveness trials identified in a systematic review, using path analysis to examine rates of refusal to screen, test, and consent to trial participation. Our analysis suggests that refusal rates might be on net slightly higher if potential subjects are screened or asked to undergo physical eligibility tests, but this was not significant in our sample of trials ( p = .11 by Mann–Whitney test). We find that rates of refusing to provide informed consent are much lower for trials in which subjects have agreed to screening or testing (odds ratio = 0.40, Wilcoxon rank-sum z = 2.67, p = .008). We also observe that the overwhelming majority of trials examined secured consent after determining eligibility, even in trials involving screening or testing activities. The ethical implications and areas for future research are discussed.

2021 ◽  
Author(s):  
RaeAnn Elizabeth Anderson ◽  
Sara K Kuhn ◽  
Amanda M. Vitale ◽  
Alyssa M. Ciampaglia ◽  
Kristin E. Silver

Purpose: Prior literature illustrates that sexual minority people (e.g., bisexual, gay, queer) are at increased vulnerability for sexual violence victimization compared to heterosexual peers, including while in college. However, the study of sexual violence perpetration in sexual minority populations, much less specifically sexual minority college men, has been neglected. This article reviews the literature and presents a secondary data analysis of a systematic review on college men’s sexual perpetration rates and associated methodology. We also conducted analyses to summarize available literature regarding publishing dates, authors, and data inclusivity. Methods: We downloaded the dataset and associated materials from Mendeley.com’s data archive. Results: To our surprise, we could not analyze sexual perpetration prevalence rates in sexual minority men using the systematic review data due to absence of reported data across all 77 independent samples including over 5,500 male participants. We found no significant relationship between inclusion of sexual minority men and the use of measurement strategies specialized to assess sexual minority needs. We did find a positive relationship between recency of publication and the inclusion of sexual minority men, r(76) = .24, p = .03, and that most authors/co-authors were women (72%). Conclusions: Preventing perpetration is central to ending sexual violence; therefore, future research should include sexual minority people and use appropriate methodology in the investigation of sexual perpetration characteristics and patterns.


2021 ◽  
pp. 108926802110213
Author(s):  
Yerin Shim ◽  
Andrew T. Jebb ◽  
Louis Tay ◽  
James O. Pawelski

The arts and humanities have enriched human life in various ways throughout history. Yet, an analysis of empirical research into the effects of arts and humanities engagement remains incomplete, calling for a systematic and integrative understanding of the role of arts and humanities in promoting human flourishing. The present study used a mixed studies systematic review approach to integrating recent evidence from 27 intervention studies on the effectiveness of arts and humanities interventions on psychological flourishing of healthy adults. Our final dataset both represented quantitative and qualitative data on real-world interventions that encompassed a range of arts and humanities domains, including music, theater, visual arts, and integrative arts. A separate quantitative and qualitative data synthesis on study characteristics and psychological flourishing outcomes and a meta-integration of both types of evidence were conducted. Overall, arts and humanities interventions were associated with positive changes in a range of psychological flourishing outcomes, with overlapping quantitative and qualitative evidence for emotional, social, and sense of self outcomes. A secondary analysis explored key contextual and implementation features that contributed to effectiveness. Recommendations for future research and practice are provided based on our review.


2014 ◽  
Vol 40 (1) ◽  
pp. 31-43 ◽  
Author(s):  
Brian J Hafner ◽  
Andrew B Sawers

Background:Systematic reviews of scientific literature are valuable sources of synthesized knowledge. Systematic review results may also be used to inform readers about challenges inherent to an area of research, guide future research efforts, and facilitate improvements in evidence quality.Objectives:To identify methodological issues that affected the overall level of scientific evidence reported in a contemporary systematic review and to offer suggestions for enhancing publications’ contribution to the overall evidence.Study design:Secondary analysis of a systematic review.Methods:Publications included in a systematic review related to microprocessor-controlled prosthetic knees were analyzed with respect to established methodological quality criteria. Common issues were identified and discussed.Results:Internal validity was commonly affected by variable comparison conditions, limited justification of accommodation time, potential fatigue and learning effects, lack of blinding, small sample sizes, limited evidence of measurement reliability, subject attrition, and limited descriptions of selection criteria. Similarly, external validity was affected by limited descriptions of the study sample, indeterminate representativeness, and suboptimal description of the interventions.Conclusion:Results suggest that efforts to address methodological limitations, educate evidence consumers, and improve research reporting are needed to advance the quality and use of evidence in the field of prosthetics.Clinical relevanceCritical analysis of the strengths and limitations of publications included in a systematic review can inform evidence consumers and contributors about challenges inherent to a field of research. Results of this analysis suggest that efforts to address identified limitations are needed to enhance the overall level of prosthetics evidence.


Pain Medicine ◽  
2020 ◽  
Vol 21 (9) ◽  
pp. 1825-1839 ◽  
Author(s):  
Anaïs Lacasse ◽  
Elizabeth Cauvier Charest ◽  
Roxanne Dault ◽  
Anne-Marie Cloutier ◽  
Manon Choinière ◽  
...  

Abstract Background Secondary analysis of health administrative databases is indispensable to enriching our understanding of health trajectories, health care utilization, and real-world risks and benefits of drugs among large populations. Objectives This systematic review aimed at assessing evidence about the validity of algorithms for the identification of individuals suffering from nonarthritic chronic noncancer pain (CNCP) in administrative databases. Methods Studies reporting measures of diagnostic accuracy of such algorithms and published in English or French were searched in the Medline, Embase, CINAHL, AgeLine, PsycINFO, and Abstracts in Social Gerontology electronic databases without any dates of coverage restrictions up to March 1, 2018. Reference lists of included studies were also screened for additional publications. Results Only six studies focused on commonly studied CNCP conditions and were included in the review. Some algorithms showed a ≥60% combination of sensitivity and specificity values (back pain disorders in general, fibromyalgia, low back pain, migraine, neck/back problems studied together). Only algorithms designed to identify fibromyalgia cases reached a ≥80% combination (without replication of findings in other studies/databases). Conclusions In summary, the present investigation informs us about the limited amount of literature available to guide and support the use of administrative databases as valid sources of data for research on CNCP. Considering the added value of such data sources, the important research gaps identified in this innovative review provide important directions for future research. The review protocol was registered with PROSPERO (CRD42018086402).


BMJ Open ◽  
2022 ◽  
Vol 12 (1) ◽  
pp. e046602
Author(s):  
João Vitor Miranda Porto Oliveira ◽  
André Luiz Freitas Oliveira Júnior ◽  
Angelos G Kolias ◽  
Wellingson S Paiva ◽  
Davi Jorge Fontoura Solla

IntroductionSpin is defined as an inaccurate interpretation of results, intentionally or not, leading to equivocal conclusions and misdirecting readers to look at the data in an overly optimistic way. Previous studies have shown a high prevalence of spin in scientific papers and this systematic review aims to investigate the nature and prevalence of spin in the neurosurgical trauma literature. Any associated factors will be identified to guide future research practice recommendations.Methods and analysisThe Preferred Reporting Item for Systematic Reviews and Meta-Analyses recommendations will be followed. Randomised clinical trials (RCTs) that enrolled only patients with traumatic brain injury and investigated any type of intervention (surgical or non-surgical) will be eligible for inclusion. The MEDLINE/PubMed database will be searched for articles in English published in 15 top-ranked journals. Spin will be defined as (1) a focus on statistically significant results not based on the primary outcome; (2) interpreting statistically non-significant results for a superiority analysis of the primary outcome; (3) claiming or emphasising the beneficial effect of the treatment despite statistically non-significant results; (4) conclusion focused in the per-protocol or as-treated analysis instead of the intention-to-treat results; (5) incorrect statistical analysis; (6) republication of a significant secondary analysis without proper acknowledgement of the primary outcome analysis result. Traditional descriptive statistics will be used to present RCT characteristics. Standardised differences between the groups with or without spin will be calculated. The variables with a standardised difference equal or above 0.2 and 0.5 will be considered weakly and strongly associated with spin, respectively.Ethics and disseminationThis study will not involve primary data collection and patients will not be involved.Trial registration number10.17605/OSF.IO/H3FGY.


2020 ◽  
Vol 5 (1) ◽  
pp. 326-338 ◽  
Author(s):  
Kristen Weidner ◽  
Joneen Lowman

Purpose We conducted a systematic review of the literature regarding adult telepractice services (screening, assessment, and treatment) from approximately 2014 to 2019. Method Thirty-one relevant studies were identified from a literature search, assessed for quality, and reported. Results Included studies illustrated feasibility, efficacy, diagnostic accuracy, and noninferiority of various speech-language pathology services across adult populations, including chronic aphasia, Parkinson's disease, dysphagia, and primary progressive aphasia. Technical aspects of the equipment and software used to deliver services were discussed. Some general themes were noted as areas for future research. Conclusion Overall, results of the review continue to support the use of telepractice as an appropriate service delivery model in speech-language pathology for adults. Strong research designs, including experimental control, across multiple well-described settings are still needed to definitively determine effectiveness of telepractice services.


2020 ◽  
Author(s):  
Kurt D Shulver ◽  
Nicholas A Badcock

We report the results of a systematic review and meta-analysis investigating the relationship between perceptual anchoring and dyslexia. Our goal was to assess the direction and degree of effect between perceptual anchoring and reading ability in typical and atypical (dyslexic) readers. We performed a literature search of experiments explicitly assessing perceptual anchoring and reading ability using PsycInfo (Ovid, 1860 to 2020), MEDLINE (Ovid, 1860 to 2019), EMBASE (Ovid, 1883 to 2019), and PubMed for all available years up to June (2020). Our eligibility criteria consisted of English-language articles and, at minimum, one experimental group identified as dyslexic - either by reading assessment at the time, or by previous diagnosis. We assessed for risk of bias using an adapted version of the Newcastle-Ottawa scale. Six studies were included in this review, but only five (n = 280 participants) were included in the meta-analysis (we were unable to access the necessary data for one study).The overall effect was negative, large and statistically significant; g = -0.87, 95% CI [-1.47, 0.27]: a negative effect size indicating less perceptual anchoring in dyslexic versus non-dyslexic groups. Visual assessment of funnel plot and Egger’s test suggest minimal bias but with significant heterogeneity; Q (4) = 9.70, PI (prediction interval) [-2.32, -0.58]. The primary limitation of the current review is the small number of included studies. We discuss methodological limitations, such as limited power, and how future research may redress these concerns. The variability of effect sizes appears consistent with the inherent variability within subtypes of dyslexia. This level of dispersion seems indicative of the how we define cut-off thresholds between typical reading and dyslexia populations, but also the methodological tools we use to investigate individual performance.


2019 ◽  
Vol 23 (4) ◽  
pp. 442-454 ◽  
Author(s):  
Rachel Mandela ◽  
Maggie Bellew ◽  
Paul Chumas ◽  
Hannah Nash

OBJECTIVEThere are currently no guidelines for the optimum age for surgical treatment of craniosynostosis. This systematic review summarizes and assesses evidence on whether there is an optimal age for surgery in terms of neurodevelopmental outcomes.METHODSThe databases MEDLINE, PsycINFO, CINAHL, Embase + Embase Classic, and Web of Science were searched between October and November 2016 and searches were repeated in July 2017. According to PICO (participants, intervention, comparison, outcome) criteria, studies were included that focused on: children diagnosed with nonsyndromic craniosynostosis, aged ≤ 5 years at time of surgery; corrective surgery for nonsyndromic craniosynostosis; comparison of age-at-surgery groups; and tests of cognitive and neurodevelopmental postoperative outcomes. Studies that did not compare age-at-surgery groups (e.g., those employing a correlational design alone) were excluded. Data were double-extracted by 2 authors using a modified version of the Cochrane data extraction form.RESULTSTen studies met the specified criteria; 5 found a beneficial effect of earlier surgery, and 5 did not. No study found a beneficial effect of later surgery. No study collected data on length of anesthetic exposure and only 1 study collected data on sociodemographic factors.CONCLUSIONSIt was difficult to draw firm conclusions from the results due to multiple confounding factors. There is some inconclusive evidence that earlier surgery is beneficial for patients with sagittal synostosis. The picture is even more mixed for other subtypes. There is no evidence that later surgery is beneficial. The authors recommend that future research use agreed-upon parameters for: age-at-surgery cut-offs, follow-up times, and outcome measures.


2020 ◽  
Vol 9 (1) ◽  
Author(s):  
Charles James ◽  
Catherine Walshe ◽  
Katherine Froggatt

Abstract Background The knowledge about the experience of informal caregivers who provide care to people with moderate to advanced dementia in a domestic home setting is limited. A consequence of long hours of caregiving in addition to dealing with normal challenges of daily living is their experience of a poor quality of life. Some of their experiences may be described in terms of a feeling of powerlessness to make changes during care provision. This feeling may also suggest an experience of moral distress. The aim of this systematic review is to synthesise qualitative evidence relating to these experiences. Methods This review adopts a narrative synthesis approach. A search will be conducted for studies written in the English language in the bibliographic databases MEDLINE Complete, CINAHL, EMBASE, PsycINFO, Web of Science and Academic Search Complete covering periods from 1984 to present. Included studies will be qualitative or mixed-methods designs. The search terms will be related to dementia and caregivers, and the process will be focused on dementia at the moderate to the advanced stages within the domestic home setting. Reference lists of included papers will also be searched for additional relevant citations. Search terms and strategies will be checked by two independent reviewers. The identification of abstracts and full texts of studies will be done by the author, while the quality and the risk of bias will also be checked by the two independent reviewers. Discussion Psychological distress is cited as an experience reported within informal caregiving. For the caregiver, it is associated with a negative impact on general health. To date, no synthesis exists on the specific experience of informal caregiving for people with moderate to advanced dementia within the domestic home setting. This review considers that variation of accounts contributes to how the informal caregivers’ general experience is explored in future research. This may enable gaps in current knowledge to be highlighted within the wider context of caregiving in the domestic home setting. Systematic review registration This review is registered with PROSPERO (CRD42020183649).


Sign in / Sign up

Export Citation Format

Share Document