Reporting and Reproducibility of Meta-Analysis in Speech, Language, and Hearing Research

2021 ◽  
pp. 1-8
Author(s):  
Jason C. Chow ◽  
Ashlee L. Sjogren ◽  
Hongyang Zhao
Keyword(s):  
Meta Analysis ◽  
Future Research ◽  
Data Sets ◽  
Full Data ◽  
Hearing Research ◽  
The Core ◽  
Meta Review ◽  
Core Elements ◽  
Meta Analyses ◽  
Over Time

Purpose The purposes of this meta-review are to (a) articulate the importance of transparency and reproducibility in meta-analysis, (b) assess the transparency and reproducibility of meta-analyses published in journals of the American Speech-Language-Hearing Association (ASHA), and (c) discuss the implications of our findings and recommendations for future research. Method We conducted a meta-review of all meta-analyses published in ASHA journals through December 31, 2020. Our systematic review yielded 47 meta-analyses for inclusion in this review. We coded all eligible reports on the core elements of transparency and reproducibility in meta-analysis. Results Our findings suggest that though reporting tendencies have improved over time, much work is needed to promote transparency and reproducibility in meta-analytic work. Key areas for future accountability include preregistering study protocol, using Preferred Reporting in Systematic Reviews and Meta-Analysis checklists, providing full data sets, and publishing analytic codes. Conclusions The state of reporting in meta-analysis is improving over time. We conclude with a discussion of specific areas that need further attention, and recommendations for researchers to consider when conducting future meta-analyses. Supplemental Material https://doi.org/10.23641/asha.14888481

scholarly journals Meta-Analysis of the Effect of Red on Perceived Attractiveness

2018 ◽  
Vol 16 (4) ◽  
pp. 147470491880241 ◽  
Author(s):  
Gabrielle K. Lehmann ◽  
Andrew J. Elliot ◽  
Robert J. Calin-Jageman
Keyword(s):  
Meta Analysis ◽  
Effect Sizes ◽  
Future Research ◽  
Meta Analyses ◽  
Heterosexual Attraction ◽  
Substantial Heterogeneity ◽  
Over Time ◽  
Perceived Attractiveness

We conducted meta-analyses of studies that test the red-romance hypothesis, which is that the color red enhances heterosexual attraction in romantic contexts. For men rating women, we found a small, statistically significant effect ( d = 0.26 [0.12, 0.40], p = .0004, N = 2,961), with substantial heterogeneity, Q(44) = 172.5, pQ < .0001, I2 = 89% [82, 94], and equivocal results regarding the possibility of upward bias in the estimate. For women rating men, we found a very small effect ( d = 0.13 [0.01, 0.25], p = .03, N = 2,739), with substantial heterogeneity, Q(35) = 73.0, pQ = .0002, I2 = 53% [33, 80], and evidence of upward bias in the estimate. Moderator analyses suggest effect sizes may have declined over time (both genders), may be largest when an original shade of red is used (men only), and may be smaller in preregistered studies (women only). We present contrasting interpretations and suggestions for future research.

The Student Risk Screening Scale: A Reliability and Validity Generalization Meta-Analysis

2017 ◽  
Vol 26 (3) ◽  
pp. 143-155 ◽  
Author(s):  
Stephen P. Kilgus ◽  
Katie Eklund ◽  
Daniel M. Maggin ◽  
Crystal N. Taylor ◽  
Amanda N. Allen
Keyword(s):  
Internal Consistency ◽  
Externalizing Behavior ◽  
Meta Analysis ◽  
Reliability And Validity ◽  
Future Research ◽  
Risk Screening ◽  
Validity Generalization ◽  
Meta Analyses ◽  
Student Risk ◽  
Screening Scale

The purpose of this study was to conduct reliability and validity generalization meta-analyses of evidence regarding the Student Risk Screening Scale (SRSS), a universal screener for externalizing behavior problems. A systematic review of the literature resulted in the identification of 17 studies inclusive of evidence regarding SRSS score (a) internal consistency reliability (i.e., alpha coefficients), and/or (b) criterion-related validity (e.g., correlations between the SRSS and various outcomes). Multilevel meta-analyses indicated that across studies, SRSS scores were associated with adequate internal consistency (α = .83). Analyses further suggested the SRSS was a valid indicator of both social and behavioral outcomes ( r = .52) and academic outcomes ( r = .42). Follow-up analyses suggested that in accordance with theory-driven expectations, the SRSS was a stronger indicator of externalizing problems and broad behavior outcomes relative to alternative outcomes (e.g., internalizing problems). Limitations and directions for future research are discussed, including recommendations for the collection of additional SRSS diagnostic accuracy evidence.

scholarly journals Comparing Bayesian Posterior Passing with Meta-analysis

2020 ◽  
Author(s):  
Joshua Pritsker
Keyword(s):  
Publication Bias ◽  
Fixed Effects ◽  
Meta Analysis ◽  
Future Research ◽  
Meta Analyses

Brand, von der Post, Ounsley, and Morgan (2019) introduced Bayesian posterior passing as an alternative to traditional meta-analyses. In this commentary I relate their procedure to traditional meta-analysis, showing that posterior passing is equivalent to fixed effects meta-analysis. To overcome the limitations of simple posterior passing, I introduce improved posterior passing methods to account for heterogeneity and publication bias. Additionally, practical limitations of posterior passing and the role that it can play in future research are discussed.

scholarly journals Obsessive healthy eating and orthorexic eating tendencies in sport and exercise contexts: A systematic review and meta-analysis

2021 ◽  
Author(s):  
Jana Strahler ◽  
Hanna Wachten ◽  
Anett Mueller-Alcazar
Keyword(s):  
Systematic Review ◽  
Gender Differences ◽  
Healthy Eating ◽  
Meta Analysis ◽  
Group Analysis ◽  
Future Research ◽  
Exercise Behaviors ◽  
Sport And Exercise ◽  
Underlying Mechanisms ◽  
Meta Analyses

AbstractBackgroundOrthorexia Nervosa (ON) and exercise addiction (ExAdd) are two phenomena believed to overlap. We conducted a meta-analysis exploring the link between ON and (addictive) exercise behaviors.MethodsA systematic review of major databases and gray literature was carried out for studies reporting on ON and (addictive) exercise behaviors. Random effects meta-analyses were undertaken calculating correlations between ON and (addictive) exercise behaviors. A sub-group analysis investigated gender differences.ResultsTwenty-five studies with 10,134 participants (mean age = 25.21; 56.4% female) were included. Analyses showed a small overall correlation between ON and exercise (21 studies, r = 0.12, 95% CI |0.06–0.18|) and a medium overall correlation between ON and ExAdd (7 studies, r = 0.29, 95% CI |0.13–0.45|). Gender differences were negligible.ConclusionsOrthorexic eating correlated slightly and moderately with exercise and ExAdd, respectively, expressing some unique and shared variance of these behaviors. While this does not suggest ON and addictive exercising to be independent, it does not indicate substantial comorbidity. Future research should focus on clinical relevance, underlying mechanisms, vulnerability, and risk factors.

Internet Use and Psychological Well-Being

2012 ◽  
pp. 302-314 ◽  
Author(s):  
Chiungjung Huang
Keyword(s):  
Social Networking ◽  
Social Networking Sites ◽  
Internet Use ◽  
Meta Analysis ◽  
Well Being ◽  
Social Networking Site ◽  
Future Research ◽  
Psychological Well Being ◽  
Site Use ◽  
Meta Analyses

The direction of the correlation between Internet use and psychological well-being is debatable. The displacement hypothesis indicates the correlation is negative, as Internet use for communication replaces face-to face-interaction. Conversely, the augmentation hypothesis suggests that the correlation is positive because Internet use for communication complements existing social interaction. While previous empirical findings about the relationship between Internet use and psychological well-being have been diverse, two previous meta-analyses and the present meta-analysis about the use of social networking sites and psychological well-being supported neither position, and found no relationship between Internet use and psychological well-being. Investigation of causal predominance between Internet use and psychological well-being, increased attention to measurement problems of social networking site use and older adults, and consideration of effects of indicators and moderators should be addressed in future research.

Is hospitalization a risk factor for cognitive decline in older age adults?

2020 ◽  
pp. 1-18
Author(s):  
Lucia Chinnappa-Quinn ◽  
Steve Robert Makkar ◽  
Michael Bennett ◽  
Ben C. P. Lam ◽  
Jessica W. Lo ◽  
...  
Keyword(s):  
Cognitive Decline ◽  
Meta Analysis ◽  
Severity Of Illness ◽  
The Elderly ◽  
Preliminary Evidence ◽  
Older Age ◽  
Future Research ◽  
Cognitive Changes ◽  
Newcastle Ottawa Scale ◽  
Meta Analyses

ABSTRACT Objectives: Many studies document cognitive decline following specific types of acute illness hospitalizations (AIH) such as surgery, critical care, or those complicated by delirium. However, cognitive decline may be a complication following all types of AIH. This systematic review will summarize longitudinal observational studies documenting cognitive changes following AIH in the majority admitted population and conduct meta-analysis (MA) to assess the quantitative effect of AIH on post-hospitalization cognitive decline (PHCD). Methods: We followed Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. Selection criteria were defined to identify studies of older age adults exposed to AIH with cognitive measures. 6566 titles were screened. 46 reports were reviewed qualitatively, of which seven contributed data to the MA. Risk of bias was assessed using the Newcastle–Ottawa Scale. Results: The qualitative review suggested increased cognitive decline following AIH, but several reports were particularly vulnerable to bias. Domain-specific outcomes following AIH included declines in memory and processing speed. Increasing age and the severity of illness were the most consistent risk factors for PHCD. PHCD was supported by MA of seven eligible studies with 41,453 participants (Cohen’s d = −0.25, 95% CI [−0.02, −0.49] I2 35%). Conclusions: There is preliminary evidence that AIH exposure accelerates or triggers cognitive decline in the elderly patient. PHCD reported in specific contexts could be subsets of a larger phenomenon and caused by overlapping mechanisms. Future research must clarify the trajectory, clinical significance, and etiology of PHCD: a priority in the face of an aging population with increasing rates of both cognitive impairment and hospitalization.

scholarly journals Clinical Behavior of Ceramic, Hybrid and Composite Onlays. A Systematic Review and Meta-Analysis

2020 ◽  
Vol 17 (20) ◽  
pp. 7582
Author(s):  
Naia Bustamante-Hernández ◽  
Jose María Montiel-Company ◽  
Carlos Bellot-Arcís ◽  
José Félix Mañes-Ferrer ◽  
María Fernanda Solá-Ruíz ◽  
...  
Keyword(s):  
Systematic Review ◽  
Survival Rate ◽  
Meta Analysis ◽  
Posterior Region ◽  
Publication Date ◽  
Clinical Behavior ◽  
Lower Survival Rate ◽  
Meta Analyses ◽  
Over Time

A systematic review and meta-analysis was performed to analyze the survival of onlay restorations in the posterior region, their clinical behavior according to the material used (ceramic reinforced with lithium disilicate, conventional feldspathic ceramic or reinforced with leucite; hybrid materials and composite), possible complications, and the factors influencing restoration success. The systematic review was based on the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement, without publication date or language restrictions. An electronic search was made in the PubMed, Scopus, Embase, and Cochrane databases. After discarding duplicate publications and studies that failed to meet the inclusion criteria, the articles were selected based on the population, intervention, comparison, outcome (PICO) question. The following variables were considered in the qualitative and quantitative analyses: restoration survival rate (determined by several clinical parameters), the influence of the material used upon the clinical behavior of the restorations, and the complications recorded over follow-up. A total of 29 articles were selected for the qualitative analysis and 27 for the quantitative analysis. The estimated restoration survival rate was 94.2%. The predictors of survival were the duration of follow-up (beta = −0.001; p = 0.001) and the onlay material used (beta = −0.064; p = 0.028). Composite onlays were associated with a lower survival rate over time. Onlays are a good, conservative, and predictable option for restoring dental defects in the posterior region, with a survival rate of over 90%. The survival rate decreases over time and with the use of composite as onlay material.

scholarly journals Suggestibility in functional neurological disorder: a meta-analysis

2020 ◽  
pp. jnnp-2020-323706
Author(s):  
Lillian Wieder ◽  
Richard Brown ◽  
Trevor Thompson ◽  
Devin B. Terhune
Keyword(s):  
Neurological Disorder ◽  
Data Extraction ◽  
Meta Analysis ◽  
Random Effect ◽  
Data Sets ◽  
Predisposing Factor ◽  
Somatisation Disorder ◽  
Mean Differences ◽  
Meta Analyses ◽  
Functional Neurological Disorder

ObjectiveResponsiveness to direct verbal suggestions (suggestibility) has long been hypothesised to represent a predisposing factor for functional neurological disorder (FND) but previous research has yielded conflicting results. The aim of this study was to quantitatively evaluate whether patients with FND display elevated suggestibility relative to controls via meta-analysis.MethodsFour electronic databases were searched in November 2019, with the search updated in April 2020, for original studies assessing suggestibility using standardised behavioural scales or suggestive symptom induction protocols in patients with FND (including somatisation disorder) and controls. The meta-analysis followed Cochrane, Preferred Reporting Items for Systematic Reviews and Meta-Analyses and Meta-analyses Of Observational Studies in Epidemiology (MOOSE) guidelines. Data extraction and study quality coding were performed by two independent reviewers. Standardised suggestibility scores and responsiveness to symptom induction protocols were used to calculate standardised mean differences (SMDs) between groups.ResultsOf 26 643 search results, 19 articles presenting 11 standardised suggestibility data sets (FND: n=316; control: n=360) and 11 symptom suggestibility data sets (FND: n=1285; control: n=1409) were included in random-effect meta-analyses. Meta-analyses revealed that patients with FND displayed greater suggestibility than controls on standardised behavioural scales (SMD, 0.48 (95% C, 0.15 to 0.81)) and greater responsiveness to suggestive symptom induction (SMD, 1.39 (95% CI 0.92 to 1.86)). Moderation analyses presented mixed evidence regarding the extent to which effect sizes covaried with methodological differences across studies. No evidence of publication bias was found.ConclusionsThese results corroborate the hypothesis that FND is characterised by heightened responsiveness to verbal suggestion. Atypical suggestibility may confer risk for FND and be a cognitive marker that can inform diagnosis and treatment of this condition.

Beyond the Theoretical Rhetoric: A Proposal to Study the Consequences of Drug Legalization

2001 ◽  
Vol 31 (4) ◽  
pp. 319-328
Author(s):  
George S. Yacoubian
Keyword(s):  
Empirical Studies ◽  
Control Policy ◽  
Drug Control ◽  
Future Research ◽  
Policy Alternative ◽  
The Core ◽  
Drug Control Policy ◽  
Core Elements ◽  
Drug Legalization

Drug legalization is a frequently-debated drug control policy alternative. It should come as little surprise, therefore, that the arguments in favor of both legalization and prohibition have resulted in a conceptual stalemate. While theoretical deliberations are unquestionably valuable, they seem to have propelled this particular issue to its limit. To date, no works have suggested any empirical studies that might test the framework and potential consequences of drug legalization. In the current study, the arguments surrounding the drug legalization debate are synthesized into a proposal for future research. Such a proposal illustrates that the core elements surrounding drug legalization are not only testable, but that the time may be right to consider such an empirical effort.

TBLT implementation and evaluation: A meta-analysis

2017 ◽  
Vol 23 (5) ◽  
pp. 603-632 ◽  
Author(s):  
Lara Bryfonski ◽  
Todd H. McKay
Keyword(s):  
Meta Analysis ◽  
Future Research ◽  
Language Program ◽  
Language Programs ◽  
Language Classrooms ◽  
L2 Development ◽  
Meta Analyses ◽  
Traditional Grammar ◽  
Authentic Language ◽  
Main Effects

Task-based language teaching (TBLT) is an empirically investigated pedagogy that has garnered attention from language programs across the globe. TBLT provides an alternative to traditional grammar translation or present-practice-produce pedagogies by emphasizing interaction during authentic tasks. Despite several previous meta-analyses investigating the effect of individual tasks or short-term task-based treatments on second language (L2) development, no studies to date have synthesized the effects of long-term implementation of TBLT in authentic language classrooms. The present study uses meta-analytic techniques to investigate the effectiveness of TBLT programs on L2 learning. Findings based on a sample of 52 studies revealed an overall positive and strong effect ( d = 0.93) for TBLT implementation on a variety of learning outcomes. The study further examined a range of programmatic and methodological features that moderated these main-effects (program region, institution type, needs analysis, and cycles of implementation). Additionally, synthesizing across both quantitative and qualitative data, results also showed positive stakeholder perceptions towards TBLT programs. The study concludes with implications for the domain of TBLT implementation, language program evaluation, and future research in this domain.

Sign in / Sign up

Export Citation Format

Share Document