Research Review: Test-retest reliability of standardized diagnostic interviews to assess child and adolescent psychiatric disorders: a systematic review and meta-analysis

2018 ◽  
Vol 60 (1) ◽  
pp. 16-29 ◽  
Author(s):  
Laura Duncan ◽  
Jinette Comeau ◽  
Li Wang ◽  
Irene Vitoroulis ◽  
Michael H. Boyle ◽  
...  
Keyword(s):  
Systematic Review ◽  
Psychiatric Disorders ◽  
Meta Analysis ◽  
Child And Adolescent ◽  
Research Review ◽  
Retest Reliability ◽  
Diagnostic Interviews ◽  
Test Retest Reliability ◽  
Standardized Diagnostic

scholarly journals Test-Retest Reliability of Five Times Sit to Stand Test (FTSST) in Adults: A Systematic Review and Meta-Analysis

Biology ◽  
2021 ◽  
Vol 10 (6) ◽  
pp. 510
Author(s):  
Laura Muñoz-Bermejo ◽  
José Carmelo Adsuar ◽  
María Mendoza-Muñoz ◽  
Sabina Barrios-Fernández ◽  
Miguel A. Garcia-Gordillo ◽  
...  
Keyword(s):  
Systematic Review ◽  
Lower Limb ◽  
Balance Control ◽  
Meta Analysis ◽  
Functional Independence ◽  
Lower Limbs ◽  
Retest Reliability ◽  
Stand Test ◽  
Sit To Stand ◽  
Test Retest Reliability

Functional independence in adults is conditioned by lower limb muscle strength. Thus, it seems important to assess lower limb strength using reliable and easy to reproduce measurements. The purpose of this study was to conduct a systematic review and meta-analysis to collect studies that examined the test-retest reliability of the Five Times Sit to Stand Test (FTSST) in adults. The search was conducted in PubMed, Web of Science, and Scopus databases, including all studies published up to 28 December 2020. To be included, studies had to include relative reliability scores (ICC) and maximum torque or standard error of measurements (SEM) of FTSST. A total of 693 studies were initially identified, but only 8 met the eligibility criteria and were included in the meta-analysis, covering a total of 14 groups with 400 participants. Relative inter-rater reliability results (ICC = 0.937, p < 0.001, n = 400) revealed excellent reliability of FTSST to assess sitting and standing performance, lower limbs strength and balance control. Conclusion: The Five Times Sit to Stand Test is a highly reliable tool for assessing lower limbs strength, balance control, and mobility in both healthy adults and those with pathologies.

scholarly journals Reliability, and Convergent and Discriminant Validity of Gaming Disorder Scales: A Meta-Analysis

2021 ◽  
Vol 12 ◽  
Author(s):  
Seowon Yoon ◽  
Yeji Yang ◽  
Eunbin Ro ◽  
Woo-Young Ahn ◽  
Jueun Kim ◽  
...  
Keyword(s):  
Systematic Review ◽  
Internet Addiction ◽  
Discriminant Validity ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Gaming Disorder ◽  
Reliability Generalization ◽  
Retest Reliability ◽  
Convergent And Discriminant Validity ◽  
Test Retest Reliability

Background: An association between gaming disorder (GD) and the symptoms of common mental disorders is unraveled yet. In this preregistered study, we quantitatively synthesized reliability, convergent and discriminant validity of GD scales to examine association between GD and other constructs.Methods: Five representative GD instruments (GAS-7, AICA, IGDT-10, Lemmens IGD-9, and IGDS9-SF) were chosen based on recommendations by the previous systematic review study to conduct correlation meta-analyses and reliability generalization. A systematic literature search was conducted through Pubmed, Proquest, Embase, and Google Scholar to identify studies that reported information on either reliability or correlation with related variables. 2,124 studies were full-text assessed as of October 2020, and 184 were quantitatively synthesized. Conventional Hedges two-level meta-analytic method was utilized.Results: The result of reliability generalization reported a mean coefficient alpha of 0.86 (95% CI = 0.85–0.87) and a mean test-retest estimate of 0.86 (95% CI = 0.81–0.89). Estimated effect sizes of correlation between GD and the variables were as follows: 0.33 with depression (k = 45; number of effect sizes), 0.29 with anxiety (k = 37), 0.30 with aggression (k = 19), –0.22 with quality of life (k = 18), 0.29 with loneliness (k = 18), 0.56 with internet addiction (k = 20), and 0.40 with game playtime (k = 53), respectively. The result of moderator analyses, funnel and forest plots, and publication bias analyses were also presented.Discussion and Conclusion: All five GD instruments have good internal consistency and test-retest reliability. Relatively few studies reported the test-retest reliability. The result of correlation meta-analysis revealed that GD scores were only moderately associated with game playtime. Common psychological problems such as depression and anxiety were found to have a slightly smaller association with GD than the gaming behavior. GD scores were strongly correlated with internet addiction. Further studies should adopt a rigorous methodological procedure to unravel the bidirectional relationship between GD and other psychopathologies.Limitations: The current study did not include gray literature. The representativeness of the five tools included in the current study could be questioned. High heterogeneity is another limitation of the study.Systematic Review Registration: [https://www.crd.york.ac.uk/PROSPERO/], identifier [CRD42020219781].

A Test-Retest Reliability Generalization Meta-Analysis of Judgments Via the Policy-Capturing Technique

2021 ◽  
pp. 109442812110115
Author(s):  
Ze Zhu ◽  
Alan J. Tomassetti ◽  
Reeshad S. Dalal ◽  
Shannon W. Schrader ◽  
Kevin Loo ◽  
...  
Keyword(s):  
Best Practice ◽  
Meta Analysis ◽  
Temporal Stability ◽  
Future Research ◽  
Policy Capturing ◽  
Reliability Estimate ◽  
Reliability Generalization ◽  
Retest Reliability ◽  
Reliability Estimates ◽  
Test Retest Reliability

Policy capturing is a widely used technique, but the temporal stability of policy-capturing judgments has long been a cause for concern. This article emphasizes the importance of reporting reliability, and in particular test-retest reliability, estimates in policy-capturing studies. We found that only 164 of 955 policy-capturing studies (i.e., 17.17%) reported a test-retest reliability estimate. We then conducted a reliability generalization meta-analysis on policy-capturing studies that did report test-retest reliability estimates—and we obtained an average reliability estimate of .78. We additionally examined 16 potential methodological and substantive antecedents to test-retest reliability (equivalent to moderators in validity generalization studies). We found that test-retest reliability was robust to variation in 14 of the 16 factors examined but that reliability was higher in paper-and-pencil studies than in web-based studies and was higher for behavioral intention judgments than for other (e.g., attitudinal and perceptual) judgments. We provide an agenda for future research. Finally, we provide several best-practice recommendations for researchers (and journal reviewers) with regard to (a) reporting test-retest reliability, (b) designing policy-capturing studies for appropriate reportage, and (c) properly interpreting test-retest reliability in policy-capturing studies.

scholarly journals Tandem Gait Test-Retest Reliability Among Healthy Child and Adolescent Athletes

2019 ◽  
Vol 54 (12) ◽  
pp. 1254-1259 ◽  
Author(s):  
David R. Howell ◽  
Anna N. Brilliant ◽  
William P. Meehan
Keyword(s):  
Dual Task ◽  
Healthy Child ◽  
Outcome Measure ◽  
Child And Adolescent ◽  
Adolescent Athletes ◽  
Single Task ◽  
Retest Reliability ◽  
Task Conditions ◽  
Test Retest Reliability ◽  
Tandem Gait

Context The tandem gait test is a method for assessing dynamic postural control and part of the Sport Concussion Assessment Tool, versions 3 and 5. However, its reliability among child and adolescent athletes has yet to be established. Objective To examine the test-retest reliability of the single-task and dual-task tandem gait test among healthy child and adolescent athletes. Design Descriptive laboratory study. Setting Sports injury-prevention center. Patients or Other Participants Uninjured and healthy athletes between the ages of 9 and 18 years. Intervention(s) Tandem gait measures repeated 3 times across the period of approximately 1 month. Main Outcome Measure(s) Participants completed the tandem gait test under single-task and dual-task (ie, while simultaneously executing a cognitive task) conditions. Our primary outcome measure was completion time during the single-task and dual-task conditions. We also assessed cognitive accuracy and response rate while participants completed the dual-task tandem gait test. Results Thirty-two child and adolescent athletes completed the study (mean age = 14.3 ± 2.4 years; females = 16). Single-task tandem gait times were similar across the 3 testing sessions (14.4 ± 4.8, 13.5 ± 4.2, and 13.8 ± 4.8 seconds; P = .45). Dual-task tandem gait times steadily improved across the test timeline (18.6 ± 6.9, 16.6 ± 4.5, and 15.8 ± 4.7 seconds; P = .02). Bivariate correlations indicated moderately high to high agreement from test 1 to test 2 (single-task r = .627; dual-task r = 0.655) and from test 2 to test 3 (single-task r = 0.852; dual-task r = 0.775). Both the single-task (intraclass correlation coefficient; ICC [3,1] = 0.86; 95% confidence interval [CI] = 0.73, 0.93) and dual-task (ICC [3,1] = 0.84; 95% CI = 0.69, 0.92) conditions demonstrated high reliability across testing sessions. Conclusions Tandem gait outcome measures demonstrated high test-retest reliability in both the single- and dual-task conditions. The overall reliability was within the acceptable range for clinical practice, but improvements across tests suggested a moderate practice effect. Tandem gait represents a reliable, dynamic, postural-control test that requires minimal space, cost, and time.

Sign in / Sign up

Export Citation Format

Share Document