Test-retest reliability and practice effects of the Wechsler Memory Scale-III

Abstract Objective The Grooved Pegboard Test (GPT) is among the most commonly used fine motor tasks, though there is limited data on its basic psychometric properties in children and adolescents with medical conditions. The purpose of this study was to establish test reliability for the GPT within this group. Method Participants (N = 44; 22 males, 22 females) were children and adolescents clinically referred for neuropsychological evaluation. Diagnoses included epilepsy (n = 24), cardiac conditions (n = 13), other (n = 5). Each completed the GPT twice: once in the morning and once in the afternoon, ranging from 64-390 minutes apart (x-=263 min., SD = 60 min.). Spearman correlations assessed test–retest reliability for speed of completion for both dominant (DH) and non-dominant hands (NDH) trials and number of peg drops. Paired sample t-test assessed for practice effects between administrations. Results Ages ranged between 6.11 to 18.10 years (x-=12.52 yrs., SD = 3.19 yrs.). GPT raw scores for first presentation ranged from 25-296 seconds (DH x-=80.91, SD = 25.1; NDH x-=95.34, SD = 49.42). The GPT showed high test–retest reliability for DH (ρ = 0.80, p < 0.001) and NDH (ρ = 0.83, p < 0.001). Number of drops showed non-significant correlations across trials (DH ρ = −0.03, p = 0.87; NDH ρ = 0.11, p = 0.49). Practice effects were identified for the DH (t = −3.25, p = 0.002) but not NDH (t = −1.83, p = 0.074). Conclusion Strong test–retest reliability of the GPT speed of completion in this population supports stability of test results over time, though practice effects are seen at short intervals. Number of pegs dropped, however, lacks sufficient retest reliability and may be of lesser clinical utility. Overall, this study provides increased confidence for continued use of the GPT.

Download Full-text

Expressive language sampling as a source of outcome measures for treatment studies in fragile X syndrome: feasibility, practice effects, test-retest reliability, and construct validity

Journal of Neurodevelopmental Disorders ◽

10.1186/s11689-020-09313-6 ◽

2020 ◽

Vol 12 (1) ◽

Cited By ~ 4

Author(s):

Leonard Abbeduto ◽

Elizabeth Berry-Kravis ◽

Audra Sterling ◽

Stephanie Sherman ◽

Jamie O. Edgin ◽

...

Keyword(s):

Construct Validity ◽

Outcome Measures ◽

Symptom Severity ◽

Fragile X ◽

Expressive Language ◽

Practice Effects ◽

Full Sample ◽

Retest Reliability ◽

Language Sampling ◽

Test Retest Reliability

Abstract Background The evaluation of treatment efficacy for individuals with fragile X syndrome (FXS) or intellectual disability (ID) more generally has been hampered by the lack of adequate outcome measures. We evaluated expressive language sampling (ELS) as a procedure for generating outcome measures for treatment research in FXS. We addressed: (a) feasibility, (b) practice effects over two administrations, (c) test-retest reliability over the repeated administrations, and (d) construct validity. We addressed these issues for the full sample as well as for subgroups defined by age, IQ, and ASD status. Methods Participants were 106 individuals with FXS between ages 6 and 23 years who had IQs within the range of intellectual disability (IQ < 70). ELS procedures for collecting samples in conversation and narration were followed and analyzed separately. Five measures were derived from transcripts segmented into C-units (i.e., an independent clause and its modifiers): number of C-units per minute (talkativeness), number of different word roots (vocabulary), C-unit length in morphemes (syntax), percentage of C-units containing dysfluency (utterance planning), and percentage of C-units that were fully or partly unintelligible (articulatory quality). ELS procedures were administered twice at 4-week intervals for each participant. Standardized tests and informant reports were administered and provided measures for evaluating construct validity of ELS measures. Results We found low rates of noncompliance, suggesting the task can be completed meaningfully by most individuals with FXS, although noncompliance was higher for younger, lower IQ, and more autistic participants. Minimal practice effects and strong test-retest reliability over the 4-week interval were observed for the full sample and across the range of ages, IQs, and autism symptom severity. Evidence of convergent construct validity was observed for the measures of vocabulary, syntax, and unintelligibility for the full sample and across the range of IQ and autism symptom severity, but not for participants under age 12. Conversation and narration yielded largely similar results in all analyses. Conclusions The findings suggest that the ELS procedures are feasible and yield measures with adequate psychometric properties for a majority of 6 to 23 years with FXS who have ID. The procedures work equally well regardless of level of ID or degree of ASD severity. The procedures, however, are more challenging and have somewhat less adequate psychometric properties for individuals with FXS under age 12.

Download Full-text

Test-Retest Reliability and Practice Effects of the Stability Evaluation Test

Journal of Sport Rehabilitation ◽

10.1123/jsr.2016-0163 ◽

2017 ◽

Vol 26 (3) ◽

Cited By ~ 4

Author(s):

Richelle M. Williams ◽

Matthew A. Corvo ◽

Kenneth C. Lam ◽

Travis A. Williams ◽

Lesley K. Gilmer ◽

...

Keyword(s):

Postural Control ◽

Repeated Measures ◽

Healthy Adults ◽

Composite Score ◽

Practice Effects ◽

Stability Evaluation ◽

Retest Reliability ◽

Evaluation Test ◽

The Stability ◽

Test Retest Reliability

Context: Postural control plays an essential role in concussion evaluation. The Stability Evaluation Test (SET) aims to objectively analyze postural control by measuring sway velocity on the NeuroCom VSR portable force platform (Natus, San Carlos, CA). Objective: To assess the test-retest reliability and practice effects of the SET protocol. Design: Cohort. Setting: Research laboratory. Patients or Other Participants: 50 healthy adults (20 men, 30 women, age 25.30 ± 3.60 y, height 166.60± 12.80 cm, mass 68.80 ± 13.90 kg). Interventions: All participants completed 4 trials of the SET. Each trial consisted of six 20-s balance tests with eyes closed, under the following conditions: double-leg firm (DFi), single-leg firm (SFi), tandem firm (TFi), double-leg foam (DFo), single-leg foam (SFo), and tandem foam (TFo). Each trial was separated by a 5-min seated rest period. Main Outcome Measures: The dependent variable was sway velocity (deg/s), with lower values indicating better balance. Sway velocity was recorded for each of the 6 conditions as well as a composite score for each trial. Test-retest reliability was analyzed across 4 trials with intraclass correlation coefficients (ICCs). Practice effects analyzed with repeated measures analysis of variance, followed by Tukey post hoc comparisons for any significant main effects (P < .05). Results: Sway-velocity reliability values were good to excellent: DFi (ICC = .88; 95%CI: .81, .92), SFi (ICC = .75; 95%CI: .61, .85), TFi (ICC = .84; 95%CI: .75, .90), DFo (ICC = .83; 95%CI: .74, .90), SFo (ICC = .82; 95%CI: .72, .89), TFo (ICC = .81; 95%CI: .69, .88), and composite score (ICC = .93; 95%CI: .88, .95). Significant practice effects (P < .05) were noted on the SFi, DFo, SFo, TFo conditions and composite scores. Conclusions: Our results suggest the SET has good to excellent reliability for the assessment of postural control in healthy adults. Due to the practice effects noted, a familiarization session is recommended (ie, all 6 conditions) before data are recorded. Future studies should evaluate injured patients to determine meaningful change scores during various injuries.

Download Full-text

Test-retest Reliability and Practice Effects of a Rapid Screen of Mild Traumatic Brain Injury

Journal of Clinical and Experimental Neuropsychology ◽

10.1080/13803390490918589 ◽

2005 ◽

Vol 27 (5) ◽

pp. 624-632 ◽

Cited By ~ 12

Author(s):

Veronica Eileen De Monte ◽

Gina Malke Geffen ◽

Karleigh Kwapil

Keyword(s):

Traumatic Brain Injury ◽

Brain Injury ◽

Mild Traumatic Brain Injury ◽

Practice Effects ◽

Retest Reliability ◽

Test Retest Reliability

Download Full-text

Test-retest reliability and practice effects of the virtual environment grocery store (VEGS)

Journal of Clinical and Experimental Neuropsychology ◽

10.1080/13803395.2021.1960277 ◽

2021 ◽

pp. 1-11

Author(s):

Daniel S. Weitzner ◽

Matthew Calamia ◽

Thomas D. Parsons

Keyword(s):

Virtual Environment ◽

Grocery Store ◽

Practice Effects ◽

Retest Reliability ◽

Test Retest Reliability

Download Full-text

The Arizona Cognitive Test Battery for Down Syndrome: Test-Retest Reliability and Practice Effects

American Journal on Intellectual and Developmental Disabilities ◽

10.1352/1944-7558-122.3.215 ◽

2017 ◽

Vol 122 (3) ◽

pp. 215-234 ◽

Cited By ~ 12

Author(s):

Jamie O. Edgin ◽

Payal Anand ◽

Tracie Rosser ◽

Elizabeth I. Pierpont ◽

Carlos Figueroa ◽

...

Keyword(s):

Down Syndrome ◽

Motor Planning ◽

Parent Report ◽

Test Battery ◽

Practice Effects ◽

Cognitive Test ◽

Repeated Testing ◽

Retest Reliability ◽

Baseline Evaluation ◽

Test Retest Reliability

Abstract A multisite study investigated the test-retest reliability and practice effects of a battery of assessments to measure neurocognitive function in individuals with Down syndrome (DS). The study aimed to establish the appropriateness of these measures as potential endpoints for clinical trials. Neurocognitive tasks and parent report measures comprising the Arizona Cognitive Test Battery (ACTB) were administered to 54 young participants with DS (7–20 years of age) with mild to moderate levels of intellectual disability in an initial baseline evaluation and a follow-up assessment 3 months later. Although revisions to ACTB measures are indicated, results demonstrate adequate levels of reliability and resistance to practice effects for some measures. The ACTB offers viable options for repeated testing of memory, motor planning, behavioral regulation, and attention. Alternative measures of executive functioning are required.

Download Full-text