Utility of WAIS-IV Digit Span indices as measures of performance validity in moderate to severe traumatic brain injury

BACKGROUND: The COVID-19 pandemic has led to increased utilization of teleneuropsychology (TeleNP) services. Unfortunately, investigations of performance validity tests (PVT) delivered via TeleNP are sparse. OBJECTIVE: The purpose of this study was to examine the specificity of the Reliable Digit Span (RDS) and 21-item test administered via telephone METHOD: Participants were 51 veterans with moderate-to-severe traumatic brain injury (TBI). All participants completed the RDS and 21-item test in the context of a larger TeleNP battery. Specificity rates were examined across multiple cutoffs for both PVTs. RESULTS: Consistent with research employing traditional face-to-face neuropsychological evaluations, both PVTs maintained adequate specificity (i.e., > 90%) across previously established cutoffs. Specifically, defining performance invalidity as RDS < 7 or 21-item test forced choice total correct < 11 led to < 10%false positive classification errors. CONCLUSIONS: Findings add to the limited body of research examining and provide preliminary support for the use of the RDS and 21-item test in TeleNP via telephone. Both measures maintained adequate specificity in veterans with moderate-to-severe TBI. Future investigations including clinical or experimental “feigners” in a counter-balanced cross-over design (i.e., face-to-face vs. TeleNP) are recommended.

Download Full-text

A-102 Performance Validity Testing in Telehealth Research: A VA Traumatic Brain Injury Model Systems Study

Archives of Clinical Neuropsychology ◽

10.1093/arclin/acab062.120 ◽

2021 ◽

Vol 36 (6) ◽

pp. 1151-1151

Author(s):

Justin O'Rourke ◽

Robert J Kanser ◽

Marc A Silva

Keyword(s):

Traumatic Brain Injury ◽

Brain Injury ◽

Digit Span ◽

Secondary Analysis ◽

Primary Objective ◽

Model Systems ◽

Performance Validity ◽

Cut Scores ◽

Chi Square ◽

Severe Tbi

Abstract Objective Studies on Performance Validity Tests (PVTs) for tele-neuropsychology (TeleNP) are sparse. Verbal PVTs appear to better translate to TeleNP, so the primary objective of this study was to provide initial data on two well-established, verbal PVTs administered via TeleNP for research participants with traumatic brain injury (TBI). Methods This secondary analysis of the Veterans Affairs TBI Model Systems data included 53 participants enrolled in a PVT module study (3/01/2020–09/20/2020) with documented moderate-to-severe TBI per Glasgow Coma Score (M = 6.5, SD = 4.4), posttraumatic amnesia duration (M = 42.7 days, SD = 47.1), and/or time to follow commands (M = 10.5 days, SD = 16.3). Participants completed two PVTs—Reliable Digit Span (RDS) and the 21-Item Test (21-IT)—alongside telephone-based cognitive assessment 1–7 years after TBI. Descriptive analyses were performed to compare PVT performances to previously established cut scores. Chi square analyses were employed to examine 21-IT and RDS as dichotomous outcomes (pass/fail) at selected cutoffs. Results RDS ranged from 5 to 16 (M = 10.5, SD = 2.4). 21-IT ranged from 7 to 21 (M = 16.4, SD = 3.1). For RDS, 9.8% were invalid with a cutscore of ≤7 and 19.6% using a cutscore of ≤8. For the 21-IT, 7.8% were in invalid using a cutscore of ≤11, and 13.7% using a cutscore of ≤12. Conclusion(s) Using previously established cut scores, telephone-administered RDS and 21-IT resulted in relatively low rates of invalid performance among individuals with moderate-to-severe TBI. These findings provide preliminary support for the RDS and 21-IT in TeleNP.

Download Full-text