Validation of the Advanced Clinical Solutions Word Choice Test (WCT) in a Mixed Clinical Sample: Establishing Classification Accuracy, Sensitivity/Specificity, and Cutoff Scores

Assessment ◽  
2017 ◽  
Vol 26 (7) ◽  
pp. 1320-1328 ◽  
Author(s):  
Kathleen M. Bain ◽  
Jason R. Soble
Keyword(s):  
Classification Accuracy ◽  
Clinical Sample ◽  
Choice Test ◽  
Word Choice ◽  
Performance Validity ◽  
Cut Scores ◽  
Word Memory Test ◽  
Word Memory ◽  
Good Classification ◽  
Sensitivity Specificity

This study examined the Word Choice Test’s (WCT) utility as a performance validity test in a mixed clinical sample of veterans referred for neuropsychological evaluation. Participants completed Green’s Word Memory Test (WMT), WCT, and Test of Memory Malingering (TOMM) Trial 1. Using the WMT as the criterion for valid performance, logistic regressions examined the WCT and TOMM’s classification accuracy for those with and without cognitive impairment (CI). Receiver operating characteristic curves were used to establish cut scores which maximized the sensitivity/specificity of each measure. In those without CI, both tests showed good classification accuracy (86.7% and 85.0%, respectively). Among those with CI, the TOMM retained good classification accuracy (82.3%), while the WCT’s decreased considerably (69.4%). Optimal WCT cut scores differed based on impairment status, with a higher sensitivity/specificity trade-off among those with CI. Successful performance on the WCT appeared to rely more heavily on cognitive processes unrelated to performance validity.

When Time is of the Essence: Preliminary Findings for a Quick Administration of the Dot Counting Test

2019 ◽  
Author(s):  
K Chase Bailey ◽  
Troy A Webber ◽  
Jacob I Phillips ◽  
Lindsay D R Kraemer ◽  
Janice C Marceaux ◽  
...  
Keyword(s):  
Classification Accuracy ◽  
Clinical Sample ◽  
Characteristic Curve ◽  
Cross Sectional Study ◽  
Receiver Operator Characteristic Curve ◽  
Performance Validity ◽  
Free Standing ◽  
Cross Sectional ◽  
Validity Measures ◽  
Sensitivity Specificity

Abstract Objective Performance validity research has emphasized the need for briefer measures and, more recently, abbreviated versions of established free-standing tests to minimize neuropsychological evaluation costs/time burden. This study examined the accuracy of multiple abbreviated versions of the Dot Counting Test (“quick” DCT) for detecting invalid performance in isolation and in combination with the Test of Memory Malingering Trial 1 (TOMMT1). Method Data from a mixed clinical sample of 107 veterans (80 valid/27 invalid per independent validity measures and structured criteria) were included in this cross-sectional study; 47% of valid participants were cognitively impaired. Sensitivities/specificities of various 6- and 4-card DCT combinations were calculated and compared to the full, 12-card DCT. Combined models with the most accurate 6- and 4-card combinations and TOMMT1 were then examined. Results Receiver operator characteristic curve analyses were significant for all 6- and 4-card DCT combinations with areas under the curve of .868–.897. The best 6-card combination (cards, 1-3-5-8-11-12) had 56% sensitivity/90% specificity (E-score cut-off, ≥14.5), and the best 4-card combination (cards, 3-4-8-11) had 63% sensitivity/94% specificity (cut-off, ≥16.75). The full DCT had 70% sensitivity/90% specificity (cut-off, ≥16.00). Logistic regression revealed 95% classification accuracy when 6-card or 4-card “quick” combinations were combined with TOMMT1, with the DCT combinations and TOMMT1 both emerging as significant predictors. Conclusions Abbreviated DCT versions utilizing 6- and 4-card combinations yielded comparable sensitivity/specificity as the full DCT. When these “quick” DCT combinations were further combined with an abbreviated memory-based performance validity test (i.e., TOMMT1), overall classification accuracy for identifying invalid performance was 95%.

The power of timing: Adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy

2016 ◽  
Vol 39 (4) ◽  
pp. 369-383 ◽  
Author(s):  
Laszlo A. Erdodi ◽  
Bradley T. Tyson ◽  
Ayman G. Shahein ◽  
Jonathan D. Lichtenstein ◽  
Christopher A. Abeare ◽  
...  
Keyword(s):  
Recognition Memory ◽  
Classification Accuracy ◽  
Memory Test ◽  
Choice Test ◽  
Word Choice ◽  
Recognition Memory Test ◽  
Time To Completion

scholarly journals Illness Perceptions Predict Cognitive Performance Validity

2018 ◽  
Vol 24 (7) ◽  
pp. 735-745 ◽  
Author(s):  
George K. Henry ◽  
Robert L. Heilbronner ◽  
Julie Suhr ◽  
Jeffrey Gornbein ◽  
Eveleigh Wagner ◽  
...  
Keyword(s):  
Cognitive Performance ◽  
Illness Perceptions ◽  
Multivariate Logistic Regression Analysis ◽  
Cognitive Effort ◽  
Clinical Samples ◽  
Performance Validity ◽  
Psychological Variables ◽  
Word Memory Test ◽  
Word Memory ◽  
Forensic Sample

AbstractObjectives:The aim of this study was to investigate the relationship of psychological variables to cognitive performance validity test (PVT) results in mixed forensic and nonforensic clinical samples.Methods:Participants included 183 adults who underwent comprehensive neuropsychological examination. Criterion groups were formed, that is, Credible Group or Noncredible Group, based upon their performance on the Word Memory Test and other stand-alone and embedded PVT measures.Results:Multivariate logistic regression analysis identified three significant predictors of cognitive performance validity. These included two psychological constructs, for example, Cogniphobia (perception that cognitive effort will exacerbate neurological symptoms), and Symptom Identity (perception that current symptoms are the result of illness or injury), and one contextual factor (forensic). While there was no interaction between these factors, elevated scores were most often observed in the forensic sample, suggesting that these independently contributing intrinsic psychological factors are more likely to occur in a forensic environment.Conclusions:Illness perceptions were significant predictors of cognitive performance validity particularly when they reached very elevated levels. Extreme elevations were more common among participants in the forensic sample, and potential reasons for this pattern are explored. (JINS, 2018,24, 1–11)

Convergent, Discriminant, and Concurrent Validity of Nonmemory-Based Performance Validity Tests

Assessment ◽  
2018 ◽  
Vol 27 (7) ◽  
pp. 1399-1415 ◽  
Author(s):  
Troy A. Webber ◽  
Edan A. Critchfield ◽  
Jason R. Soble
Keyword(s):  
Test Performance ◽  
Digit Span ◽  
Neuropsychological Test ◽  
Test Validity ◽  
Choice Test ◽  
Word Choice ◽  
Performance Validity ◽  
Adult Intelligence Scale ◽  
Validity Tests ◽  
Performance Validity Tests

To supplement memory-based Performance Validity Tests (PVTs) in identifying noncredible performance, we examined the validity of the two most commonly used nonmemory-based PVTs—Dot Counting Test (DCT) and Wechsler Adult Intelligence Scale–Fourth edition (WAIS-IV) Reliable Digit Span (RDS)—as well as two alternative WAIS-IV Digit Span (DS) subtest PVTs. Examinees completed DCT, WAIS-IV DS, and the following criterion PVTs: Test of Memory Malingering, Word Memory Test, and Word Choice Test. Validity groups were determined by passing 3 (valid; n = 69) or failing ⩾2 (noncredible; n = 30) criterion PVTs. DCT, RDS, RDS–Revised (RDS-R), and WAIS-IV DS Age-Corrected Scaled Score (ACSS) were significantly correlated (but uncorrelated with memory-based PVTs). Combining RDS, RDS-R, and ACSS with DCT improved classification accuracy (particularly for DCT/ACSS) for detecting noncredible performance among valid-unimpaired, but largely not valid-impaired examinees. Combining DCT with ACSS may uniquely assess and best supplement memory-based PVTs to identify noncredible neuropsychological test performance in cognitively unimpaired examinees.

scholarly journals Utility of Green's Word Memory Test Free Recall Subtest as a Measure of Verbal Memory: Initial Evidence from a Temporal Lobe Epilepsy Clinical Sample

2015 ◽  
Vol 31 (1) ◽  
pp. 79-87 ◽  
Author(s):  
Jason R. Soble ◽  
Katie E. Osborn ◽  
Michelle L. Mattingly ◽  
Fernando L. Vale ◽  
Selim R. Benbadis ◽  
...  
Keyword(s):  
Free Recall ◽  
Temporal Lobe Epilepsy ◽  
Temporal Lobe ◽  
Verbal Memory ◽  
Clinical Sample ◽  
Memory Test ◽  
Word Memory Test ◽  
Word Memory

Comparing the Recognition Memory Test and the Word Choice Test in a Mixed Clinical Sample: Are They Equivalent?

2014 ◽  
Vol 7 (3) ◽  
pp. 255-263 ◽  
Author(s):  
Laszlo A. Erdodi ◽  
Ned L. Kirsch ◽  
Renee Lajiness-O’Neill ◽  
Evelyn Vingilis ◽  
Brent Medoff
Keyword(s):  
Recognition Memory ◽  
Clinical Sample ◽  
Memory Test ◽  
Choice Test ◽  
Word Choice ◽  
Recognition Memory Test

scholarly journals Performance Validity Testing in Justice-Involved Adults with Fetal Alcohol Spectrum Disorder

2020 ◽  
Vol 26 (7) ◽  
pp. 701-713 ◽  
Author(s):  
Katelyn Mullally ◽  
Kaitlyn McLachlan ◽  
Emily MacKillop ◽  
Jacqueline Pei
Keyword(s):  
Fetal Alcohol Spectrum Disorder ◽  
Digit Span ◽  
Performance Validity ◽  
Neurocognitive Deficits ◽  
Fourth Edition ◽  
Fetal Alcohol ◽  
Word Memory Test ◽  
Logical Memory ◽  
Word Memory ◽  
Fetal Alcohol Spectrum

AbstractObjectives:A number of commonly used performance validity tests (PVTs) may be prone to high failure rates when used for individuals with severe neurocognitive deficits. This study investigated the validity of 10 PVT scores in justice-involved adults with fetal alcohol spectrum disorder (FASD), a neurodevelopmental disability stemming from prenatal alcohol exposure and linked with severe neurocognitive deficits.Method:The sample comprised 80 justice-involved adults (ages 19–40) including 25 with confirmed or possible FASD and 55 where FASD was ruled out. Ten PVT scores were calculated, derived from Word Memory Test, Genuine Memory Impairment Profile, Advanced Clinical Solutions (Word Choice), the Wechsler Adult Intelligence Scale – Fourth Edition (Reliable Digit Span and age-corrected scaled scores (ACSS) from Digit Span, Coding, Symbol Search, Coding – Symbol Search, Vocabulary – Digit Span), and the Wechsler Memory Scale – Fourth Edition (Logical Memory II Recognition).Results:Participants with diagnosed/possible FASD were more likely to fail any single PVT, and failed a greater number of PVTs overall, compared to those without FASD. They were also more likely to fail based on Word Memory Test, Digit Span ACSS, Coding ACSS, Symbol Search ACSS, and Logical Memory II Recognition, compared to controls (35–76%). Across both groups, substantially more participants with IQ <70 failed two or more PVTs (90%), compared to those with an IQ ≥70 (44%).Conclusions:Results highlight the need for additional research examining the use of PVTs in justice-involved populations with FASD.

Sign in / Sign up

Export Citation Format

Share Document