Utility of the D-KEFS Color Word Interference Test as an embedded measure of performance validity

Abstract Objective Eglit and colleagues (2019) found that the sum of the four age-corrected scaled scores from the Color Word Interference Test (CWIT) of the Delis-Kaplan Executive Function System (D-KEFS) could act as a useful embedded performance validity test (PVT). As such, we attempted to cross-validate their findings. Method Patients included 312 individuals who completed neuropsychological evaluations. Individuals were excluded if they were not administered CWIT, were not administered at least 4 criterion PVTs, had diagnoses of dementia or intellectual disability, or had indeterminate validity results (i.e., failure of one PVT). Valid performers (n = 231) were those who passed all criterion PVTs while invalid performers (n = 81) failed two or more criterion PVTs. A receiver operating characteristic curve was conducted for the CWIT embedded PVT. Results Area under the curve (AUC) was .804. At a cutoff of < 26, specificity was 90% and sensitivity was 48%. At a cutoff of < 20 (the first cutoff at which 90% specificity was found by Eglit et al.), specificity was 95% and sensitivity was 32%. At an even more conservative cutoff of < 18 (the cutoff recommended by Eglit et al.), specificity was 96% and sensitivity was 22%. Conclusions These results cross-validate Eglit et al.’s findings, indicating that the sum of age-corrected scaled scores across the four CWIT trials can effectively serve as an embedded PVT. A more liberal cutoff was able to be applied in our sample but, even at conservative cutoffs documented in Eglit et al., sensitivity rates were adequate enough to warrant use of the index as an embedded PVT.

Download Full-text

Motor Reaction Times as an Embedded Measure of Performance Validity: a Study with a Sample of Austrian Early Retirement Claimants

Psychological Injury and Law ◽

10.1007/s12207-021-09431-z ◽

2021 ◽

Author(s):

Manuel Czornik ◽

Doris Seidl ◽

Sophie Tavakoli ◽

Thomas Merten ◽

Johann Lehrner

Keyword(s):

Reaction Time ◽

Test Performance ◽

False Positive Rate ◽

Performance Validity ◽

Motor Reaction ◽

Intraindividual Variation ◽

Validity Assessment ◽

Time Parameters ◽

Measure Of Performance ◽

Embedded Measure

AbstractAmong embedded measures of performance validity, reaction time parameters appear to be less common. However, their potential may be underestimated. In the German-speaking countries, reaction time is often examined using the Alertness subtest of the Test of Attention Performance (TAP). Several previous studies have examined its suitability for validity assessment. The current study was conceived to examine a variety of reaction time parameters of the TAP Alertness subtest with a sample of 266 Austrian civil forensic patients. Classification results from the Word Memory Test (WMT) were used as an external indicator to distinguish between valid and invalid symptom presentations. Results demonstrated that the WMT fail group performed worse in reaction time as well as its intraindividual variation across trials when compared to the WMT pass group. Receiver operating characteristic analyses revealed areas under the curve of .775–.804. Logistic regression models indicated the parameter intraindividual variation of motor reaction time with warning sound as being the best predictor for invalid test performance. Suggested cut scores yielded a sensitivity of .62 and a specificity of .90, or .45 and .95, respectively, when the accepted false-positive rate was set lower. The results encourage the use of the Alertness subtest as an embedded measure of performance validity.

Download Full-text

Use of the Color Trails Test as an Embedded Measure of Performance Validity

The Clinical Neuropsychologist ◽

10.1080/13854046.2013.786758 ◽

2013 ◽

Vol 27 (5) ◽

pp. 864-876 ◽

Cited By ~ 2

Author(s):

George K. Henry ◽

James Algina

Keyword(s):

Performance Validity ◽

Measure Of Performance ◽

Embedded Measure

Download Full-text

A-224 Clinical Utility of Grooved Pegboard as an Additional Embedded Measure of Performance Validity

Archives of Clinical Neuropsychology ◽

10.1093/arclin/acaa068.224 ◽

2020 ◽

Vol 35 (6) ◽

pp. 1019-1019

Author(s):

Link J ◽

Lu L ◽

Armistead-Jehle P ◽

Seegmiller R

Keyword(s):

Digit Span ◽

Symptom Validity ◽

Dominant Hand ◽

Performance Validity ◽

Chi Square ◽

Validity Test ◽

Medical Symptom ◽

Symptom Validity Test ◽

Measure Of Performance ◽

Embedded Measure

Abstract Objective Previously, the Grooved Pegboard Test (GPB) has shown potential as an embedded measure of performance validity (PVT) using a T-score cutoff for either hand (≤ 29) or both hands (≤ 31). This study sought to validate these cutoffs with established PVTs (Medical Symptom Validity Test [MSVT], Non-Verbal Medical Symptom Validity Test [NV-MSVT], and Reliable Digit Span [RDS]). Method Subjects (N = 190) were primarily Caucasian (85%) and male (81%). Average age and education were 41 (SD = 11.62) and 16 years (SD = 2.35), respectively. Participants were stratified as GPB “pass or fail” based on previously proposed cutoff criteria. MSVT, NV-MSVT, and RDS were also dichotomized as pass or fail based on manual or conventional recommendations. Results Chi-Square analyses revealed significant associations between GPB “fails” for both hands and MSVT, NV-MSVT, and RDS (χ2 (1, n = 190) ranging from 5.80 to 15.98, Phi ranging from .18 to .29, p ranging from < .05 to < .0001). Similar findings were observed for dominant hand “fails”; however, non-dominant hand was only related to the MSVT. Sensitivity and specificity values from the GPB measures ranged from .47 to .58 and from .89 to .92, respectively. Positive and negative predictive power ranged from .38 to .45 and .93 to .94, respectively. Conclusion These data demonstrate the relative utility of the GPB as an embedded PVT. In particular, dominant and both hand cutoffs are likely to be more clinically useful in determining sub-optimal performance. However, as sensitivity is relatively low, this measure should not be employed as the sole PVT administered.

Download Full-text

C-83Effectiveness of the D-KEFS Color-Word Interference Test as a Measure of Negative Response Bias

Archives of Clinical Neuropsychology ◽

10.1093/arclin/acv047.285 ◽

2015 ◽

Vol 30 (6) ◽

pp. 593.2-593

Author(s):

T Arentsen ◽

W Stubbs ◽

S Stern ◽

B Roper ◽

E Crouse

Keyword(s):

Response Bias ◽

Color Word ◽

Negative Response ◽

Negative Response Bias ◽

Interference Test

Download Full-text

Stroop Color-Word Interference Test: Normative data for the Latin American Spanish speaking adult population

Neurorehabilitation ◽

10.3233/nre-151281 ◽

2015 ◽

Vol 37 (4) ◽

pp. 591-624 ◽

Cited By ~ 23

Author(s):

D. Rivera ◽

P.B. Perrin ◽

L.F. Stevens ◽

M.T. Garza ◽

C. Weil ◽

...

Keyword(s):

Latin American ◽

Normative Data ◽

Color Word ◽

Adult Population ◽

Spanish Speaking ◽

Interference Test ◽

Latin American Spanish ◽

American Spanish

Download Full-text

Finger Tapping Test Performance as a Measure of Performance Validity

The Clinical Neuropsychologist ◽

10.1080/13854046.2014.907583 ◽

2014 ◽

Vol 28 (5) ◽

pp. 876-888 ◽

Cited By ~ 31

Author(s):

Bradley N. Axelrod ◽

John E. Meyers ◽

Jeremy J. Davis

Keyword(s):

Test Performance ◽

Finger Tapping ◽

Performance Validity ◽

Finger Tapping Test ◽

Measure Of Performance

Download Full-text

Clinical and neurocognitive characteristics associated with treatment-resistant depression

European Psychiatry ◽

10.1016/j.eurpsy.2017.01.753 ◽

2017 ◽

Vol 41 (S1) ◽

pp. S542-S542 ◽

Cited By ~ 1

Author(s):

G. Serafini ◽

G. Adavastro ◽

G. Canepa ◽

C. Conigliaro ◽

M. Pompili ◽

...

Keyword(s):

Depressive Symptoms ◽

Early Onset ◽

Rating Scale ◽

Color Word ◽

Late Onset ◽

Anxiety Symptoms ◽

Treatment Resistant Depression ◽

Treatment Resistant ◽

Interference Test ◽

Resistant Depression

IntroductionTreatment resistant depression (TRD) is a disabling condition associated with a relevant psychosocial impairment worldwide.ObjectivesThis exploratory study is aimed to evaluate the main clinical and neurocognitive characteristics in a sample of 21 subjects admitted to the Psychiatric Clinic of University of Genoa as inpatients between 2015 and 2016 and diagnosed with TRD according to Thase and Rush staging method.MethodsPatients have been assessed using the Hamilton Depression Rating Scale (HDRS), Hamilton Anxiety Rating Scale, and Clinical Global Impression (CGI). The Continuous Performance Test (CPT), Trial Making Test (TMT-A/B), Stroop Color Word Interference Test, Verbal Fluency Test, and Rey auditory-verbal learning test (RAVLT) have been administered as well.ResultsSubjects with early-onset (< 50 years) depression had a longer illness duration, higher depressive episodes and more impaired performance at RAVLT while individuals with late-onset (> 50 years) depression showed a higher severity of depressive symptoms and more anxiety symptoms. Depressive symptoms were positively associated with anxiety (r = 0.82; P = 0.00) and negatively with TMT-A/B (r = −0.56, P = 0.01), Stroop Color Word Interference Test (r = −0.72, P = 0.005 and r = −0.616, P = 0.008), and RAVLT (r = −0.60; P = 0.02) performances. According to regression analyses, anxiety symptoms were the only significant predictor of depression severity (P = 0.02).ConclusionsEarly-onset depression is associated with more disability and worse neurocognitive performance whereas late-onset depression is linked to more anxiety symptoms and more depressive symptoms severity. Clinicians should closely monitor patients with TRD for the presence of anxiety symptoms that may represent a significant risk factor of poorer long-term outcome.Disclosure of interestThe authors have not supplied their declaration of competing interest.

Download Full-text