A-177 Classification Statistics of the Clinical Assessment of Attention Deficit – Adult (CAT-A) Negative Impression Scale for ADHD Evaluations in an Active Duty Sample
Abstract Objective To evaluate the classification statistics of the Clinical Assessment of Attention Deficit – Adult (CAT-A) Negative Impression (NI) scale, relative to the MMPI-2-RF in an active duty military sample. We hypothesized that MMPI-2-RF RBS would have the largest AUC. Method Retrospective review of 108 active duty service members consecutively referred to neuropsychology for clinical ADHD evaluations in a Midwest Army Health Center. Cases with missing data (10) and failures of MMPI-2-RF response consistency scales (3) were removed from analysis, resulting in final sample of 95. Average age was 32.62 (SD = 8.87) and average education was 14.66 (SD = 2.66). MMPI-2-RF symptom validity scales (F-r, Fp-r, Fs, FBS-r, and RBS) were employed as criterion measures at all standard cut-offs to evaluate the CAT-A NI scale. Results ROC analyses for the MMPI-2-RF over-reporting symptom validity scales ranged from 0.599 to 0.808, with the MMPI-2-RF RBS scale >79 demonstrating the lowest AUC (0.599; p 52. With specificity held at or above 0.90, sensitivities ranged from 22.86 to 60.00, with positive and negative predictive values ranging from 11.1 to 58.8 and 66.7 to 98.8, respectively. Conclusions The CAT-A NI scale demonstrated reasonable AUC values for nearly all MMPI-2-RF over-reporting scales. Psychologically-based over-reporting scales were superior to cognitively-based over-reporting scales in terms of classification statistics. The optimal cut in the current data (>52) is slightly higher (though roughly commensurate) to the cut score for atypical responses in the CAT-A manual (>45).