A-12 Racial Differences in Performance Validity Test Failure Rates

2021 ◽  
Vol 36 (6) ◽  
pp. 1034-1034
Author(s):  
Jeremy Davis ◽  
Summer Rolin ◽  
Gabrielle Hromas
Keyword(s):  
African American ◽  
False Positive ◽  
Mmse Score ◽  
Diagnostic Group ◽  
Normal Group ◽  
Cognitive Test ◽  
Failure Rates ◽  
Performance Validity ◽  
Impaired Group ◽  
Group Failure

Abstract Objective Embedded performance validity tests (PVTs) may show increased false positive rates in racially diverse examinees. This study examined false positive rates by race in an older adult sample. Method The project involved secondary analysis of a deidentified dataset (N = 22,688) from the National Alzheimer’s Coordinating Center (NACC). Participants were included if their identified race was African American or white. Exclusion criteria included diagnosis of mild cognitive impairment (MCI; n = 5160) or dementia (n = 5550). The initial sample included 11,114 participants grouped as cognitively normal (89.9%) or impaired but not MCI of whom 16.4% identified as African American. Propensity score matching was conducted by diagnostic group to match African American and white participants on age, education, gender, and MMSE score. The final sample included 3024 and 482 participants in normal and impaired groups, respectively, with 50% of participants identifying as African American in each group. Failure rates on five embedded PVTs in the NACC cognitive test battery were examined by race and by diagnosis. Results Age, education, gender, and MMSE score were not significantly different by race in either diagnostic group. In the normal group, 4.7% of African American and 1.9% of white participants failed two or more PVTs (p < 0.001). In the impaired group, 9.5% of African American and 5.8% of white participants failed two or more PVTs (n.s.). Conclusions PVT failure rates were significantly higher among African American participants in the normal group but not in the impaired group. Failure rates remained below a common false positive threshold of 10%.

A-184 Performance Validity Test Failure Rates in Bilingual Individuals Evaluated in English

2021 ◽  
Vol 36 (6) ◽  
pp. 1239-1239
Author(s):  
Jeremy Davis ◽  
Gabrielle Hromas ◽  
Summer Rolin
Keyword(s):  
False Positive ◽  
Mmse Score ◽  
Secondary Analysis ◽  
Diagnostic Group ◽  
Cognitive Test ◽  
Failure Rates ◽  
Performance Validity ◽  
Impaired Group ◽  
Positive Threshold ◽  
Validity Tests

Abstract Objective Classification accuracy of embedded performance validity tests (PVTs) is unknown in cases involving bilingual examinees evaluated in English. This study examined false positive rates in bilingual individuals in an older adult sample. Method The project involved secondary analysis of a deidentified dataset (N = 22,688) from the National Alzheimer’s Coordinating Center (NACC). Exclusion criteria were diagnosis of mild cognitive impairment (MCI; n = 5160) or dementia (n = 5550). The initial sample included 11,513 participants grouped as cognitively normal (89.6%) or impaired but not MCI. A subset of 275 participants was identified with a primary language other than English who were evaluated in English. Propensity score matching was conducted by diagnostic group to match bilingual to monolingual participants on age, education, gender, and MMSE score. The final sample included 450 and 100 participants in normal and impaired groups, respectively. Failure rates on five embedded PVTs in the NACC cognitive test battery were examined by language and by diagnosis. Results Age, education, gender, and MMSE score were not significantly different by language in either diagnostic group. In the normal group, 4.9% of bilingual and 2.2% of monolingual participants failed two or more PVTs (n.s.). In the impaired group, 12% of bilingual and 6% of monolingual participants failed two or more PVTs (n.s.). Conclusions PVT failure rates were not significantly different between bilingual participants evaluated in English and monolingual participants in either diagnostic group. Failure rates, however, increased slightly above a common false positive threshold of 10% in bilingual participants in the impaired group.

scholarly journals 122 Use of Pimavanserin in Patients With Parkinson’s Disease Psychosis: Subgroup Analysis of Efficacy and Safety in Patients With and Without Cognitive Impairment

CNS Spectrums ◽  
2018 ◽  
Vol 23 (1) ◽  
pp. 77-77 ◽  
Author(s):  
Daniel Weintraub ◽  
James Norton ◽  
Bruce Coate ◽  
Candace Andersson ◽  
Doral Fredericks ◽  
...  
Keyword(s):  
Parkinson’S Disease ◽  
Parkinson's Disease ◽  
Cognitive Impairment ◽  
Subgroup Analysis ◽  
Serotonin Receptor ◽  
Mmse Score ◽  
Cognitively Impaired ◽  
Efficacy And Safety ◽  
Impaired Group ◽  
Moca Score

AbstractObjectiveA planned subgroup analysis of a phase 3 study was performed to evaluate the efficacy and safety of pimavanserin (PIM) in Parkinson’s disease psychosis (PDP) patients withglobal cognitive impairment.BackgroundPDP is frequent, distressing, a leading cause of institutionalization, complicates PD management and is linked to increased morbidity, incident dementia and mortality. PIM, a selective serotonin receptor (5-HT2A) inverse agonist/antagonist, is newly FDA-approved for the treatment of hallucinations and delusions associated with PDP.MethodsIn Study 020, a 6-week FDA registration study, 199 patients with baseline Mini-Mental State Examination (MMSE) score ≥21, moderate-severe psychosis, and on stable PD meds, were randomized to PIM (34 mg/day) or placebo (PBO) for 6 weeks. This subgroup analysis evaluates efficacy and safety between two groups: those with MMSE total score ≥21 but <25 (cognitively impaired; equivalent to Montreal Cognitive Assessment [MoCA] score 15-19) and those with score ≥25 (cognitively normal; equivalent to MoCA score 20-30). Safety assessments were performed on the full safety dataset (i.e., three 6-week placebo-controlled studies) including 614 subjects (PIM=382, PBO=231).ResultsOverall, patients in the PIM group experienced a statistically significant improvement in SAPS-PD scores from baseline to Day 43 compared with PBO (-5.79 vs. -2.73; p=0.001). In the subgroup analysis stratifying by baseline MMSE score, the change from baseline to Day 43 compared with PBO in the cognitively-impaired group (N=50) was numerically larger (-7.11 vs. -0.47; p=0.002). In the full safety dataset examining cognitively impaired patients, there were no between-group (PIM vs. PBO) differences in any treatment-emergent adverse event (TEAE) (57.6% vs. 56.1%) or serious TEAE (6.8% vs. 5.3%). The most common TEAEs occurring at ≥5% in either group were fall (7.4% vs.10.5%), confusional state (6.5% vs.1.8%), and orthostatic hypotension (0.0% vs. 8.8%).ConclusionsIn this subgroup analysis of PDP patients, the treatment effect of PIM on SAPS-PD was larger in the cognitively-impaired group, with similar TEAE and serious TEAE rates. These results hold promise for cognitively-impaired patients that will be further elucidated in future studies.Funding AcknowledgementsClinical study was funded by ACADIA Pharmaceuticals Inc.

The Effects of Physiological Noise on the Auditory Threshold

1972 ◽  
Vol 15 (4) ◽  
pp. 837-844 ◽  
Author(s):  
Linda K. Moulin
Keyword(s):  
Psychometric Function ◽  
Middle Ear ◽  
External Auditory Canal ◽  
False Positive ◽  
Normal Group ◽  
Auditory Threshold ◽  
Physiological Noise ◽  
Threshold Determination ◽  
Interpretation Of Results

Psychometric function slopes and false positive rates were obtained from two groups of 10 subjects each: a normal group observed both with and without external auditory canal occlusion, and a group of subjects with otosclerotic hearing losses. The measures were obtained at 80, 125, and 1000 Hz. Analysis of subject responses revealed that steeper psychometric function slopes and fewer false positive responses were observed in the otosclerotic group as compared with the normal group. Interpretation of results supports a model of auditory functioning in which a substantial amount of physiological noise originates in the middle ear and creates confusion, uncertainty, and variability during threshold determination for normal listeners. This variability, reflected in a flattening of the psychometric function slope and an increase in occurrence of false positive responses, is not seen in subjects with otosclerosis, presumably because of attenuation of physiological noise arising in the middle ear.

Performance validity in undergraduate research participants: a comparison of failure rates across tests and cutoffs

2016 ◽  
Vol 31 (1) ◽  
pp. 193-206 ◽  
Author(s):  
Kelly Y. An ◽  
Kristen Kaploun ◽  
Laszlo A. Erdodi ◽  
Christopher A. Abeare
Keyword(s):  
Undergraduate Research ◽  
Failure Rates ◽  
Performance Validity ◽  
Research Participants

scholarly journals B-68 The Effect of Bilingualism on Stroop Performance in Traumatic Brain Injury Survivors and Healthy Adults

2019 ◽  
Vol 34 (6) ◽  
pp. 1016-1016
Author(s):  
J Knight ◽  
A Arzuyan ◽  
W Lopez-Hernandez ◽  
P Litvin ◽  
R Cervante ◽  
...  
Keyword(s):  
Traumatic Brain Injury ◽  
Brain Injury ◽  
Response Inhibition ◽  
Color Word ◽  
Cognitive Test ◽  
Control Group ◽  
Performance Validity ◽  
Post Injury ◽  
Main Effects ◽  
The Relationship

Abstract Objective Traumatic brain injury (TBI) affects neurocognition. Speaking multiple languages can also influence cognitive test performances. We examined the relationship between TBI and monolingualism/bilingualism on a task of attention and response inhibition (Stroop Color Word Test; SCWT). Method The sample (N = 96) consisted of 37 healthy controls (19 bilingual; 18 monolingual), 32 acute TBI participants (12 bilingual; 20 monolingual), and 27 chronic TBI participants (16 bilingual; 11 monolingual). Acute TBI participants were tested 6 months post-injury and chronic TBI participants were tested 12 months or more post-injury. The SCWT included the word (SCWT-W), color (SCWT-C), and color-word interference (SCWT-I) conditions. All participants passed performance validity testing. 3X2 ANOVAs were conducted to examine the relationship between TBI and monolingualism/bilingualism on SCWT performances. Results Group effects (control and TBI groups) were found for all Stroop measures. We found main effects of TBI on SCWT-W, p = .013, ηp² = .09, SCWT-C, p = .001, ηp² = .14, and SCWT-I, p = .022, ηp² = .08, with the controls outperforming acute TBI survivors on SCWT-I, chronic TBI survivors on SCWT-W, and both TBI groups on SCWT-C. We also observed main effects of language for SCWT-C, p = .012, ηp² = .07, and SCWT-I, p = .003, ηp² = .09, with the monolinguals outperforming bilinguals on SCWT-C and SCWT-I. However, no significant interactions between TBI and language were found. Conclusion As expected, the control group outperformed TBI survivors on the SCWT. Monolinguals outperformed bilinguals on all Stroop measures except SCWT-W condition. Our findings seem to suggest that monolingual speakers may have better attention and response inhibition abilities that resulted in better SCWT performance.

The Role of Potentially Malleable Factors in Post-Concussive Symptoms and Objective Cognitive Outcomes in Iraq and Afghanistan Veterans with History of Mild TBI

2019 ◽  
Vol 34 (6) ◽  
pp. 850-850
Author(s):  
S Jurick ◽  
V Merritt ◽  
L Crocker ◽  
G Iverson ◽  
S Hoffman ◽  
...  
Keyword(s):  
Brain Injury ◽  
Executive Functioning ◽  
Self Efficacy ◽  
Psychiatric Symptoms ◽  
Self Report ◽  
Cognitive Test ◽  
Performance Validity ◽  
Mild Brain Injury ◽  
History Of ◽  
Additional Variance

Abstract Objective We examined whether potentially malleable factors are associated with post-concussive symptoms (PCS) and cognition in Veterans with mild traumatic brain injury (mTBI) histories. Method Combat-exposed Iraq and Afghanistan Veterans with remote history of mTBI (N=48) completed a neuropsychological assessment and self-report questionnaires. Hierarchical linear regressions predicting PCS (Rivermead Post-Concussion Symptoms Questionnaire) and objective cognition included relevant demographic, injury, and psychiatric symptom variables in the first block and five malleable factors (TBI knowledge, self-efficacy, coping style, attribution of symptoms to mTBI, and uncommonly-endorsed symptoms [mild Brain Injury Atypical Symptoms (mBIAS) scale]) in the second block. Those with valid performance validity tests (n = 42) were included in the cognitive test analyses. Results With psychiatric symptoms and lifetime history of mTBIs entered first, malleable factors accounted for 14-17% of additional variance in PCS (p < .001). Lower self-efficacy (B = -.53, p < .001) and greater attribution of symptoms to mTBI (B = .21, p = .05) were associated with higher PCS, whereas an approach style of coping, TBI knowledge, and the mBIAS were not (p’s>.05). Regarding cognition, the malleable factors block accounted for 25% of additional variance in executive functioning (p = .04) with premorbid intelligence entered first. Specifically, higher mBIAS scores significantly predicted worse executive functioning (B = -.50, p = .004). No significant associations emerged when predicting attention/processing speed or memory (p’s>.05). Conclusions In combat-exposed Veterans with mTBI histories, potentially malleable factors contribute to clinical outcomes even after accounting for psychiatric symptoms. These malleable features are prime targets to augment during psychoeducation (e.g., uncommonly-endorsed symptoms, attribution of symptoms) and cognitive behavioral therapy (e.g., self-efficacy) in the context of chronic PCS.

Interpretation of Fables and Proverbs by African Americans With and Without Aphasia

2001 ◽  
Vol 10 (1) ◽  
pp. 40-50 ◽  
Author(s):  
Hanna K. Ulatowska ◽  
Robert T. Wertz ◽  
Sandra B. Chapman ◽  
CaSaundra L. Hill ◽  
Jennifer L. Thompson ◽  
...  
Keyword(s):  
African American ◽  
Language Impairment ◽  
Communicative Competence ◽  
Normal Group ◽  
Functional Communication ◽  
Performance Information ◽  
African American Adults ◽  
Significant Relationships ◽  
Picture Description ◽  
Neurologically Normal

There is a paucity of performance information for African American adults with aphasia on appraisal tasks, especially in comparison with performance by neurologically normal African American adults. We administered language impairment, functional communication, and discourse measures to neurologically normal African American adults and African American adults with aphasia. The neurologically normal group performed significantly better on the language impairment measure (Western Aphasia Battery), the functional communication measure (ASHA Functional Assessment of Communication Skills for Adults), providing the lesson in a fable discourse task, and spontaneous interpretation of proverbs. No significant differences between groups were observed on a picture description fable task or in performance on a multiple-choice proverb task. Few significant relationships were observed among measures in the neurologically normal group; however, the group with aphasia displayed a variety of significant relationships in their performance on the language impairment, functional communication, fable lesson, and interpretation of proverbs tasks. The results imply that fable and proverb discourse tasks may be valuable supplemental measures for characterizing communicative competence in African American adults who have aphasia.

A-112 Examining the Utility of the New Dot Counting Test Cut-off Score in Latinx and Traumatic Brain Injury

2021 ◽  
Vol 36 (6) ◽  
pp. 1161-1161
Author(s):  
Sarah Saravia ◽  
Daniel W Lopez-Hernandez ◽  
Abril J Baez ◽  
Isabel Muñoz ◽  
Winter Olmos ◽  
...  
Keyword(s):  
Traumatic Brain Injury ◽  
Brain Injury ◽  
Ethnic Groups ◽  
Group Differences ◽  
Failure Rates ◽  
Performance Validity ◽  
Validity Test ◽  
Chi Squared ◽  
Future Work ◽  
A Performance

Abstract Objective The Dot Counting Test (DCT) is a performance validity test. McCaul et al. (2018) recently revised the DCT cut-off score from ≥17 to 13.80; we evaluated the new cut-off in non-Latinx Caucasian and Caucasian Latinx traumatic brain injury (TBI) survivors and healthy comparison (HC) participants. Method The sample consisted of 37 acute TBI (ATBI; 11 Caucasian Latinx; 26 non-Latinx Caucasian), 27 chronic TBI (CTBI; 10 Caucasian Latinx; 17 non-Latinx Caucasian), and 55 HC (29 Caucasian Latinx; 26 non-Latinx Caucasian) participants. Results An ANCOVA, controlling for age, revealed no DCT E-scores differences between groups. Both the conventional and the new cut-off scores had different failure rates in ATBI (conventional cut-off: 0%; PNC: 16%), CTBI (conventional cut-off: 7%; PNC: 15%), and HC (conventional cut-off: 10%; PNC: 11%) participants. For the Caucasian Latinx group (conventional cut-off: 6%; PNC: 12%) and the non-Latinx Caucasian group (conventional cut-off: 6%; PNC: 14%), demonstrated different failure rates across cut-off scores. Group differences were found with the McCaul et al. (2018) cut-off and the conventional cut-off. Also, chi-squared analysis revealed non-Latinx Caucasian participants with ATBI had greater failure rates than Caucasian Latinx participants with ATBI. Conclusion The new DCT cut-off score resulted in greater failure rates in TBI survivors. Also, this effect appears to be most pronounced in non-Latinx Caucasian persons with ATBI. Future work should investigate possible reasons for these differences so that more stringent DCT can be utilized in a way that provides less biased results for brain injury survivors across racial and ethnic groups.

Sign in / Sign up

Export Citation Format

Share Document