Researchers and practitioners have long been concerned about detrimental effects of socially desirable responding on the structure and criterion validity of personality assessments. The current research examined the effect of reducing evaluative item content of a Big Five personality assessment on test structure and criterion validity. We developed a new public domain measure of the Big Five called the Less Evaluative Five Factor Inventory (LEFFI), adapted from the standard 50-item IPIP NEO, and intended to be less evaluative. Participants ( n = 3164) then completed standard (IPIP) and neutralized (LEFFI) measures of personality. Criteria were also collected, including academic grades, age, sex, smoking, alcohol consumption, exercise, protesting, religious worship, music preferences, dental hygiene, blood donation, other-rated communication styles, other-rated HEXACO personality, and cognitive ability (ICAR). Evaluativeness of items was reduced in the neutralized measure. Cronbach's alpha and test-retest reliability were maintained. Correlations between the Big Five were reduced in the neutralized measure and criterion validity was similar or slightly reduced in the neutralized measure. The large sample size and use of objective criteria extend past research. The study also contributes to debates about whether the general factor of personality and agreement with socially desirable content reflect substance or bias.
A less evaluative measure of Big Five personality: Comparison of structure and criterion validity