Modeling Effects of Faking on an Objective Personality Test

2011 ◽  
Vol 32 (4) ◽  
pp. 210-218 ◽  
Author(s):  
Martin Arendasy ◽  
Markus Sommer ◽  
Margit Herle ◽  
Bettina Schützhofer ◽  
Dagmar Inwanschitz
Keyword(s):  
Item Response ◽  
Test Scores ◽  
Latent Trait ◽  
Personality Test ◽  
Personality Tests ◽  
Naturally Occurring ◽  
Subject Design ◽  
Personality Questionnaires ◽  
Clear Description ◽  
The Ideal

The article investigated the effect of faking on the dimensionality and mean scores of an objective personality test measuring subjectively accepted level of risk. Various studies conducted with standardized personality questionnaires have demonstrated that faking may distort both the dimensionality and mean scores. In contrast, the empirical evidence on the effect of faking on the dimensionality and mean scores obtained with objective personality tests is still sparse. In the first study, we evaluated the effect of naturally occurring faking on the dimensionality and mean scores using a between-subject design that compared professional driver applicants to volunteers matched according to relevant sociodemographic characteristics. The results indicated that the objective personality test measures the same latent trait in both samples. Furthermore, we failed to observe a significant mean difference between volunteers and professional driver applicants. Furthermore, we failed to observe any mean score differences between both samples. The second study experimentally evaluated the effect of individual differences in respondents’ ability to infer the ideal level of the latent trait on the dimensionality and mean scores using a combined between- and within-subject design. Using modern item response theory techniques we found that a less clear description of the ideal level of the latent trait prevented a successful faking attempt. In contrast, a more clear and less difficult to implement a description of the ideal level of the latent trait allowed respondents to successfully increase their test scores. The results are discussed in light of current models of applicants response processes when working personality tests.

Implications of Person Fluctuation for the Stability and Validity of Test Scores

Methodology ◽  
2006 ◽  
Vol 2 (4) ◽  
pp. 142-148 ◽  
Author(s):  
Pere J. Ferrando
Keyword(s):  
Item Response ◽  
Test Scores ◽  
Temporal Stability ◽  
Person Fit ◽  
Item Parameters ◽  
Individual Trait ◽  
The Stability ◽  
The Individual ◽  
Different Levels ◽  
Fluctuation Model

In the IRT person-fluctuation model, the individual trait levels fluctuate within a single test administration whereas the items have fixed locations. This article studies the relations between the person and item parameters of this model and two central properties of item and test scores: temporal stability and external validity. For temporal stability, formulas are derived for predicting and interpreting item response changes in a test-retest situation on the basis of the individual fluctuations. As for validity, formulas are derived for obtaining disattenuated estimates and for predicting changes in validity in groups with different levels of fluctuation. These latter formulas are related to previous research in the person-fit domain. The results obtained and the relations discussed are illustrated with an empirical example.

Effects of Targeted Self-Coaching on Applicant Distortion of Personality Measures

2012 ◽  
Vol 11 (4) ◽  
pp. 169-175 ◽  
Author(s):  
Katherine A. Sliter ◽  
Neil D. Christiansen
Keyword(s):  
Impression Management ◽  
Personality Assessment ◽  
Personnel Selection ◽  
Lie Detection ◽  
Personality Test ◽  
Personality Measures ◽  
Personality Tests ◽  
The Impact

The present study evaluated the impact of reading self-coaching book excerpts on success at faking a personality test. Participants (N = 207) completed an initial honest personality assessment and a subsequent assessment with faking instructions under one of the following self-coaching conditions: no coaching, chapters from a commercial book on how to fake preemployment personality scales, and personality coaching plus a chapter on avoiding lie-detection scales. Results showed that those receiving coaching materials had greater success in raising their personality scores, primarily on the traits that had been targeted in the chapters. In addition, those who read the chapter on avoiding lie-detection scales scored significantly lower on a popular impression management scale while simultaneously increasing their personality scores. Implications for the use of personality tests in personnel selection are discussed.

Item Response Theory and Music Testing

2019 ◽  
pp. 477-503
Author(s):  
Brian Wesolowski
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Test Scores ◽  
General Framework ◽  
Logistic Function ◽  
Response Theory ◽  
Measurement Models ◽  
Latent Constructs ◽  
Item Parameters ◽  
Introductory Overview

This chapter presents an introductory overview of concepts that underscore the general framework of item response theory. “Item response theory” is a broad umbrella term used to describe a family of mathematical measurement models that consider observed test scores to be a function of latent, unobservable constructs. Most musical constructs cannot be directly measured and are therefore unobservable. Musical constructs can therefore only be inferred based on secondary, observable behaviors. Item response theory uses observable behaviors as probabilistic distributions of responses as a logistic function of person and item parameters in order to define latent constructs. This chapter describes philosophical, theoretical, and applied perspectives of item response theory in the context of measuring musical behaviors.

scholarly journals Scale Alignment in the Between-Item Multidimensional Partial Credit Model

2021 ◽  
pp. 014662162110131
Author(s):  
Leah Feuerstahler ◽  
Mark Wilson
Keyword(s):  
Item Response ◽  
Kindergarten Readiness ◽  
Latent Trait ◽  
Individual Development ◽  
Partial Credit Model ◽  
Partial Credit ◽  
Response Models ◽  
Item Response Models ◽  
Item Parameters ◽  
Polytomous Item Response

In between-item multidimensional item response models, it is often desirable to compare individual latent trait estimates across dimensions. These comparisons are only justified if the model dimensions are scaled relative to each other. Traditionally, this scaling is done using approaches such as standardization—fixing the latent mean and standard deviation to 0 and 1 for all dimensions. However, approaches such as standardization do not guarantee that Rasch model properties hold across dimensions. Specifically, for between-item multidimensional Rasch family models, the unique ordering of items holds within dimensions, but not across dimensions. Previously, Feuerstahler and Wilson described the concept of scale alignment, which aims to enforce the unique ordering of items across dimensions by linearly transforming item parameters within dimensions. In this article, we extend the concept of scale alignment to the between-item multidimensional partial credit model and to models fit using incomplete data. We illustrate this method in the context of the Kindergarten Individual Development Survey (KIDS), a multidimensional survey of kindergarten readiness used in the state of Illinois. We also present simulation results that demonstrate the effectiveness of scale alignment in the context of polytomous item response models and missing data.

Comparability of personality test scores for immigrants and majority group members: Some dutch findings

1997 ◽  
Vol 23 (5) ◽  
pp. 849-859 ◽  
Author(s):  
Jan te Nijenhuis ◽  
Henk van der Flier ◽  
Liesbeth van Leeuwen
Keyword(s):  
Test Scores ◽  
Personality Test ◽  
Majority Group ◽  
Group Members

scholarly journals Assessing the physical violence component of the Revised Conflict Tactics Scales when used in heterosexual couples: an item response theory analysis

2007 ◽  
Vol 23 (1) ◽  
pp. 53-62 ◽  
Author(s):  
Michael E. Reichenheim ◽  
Ruben Klein ◽  
Claudia Leite Moraes
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Physical Violence ◽  
Latent Trait ◽  
Heterosexual Couples ◽  
Heterosexual Relationships ◽  
Response Theory ◽  
Conflict Tactics Scales ◽  
Conflict Tactics ◽  
Revised Conflict Tactics Scales

Although there are psychometric evaluations of the Revised Conflict Tactics Scales (CTS2) when applied to heterosexual relationships, none has used item response theory (IRT). To address this gap, the present paper assesses the instrument's physical violence subscale. The CTS2 was applied to 764 women who also responded for their partners. Single dimensionality assumption was corroborated. A 2-parameter logistic IRT model was used for estimating location and discriminating power of each item. Differential item functioning and item information pattern along the violence continuum were assessed. Gender differences were detected in 3 out of 12 items. Item coverage of the latent trait spectrum indicated little information at the lower ends, while plenty in the middle and upper ranges. Still, depending on gender, some item overlaps and regions with gaps could be detected. Despite some unresolved problems, the analysis shows that the items form a theoretically coherent information set across the continuum. Provided the user is aware of possible drawbacks, using the physical violence subscale of the CTS2 in heterosexual couples is still a sensible option.

scholarly journals Data Similarity Filtering of Wartegg Personality Test Result using Cosine-Similarity

2018 ◽  
Vol 6 (3) ◽  
pp. 19
Author(s):  
Rosihan Ari Yuana ◽  
Dewanto Harjunowibowo ◽  
Nugraha Arif Karyanta ◽  
Cucuk Wawan Budiyanto
Keyword(s):  
Graphical Representation ◽  
Cosine Similarity ◽  
Potential Contribution ◽  
Personality Test ◽  
Evaluation Instrument ◽  
Technical Procedure ◽  
Data Similarity ◽  
Identification Technique ◽  
Similarity Method ◽  
The Ideal

Wartegg test is a widely adopted personality evaluation instrument known for its drawing completion technique.  Employee personality data, for instance, can be sorted by the closest similarity with the expected characters. Whereas, Wartegg test plays a significant role in data similarity filtering. Despite the potential contribution of personal characters identification technique, practical guidance is rarely found in the literature. This paper demonstrates the usage of cosine-similarity method for data similarity filtering on Wartegg personality test. The method used in this study is a case study, in which will be selected several Wartegg test subjects. By using the value of each character aspect derived from the Wartegg test, the cosine-similarity value will be calculated against the expected/ideal aspect character. Based on this value, the Wartegg test subjects will be filtered based on similarity to the expected/ideal character aspects. A technical procedure to perform the method is also presented in this paper. In order to find out the effectiveness, sample data scores of each character aspect from five test subjects, and also the ideal scores of the expected characters are given. By using FWAT, a graphical representation of the test subjects' characters to the ideal characters is generated. Then, this graph was compared to the results obtained from the cosine-similarity method. Drawn from the results, the cosine-similarity is effectively applied for Wartegg test data similarity filtering.

scholarly journals Item Response Theory Analysis of ADHD Symptoms in Children With and Without ADHD

Assessment ◽  
2016 ◽  
Vol 23 (6) ◽  
pp. 655-671 ◽  
Author(s):  
James J. Li ◽  
Steven P. Reise ◽  
Andrea Chronis-Tuscano ◽  
Amori Yee Mikami ◽  
Steve S. Lee
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Trait ◽  
Dimensional Structure ◽  
Adhd Symptoms ◽  
Response Theory ◽  
Confirmatory Factor Analyses ◽  
Item Response Theory Analysis ◽  
Graded Response ◽  
Moderate Range

Item response theory (IRT) was separately applied to parent- and teacher-rated symptoms of attention-deficit/hyperactivity disorder (ADHD) from a pooled sample of 526 six- to twelve-year-old children with and without ADHD. The dimensional structure ADHD was first examined using confirmatory factor analyses, including the bifactor model. A general ADHD factor and two group factors, representing inattentive and hyperactive/impulsive dimensions, optimally fit the data. Using the graded response model, we estimated discrimination and location parameters and information functions for all 18 symptoms of ADHD. Parent- and teacher-rated symptoms demonstrated adequate discrimination and location values, although these estimates varied substantially. For parent ratings, the test information curve peaked between −2 and +2 SD, suggesting that ADHD symptoms exhibited excellent overall reliability at measuring children in the low to moderate range of the general ADHD factor, but not in the extreme ranges. Similar results emerged for teacher ratings, in which the peak range of measurement precision was from −1.40 to 1.90 SD. Several symptoms were comparatively more informative than others; for example, is often easily distracted (“Distracted”) was the most informative parent- and teacher-rated symptom across the latent trait continuum. Clinical implications for the assessment of ADHD as well as relevant considerations for future revisions to diagnostic criteria are discussed.

Item Response Theory Analysis to Assess Dimensionality of Substance Use Disorder Abuse and Dependence Symptoms

2017 ◽  
Vol 6 (4) ◽  
Author(s):  
Levent Kirisci ◽  
Ralph Tarter ◽  
Maureen Reynolds ◽  
Michael Vanyukov
Keyword(s):  
Substance Use ◽  
Item Response Theory ◽  
Item Response ◽  
Substance Use Disorder ◽  
Factor Model ◽  
Common Factor ◽  
Latent Trait ◽  
Dominant Factor ◽  
Response Theory ◽  
Men And Women

Background. Item response theory (IRT) based studies conducted on diverse samples showed a single dominant factor for DSM-III-R and DSM-IV substance use disorder (SUD) abuse and dependence symptoms of alcohol, cannabis, sedative, cocaine, stimulants, and opiates use disorders. IRT provides the opportunity, within a person-centered framework, to accurately gauge each person’s severity of disorder that, in turn, informs required intensiveness of treatment. Objectives. The aim of this study was to determine whether the SUD symptoms indicate a unidimensional trait or instead need to be conceptualized and quantified as a multidimensional scale. Methods. The sample was composed of families of adult SUD+ men (n=349), and SUD+ women (n=173), who qualified for DSM-III-R diagnosis of substance use disorder (abuse or dependence) and families of adult men and women who did not qualify for a SUD diagnosis (SUD- men: n=190, SUD- women: n=133). An expanded version of the Structured Clinical Interview for DSM-III-R (SCID) was administered to characterize lifetime and current substance use disorders. Item response theory methodology was used to assess the dimensionality of DSM-III-R SUD abuse and dependence symptoms.Results. A bi-factor model provided the optimal representation of the factor structure of SUD symptoms in males and females. SUD symptoms are scalable as indicators of a single common factor, corresponding to general (non-drug-specific, common) liability to addiction, combined with drug-specific liabilities. Conclusions. IRT methodology used to quantify the continuous general liability to addiction (GLA) latent trait in individuals having SUD symptoms was found effective for accurately measuring SUD severity in men and women. This may be helpful for person-centered medicine approaches to effectively address intensity of treatment.

Sign in / Sign up

Export Citation Format

Share Document