Het nut van de item respons theorie bij de constructie en evaluatie van niet-cognitieve instrumenten voor selectie en assessment binnen organisaties

2012 ◽  
Vol 25 (1) ◽  
Author(s):  
Iris J.L. Egberink ◽  
Rob R. Meijer
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Personnel Selection ◽  
Computerized Adaptive Testing ◽  
Testing System ◽  
Response Theory ◽  
Irt Models ◽  
Trait Level ◽  
Selection And Assessment

The usefulness of item response theory for the construction and evaluation of noncognitive tests in personnel selection and assessment The usefulness of item response theory for the construction and evaluation of noncognitive tests in personnel selection and assessment In this article we discuss the use of IRT for the development and application of noncognitive measures in personnel selection and career development. We introduce the basic principles of IRT and we discuss the usefulness of IRT to evaluate the quality of items and tests to assess the measurement precision of a candidate’s trait level, and to investigate item and test bias. Furthermore, we describe several applications of IRT, including computerized adaptive testing and the development of item banks in an automated testing system. Finally, a list of software programs is provided to stimulate the use of IRT models.

Evaluation of the Multiple Sclerosis Walking Scale-12 (MSWS-12) in a Dutch sample: Application of item response theory

2016 ◽  
Vol 22 (14) ◽  
pp. 1867-1873 ◽  
Author(s):  
Lidwine Brigitta Mokkink ◽  
Francisca Galindo-Garre ◽  
Bernard MJ Uitdehaag
Keyword(s):  
Multiple Sclerosis ◽  
Item Response Theory ◽  
Item Response ◽  
Theory Model ◽  
Walking Ability ◽  
Response Theory ◽  
Trait Level ◽  
Sample Application ◽  
Dutch Sample

Background: The Multiple Sclerosis Walking Scale-12 (MSWS-12) measures walking ability from the patients’ perspective. We examined the quality of the MSWS-12 using an item response theory model, the graded response model (GRM). Methods: A total of 625 unique Dutch multiple sclerosis (MS) patients were included. After testing for unidimensionality, monotonicity, and absence of local dependence, a GRM was fit and item characteristics were assessed. Differential item functioning (DIF) for the variables gender, age, duration of MS, type of MS and severity of MS, reliability, total test information, and standard error of the trait level (θ) were investigated. Results: Confirmatory factor analysis showed a unidimensional structure of the 12 items of the scale, explaining 88% of the variance. Item 2 did not fit into the GRM model. Reliability was 0.93. Items 8 and 9 (of the 11 and 12 item version respectively) showed DIF on the variable severity, based on the Expanded Disability Status Scale (EDSS). However, the EDSS is strongly related to the content of both items. Conclusion: Our results confirm the good quality of the MSWS-12. The trait level (θ) scores and item parameters of both the 12- and 11-item versions were highly comparable, although we do not suggest to change the content of the MSWS-12.

scholarly journals Entropy-Based Measures for Person Fit in Item Response Theory

2017 ◽  
Vol 41 (7) ◽  
pp. 512-529 ◽  
Author(s):  
William R. Dardick ◽  
Brandi A. Weiss
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Preliminary Evidence ◽  
Model Fit ◽  
Response Patterns ◽  
Person Fit ◽  
Response Theory ◽  
Logistic Regression Models ◽  
Irt Models

This article introduces three new variants of entropy to detect person misfit ( Ei, EMi, and EMRi), and provides preliminary evidence that these measures are worthy of further investigation. Previously, entropy has been used as a measure of approximate data–model fit to quantify how well individuals are classified into latent classes, and to quantify the quality of classification and separation between groups in logistic regression models. In the current study, entropy is explored through conceptual examples and Monte Carlo simulation comparing entropy with established measures of person fit in item response theory (IRT) such as lz, lz*, U, and W. Simulation results indicated that EMi and EMRi were successfully able to detect aberrant response patterns when comparing contaminated and uncontaminated subgroups of persons. In addition, EMi and EMRi performed similarly in showing separation between the contaminated and uncontaminated subgroups. However, EMRi may be advantageous over other measures when subtests include a small number of items. EMi and EMRi are recommended for use as approximate person-fit measures for IRT models. These measures of approximate person fit may be useful in making relative judgments about potential persons whose response patterns do not fit the theoretical model.

Construct validity of the Smoker Complaint Scale: A clinimetric analysis using Item Response Theory (IRT) models

2021 ◽  
Vol 117 ◽  
pp. 106849
Author(s):  
Danilo Carrozzino ◽  
Kaj Sparle Christensen ◽  
Giovanni Mansueto ◽  
Fiammetta Cosci
Keyword(s):  
Item Response Theory ◽  
Construct Validity ◽  
Item Response ◽  
Response Theory ◽  
Irt Models

Mokken Scale Analysis: Discussion and Application

2021 ◽  
Vol 8 (3) ◽  
pp. 672-695
Author(s):  
Thomas DeVaney
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Rating Scale ◽  
Scale Analysis ◽  
Guttman Scale ◽  
Response Theory ◽  
Data Set ◽  
Mokken Scale Analysis ◽  
Irt Models ◽  
Guttman Scaling

This article presents a discussion and illustration of Mokken scale analysis (MSA), a nonparametric form of item response theory (IRT), in relation to common IRT models such as Rasch and Guttman scaling. The procedure can be used for dichotomous and ordinal polytomous data commonly used with questionnaires. The assumptions of MSA are discussed as well as characteristics that differentiate a Mokken scale from a Guttman scale. MSA is illustrated using the mokken package with R Studio and a data set that included over 3,340 responses to a modified version of the Statistical Anxiety Rating Scale. Issues addressed in the illustration include monotonicity, scalability, and invariant ordering. The R script for the illustration is included.

Clustering students according to their proficiency: a comparison between different approaches based on item response theory models

2021 ◽  
pp. 43-48
Author(s):  
Rosa Fabbricatore ◽  
Francesco Palumbo
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Clustering Algorithm ◽  
Latent Class ◽  
Latent Class Models ◽  
Response Theory ◽  
Homogeneous Groups ◽  
Final Grade ◽  
Irt Model ◽  
Irt Models

Evaluating learners' competencies is a crucial concern in education, and home and classroom structured tests represent an effective assessment tool. Structured tests consist of sets of items that can refer to several abilities or more than one topic. Several statistical approaches allow evaluating students considering the items in a multidimensional way, accounting for their structure. According to the evaluation's ending aim, the assessment process assigns a final grade to each student or clusters students in homogeneous groups according to their level of mastery and ability. The latter represents a helpful tool for developing tailored recommendations and remediations for each group. At this aim, latent class models represent a reference. In the item response theory (IRT) paradigm, the multidimensional latent class IRT models, releasing both the traditional constraints of unidimensionality and continuous nature of the latent trait, allow to detect sub-populations of homogeneous students according to their proficiency level also accounting for the multidimensional nature of their ability. Moreover, the semi-parametric formulation leads to several advantages in practice: It avoids normality assumptions that may not hold and reduces the computation demanding. This study compares the results of the multidimensional latent class IRT models with those obtained by a two-step procedure, which consists of firstly modeling a multidimensional IRT model to estimate students' ability and then applying a clustering algorithm to classify students accordingly. Regarding the latter, parametric and non-parametric approaches were considered. Data refer to the admission test for the degree course in psychology exploited in 2014 at the University of Naples Federico II. Students involved were N=944, and their ability dimensions were defined according to the domains assessed by the entrance exam, namely Humanities, Reading and Comprehension, Mathematics, Science, and English. In particular, a multidimensional two-parameter logistic IRT model for dichotomously-scored items was considered for students' ability estimation.

scholarly journals Improving Measurement Precision in Experimental Psychopathology Using Item Response Theory

2019 ◽  
Vol 80 (4) ◽  
pp. 695-725
Author(s):  
Leah M. Feuerstahler ◽  
Niels Waller ◽  
Angus MacDonald
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Computerized Adaptive Testing ◽  
Cognitive Task ◽  
Working Memory Capacity ◽  
Response Theory ◽  
Response Models ◽  
Item Response Models ◽  
Experimental Psychopathology ◽  
Assessment Tasks

Although item response models have grown in popularity in many areas of educational and psychological assessment, there are relatively few applications of these models in experimental psychopathology. In this article, we explore the use of item response models in the context of a computerized cognitive task designed to assess visual working memory capacity in people with psychosis as well as healthy adults. We begin our discussion by describing how item response theory can be used to evaluate and improve unidimensional cognitive assessment tasks in various examinee populations. We then suggest how computerized adaptive testing can be used to improve the efficiency of cognitive task administration. Finally, we explore how these ideas might be extended to multidimensional item response models that better represent the complex response processes underlying task performance in psychopathological populations.

Sign in / Sign up

Export Citation Format

Share Document