scholarly journals A literature review of detecting aberrant response patterns by using IRT -based fit indices

2002 ◽  
Vol 5 (1) ◽  
pp. 99-117
Author(s):  
Hyunsoo Seol
2020 ◽  
Vol 10 (11) ◽  
pp. 324
Author(s):  
Amin Mousavi ◽  
Ying Cui

Often, important decisions regarding accountability and placement of students in performance categories are made on the basis of test scores generated from tests, therefore, it is important to evaluate the validity of the inferences derived from test results. One of the threats to the validity of such inferences is aberrant responding. Several person fit indices were developed to detect aberrant responding on educational and psychological tests. The majority of the person fit literature has been focused on creating and evaluating new indices. The aim of this study was to assess the effect of aberrant responding on the accuracy of estimated item parameters and refining estimations by using person fit statistics by means of simulation. Our results showed that the presence of aberrant response patterns created bias in the both b and a parameters at the item level and affected the classification of students, particularly high-performing students, into performance categories regardless of whether aberrant response patterns were present in the data or were removed. The results differed by test length and the percentage of students with aberrant response patterns. Practical and theoretical implications are discussed.


2020 ◽  
Vol 45 (6) ◽  
pp. 719-749
Author(s):  
Eduardo Doval ◽  
Pedro Delicado

We propose new methods for identifying and classifying aberrant response patterns (ARPs) by means of functional data analysis. These methods take the person response function (PRF) of an individual and compare it with the pattern that would correspond to a generic individual of the same ability according to the item-person response surface. ARPs correspond to atypical difference functions. The ARP classification is done with functional data clustering applied to the PRFs identified as ARP. We apply these methods to two sets of simulated data (the first is used to illustrate the ARP identification methods and the second demonstrates classification of the response patterns flagged as ARP) and a real data set (a Grade 12 science assessment test, SAT, with 32 items answered by 600 examinees). For comparative purposes, ARPs are also identified with three nonparametric person-fit indices (Ht, Modified Caution Index, and ZU3). Our results indicate that the ARP detection ability of one of our proposed methods is comparable to that of person-fit indices. Moreover, the proposed classification methods enable ARP associated with either spuriously low or spuriously high scores to be distinguished.


1982 ◽  
Vol 7 (3) ◽  
pp. 215-231 ◽  
Author(s):  
Kikumi K. Tatsuoka ◽  
Maurice M. Tatsuoka

Two indices were developed for measuring the degree of conformity or consistency of an individual examinee’s response pattern on a set of items. The first, called the norm conformity index (NCI), measures the proximity of the pattern to a baseline pattern in which all 0’s precede all l’s when the items are arranged in some prescribed order. The second, called the individual consistency index (ICI), measures the extent to which an individual’s response pattern remains invariant when he or she responds to several waves of parallel items. We show how these two indices, used in conjunction with test scores, can spot aberrant response patterns of students requiring detailed error diagnosis and remedial treatment.


Author(s):  
Zaid S. Bani Ata

This study aimed at investigating the aberrant response patterns and their impacts on the Jordanian version Otis- Lennon as well as the accuracy in the estimation of a person's' ability and information function test.  To achieve this goal, the Jordanian version of  the Ability Test primary II level form K was administrated to 568 first-grade male and female students of Ajloun district public schools during  2016/2017. The Lz person fit index and the three-parameter  logistic model were used to analyze students' responses to test items to assess the person ability, information function test, and to detect aberrant response patterns. The results revealed that the response patterns of 56 students were aberrant based on Lz index; also the results showed that the factors responsible for the presence of this aberrant response were: guessing, cheating, laziness, and exponential creatively. The results indicated that when the aberrant patterns were excluded, both the accuracy person's estimating ability and the information function test had significantly increased at different ability levels.


1982 ◽  
Vol 7 (3) ◽  
pp. 215 ◽  
Author(s):  
Kikumi K. Tatsuoka ◽  
Maurice M. Tatsuoka

2017 ◽  
Vol 41 (6) ◽  
pp. 399-423 ◽  
Author(s):  
Aminabadi Naser Asl ◽  
Marzieh Shokravi ◽  
Zahra Jamali ◽  
Sajjad Shirazi

Objective: Dental anxiety, fear and phobia have different etiology, response patterns, time courses, and intensities that justify a clear distinction between these constructs. Differentiation of dental anxiety, fear or phobia in practice is a critical prerequisite for developing and implementing effective treatment for children. The aim of this study was to investigate whether current researches in the pediatric dentistry appropriately discriminate the central construct of dental anxiety, fear and phobia. We also highlighted the specific methodological issues in the assessment of these issues in pediatric dentistry. Study design: A systematic search was conducted in Pubmed/medline and Scopus for articles which assessed dental anxiety, fear or phobia in children. Results: 104 research papers were included in the review that had made a distinction between dental anxiety, fear and phobia and had not used them interchangeably. Only five studies used different clinical measures or cut-offs to discriminate between dental anxiety, fear and phobia. Conclusion: The dental literature appears unable to capture and also measure the multi-sided construct of dental anxiety, fear and phobia and, therefore, there was a tendency to use them interchangeably.


Sign in / Sign up

Export Citation Format

Share Document