Item response theory: applications of modern test theory in medical education

AbstractThe reliable change index has been used to evaluate the significance of individual change in health-related quality of life. We estimate reliable change for two measures (physical function and emotional distress) in the Patient-Reported Outcomes Measurement Information System (PROMIS®) 29-item health-related quality of life measure (PROMIS-29 v2.1). Using two waves of data collected 3 months apart in a longitudinal observational study of chronic low back pain and chronic neck pain patients receiving chiropractic care, and simulations, we compare estimates of reliable change from classical test theory fixed standard errors with item response theory standard errors from the graded response model. We find that unless true change in the PROMIS physical function and emotional distress scales is substantial, classical test theory estimates of significant individual change are much more optimistic than estimates of change based on item response theory.

Download Full-text

Refinement and Validation of the ItchyQoL using Classical Test Theory and Item Response Theory resulted in a reduction of the response categories from a 5‐point to a 3‐point scale

British Journal of Dermatology ◽

10.1111/bjd.20082 ◽

2021 ◽

Author(s):

M. Gabes ◽

C. Zeidler ◽

S. Ständer ◽

S.C. Chen ◽

C.J. Apfelbacher

Keyword(s):

Item Response Theory ◽

Item Response ◽

Classical Test Theory ◽

Test Theory ◽

Point Scale ◽

Response Theory ◽

Classical Test

Download Full-text

Validation study of the Korean version of decent work scale

European Journal of Training and Development ◽

10.1108/ejtd-03-2021-0040 ◽

2021 ◽

Vol ahead-of-print (ahead-of-print) ◽

Author(s):

Yunsoo Lee ◽

Ji Hoon Song ◽

Soo Jung Kim

Keyword(s):

Item Response Theory ◽

Item Response ◽

Work Engagement ◽

Item Difficulty ◽

Test Theory ◽

Decent Work ◽

Validity And Reliability ◽

Response Theory ◽

Content Type ◽

Korean Version

Purpose This paper aims to validate the Korean version of the decent work scale and examine the relationship between decent work and work engagement. Design/methodology/approach After completing translation and back translation, the authors surveyed 266 Korean employees from various organizations via network sampling. They assessed Rasch’s model based on item response theory. In addition, they used classical test theory to evaluate the decent work scale’s validity and reliability. Findings The authors found that the current version of the decent work scale has good validity, reliability and item difficulty, and decent work has a positive relationship with work engagement. However, based on item response theory, the assessment showed that three of the items are extremely similar to another item within the same dimension, implying that the items are unable to discriminate among individual traits. Originality/value This study validated the decent work scale in a Korean work environment using Rasch’s (1960) model from the perspective of item response theory.

Download Full-text