scholarly journals Application of the Graded Response Model of Item Response Theory to Computerized Dynamic Assessment in L2 English Education

2017 ◽  
Vol 16 (1) ◽  
pp. 18-25
Author(s):  
Sei Sumi ◽  
Yoshimitsu Miyazawa
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
English Education ◽  
Dynamic Assessment ◽  
Response Model ◽  
Graded Response Model ◽  
Response Theory ◽  
Graded Response

scholarly journals Reevaluation of the Amsterdam Inventory for Auditory Disability and Handicap Using Item Response Theory

2016 ◽  
Vol 59 (2) ◽  
pp. 373-383 ◽  
Author(s):  
J. Mirjam Boeschen Hospers ◽  
Niels Smits ◽  
Cas Smits ◽  
Mariska Stam ◽  
Caroline B. Terwee ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Standard Error ◽  
Item Information ◽  
Response Model ◽  
Graded Response Model ◽  
Response Theory ◽  
Hearing Disability ◽  
Hearing Ability ◽  
Graded Response

Purpose We reevaluated the psychometric properties of the Amsterdam Inventory for Auditory Disability and Handicap (AIADH; Kramer, Kapteyn, Festen, & Tobi, 1995) using item response theory. Item response theory describes item functioning along an ability continuum. Method Cross-sectional data from 2,352 adults with and without hearing impairment, ages 18–70 years, were analyzed. They completed the AIADH in the web-based prospective cohort study “Netherlands Longitudinal Study on Hearing.” A graded response model was fitted to the AIADH data. Category response curves, item information curves, and the standard error as a function of self-reported hearing ability were plotted. Results The graded response model showed a good fit. Item information curves were most reliable for adults who reported having hearing disability and less reliable for adults with normal hearing. The standard error plot showed that self-reported hearing ability is most reliably measured for adults reporting mild up to moderate hearing disability. Conclusions This is one of the few item response theory studies on audiological self-reports. All AIADH items could be hierarchically placed on the self-reported hearing ability continuum, meaning they measure the same construct. This provides a promising basis for developing a clinically useful computerized adaptive test, where item selection adapts to the hearing ability of individuals, resulting in efficient assessment of hearing disability.

scholarly journals Optimal Examination Sites for Periodontal Disease Evaluation: Applying the Item Response Theory Graded Response Model

2020 ◽  
Vol 9 (11) ◽  
pp. 3754
Author(s):  
Yoshiaki Nomura ◽  
Toshiya Morozumi ◽  
Mitsuo Fukuda ◽  
Nobuhiro Hanada ◽  
Erika Kakuta ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Complex Structure ◽  
Response Model ◽  
Graded Response Model ◽  
Response Theory ◽  
Graded Response ◽  
Periodontal Index ◽  
Selection Of

Periodontal examination data have a complex structure. For epidemiological studies, mass screenings, and public health use, a simple index that represents the periodontal condition is necessary. Periodontal indices for partial examination of selected teeth have been developed. However, the selected teeth vary between indices, and a justification for the selection of examination teeth has not been presented. We applied a graded response model based on the item response theory to select optimal examination teeth and sites that represent periodontal conditions. Data were obtained from 254 patients who participated in a multicenter follow-up study. Baseline data were obtained from initial follow-up. Optimal examination sites were selected using item information calculated by graded response modeling. Twelve sites—maxillary 2nd premolar (palatal-medial), 1st premolar (palatal-distal), canine (palatal-medial), lateral incisor (palatal-central), central incisor (palatal-distal) and mandibular 1st premolar (lingual, medial)—were selected. Mean values for clinical attachment level, probing pocket depth, and bleeding on probing by full mouth examinations were used for objective variables. Measuring the clinical parameters of these sites can predict the results of full mouth examination. For calculating the periodontal index by partial oral examination, a justification for the selection of examination sites is essential. This study presents an evidence-based partial examination methodology and its modeling.

scholarly journals Using the Stan Program for Bayesian Item Response Theory

2017 ◽  
Vol 78 (3) ◽  
pp. 384-408 ◽  
Author(s):  
Yong Luo ◽  
Hong Jiao
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Model Comparison ◽  
Response Model ◽  
Graded Response Model ◽  
Response Theory ◽  
Irt Model ◽  
Irt Models ◽  
Nominal Response Model ◽  
Graded Response

Stan is a new Bayesian statistical software program that implements the powerful and efficient Hamiltonian Monte Carlo (HMC) algorithm. To date there is not a source that systematically provides Stan code for various item response theory (IRT) models. This article provides Stan code for three representative IRT models, including the three-parameter logistic IRT model, the graded response model, and the nominal response model. We demonstrate how IRT model comparison can be conducted with Stan and how the provided Stan code for simple IRT models can be easily extended to their multidimensional and multilevel cases.

Item response theory analysis of the Pain Self-Efficacy Questionnaire

2017 ◽  
Vol 14 (1) ◽  
pp. 113-117 ◽  
Author(s):  
Daniel S.J. Costa ◽  
Ali Asghari ◽  
Michael K. Nicholas
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Self Efficacy ◽  
Latent Variable ◽  
Response Threshold ◽  
Response Model ◽  
Graded Response Model ◽  
Response Theory ◽  
Graded Response

AbstractBackground and aimsThe Pain Self-Efficacy Questionnaire (PSEQ) is a 10-item instrument designed to assess the extent to which a person in pain believes s/he is able to accomplish various activities despite their pain. There is strong evidence for the validity and reliability of both the full-length PSEQ and a 2-item version. The purpose of this study is to further examine the properties of the PSEQ using an item response theory (IRT) approach.MethodsWe used the two-parameter graded response model to examine the category probability curves, and location and discrimination parameters of the 10 PSEQ items. In item response theory, responses to a set of items are assumed to be probabilistically determined by a latent (unobserved) variable. In the graded-response model specifically, item response threshold (the value of the latent variable for which adjacent response categories are equally likely) and discrimination parameters are estimated for each item. Participants were 1511 mixed, chronic pain patients attending for initial assessment at a tertiary pain management centre.ResultsAll items except item 7 (‘I can cope with my pain without medication’) performed well in IRT analysis, and the category probability curves suggested that participants used the 7-point response scale consistently. Items 6 (‘I can still do many of the things I enjoy doing, such as hobbies or leisure activity, despite pain’), 8 (‘I can still accomplish most of my goals in life, despite the pain’) and 9 (‘I can live a normal lifestyle, despite the pain’) captured higher levels of the latent variable with greater precision.ConclusionsThe results from this IRT analysis add to the body of evidence based on classical test theory illustrating the strong psychometric properties of the PSEQ. Despite the relatively poor performance of Item 7, its clinical utility warrants its retention in the questionnaire.ImplicationsThe strong psychometric properties of the PSEQ support its use as an effective tool for assessing self-efficacy in people with pain.

scholarly journals A Multidimensional Item Response Theory Model for Continuous and Graded Responses With Error in Persons and Items

2021 ◽  
pp. 001316442199841
Author(s):  
Pere J. Ferrando ◽  
David Navarro-González
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Theory Model ◽  
Response Model ◽  
Response Theory ◽  
Continuous Response ◽  
Graded Responses ◽  
Graded Response ◽  
Continuous Responses ◽  
Differential Measurement Error

Item response theory “dual” models (DMs) in which both items and individuals are viewed as sources of differential measurement error so far have been proposed only for unidimensional measures. This article proposes two multidimensional extensions of existing DMs: the M-DTCRM (dual Thurstonian continuous response model), intended for (approximately) continuous responses, and the M-DTGRM (dual Thurstonian graded response model), intended for ordered-categorical responses (including binary). A rationale for the extension to the multiple-content-dimensions case, which is based on the concept of the multidimensional location index, is first proposed and discussed. Then, the models are described using both the factor-analytic and the item response theory parameterizations. Procedures for (a) calibrating the items, (b) scoring individuals, (c) assessing model appropriateness, and (d) assessing measurement precision are finally discussed. The simulation results suggest that the proposal is quite feasible, and an illustrative example based on personality data is also provided. The proposals are submitted to be of particular interest for the case of multidimensional questionnaires in which the number of items per scale would not be enough for arriving at stable estimates if the existing unidimensional DMs were fitted on a separate-scale basis.

Quantification of Experienced Hearing Problems With Item Response Theory

2013 ◽  
Vol 22 (2) ◽  
pp. 252-262 ◽  
Author(s):  
Michelene Chenault ◽  
Martijn Berger ◽  
Bernd Kremer ◽  
Lucien Anteunis
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Patient Reported Outcomes ◽  
Graded Response Model ◽  
Response Theory ◽  
Discriminative Ability ◽  
Graded Response ◽  
Patient Reported ◽  
Best Fit ◽  
Selection Of

Purpose The purpose of this study was to improve the effectiveness of adult hearing screens and demonstrate that interventions assessment methods are needed that address the individual's experienced hearing. Item response theory, which provides a methodology for assessing patient-reported outcomes, is examined here to demonstrate its usefulness in hearing screens and interventions. Method The graded response model is applied to a scale of 11 items assessing perceived hearing functioning and 10 items assessing experienced social limitations completed by a sample of 212 persons age 55+ years. Fixed and variable slope models are compared. Discrimination and threshold parameters are estimated and information functions evaluated. Results Variable slope models for both scales provided the best fit. The estimated discrimination parameters for all items except for one in each scale were good if not excellent (1.5–3.4). Threshold values varied, demonstrating the complementary and supplementary value of items within a scale. The information provided by each item varies relative to trait values so that each scale of items provides information over a wider range of trait values. Conclusion Item response theory methodology facilitates the comparison of items relative to their discriminative ability and information provided and thus provides a basis for the selection of items for application in a screening setting.

scholarly journals Use of item response theory to investigate disability-related questions in the National Health and Nutrition Examination Survey

2021 ◽  
Vol 9 ◽  
pp. 205031212110122
Author(s):  
Samuel W Terman ◽  
James F Burke
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
National Health ◽  
Activity Limitations ◽  
Response Model ◽  
Nutrition Examination Survey ◽  
Graded Response Model ◽  
Health And Nutrition ◽  
Graded Response ◽  
Two Parameter

Objectives: Accurately measuring disability is critical toward policy development, economic analyses, and determining individual-level effects of health interventions. Nationally representative population surveys such as the National Health and Nutrition Examination Survey provide key opportunities to measure disability constructs such as activity limitations. However, only very limited work has previously evaluated the item response properties of questions pertaining to limitations in National Health and Nutrition Examination Survey. Methods: This was a cross-sectional study. We included participants ⩾20 years old for the 2013–2018 National Health and Nutrition Examination Survey cycles. Activity limitations, and a smaller number of body function impairments or participation restrictions, were determined from interview questions. We performed item response theory models (a two-parameter logistic and a graded response model) to characterize discriminating information along the latent continuum of activity limitation. Results: We included 17,057 participants. Although each particular limitation was somewhat rare (maximally 13%), 7214 (38%) responded having at least one limitation. We found a high amount of discriminating information at 1–2 standard deviations above average limitation, though essentially zero discrimination below that range. Items had substantial overlap in the range at which they provided information distinguishing individuals. The ordinal graded response model including 20 limitations provided greater information than the dichotomous two-parameter logistic model, though further omitting items from the graded response model led to loss of information. Conclusion: National Health and Nutrition Examination Survey disability-related questions, mostly specifically activity limitations, provided a high degree of information distinguishing individuals with higher than average limitations on the latent continuum, but essentially zero resolution to distinguish individuals with low or average limitations. Future work may focus on developing items which better distinguish individuals at the “lower” end of the limitation spectrum.

scholarly journals Modification and verification of the Infant–Toddler Meaningful Auditory Integration Scale: a psychometric analysis combining item response theory with classical test theory

2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Fengling Yang ◽  
Fei Zhao ◽  
Yun Zheng ◽  
Gang Li
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Classical Test Theory ◽  
Test Theory ◽  
Psychometric Analysis ◽  
Response Model ◽  
Graded Response Model ◽  
Infants And Toddlers ◽  
Graded Response ◽  
Auditory Integration

Abstract Background Early prelingual auditory development (EPLAD) is a fundamental and important process in the speech and language development of infants and toddlers. The Infant–Toddler Meaningful Auditory Integration Scale (ITMAIS) is a widely used measurement tool for EPLAD, however it has not yet undergone a comprehensive psychometric analysis. The aim of this research was to modify and verify the psychometric properties of ITMAIS using a combination of Item Response Theory (IRT) and Classical Test Theory (CTT). Methods Stage 1—1730 children were retrospectively recruited to enable the application of an IRT model, specifically the graded response model, to modify the ITMAIS. Stage 2—another 450 infants and toddlers with normal hearing or permanent hearing loss before auditory intervention were recruited to verify the psychometric properties of the modified ITMAIS (ITMAIS-m) using the CTT method. Results Using the metric of the graded response model, by removing item 2 from the ITMAIS, ITMAIS-m demonstrated discrimination parameters ranging from 3.947 to 5.431, difficulty parameters from − 1.146 to 1.150, item information distributed between 4.798 and 9.259 and a test information score of 48.061. None of the items showed differential item functioning. ITMAIS-m was further verified in Stage 2, showing Cronbach’s α of 0.919 and item-total correlations ranging from 0.693 to 0.851. There was good convergent validity of ITMAIS-m with other auditory outcome measure (r = 0.932) and pure tone average thresholds (r ranging from − 0.670 to − 0.909), as well as a high ability to discriminate between different hearing grades (Cohen d ranging from 0.41 to 5.83). Conclusions The ITMAIS-m is a reliable and valid tool for evaluating EPLAD in infants and toddlers, which can be efficiently and precisely applied in clinical practice. The combined use of IRT and CTT provides a powerful means to modify psychometrically robust scales aimed at childhood auditory outcome measurements.

Using Item Response Theory Models to Evaluate the Practice Environment Scale

2014 ◽  
Vol 22 (2) ◽  
pp. 323-341 ◽  
Author(s):  
Dheeraj Raju ◽  
Xiaogang Su ◽  
Patricia A. Patrician
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Information Criterion ◽  
Partial Credit Model ◽  
Practice Environment ◽  
Partial Credit ◽  
Response Theory ◽  
Environment Scale ◽  
Graded Response ◽  
Item Response Theory Models

Background and Purpose: The purpose of this article is to introduce different types of item response theory models and to demonstrate their usefulness by evaluating the Practice Environment Scale. Methods: Item response theory models such as constrained and unconstrained graded response model, partial credit model, Rasch model, and one-parameter logistic model are demonstrated. The Akaike information criterion (AIC) and Bayesian information criterion (BIC) indices are used as model selection criterion. Results: The unconstrained graded response and partial credit models indicated the best fit for the data. Almost all items in the instrument performed well. Conclusions: Although most of the items strongly measure the construct, there are a few items that could be eliminated without substantially altering the instrument. The analysis revealed that the instrument may function differently when administered to different unit types.

Sign in / Sign up

Export Citation Format

Share Document