Assessing the fit of measurement models at the individual level: A comparison of item response theory and covariance structure approaches.

1999 ◽  
Vol 4 (1) ◽  
pp. 3-21 ◽  
Author(s):  
Steven P. Reise ◽  
Keith F. Widaman
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Covariance Structure ◽  
Response Theory ◽  
Individual Level ◽  
Measurement Models ◽  
The Individual

scholarly journals The measurement of populist attitudes: Testing cross-national scales using item response theory

Politics ◽  
2019 ◽  
Vol 40 (1) ◽  
pp. 3-21 ◽  
Author(s):  
Steven M Van Hauwaert ◽  
Christian H Schimpf ◽  
Flavio Azevedo
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Empirical Evaluation ◽  
Measurement Model ◽  
Future Research ◽  
Response Theory ◽  
Individual Level ◽  
National Measurement ◽  
The Individual ◽  
Cross National

Recent research in the populism literature has devoted considerable efforts to the conceptualisation and examination of populism on the individual level, that is, populist attitudes. Despite rapid progress in the field, questions of adequate measurement and empirical evaluation of measures of populist attitudes remain scarce. Seeking to remedy these shortcomings, we apply a cross-national measurement model, using item response theory, to six established and two new populist indicators. Drawing on a cross-national survey (nine European countries, n = 18,368), we engage in a four-folded analysis. First, we examine the commonly used 6-item populism scale. Second, we expand the measurement with two novel items. Third, we use the improved 8-item populism scale to further refine equally comprehensive but more concise and parsimonious populist measurements. Finally, we externally validate these sub-scales and find that some of the proposed sub-scales outperform the initial 6- and 8-item scales. We conclude that existing measures of populism capture moderate populist attitudes, but face difficulties measuring more extreme levels, while the individual information of some of the populist items remains limited. Altogether, this provides several interesting routes for future research, both within and between countries.

Item Response Theory and Music Testing

2019 ◽  
pp. 477-503
Author(s):  
Brian Wesolowski
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Test Scores ◽  
General Framework ◽  
Logistic Function ◽  
Response Theory ◽  
Measurement Models ◽  
Latent Constructs ◽  
Item Parameters ◽  
Introductory Overview

This chapter presents an introductory overview of concepts that underscore the general framework of item response theory. “Item response theory” is a broad umbrella term used to describe a family of mathematical measurement models that consider observed test scores to be a function of latent, unobservable constructs. Most musical constructs cannot be directly measured and are therefore unobservable. Musical constructs can therefore only be inferred based on secondary, observable behaviors. Item response theory uses observable behaviors as probabilistic distributions of responses as a logistic function of person and item parameters in order to define latent constructs. This chapter describes philosophical, theoretical, and applied perspectives of item response theory in the context of measuring musical behaviors.

scholarly journals Assessment of the Mate Retention Inventory-Short Form Using Item Response Theory

2021 ◽  
Vol 19 (4) ◽  
pp. 147470492110441
Author(s):  
Patrick J. Nebl ◽  
Mark G. McCoy ◽  
Garett C. Foster ◽  
Michael J. Zickar
Keyword(s):  
Item Response Theory ◽  
Evolutionary Psychology ◽  
Item Response ◽  
Function Analysis ◽  
Short Form ◽  
Response Theory ◽  
Female Behavior ◽  
Mate Retention ◽  
Good Scale ◽  
The Individual

The mate retention inventory (MRI) has been a valuable tool in the field of evolutionary psychology for the past 30 years. The goal of the current research is to subject the MRI to rigorous psychometric analysis using item response theory to answer three broad questions. Do the individual items of the MRI fit the scale well? Does the overall function of the MRI match what is predicted? Finally, do men and women respond similarly to the MRI? Using a graded response model, it was found that all but two of the items fit acceptable model patterns. Test information function analysis found that the scale acceptably captures individual differences for participants with a high degree of mate retention but the scale is lacking in capturing information from participants with a low degree of mate retention. Finally, discriminate item function analysis reveals that the MRI is better at assessing male than female participants, indicating that the scale may not be the best indicator of female behavior in a relationship. Overall, we conclude that the MRI is a good scale, especially for assessing male behavior, but it could be improved for assessing female behavior and individuals lower on overall mate retention behavior. It is suggested that this paper be used as a framework for how the newest psychometrics techniques can be applied in order to create more robust and valid measures in the field of evolutionary psychology.

scholarly journals A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats

2019 ◽  
Vol 80 (3) ◽  
pp. 578-603
Author(s):  
HyeSun Lee ◽  
Weldon Z. Smith
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Model Performance ◽  
Theory Model ◽  
Forced Choice ◽  
Simultaneous Estimation ◽  
Response Theory ◽  
Irt Model ◽  
Measurement Models ◽  
Random Block

Based on the framework of testlet models, the current study suggests the Bayesian random block item response theory (BRB IRT) model to fit forced-choice formats where an item block is composed of three or more items. To account for local dependence among items within a block, the BRB IRT model incorporated a random block effect into the response function and used a Markov Chain Monte Carlo procedure for simultaneous estimation of item and trait parameters. The simulation results demonstrated that the BRB IRT model performed well for the estimation of item and trait parameters and for screening those with relatively low scores on target traits. As found in the literature, the composition of item blocks was crucial for model performance; negatively keyed items were required for item blocks. The empirical application showed the performance of the BRB IRT model was equivalent to that of the Thurstonian IRT model. The potential advantage of the BRB IRT model as a base for more complex measurement models was also demonstrated by incorporating gender as a covariate into the BRB IRT model to explain response probabilities. Recommendations for the adoption of forced-choice formats were provided along with the discussion about using negatively keyed items.

scholarly journals PROPERTI PSIKOMETRI STRUKTUR INTELIGENSI IST SUBTES VERBAL (SATZERGAENZUNG, WORTAUSWAHL, DAN ANALOGIEN) BERBAHASA INDONESIA

2021 ◽  
Vol 5 (1) ◽  
pp. 63
Author(s):  
Medianta Tarigan ◽  
Fadillah Fadillah
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Verbal Ability ◽  
Response Theory ◽  
Verbal Comprehension ◽  
Irt Model ◽  
Item Fit ◽  
Measurement Tools ◽  
The Individual ◽  
Bahasa Indonesia

Intelligence as one of the individual abilities that is widely used in everyday life has been extensively studied and measured using psychological measurement tools. One of them is the Intelligenz Structure Test (IST). However, at this time IST has leakage through discussions made by many parties. Moreover, the process of IST adaptation to the Indonesian version which tends to translate each word allegedly results in a bias of meaning that can affect the validity of this measurement tools. Therefore, this study is aimed to evaluating the current quality of IST by testing the feasibility of the Indonesian version of IST items for verbal ability, namely SE (Satzergaenzung), WA (Wortauswahl), and AN (Analogien). Item Response Theory (IRT) is used as a research method. The data were collected from 2.064 participants who live in Bandung. The results of the analysis revealed that the SE, WA, and AN subtest are still valid. Based on 60 items analyzed, 71.67% of the items have good quality, i.e. 43 of the 60 items have estimation of discriminant (a) parameter is acceptable. In addition, based on the fit item statistics it was also known that 78.33% of significant items followed the IRT model. Furthermore, based on statistics of item fit, it is also known that 78.33% of items fit the IRT model. This shows that the Indonesian version of IST is still valid to be used particularly in measuring verbal comprehension (V) through 3 subtests (SE, WA, and AN). However, it is necessary to revise the items that have been infected with DIF, in which 25% of items were declared to have a gender bias. Inteligensi sebagai salah satu kemampuan individu yang banyak berperan dalam kehidupan sehari-hari telah banyak diteliti dan diukur menggunakan alat ukur psikologi. Salah satunya adalah Intelligenz Struktur Test (IST). Namun, saat ini IST telah mengalami kebocoran melalui pembahasan yang dibuat oleh banyak pihak. Selain itu, proses adaptasi IST ke bahasa Indonesia yang cenderung menerjemahkan setiap kata secara langsung diduga mengakibatkan terjadinya bias makna yang dapat mempengaruhi keabsahan alat ukur ini. Oleh karena itu, penelitian ini ditujukan untuk mengevaluasi kualitas terkini IST dengan menguji kelayakan butir soal IST Bahasa Indonesia untuk kemampuan verbal, yaitu SE (Satzergaenzung), WA (Wortauswahl), dan AN (Analogien). Item Response Theory (IRT) digunakan sebagai metode penelitian ini. Data penelitian ini diperoleh dari 2.064 partisipan yang berdomisili di kota Bandung. Adapun penelitian ini menunjukkan hasil bahwa subtes SE, WA, dan AN masih tergolong valid. Berdasarkan 60 item yang dianalisis, 71,67% item memiliki kualitas yang cukup baik, yaitu 43 dari 60 item memiliki estimasi daya beda yang dapat diterima. Selain itu, berdasarkan statistik item fit juga diketahui 78,33% item signifikan mengikuti model IRT. Hal ini menunjukkan bahwa IST Bahasa Indonesia masih valid untuk digunakan terutama dalam mengukur verbal comprehension (V) melalui 3 subtes (SE, WA, dan AN). Namun, perlu dilakukan revisi terhadap item soal yang terjangkit DIF, di mana 25% butir soal dinyatakan mempunyai bias jenis kelamin.

Item response theory and the measurement of psychiatric constructs: some empirical and conceptual issues and challenges

2016 ◽  
Vol 46 (10) ◽  
pp. 2025-2039 ◽  
Author(s):  
S. P. Reise ◽  
A. Rodriguez
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Trait ◽  
Response Theory ◽  
Outcomes Measurement ◽  
Measurement Models ◽  
Irt Models ◽  
Trait Distribution ◽  
Item Pools ◽  
Latent Trait Distribution

Item response theory (IRT) measurement models are now commonly used in educational, psychological, and health-outcomes measurement, but their impact in the evaluation of measures of psychiatric constructs remains limited. Herein we present two, somewhat contradictory, theses. The first is that, when skillfully applied, IRT has much to offer psychiatric measurement in terms of scale development, psychometric analysis, and scoring. The second argument, however, is that psychiatric measurement presents some unique challenges to the application of IRT – challenges that may not be easily addressed by application of conventional IRT models and methods. These challenges include, but are not limited to, the modeling of conceptually narrow constructs and their associated limited item pools, and unipolar constructs where the expected latent trait distribution is highly skewed.

Item Response Theory in Cross-Cultural Measurement

2018 ◽  
Author(s):  
Thanh V. Tran ◽  
Tam Nguyen ◽  
Keith Chan
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Measurement Theory ◽  
Response Theory ◽  
Underlying Principle ◽  
Item Level ◽  
The Individual ◽  
Basic Features ◽  
Key Steps ◽  
Test Level

Item response theory (IRT) is a modern measurement theory that, as its name implies, focuses mainly at the item level as opposed to the test level. The underlying principle of IRT is that a relationship exists between an individual’s ability and how the individual responds to items on a test. IRT offers item-level details not provided through classical approaches. The aims of this chapter are to (1) provide a brief overview of IRT, (2) demonstrate the basic features of IRT using existing data, and (3) walk the reader through the key steps in conducting IRT analysis using IRTPRO®. IRT has also increasingly been used to develop, shorten, and refine psychosocial instruments.

Sign in / Sign up

Export Citation Format

Share Document