scholarly journals The measurement of populist attitudes: Testing cross-national scales using item response theory

Politics ◽  
2019 ◽  
Vol 40 (1) ◽  
pp. 3-21 ◽  
Author(s):  
Steven M Van Hauwaert ◽  
Christian H Schimpf ◽  
Flavio Azevedo
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Empirical Evaluation ◽  
Measurement Model ◽  
Future Research ◽  
Response Theory ◽  
Individual Level ◽  
National Measurement ◽  
The Individual ◽  
Cross National

Recent research in the populism literature has devoted considerable efforts to the conceptualisation and examination of populism on the individual level, that is, populist attitudes. Despite rapid progress in the field, questions of adequate measurement and empirical evaluation of measures of populist attitudes remain scarce. Seeking to remedy these shortcomings, we apply a cross-national measurement model, using item response theory, to six established and two new populist indicators. Drawing on a cross-national survey (nine European countries, n = 18,368), we engage in a four-folded analysis. First, we examine the commonly used 6-item populism scale. Second, we expand the measurement with two novel items. Third, we use the improved 8-item populism scale to further refine equally comprehensive but more concise and parsimonious populist measurements. Finally, we externally validate these sub-scales and find that some of the proposed sub-scales outperform the initial 6- and 8-item scales. We conclude that existing measures of populism capture moderate populist attitudes, but face difficulties measuring more extreme levels, while the individual information of some of the populist items remains limited. Altogether, this provides several interesting routes for future research, both within and between countries.

Latent growth modeling of IRT versus CTT measured longitudinal latent variables

2019 ◽  
Vol 29 (4) ◽  
pp. 962-986
Author(s):  
R Gorter ◽  
J-P Fox ◽  
G Ter Riet ◽  
MW Heymans ◽  
JWR Twisk
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Classical Test Theory ◽  
Measurement Model ◽  
Test Theory ◽  
Response Theory ◽  
Latent Growth ◽  
Classical Test ◽  
Plausible Values ◽  
The Individual

Latent growth models are often used to measure individual trajectories representing change over time. The characteristics of the individual trajectories depend on the variability in the longitudinal outcomes. In many medical and epidemiological studies, the individual health outcomes cannot be observed directly and are indirectly observed through indicators (i.e. items of a questionnaire). An item response theory or a classical test theory measurement model is required, but the choice can influence the latent growth estimates. In this study, under various conditions, this influence is directly assessed by estimating latent growth parameters on a common scale for item response theory and classical test theory using a novel plausible value method in combination with Markov chain Monte Carlo. The latent outcomes are considered missing data and plausible values are generated from the corresponding posterior distribution, separately for item response theory and classical test theory. These plausible values are linearly transformed to a common scale. A Markov chain Monte Carlo method was developed to simultaneously estimate the latent growth and measurement model parameters using this plausible value technique. It is shown that estimated individual trajectories using item response theory, compared to classical test theory to measure outcomes, provide a more detailed description of individual change over time, since item response patterns (item response theory) are more informative about the health measurements than sum scores (classical test theory).

scholarly journals The Value Of Item Response Theory In Invariance Testing

2016 ◽  
Vol 32 (6) ◽  
pp. 1843
Author(s):  
Nico Martins ◽  
Hester Nienaber
Keyword(s):  
Item Response Theory ◽  
Measurement Invariance ◽  
Item Response ◽  
Employee Engagement ◽  
Future Research ◽  
Analytic Structure ◽  
Response Theory ◽  
Multiple Group ◽  
The Individual ◽  
Annual Turnover

The goal of the current study was to assess the Employee Engagement Instrument (EEI) from an item response theory (IRT) perspective, with a specific focus on measurement invariance for annual turnover.  The sample comprised 4 099 respondents from all business sectors in South Africa.  This article describes the logic and procedures used to test for factorial invariance across groups in the context of construct validation. The procedures included testing for configural and metric invariance in the framework of multiple-group confirmatory factor analysis (CFA).The results confirmed the factor analytic structure of the model fit for some of the individual scales of the EEI. The measurement invariance of the EEI as a function of annual turnover was confirmed. However, the results indicated that the EEI needs to be refined for future research.

scholarly journals Assessment of the Mate Retention Inventory-Short Form Using Item Response Theory

2021 ◽  
Vol 19 (4) ◽  
pp. 147470492110441
Author(s):  
Patrick J. Nebl ◽  
Mark G. McCoy ◽  
Garett C. Foster ◽  
Michael J. Zickar
Keyword(s):  
Item Response Theory ◽  
Evolutionary Psychology ◽  
Item Response ◽  
Function Analysis ◽  
Short Form ◽  
Response Theory ◽  
Female Behavior ◽  
Mate Retention ◽  
Good Scale ◽  
The Individual

The mate retention inventory (MRI) has been a valuable tool in the field of evolutionary psychology for the past 30 years. The goal of the current research is to subject the MRI to rigorous psychometric analysis using item response theory to answer three broad questions. Do the individual items of the MRI fit the scale well? Does the overall function of the MRI match what is predicted? Finally, do men and women respond similarly to the MRI? Using a graded response model, it was found that all but two of the items fit acceptable model patterns. Test information function analysis found that the scale acceptably captures individual differences for participants with a high degree of mate retention but the scale is lacking in capturing information from participants with a low degree of mate retention. Finally, discriminate item function analysis reveals that the MRI is better at assessing male than female participants, indicating that the scale may not be the best indicator of female behavior in a relationship. Overall, we conclude that the MRI is a good scale, especially for assessing male behavior, but it could be improved for assessing female behavior and individuals lower on overall mate retention behavior. It is suggested that this paper be used as a framework for how the newest psychometrics techniques can be applied in order to create more robust and valid measures in the field of evolutionary psychology.

Item Response Theory in Affective Instrument Development: An Illustration

2001 ◽  
Vol 9 (1) ◽  
pp. 5-22 ◽  
Author(s):  
Cheryl T. Beck ◽  
Robert K. Gable
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Instrument Development ◽  
Development Process ◽  
Item Difficulty ◽  
Empirical Support ◽  
Measurement Model ◽  
Response Theory ◽  
Critical Function ◽  
Screening Scale

The benefits of item response theory (IRT) analysis in obtaining empirical support for construct validity make it an essential step in the instrument development process. IRT analysis can result in finer construct interpretations that lead to more thorough descriptions of low- and high-scoring respondents. A critical function of IRT is its ability to determine the adequacy with which the attitude continuum underlying each dimension is assessed by the respective items in an instrument. Many nurse researchers, however, are not reaping the benefits of IRT in the development of affective instruments. The purpose of this article is to familiarize nurse researchers with this valuable approach through a description of the Facets computer program. Facets uses a one parameter (i.e., item difficulty) Rasch measurement model. Data from a survey of 525 new mothers that assessed the psychometric properties of the Postpartum Depresssion Screening Scale are used to illustrate the Facets program. It is hoped that IRT will gain increased prominence in affective instrument development as more nurse researchers become aware of computer programs such as Facets to assist in analysis.

scholarly journals Using Item Response Theory to Develop Measures of Acquisitive and Protective Self-Monitoring From the Original Self-Monitoring Scale

Assessment ◽  
2015 ◽  
Vol 24 (5) ◽  
pp. 677-691 ◽  
Author(s):  
Michael P. Wilmot ◽  
Jack W. Kostal ◽  
David Stillwell ◽  
Michal Kosinski
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Future Research ◽  
Response Theory ◽  
Bivariate Model ◽  
Study Item ◽  
Self Monitoring ◽  
The Past ◽  
Gender And Age ◽  
Conventional Paradigm

For the past 40 years, the conventional univariate model of self-monitoring has reigned as the dominant interpretative paradigm in the literature. However, recent findings associated with an alternative bivariate model challenge the conventional paradigm. In this study, item response theory is used to develop measures of the bivariate model of acquisitive and protective self-monitoring using original Self-Monitoring Scale (SMS) items, and data from two large, nonstudent samples ( Ns = 13,563 and 709). Results indicate that the new acquisitive (six-item) and protective (seven-item) self-monitoring scales are reliable, unbiased in terms of gender and age, and demonstrate theoretically consistent relations to measures of personality traits and cognitive ability. Additionally, by virtue of using original SMS items, previously collected responses can be reanalyzed in accordance with the alternative bivariate model. Recommendations for the reanalysis of archival SMS data, as well as directions for future research, are provided.

Sign in / Sign up

Export Citation Format

Share Document