scholarly journals Estimating latent traits from expert surveys: an analysis of sensitivity to data-generating process

2021 ◽  
pp. 1-10
Author(s):  
Kyle L. Marquardt ◽  
Daniel Pemstein
Keyword(s):  
Item Response ◽  
Latent Variable ◽  
Latent Variable Models ◽  
Irt Models ◽  
Valid Data ◽  
Data Generating Process ◽  
The Mean ◽  
Latent Traits ◽  
True Values ◽  
Expert Surveys

Abstract Models for converting expert-coded data to estimates of latent concepts assume different data-generating processes (DGPs). In this paper, we simulate ecologically valid data according to different assumptions, and examine the degree to which common methods for aggregating expert-coded data (1) recover true values and (2) construct appropriate coverage intervals. We find that the mean and both hierarchical Aldrich–McKelvey (A–M) scaling and hierarchical item-response theory (IRT) models perform similarly when expert error is low; the hierarchical latent variable models (A-M and IRT) outperform the mean when expert error is high. Hierarchical A–M and IRT models generally perform similarly, although IRT models are often more likely to include true values within their coverage intervals. The median and non-hierarchical latent variable models perform poorly under most assumed DGPs.

scholarly journals Latent Variable Modelling and Item Response Theory Analyses in Marketing Research

2016 ◽  
Vol 16 (2) ◽  
pp. 163-174 ◽  
Author(s):  
Justyna Brzezińska
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Variables ◽  
Latent Variable ◽  
Marketing Research ◽  
Response Theory ◽  
Irt Models ◽  
Latent Variable Modelling ◽  
Item Responses ◽  
Latent Traits

Abstract Item Response Theory (IRT) is a modern statistical method using latent variables designed to model the interaction between a subject’s ability and the item level stimuli (difficulty, guessing). Item responses are treated as the outcome (dependent) variables, and the examinee’s ability and the items’ characteristics are the latent predictor (independent) variables. IRT models the relationship between a respondent’s trait (ability, attitude) and the pattern of item responses. Thus, the estimation of individual latent traits can differ even for two individuals with the same total scores. IRT scores can yield additional benefits and this will be discussed in detail. In this paper theory and application with R software with the use of packages designed for modelling IRT will be presented.

scholarly journals A Gibbs Sampler for the Multidimensional Item Response Model

2012 ◽  
Vol 2012 ◽  
pp. 1-14 ◽  
Author(s):  
Yanyan Sheng ◽  
Todd C. Headrick
Keyword(s):  
Item Response ◽  
Latent Trait ◽  
Multidimensional Item Response Theory ◽  
Relative Importance ◽  
Response Model ◽  
Item Response Model ◽  
Mcmc Algorithm ◽  
Multidimensional Item Response ◽  
Irt Models ◽  
Latent Traits

Current procedures for estimating compensatory multidimensional item response theory (MIRT) models using Markov chain Monte Carlo (MCMC) techniques are inadequate in that they do not directly model the interrelationship between latent traits. This limits the implementation of the model in various applications and further prevents the development of other types of IRT models that offer advantages not realized in existing models. In view of this, an MCMC algorithm is proposed for MIRT models so that the actual latent structure is directly modeled. It is demonstrated that the algorithm performs well in modeling parameters as well as intertrait correlations and that the MIRT model can be used to explore the relative importance of a latent trait in answering each test item.

scholarly journals Development of an Instrument to Measure Staff-Reported Resident-to-Resident Elder Mistreatment (R-REM) Using Item Response Theory and Other Latent Variable Models

2013 ◽  
Vol 54 (3) ◽  
pp. 460-472 ◽  
Author(s):  
Jeanne A. Teresi ◽  
Katja Ocepek-Welikson ◽  
Mildred Ramirez ◽  
Joseph P. Eimicke ◽  
Stephanie Silver ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Variable ◽  
Latent Variable Models ◽  
Response Theory ◽  
Elder Mistreatment

scholarly journals An Item Response Theory–Informed Strategy to Model Total Score Data from Composite Scales

2021 ◽  
Vol 23 (3) ◽  
Author(s):  
Gustaf J. Wellhagen ◽  
Sebastian Ueckert ◽  
Maria C. Kjellsson ◽  
Mats O. Karlsson
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Variable ◽  
Continuous Variable ◽  
Response Theory ◽  
Irt Models ◽  
Composite Scale ◽  
Level Data ◽  
Item Level ◽  
Scale Data

AbstractComposite scale data is widely used in many therapeutic areas and consists of several categorical questions/items that are usually summarized into a total score (TS). Such data is discrete and bounded by nature. The gold standard to analyse composite scale data is item response theory (IRT) models. However, IRT models require item-level data while sometimes only TS is available. This work investigates models for TS. When an IRT model exists, it can be used to derive the information as well as expected mean and variability of TS at any point, which can inform TS-analyses. We propose a new method: IRT-informed functions of expected values and standard deviation in TS-analyses. The most common models for TS-analyses are continuous variable (CV) models, while bounded integer (BI) models offer an alternative that respects scale boundaries and the nature of TS data. We investigate the method in CV and BI models on both simulated and real data. Both CV and BI models were improved in fit by IRT-informed disease progression, which allows modellers to precisely and accurately find the corresponding latent variable parameters, and IRT-informed SD, which allows deviations from homoscedasticity. The methodology provides a formal way to link IRT models and TS models, and to compare the relative information of different model types. Also, joint analyses of item-level data and TS data are made possible. Thus, IRT-informed functions can facilitate total score analysis and allow a quantitative analysis of relative merits of different analysis methods.

scholarly journals Estimating Parameters of Dichotomous and Ordinal Item Response Models with Gllamm

2007 ◽  
Vol 7 (3) ◽  
pp. 313-333 ◽  
Author(s):  
Xiaohui Zheng ◽  
Sophia Rabe-Hesketh
Keyword(s):  
Item Response ◽  
Latent Variable ◽  
Rating Scale ◽  
Ordinal Scale ◽  
Response Models ◽  
Item Response Models ◽  
Explanatory Variables ◽  
Test Items ◽  
Measurement Models ◽  
Latent Traits

Item response theory models are measurement models for categorical responses. Traditionally, the models are used in educational testing, where responses to test items can be viewed as indirect measures of latent ability. The test items are scored either dichotomously (correct–incorrect) or by using an ordinal scale (a grade from poor to excellent). Item response models also apply equally for measurement of other latent traits. Here we describe the one- and two-parameter logit models for dichotomous items, the partial-credit and rating scale models for ordinal items, and an extension of these models where the latent variable is regressed on explanatory variables. We show how these models can be expressed as generalized linear latent and mixed models and fitted by using the user-written command gllamm.

scholarly journals Assessing Cognitive Abilities Using the WAIS-IV: An Item Response Theory Approach

2021 ◽  
Vol 18 (13) ◽  
pp. 6835
Author(s):  
Gomaa Said Mohamed Abdelhamid ◽  
Marwa Gomaa Abdelghani Bassiouni ◽  
Juana Gómez-Benito
Keyword(s):  
Factor Analysis ◽  
Item Response Theory ◽  
Item Response ◽  
Cognitive Abilities ◽  
Theory Approach ◽  
Response Theory ◽  
Adult Intelligence Scale ◽  
Irt Models ◽  
Scale Properties ◽  
Latent Traits

Background: The Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) has been adapted to 28 different cultures and there has been considerable interest in examining its structure through exploratory and confirmatory factor analysis. This study investigates item and scale properties of the Egyptian WAIS-IV using item response theory (IRT) models. Methods: The sample consisted of 250 adults from Egypt. The item-level and subtest statistical properties of the Egyptian WAIS-IV were established using a combination of four dichotomous IRT models and four polytomous IRT models. In addition, factor analysis was performed to investigate the dimensionality of each subtest. Results: Factor analysis indicated the unidimensionality of each subtest. Among IRT models, the two-parameter logistic model provided a good fit for dichotomous subtests, while the graded response model fitted the polytomous data. Most items of the Egyptian WAIS-IV showed high discrimination, and the scale was adequately informative across the levels of latent traits (i.e., cognitive variables). However, each subtest included at least some items with limited ability to distinguish between individuals with differing levels of the cognitive variable being measured. Furthermore, most subtests have items that do not follow the difficulty rank they are ascribed in the WAIS-IV manual. Conclusions: Overall, the results suggest that the Egyptian WAIS-IV offers a highly valid assessment of intellectual abilities, despite the need for some improvements.

Right-Wing Authoritarians Aren't Very Funny: RWA, Personality, and Creative Humor Production

2020 ◽  
Author(s):  
Paul Silvia ◽  
Alexander P. Christensen ◽  
Katherine N. Cotter
Keyword(s):  
Young Adults ◽  
Latent Variable ◽  
Latent Variable Models ◽  
Openness To Experience ◽  
Rasch Models ◽  
Right Wing ◽  
Right Wing Authoritarianism ◽  
Humor Appreciation ◽  
Negative Effect

Right-wing authoritarianism (RWA) has well-known links with humor appreciation, such as enjoying jokes that target deviant groups, but less is known about RWA and creative humor production—coming up with funny ideas oneself. A sample of 186 young adults completed a measure of RWA, the HEXACO-100, and 3 humor production tasks that involved writing funny cartoon captions, creating humorous definitions for quirky concepts, and completing joke stems with punchlines. The humor responses were scored by 8 raters and analyzed with many-facet Rasch models. Latent variable models found that RWA had a large, significant effect on humor production (β = -.47 [-.65, -.30], p < .001): responses created by people high in RWA were rated as much less funny. RWA’s negative effect on humor was smaller but still significant (β = -.25 [-.49, -.01], p = .044) after controlling for Openness to Experience (β = .39 [.20, .59], p < .001) and Conscientiousness (β = -.21 [-.41, -.02], p = .029). Taken together, the findings suggest that people high in RWA just aren’t very funny.

Sign in / Sign up

Export Citation Format

Share Document