scholarly journals Adaptive testing with the GGUM-RANK multidimensional forced choice model: Comparison of pair, triplet, and tetrad scoring

2019 ◽  
Vol 52 (2) ◽  
pp. 761-772
Author(s):  
Seang-Hwane Joo ◽  
Philseok Lee ◽  
Stephen Stark
Keyword(s):  
Model Comparison ◽  
Choice Model ◽  
Adaptive Testing ◽  
Forced Choice

scholarly journals Development of Computerized Adaptive Testing for Emotion Regulation

2020 ◽  
Vol 11 ◽  
Author(s):  
Lingling Xu ◽  
Ruyi Jin ◽  
Feifei Huang ◽  
Yanhui Zhou ◽  
Zonglong Li ◽  
...  
Keyword(s):  
Emotion Regulation ◽  
Model Comparison ◽  
Computerized Adaptive Testing ◽  
Item Analysis ◽  
Well Being ◽  
Adaptive Testing ◽  
Vital Role ◽  
Test Items ◽  
Item Fit ◽  
Item Functioning

Emotion regulation (ER) plays a vital role in individuals’ well-being and successful functioning. In this study, we attempted to develop a computerized adaptive testing (CAT) to efficiently evaluate ER, namely the CAT-ER. The initial CAT-ER item bank comprised 154 items from six commonly used ER scales, which were completed by 887 participants recruited in China. We conducted unidimensionality testing, item response theory (IRT) model comparison and selection, and IRT item analysis including local independence, item fit, differential item functioning, and item discrimination. Sixty-three items with good psychometric properties were retained in the final CAT-ER. Then, two CAT simulation studies were implemented to assess the CAT-ER, which revealed that the CAT-ER developed in this study performed reasonably well, considering that it greatly lessened the test items and time without losing measurement accuracy.

scholarly journals Assessing the Influence of Reversed Items and Force-Choice on the Work and Meaning Inventory [Evaluación de la influencia de los ítems invertidos y de elección forzosa en el Inventario de trabajo significativo]

2021 ◽  
Vol 17 (1) ◽  
pp. 103
Author(s):  
Maria da Glória Lima Leonardo ◽  
Michelle Morelo Pereira ◽  
Felipe Valentini ◽  
Clarissa Pinto Pizarro de Freitas ◽  
Michael F. Steger
Keyword(s):  
Response Bias ◽  
Choice Model ◽  
Organizational Psychology ◽  
Forced Choice ◽  
Model Fit ◽  
Self Report ◽  
Meaning Of Work ◽  
Positive Organizational Psychology ◽  
Latent Dimension

AbstractResponse biases are issues in inventories in positive organizational psychology. The study aims to control the response bias in the assessment of meaning of work through two methods: reversed key items and forced-choice format. The sample consisted of 351 professionals; women constituted 60.0 % of the sample. The participants answered two versions of the instrument for meaning of work: Likert-type items and forced-choice. For both versions, the unifactorial model was the most appropriate for the data available. The results indicate that the random intercepts model fit the Likert data (CFI = .92), as well as the forced-choice model (CFI = .97). Besides, the latent dimension of the forced-choice version did not correlate with acquiescence index (r < .08; p > .05), and approximately 20 % of the variance of the items might be due to the method (Likert or forced-choice). The present study illustrates the importance of response bias control in self-report instruments. ResumenLos sesgos de respuesta son problemas en los inventarios de la psicología organizacional positiva. El estudio tiene como objetivo controlar el sesgo de respuesta en la eva­luación del trabajo significativo a través de dos métodos: ítems clave invertidos y formato de elección forzosa. La muestra estuvo formada por 351 profesionales; las muje­res constituyeron el 60.0 % de la muestra. Los participan­tes respondieron dos versiones del instrumento de signifi­cado del trabajo: ítems tipo Likert y elección forzosa. Para ambas versiones, el modelo unifactorial fue el más apro­piado para los datos disponibles. Los resultados indican que el modelo de intersecciones aleatorias se ajusta a los datos Likert (CFI = .92), así como al modelo de elección forzada (CFI = .97). Además, la dimensión latente de la versión de elección forzada no se correlacionó con el ín­dice de aquiescencia (r < .08; p > .05), y aproximada­mente el 20 % de la varianza de los ítems podría deberse al método (Likert o forzado). elección). El presente estu­dio ilustra la importancia del control del sesgo de res­puesta en los instrumentos de autoinforme.

Social Cognitive Choice Model: Comparison of Two Meta-Analytic Approaches

2006 ◽  
Author(s):  
Hung-Bin Sheu ◽  
Matthew J. Miller ◽  
Robert W. Lent ◽  
Steven D. Brown ◽  
Kelly Hennessy ◽  
...  
Keyword(s):  
Model Comparison ◽  
Social Cognitive ◽  
Choice Model ◽  
Cognitive Choice

scholarly journals Influence of Context on Item Parameters in Forced-Choice Personality Assessments

2016 ◽  
Vol 77 (3) ◽  
pp. 389-414 ◽  
Author(s):  
Yin Lin ◽  
Anna Brown
Keyword(s):  
Small Proportion ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Forced Choice ◽  
Item Parameter ◽  
Parameter Estimates ◽  
Personality Assessments ◽  
Fundamental Assumption ◽  
Item Parameters ◽  
Item Parameter Estimates

A fundamental assumption in computerized adaptive testing is that item parameters are invariant with respect to context—items surrounding the administered item. This assumption, however, may not hold in forced-choice (FC) assessments, where explicit comparisons are made between items included in the same block. We empirically examined the influence of context on item parameters by comparing parameter estimates from two FC instruments. The first instrument was composed of blocks of three items, whereas in the second, the context was manipulated by adding one item to each block, resulting in blocks of four. The item parameter estimates were highly similar. However, a small number of significant deviations were observed, confirming the importance of context when designing adaptive FC assessments. Two patterns of such deviations were identified, and methods to reduce their occurrences in an FC computerized adaptive testing setting were proposed. It was shown that with a small proportion of violations of the parameter invariance assumption, score estimation remained stable.

scholarly journals Comparing two neurocognitive models of self-control during dietary decisions

2019 ◽  
Vol 14 (9) ◽  
pp. 957-966 ◽  
Author(s):  
Danielle Cosme ◽  
Rita M Ludwig ◽  
Elliot T Berkman
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Process Model ◽  
Model Comparison ◽  
Choice Model ◽  
Well Being ◽  
Brain Regions ◽  
Self Control ◽  
Dual Process ◽  
Dorsolateral Prefrontal

Abstract Self-control is the process of favoring abstract, distal goals over concrete, proximal goals during decision-making and is an important factor in health and well-being. We directly compare two prominent neurocognitive models of human self-control with the goal of identifying which, if either, best describes behavioral and neural data of dietary decisions in a large sample of overweight and obese adults motivated to eat more healthfully. We extracted trial-by-trial estimates of neural activity during incentive-compatible choice from three brain regions implicated in self-control, dorsolateral prefrontal cortex, ventral striatum and ventromedial prefrontal cortex and assessed evidence for the dual-process and value-based choice models of self-control using multilevel modeling. Model comparison tests revealed that the value-based choice model outperformed the dual-process model and best fit the observed data. These results advance scientific knowledge of the neurobiological mechanisms underlying self-control-relevant decision-making and are consistent with a value-based choice model of self-control.

scholarly journals Comparing two neurocognitive models of self-control during dietary decisions

2019 ◽  
Author(s):  
Danielle Cosme ◽  
Rita M. Ludwig ◽  
Elliot Berkman
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Process Model ◽  
Model Comparison ◽  
Choice Model ◽  
Well Being ◽  
Brain Regions ◽  
Self Control ◽  
Dual Process ◽  
Dorsolateral Prefrontal

Self-control is the process of favoring abstract, distal goals over concrete, proximal goals during decision making, and is an important factor in health and well-being. We directly compare two prominent neurocognitive models of human self-control with the goal of identifying which, if either, best describes behavioral and neural data of dietary decisions in a large sample of overweight and obese adults motivated to eat more healthfully. We extracted trial-by-trial estimates of neural activity during incentive-compatible choice from three brain regions implicated in self-control, dorsolateral prefrontal cortex, ventral striatum, and ventromedial prefrontal cortex, and assessed evidence for the dual-process and value-based choice models of self-control using multilevel modeling. Model comparison tests revealed that the value-based choice model outperformed the dual-process model, and best fit the observed data. These results advance scientific knowledge of the neurobiological mechanisms underlying self-control relevant decision making and are consistent with a value-based choice model of self-control.

Identifying suboptimalities with factorial model comparison

2018 ◽  
Vol 41 ◽  
Author(s):  
Wei Ji Ma
Keyword(s):  
Experimental Design ◽  
Model Comparison ◽  
Process Models ◽  
Multiple Forms ◽  
Factorial Experimental Design ◽  
Factorial Model ◽  
Multiple Components ◽  
The Many

AbstractGiven the many types of suboptimality in perception, I ask how one should test for multiple forms of suboptimality at the same time – or, more generally, how one should compare process models that can differ in any or all of the multiple components. In analogy to factorial experimental design, I advocate for factorial model comparison.

Benefits from Computerized Adaptive Testing as Seen in Simulation Studies

1999 ◽  
Vol 15 (2) ◽  
pp. 91-98 ◽  
Author(s):  
Lutz F. Hornke
Keyword(s):  
Measurement Error ◽  
Computerized Adaptive Testing ◽  
Test Procedure ◽  
Adaptive Testing ◽  
Parameter Estimates ◽  
Simulation Studies ◽  
Computerized Adaptive Test ◽  
Item Banks ◽  
Item Parameters ◽  
General Reliability

Summary: Item parameters for several hundreds of items were estimated based on empirical data from several thousands of subjects. The logistic one-parameter (1PL) and two-parameter (2PL) model estimates were evaluated. However, model fit showed that only a subset of items complied sufficiently, so that the remaining ones were assembled in well-fitting item banks. In several simulation studies 5000 simulated responses were generated in accordance with a computerized adaptive test procedure along with person parameters. A general reliability of .80 or a standard error of measurement of .44 was used as a stopping rule to end CAT testing. We also recorded how often each item was used by all simulees. Person-parameter estimates based on CAT correlated higher than .90 with true values simulated. For all 1PL fitting item banks most simulees used more than 20 items but less than 30 items to reach the pre-set level of measurement error. However, testing based on item banks that complied to the 2PL revealed that, on average, only 10 items were sufficient to end testing at the same measurement error level. Both clearly demonstrate the precision and economy of computerized adaptive testing. Empirical evaluations from everyday uses will show whether these trends will hold up in practice. If so, CAT will become possible and reasonable with some 150 well-calibrated 2PL items.

Methods for Restricting Maximum Exposure Rate in Computerized Adaptative Testing

Methodology ◽  
2007 ◽  
Vol 3 (1) ◽  
pp. 14-23 ◽  
Author(s):  
Juan Ramon Barrada ◽  
Julio Olea ◽  
Vicente Ponsoda
Keyword(s):  
Measurement Accuracy ◽  
Computerized Adaptive Testing ◽  
Computation Time ◽  
Adaptive Testing ◽  
Exposure Rate ◽  
Control Parameters ◽  
The Impact ◽  
Two Alternatives ◽  
Selection Of ◽  
Maximum Exposure

Abstract. The Sympson-Hetter (1985) method provides a means of controlling maximum exposure rate of items in Computerized Adaptive Testing. Through a series of simulations, control parameters are set that mark the probability of administration of an item on being selected. This method presents two main problems: it requires a long computation time for calculating the parameters and the maximum exposure rate is slightly above the fixed limit. Van der Linden (2003) presented two alternatives which appear to solve both of the problems. The impact of these methods in the measurement accuracy has not been tested yet. We show how these methods over-restrict the exposure of some highly discriminating items and, thus, the accuracy is decreased. It also shown that, when the desired maximum exposure rate is near the minimum possible value, these methods offer an empirical maximum exposure rate clearly above the goal. A new method, based on the initial estimation of the probability of administration and the probability of selection of the items with the restricted method ( Revuelta & Ponsoda, 1998 ), is presented in this paper. It can be used with the Sympson-Hetter method and with the two van der Linden's methods. This option, when used with Sympson-Hetter, speeds the convergence of the control parameters without decreasing the accuracy.

Sign in / Sign up

Export Citation Format

Share Document