Using a Response Time–Based Expected A Posteriori Estimator to Control for Differential Speededness in Computerized Adaptive Test

2021 ◽  
pp. 014662162110146
Author(s):  
Justin L. Kern ◽  
Edison Choe
Keyword(s):  
Response Times ◽  
Real Data ◽  
Joint Estimation ◽  
Item Selection ◽  
A Posteriori ◽  
Computerized Adaptive Test ◽  
Maximum Information ◽  
Adaptive Test ◽  
Estimation And Control ◽  
And Control

This study investigates using response times (RTs) with item responses in a computerized adaptive test (CAT) setting to enhance item selection and ability estimation and control for differential speededness. Using van der Linden’s hierarchical framework, an extended procedure for joint estimation of ability and speed parameters for use in CAT is developed following van der Linden; this is called the joint expected a posteriori estimator (J-EAP). It is shown that the J-EAP estimate of ability and speededness outperforms the standard maximum likelihood estimator (MLE) of ability and speededness in terms of correlation, root mean square error, and bias. It is further shown that under the maximum information per time unit item selection method (MICT)—a method which uses estimates for ability and speededness directly—using the J-EAP further reduces average examinee time spent and variability in test times between examinees above the resulting gains of this selection algorithm with the MLE while maintaining estimation efficiency. Simulated test results are further corroborated with test parameters derived from a real data example.

ADTEST: A Maximum Information Computerized Adaptive Test

1993 ◽  
Vol 17 (1) ◽  
pp. 28-28 ◽  
Author(s):  
Javier Revuelta ◽  
Vicente Ponsoda ◽  
Julio Olea
Keyword(s):  
Computerized Adaptive Test ◽  
Maximum Information ◽  
Adaptive Test

Joint Estimation and Control of Jump Linear Systems With Multiplicative Noises

1987 ◽  
Vol 109 (1) ◽  
pp. 24-28 ◽  
Author(s):  
M. Mariton
Keyword(s):  
Optimal Solution ◽  
Joint Estimation ◽  
Control Synthesis ◽  
Model Parameters ◽  
Linear Quadratic ◽  
Multiplicative Noises ◽  
Matrix Differential Equations ◽  
Estimation And Control ◽  
Matrix Differential ◽  
And Control

Jump Linear Quadratic Gaussian systems are considered in the presence of state-and control-dependent noises. Assuming that the jumps of the model parameters are perfectly observed, it is possible to formulate and solve an optimal input synthesis problem. It is found that the optimal solution does not present the certainty equivalence property, so that the estimation and control synthesis must be treated simultaneously. Optimal equations for the filter and regulator gains are obtained in terms of a set of coupled nonlinear matrix differential equations.

scholarly journals Unscented Kalman Filter Applied to the Spacecraft Attitude Estimation with Euler Angles

2012 ◽  
Vol 2012 ◽  
pp. 1-12 ◽  
Author(s):  
Roberta Veloso Garcia ◽  
Helio Koiti Kuga ◽  
Maria Cecilia F. P. S. Zanardi
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Extended Kalman Filter ◽  
Attitude Determination ◽  
Unscented Kalman Filter ◽  
Artificial Satellite ◽  
Real Data ◽  
Nonlinear Functions ◽  
Estimation And Control ◽  
And Control

The aim of this work is to test an algorithm to estimate, in real time, the attitude of an artificial satellite using real data supplied by attitude sensors that are on board of the CBERS-2 satellite (China Brazil Earth Resources Satellite). The real-time estimator used in this work for attitude determination is the Unscented Kalman Filter. This filter is a new alternative to the extended Kalman filter usually applied to the estimation and control problems of attitude and orbit. This algorithm is capable of carrying out estimation of the states of nonlinear systems, without the necessity of linearization of the nonlinear functions present in the model. This estimation is possible due to a transformation that generates a set of vectors that, suffering a nonlinear transformation, preserves the same mean and covariance of the random variables before the transformation. The performance will be evaluated and analyzed through the comparison between the Unscented Kalman filter and the extended Kalman filter results, by using real onboard data.

Cheating on Unproctored Internet Test Applications: An Analysis of a Verification Test in a Real Personnel Selection Context

2018 ◽  
Vol 21 ◽  
Author(s):  
David Aguado ◽  
Alejandro Vidal ◽  
Julio Olea ◽  
Vicente Ponsoda ◽  
Juan Ramón Barrada ◽  
...  
Keyword(s):  
Personnel Selection ◽  
Type I Error ◽  
Response Times ◽  
Item Difficulty ◽  
Real Data ◽  
Type I ◽  
Test Statistic ◽  
Computerized Adaptive Test ◽  
English Grammar ◽  
Verification Test

AbstractThis study analyses the extent to which cheating occurs in a real selection setting. A two-stage, unproctored and proctored, test administration was considered. Test score inconsistencies were concluded by applying a verification test (Guo and Drasgow Z-test). An initial simulation study showed that the Z-test has adequate Type I error and power rates in the specific selection settings explored. A second study applied the Z-test statistic verification procedure to a sample of 954 employment candidates. Additional external evidence based on item time response to the verification items was gathered. The results revealed a good performance of the Z-test statistic and a relatively low, but non-negligible, number of suspected cheaters that showed higher distorted ability estimates. The study with real data provided additional information on the presence of suspected cheating in unproctored applications and the viability of using item response times as an additional evidence of cheating. In the verification test, suspected cheaters spent 5.78 seconds per item more than expected considering the item difficulty and their assumed ability in the unproctored stage. We found that the percentage of suspected cheaters in the empirical study could be estimated at 13.84%. In summary, the study provides evidence of the usefulness of the Z-test in the detection of cheating in a specific setting, in which a computerized adaptive test for assessing English grammar knowledge was used for personnel selection.

scholarly journals Item Selection on The Moodle-Based Computerized Adaptive Test

2021 ◽  
Vol 2111 (1) ◽  
pp. 012033
Author(s):  
Haryanto ◽  
Y Neng-Shu ◽  
S Hadi ◽  
M Ali ◽  
AF Husna ◽  
...  
Keyword(s):  
Object Oriented ◽  
Item Selection ◽  
Dynamic Learning ◽  
Adaptive Tests ◽  
Computerized Adaptive Test ◽  
Test Items ◽  
Adaptive Test ◽  
Online Tests ◽  
Test Process ◽  
Selection Of

Abstract In this industrial era, all areas of life have been entered. There are five central issues that support performance, namely numerical physical devices, production tools, programs, interfaces, and networks. The Modular Object-Oriented Dynamic Learning Environment (Moodle) in order to support Industrial technology has been equipped with adaptive test facilities. Adaptive Moodle can be used to organize a communicative and interactive test process because of the communication features (chat, messaging, or forum). In addition, Adaptive Moodle can be used to administer online tests. Adaptive tests are tests whose quiz presentations will adjust to the user’s abilities. The results of the research that has been carried out regarding the selection of items on the Moodle-based computerized adaptive test (CAT) were obtained: (1) The Moodle adaptive test worked successfully in accordance with the research objectives, (2) Based on user responses, the selection of items on the Moodle adaptive test items had worked well for the exam, (3) The Moodle adaptive test can run according to its function, namely adaptive to the user’s ability.

scholarly journals Some New Item Selection Criteria for Adaptive Testing

1997 ◽  
Vol 22 (2) ◽  
pp. 203-226 ◽  
Author(s):  
Wim J. J. Veerkamp ◽  
Martijn P. F. Berger
Keyword(s):  
Selection Criteria ◽  
Information Criterion ◽  
Good Alternative ◽  
Adaptive Testing ◽  
Item Selection ◽  
A Posteriori ◽  
Likelihood Estimator ◽  
Maximum Information ◽  
Ability Estimates ◽  
Special Cases

In this study some alternative item selection criteria for adaptive testing are proposed. These criteria take into account the uncertainty of the ability estimates. A general weighted information criterion of which the usual maximum information criterion and the proposed alternative criteria are special cases is suggested. A small simulation study was conducted to compare the different criteria. The results showed that the likelihood weighted information criterion is a good alternative to the maximum information criterion. Another good alternative is a maximum information criterion with the maximum likelihood estimator of ability replaced by the Bayesian expected a posteriori estimator.

Sign in / Sign up

Export Citation Format

Share Document