scholarly journals A computerized adaptive testing advancing the measurement of subjective well-being

2019 ◽  
Vol 13 ◽  
Author(s):  
Yifang Wu ◽  
Yan Cai ◽  
Dongbo Tu
Keyword(s):  
Computerized Adaptive Testing ◽  
Simulated Data ◽  
Real Data ◽  
Well Being ◽  
Adaptive Testing ◽  
Test Time ◽  
Subjective Well Being ◽  
Test Items ◽  
Item Fit ◽  
Item Functioning

AbstractThis article aimed at developing an adaptive version of the subjective well-being (SWB) scale to measure a comprehensive concept of SWB among Chinese university students. Item response theory was employed to formulate the item bank of the SWB scale and computerized adaptive testing (CAT) for SWB (CAT-SWB), based on several commonly used SWB scales, after unidimensionality testing, model selection, local dependence testing, parameter estimation, item fit test and differential item functioning (DIF) analysis were performed. Finally, two CAT simulations using simulated-data and real-data were carried out to verify and evaluate the CAT-SWB. Results indicated that the proposed CAT-SWB had an excellent performance in that it largely reduces the number of test items and the length of test time without losing measurement precision.

scholarly journals Development of Computerized Adaptive Testing for Emotion Regulation

2020 ◽  
Vol 11 ◽  
Author(s):  
Lingling Xu ◽  
Ruyi Jin ◽  
Feifei Huang ◽  
Yanhui Zhou ◽  
Zonglong Li ◽  
...  
Keyword(s):  
Emotion Regulation ◽  
Model Comparison ◽  
Computerized Adaptive Testing ◽  
Item Analysis ◽  
Well Being ◽  
Adaptive Testing ◽  
Vital Role ◽  
Test Items ◽  
Item Fit ◽  
Item Functioning

Emotion regulation (ER) plays a vital role in individuals’ well-being and successful functioning. In this study, we attempted to develop a computerized adaptive testing (CAT) to efficiently evaluate ER, namely the CAT-ER. The initial CAT-ER item bank comprised 154 items from six commonly used ER scales, which were completed by 887 participants recruited in China. We conducted unidimensionality testing, item response theory (IRT) model comparison and selection, and IRT item analysis including local independence, item fit, differential item functioning, and item discrimination. Sixty-three items with good psychometric properties were retained in the final CAT-ER. Then, two CAT simulation studies were implemented to assess the CAT-ER, which revealed that the CAT-ER developed in this study performed reasonably well, considering that it greatly lessened the test items and time without losing measurement accuracy.

scholarly journals A new approach to assessing shyness of college students using computerized adaptive testing: CAT-Shyness

2020 ◽  
Vol 14 ◽  
Author(s):  
Zifei Li ◽  
Yan Cai ◽  
Dongbo Tu
Keyword(s):  
Psychometric Properties ◽  
Sensitivity And Specificity ◽  
Computerized Adaptive Testing ◽  
Real Data ◽  
Adaptive Testing ◽  
Measurement Precision ◽  
Item Bank ◽  
Test Time ◽  
Local Independence ◽  
Computerized Adaptive Test

Abstract Assessing shy symptoms via computerized adaptive testing (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. The computerized adaptive test for shyness (CAT-Shyness) was developed based on a large sample of 1400 participants from China. Item bank development included the investigation of unidimensionality, local independence, and exploration of differential item functioning (DIF). CAT simulations based on the real data were carried out to investigate the reliability, validity, and predicted utility (sensitivity and specificity) of the CAT-Shyness. The CAT-Shyness item bank was successfully built and proved to have excellent psychometric properties: high content validity, unidimensionality, local independence, and no DIF. The CAT simulations needed 14 items to achieve a high measurement precision with a reliability of .9. Moreover, the results revealed that the proposed CAT-Shyness had acceptable and reasonable marginal reliability, criterion-related validity, and sensitivity and specificity. It not only had acceptable psychometric properties, but also had a shorter but efficient assessment of shyness, which can save significant test time and reduce the test burden for individuals with less information loss.

scholarly journals A Second Look at Subjective Wellbeing Using Differential Item Functioning

2021 ◽  
pp. 23-42
Author(s):  
Karen H. Larwin ◽  
Milton Harvey
Keyword(s):  
Differential Item Functioning ◽  
Latent Variable ◽  
Subjective Wellbeing ◽  
Satisfaction With Life ◽  
Weighted Least Squares ◽  
Well Being ◽  
Satisfaction With Life Scale ◽  
Subjective Well Being ◽  
Current Investigation ◽  
Item Functioning

The current investigation uses latent variable modeling to investigate Subjective Well-Being (SWB). As a follow-up to Larwin, Harvey, and Constantinou (2020), subjective wellbeing is presented through third-order factor model, which explains two-second order factors, SWB and Interpersonal Experiences (IES) while incorporating measures of relationship and resiliency self-evaluations. Additionally, the current investigation considers differential item functioning not considered in the existing SWB literature. JEL classification numbers: C1,C3,C4,C9. Keywords: Subjective Well-Being, Satisfaction with Life Scale, Subjective Happiness Scale, Brief Resiliency Scale, Relationship Assessment Scale, Multiple Indicators Multiple Causes (MIMIC), Weighted least squares mean variance adjusted estimator (WLSMV).

Computerized Adaptive Testing for Sleep Disorders: Development of An Item Bank and Validation in A Simulated Study

2020 ◽  
Author(s):  
Menghua She ◽  
Yaling Li ◽  
Dongbo Tu ◽  
Yan Cai
Keyword(s):  
Sleep Disorders ◽  
Computerized Adaptive Testing ◽  
Assessment Tool ◽  
Adaptive Testing ◽  
Item Bank ◽  
Accurate Assessment ◽  
Item Pool ◽  
Psychometric Characteristics ◽  
Predictive Utility ◽  
Item Fit

Abstract Background: As more and more people suffer from sleep disorders, developing an efficient, cheap and accurate assessment tool for screening sleep disorders is becoming more urgent. This study developed a computerized adaptive testing for sleep disorders (CAT-SD). Methods: A large sample of 1,304 participants was recruited to construct the item pool of CAT-SD and to investigate the psychometric characteristics of CAT-SD. More specifically, firstly the analyses of unidimensionality, model fit, item fit, item discrimination parameter and differential item functioning (DIF) were conducted to construct a final item pool which meets the requirements of item response theory (IRT) measurement. In addition, a simulated CAT study with real response data of participants was performed to investigate the psychometric characteristics of CAT-SD, including reliability, validity and predictive utility (sensitivity and specificity). Results: The final unidimensional item bank of the CAT-SD not only had good item fit, high discrimination and no DIF; Moreover, it had acceptable reliability, validity and predictive utility. Conclusions: The CAT-SD could be used as an effective and accurate assessment tool for measuring individuals' severity of the sleep disorders and offers a bran-new perspective for screening of sleep disorders with psychological scales.

Model Diagnostics for Bayesian Networks

2006 ◽  
Vol 31 (1) ◽  
pp. 1-33 ◽  
Author(s):  
Sandip Sinharay
Keyword(s):  
Model Checking ◽  
Bayesian Networks ◽  
Real Data ◽  
Diagnostic Tools ◽  
Model Diagnostics ◽  
Posterior Predictive Model Checking ◽  
Item Fit ◽  
Item Functioning ◽  
Data Application ◽  
Educational Assessments

Bayesian networks are frequently used in educational assessments primarily for learning about students’ knowledge and skills. There is a lack of works on assessing fit of Bayesian networks. This article employs the posterior predictive model checking method, a popular Bayesian model checking tool, to assess fit of simple Bayesian networks. A number of aspects of model fit, those of usual interest to practitioners, are assessed using various diagnostic tools. This article suggests a direct data display for assessing overall fit, suggests several diagnostics for assessing item fit, suggests a graphical approach to examine if the model can explain the association among the items, and suggests a version of the Mantel–Haenszel statistic for assessing differential item functioning. Limited simulation studies and a real data application demonstrate the effectiveness of the suggested model diagnostics.

scholarly journals A new approach to computerized adaptive testing

2017 ◽  
Vol 10 (3) ◽  
pp. 33-45 ◽  
Author(s):  
L.S. Kuravsky ◽  
S.L. Artemenkov ◽  
G.A. Yuryev ◽  
E.L. Grigorenko
Keyword(s):  
Markov Processes ◽  
Computerized Adaptive Testing ◽  
Model Identification ◽  
Testing Procedure ◽  
Adaptive Testing ◽  
Observation Data ◽  
Polytomous Items ◽  
Discrete State ◽  
New Approach ◽  
Test Items

A new approach to computerized adaptive testing is presented on the basis of discrete-state discrete-time Markov processes. This approach is based on an extension of the G. Rasch model used in the Item Response Theory (IRT) and has decisive advantages over the adaptive IRT testing. This approach has a number of competitive advantages: takes into account all the observed history of performing test items that includes the distribution of successful and unsuccessful item solutions; incorporates time spent on performing test items; forecasts results in the future behavior of the subjects; allows for self-learning and changing subject abilities during a testing procedure; contains easily available model identification procedure based on simply accessible observation data. Markov processes and the adaptive transitions between the items remain hidden for the subjects who have access to the items only and do not know all the intrinsic mathematical details of a testing procedure. The developed model of adaptive testing is easily generalized for the case of polytomous items and multidimensional items and model structures.

Evaluating the Magnitude of Differential Item Functioning in Polytomous Items

1996 ◽  
Vol 21 (3) ◽  
pp. 187-201 ◽  
Author(s):  
Rebecca Zwick ◽  
Dorothy T. Thayer
Keyword(s):  
Hypothesis Testing ◽  
Differential Item Functioning ◽  
Standard Error ◽  
Simulated Data ◽  
Ordinal Scale ◽  
Polytomous Items ◽  
Testing Procedures ◽  
Test Items ◽  
Item Functioning ◽  
Error Formulas

Several recent studies have investigated the application of statistical inference procedures to the analysis of differential item functioning (DIF) in polytomous test items that are scored on an ordinal scale. Mantel’s extension of the Mantel-Haenszel test is one of several hypothesis-testing methods for this purpose. The development of descriptive statistics for characterizing DIF in polytomous test items has received less attention. As a step in this direction, two possible standard error formulas for the polytomous DIF index proposed by Dorans and Schmitt were derived. These standard errors, as well as associated hypothesis-testing procedures, were evaluated though application to simulated data. The standard error that performed better is based on Mantel’s hypergeometric model. The alternative standard error, based on a multinomial model, tended to yield values that were too small.

Controlling Item Exposure Conditional on Ability in Computerized Adaptive Testing

1998 ◽  
Vol 23 (1) ◽  
pp. 57-75 ◽  
Author(s):  
Martha L. Stocking ◽  
Charles Lewis
Keyword(s):  
Large Scale ◽  
Computerized Adaptive Testing ◽  
Simulated Data ◽  
Adaptive Testing ◽  
Testing Environment ◽  
Item Exposure ◽  
Continuous Testing ◽  
Conditional Control ◽  
Periodic Testing ◽  
Testing Algorithm

The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. One such issue is that of ensuring item and pool security in the continuous testing environment made possible by the computerized admin-istration of a test, as opposed to the more periodic testing environment typically used for linear paper-and-pencil tests. This article presents a new method of controlling the exposure rate of items conditional on ability level in this continuous testing environment. The properties of such conditional control on the exposure rates of items, when used in conjunction with a particular adaptive testing algorithm, are explored through studies with simulated data.

scholarly journals HASIL PENGUJIAN SOFTWARE COMPUTERIZED ADAPTIVE TESTING (CAT) MATA PELAJARAN PENDIDIKAN AGAMA ISLAM (PAI) DALAM MEMBUAT REKAM MEDIK PEMBELAJARAN (RMP) UNTUK MENDIAGNOSIS KEMAMPUAN SISWA DI SEKOLAH

INFERENSI ◽  
2012 ◽  
Vol 6 (2) ◽  
pp. 183
Author(s):  
Winarno Winarno
Keyword(s):  
Research And Development ◽  
Religious Education ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Estimation Result ◽  
Web Based ◽  
Test Items ◽  
Islamic Religion ◽  
Development Approach ◽  
Quantitative Descriptive

This research aims at  producing a Computerized Adaptive Testing (CAT) software Islamic religion education subject (CAT PAI) for the year 7 students of public junior high schoo and  to see the results of CAT software in making rekam medik pembelajaran (RMP) to diagnose student’s ability. This research used the research and development approach. The data was collected by doing observation and documentation. Analyzedto use quantitative descriptive technique. The findings of the research shows the CAT can be developed web-based, and The CAT is able to in estimating student’s ability correct be seen RMP. Overall, the CAT software can perform the tasks well in order to select test items and to measure student’s ability from correlation value between ability estimation result (è) in CAT with  Islamic religious education subjects enough tall that is 0,69.

Sign in / Sign up

Export Citation Format

Share Document