Two-Phase Item Selection Procedure for Flexible Content Balancing in CAT

2007 ◽  
Vol 31 (6) ◽  
pp. 467-482 ◽  
Author(s):  
Ying Cheng ◽  
Hua-Hua Chang ◽  
Qing Yi
Keyword(s):  
Selection Procedure ◽  
Item Selection ◽  
Two Phase ◽  
Content Balancing

Identifying Measurement Invariant Item Sets in Cross-Cultural Settings Using an Automated Item Selection Procedure

Methodology ◽  
2018 ◽  
Vol 14 (4) ◽  
pp. 177-188 ◽  
Author(s):  
Martin Schultze ◽  
Michael Eid
Keyword(s):  
Measurement Invariance ◽  
Optimal Solution ◽  
Selection Procedure ◽  
Cross Cultural ◽  
Item Selection ◽  
Ant System ◽  
Item Quality ◽  
Ant System Algorithm ◽  
Selection For ◽  
Selection Of

Abstract. In the construction of scales intended for the use in cross-cultural studies, the selection of items needs to be guided not only by traditional criteria of item quality, but has to take information about the measurement invariance of the scale into account. We present an approach to automated item selection which depicts the process as a combinatorial optimization problem and aims at finding a scale which fulfils predefined target criteria – such as measurement invariance across cultures. The search for an optimal solution is performed using an adaptation of the [Formula: see text] Ant System algorithm. The approach is illustrated using an application to item selection for a personality scale assuming measurement invariance across multiple countries.

scholarly journals SEQUIN: A computerized item selection procedure

1974 ◽  
Vol 6 (1) ◽  
pp. 57-58
Author(s):  
Udo W. Pooch ◽  
William Moonan
Keyword(s):  
Selection Procedure ◽  
Item Selection

A two-phase robot selection procedure

1998 ◽  
Vol 9 (7) ◽  
pp. 675-684 ◽  
Author(s):  
E. Ertugrul Karsak
Keyword(s):  
Selection Procedure ◽  
Two Phase ◽  
Robot Selection

scholarly journals Components of the item selection algorithm in computerized adaptive testing

2018 ◽  
Vol 15 ◽  
pp. 7 ◽  
Author(s):  
Kyung (Chris) Tyek Han
Keyword(s):  
Computerized Adaptive Testing ◽  
Selection Criterion ◽  
Information Criterion ◽  
Item Selection ◽  
Exposure Control ◽  
Selection Algorithm ◽  
High Stakes ◽  
Item Exposure ◽  
Content Balancing ◽  
Item Exposure Control

Computerized adaptive testing (CAT) greatly improves measurement efficiency in high-stakes testing operations through the selection and administration of test items with the difficulty level that is most relevant to each individual test taker. This paper explains the 3 components of a conventional CAT item selection algorithm: test content balancing, the item selection criterion, and item exposure control. Several noteworthy methodologies underlie each component. The test script method and constrained CAT method are used for test content balancing. Item selection criteria include the maximized Fisher information criterion, the b-matching method, the astratification method, the weighted likelihood information criterion, the efficiency balanced information criterion, and the KullbackLeibler information criterion. The randomesque method, the Sympson-Hetter method, the unconditional and conditional multinomial methods, and the fade-away method are used for item exposure control. Several holistic approaches to CAT use automated test assembly methods, such as the shadow test approach and the weighted deviation model. Item usage and exposure count vary depending on the item selection criterion and exposure control method. Finally, other important factors to consider when determining an appropriate CAT design are the computer resources requirement, the size of item pools, and the test length. The logic of CAT is now being adopted in the field of adaptive learning, which integrates the learning aspect and the (formative) assessment aspect of education into a continuous, individualized learning experience. Therefore, the algorithms and technologies described in this review may be able to help medical health educators and high-stakes test developers to adopt CAT more actively and efficiently.

scholarly journals An item selection procedure to maximise scale reliability and validity

2004 ◽  
Vol 30 (4) ◽  
Author(s):  
J. Raubenheimer
Keyword(s):  
Factor Analysis ◽  
Exploratory Factor Analysis ◽  
Religious Orientation ◽  
Discriminant Validity ◽  
Reliability And Validity ◽  
Selection Procedure ◽  
Item Selection ◽  
Selection Strategy ◽  
Religious Orientation Scale ◽  
Orientation Scale

Wille (1996) proposed an item selection strategy which may be used to maximise, first, the internal consistency and, next, the convergent and discriminant validity of items in multi-dimensional Likert-type questionnaires or scales. In terms of his strategy, the latter aspects of validity are maximised by means of exploratory factor analyses. In this article, it is done by means of Tateneni, Mels, Cudeck and Browne’s (2001) Comprehensive Exploratory Factor Analysis (CEFA) program which implements exploratory factor analysis, but provides the advantages of standard confirmatory factor analysis (e.g., the computation of the standard errors of the rotated factor loadings and measures of “model" fit). The benefits that accrue by using this incremental approach are demonstrated in terms of Allport and Ross’ (1967) Religious Orientation Scale, a widely-used psychological instrument. Opsomming Wille (1996) het ’n itemseleksiestrategie voorgestel om eerstens die interne konsekwentheid, en tweedens die konvergente en divergente geldigheid van items in multidimensionele Likert-tipe vraelyste of skale te maksimeer. Volgens sy strategie word laasgenoemde aspekte van geldigheid deur middel van eksploratiewe faktorontledings gemaksimeer. In hierdie artikel, sal dit gedoen word deur Tateneni, Mels, Cudeck en Browne (2001) se program vir Omvattende Eksploratiewe Faktorontleding (CEFA) te gebruik, wat eksploratiewe faktorontleding aanwend, maar ook die voordele van gewone, bevestigende faktorontleding (bv., die berekening van die standaardfoute van die geroteerde faktorbeladings en indekse van modelpassing) bied. Die voordele wat spruit uit die toepassing van hierdie inkrementele benadering word gedemonstreer aan die hand van Allport en Ross (1967) se Religious Orientation Scale, ’n gewilde sielkundige meetintrument.

Sign in / Sign up

Export Citation Format

Share Document