Components of the item selection algorithm in computerized adaptive testing

Computerized adaptive testing (CAT) greatly improves measurement efficiency in high-stakes testing operations through the selection and administration of test items with the difficulty level that is most relevant to each individual test taker. This paper explains the 3 components of a conventional CAT item selection algorithm: test content balancing, the item selection criterion, and item exposure control. Several noteworthy methodologies underlie each component. The test script method and constrained CAT method are used for test content balancing. Item selection criteria include the maximized Fisher information criterion, the b-matching method, the astratification method, the weighted likelihood information criterion, the efficiency balanced information criterion, and the KullbackLeibler information criterion. The randomesque method, the Sympson-Hetter method, the unconditional and conditional multinomial methods, and the fade-away method are used for item exposure control. Several holistic approaches to CAT use automated test assembly methods, such as the shadow test approach and the weighted deviation model. Item usage and exposure count vary depending on the item selection criterion and exposure control method. Finally, other important factors to consider when determining an appropriate CAT design are the computer resources requirement, the size of item pools, and the test length. The logic of CAT is now being adopted in the field of adaptive learning, which integrates the learning aspect and the (formative) assessment aspect of education into a continuous, individualized learning experience. Therefore, the algorithms and technologies described in this review may be able to help medical health educators and high-stakes test developers to adopt CAT more actively and efficiently.

Constructing Shadow Tests in Variable-Length Adaptive Testing

Imposing content constraints is very important in most operational computerized adaptive testing (CAT) programs in educational measurement. Shadow test approach to CAT (Shadow CAT) offers an elegant solution to imposing statistical and nonstatistical constraints by projecting future consequences of item selection. The original form of Shadow CAT presumes fixed test lengths. The goal of the current study was to extend Shadow CAT to tests under variable-length termination conditions and evaluate its performance relative to other content balancing approaches. The study demonstrated the feasibility of constructing Shadow CAT with variable test lengths and in operational CAT programs. The results indicated the superiority of the approach compared with other content balancing methods.

CLIL Teacher Competences and Attitudes

Summary The paper presents the findings of the research carried out among the participants of the project ”Development of Content and Language Integrated Learning (CLIL) in Education” (2011-2013) that aimed to upgrade the competences of subject teachers enabling them to implement content and foreign language integrated learning approach in general education and vocational training. The data obtained through a survey indicates that the project participants developed a positive attitude towards the CLIL approach and positively assess the competences acquired during the programme. European Framework for CLIL Teacher Education proves to be a useful tool when designing training courses for specific target groups of qualified content teachers and a fifty hours' programme seems to be adequate to get acquainted with the fundamentals of CLIL. The project participants were most positive about their CLIL methodology competence development during the project and ability to identify appropriate subject content for teaching by using the CLIL approach. The weakest point identified by the participants involves languagerelated issues, such as ability to support language learning in content, balancing the target language used between the learners' and teacher's linguistic ability, and overall insufficiency of linguistic competences. One more issue indicated by the respondents is the absence of standards, guidance and administrative support, as well as quality assurance (content delivery, materials and assessment) in CLIL.