Automating the Generation of Test Items

2021 ◽  
pp. 233-244
Author(s):  
Hollis Lai ◽  
Mark Gierl
Keyword(s):  
Health Sciences ◽  
Complex Problem ◽  
Future Research ◽  
Item Generation ◽  
Test Items ◽  
Computerized Assessments ◽  
Medical Health ◽  
Increasing Demand ◽  
Automatic Item Generation ◽  
Content Specialists

Increasing demand for knowledge of our workers has prompted the increase in assessments and providing feedback to facilitate their learning. This and the increasingly computerized assessments require new test items beyond the ability for content specialists to produce them in a feasible fashion. Automatic item generation is a promising method that has begun to demonstrate utility in its application. The purpose of this chapter is to describe how AIG can be used to generate test items using the selected-response (i.e., multiple-choice) format. To ensure our description is both concrete and practical, we illustrate template-based item generation using an example from the complex problem-solving domain of the medical health sciences. The chapter is concluded with a description of the two directions for future research.

Automatic Item Generation

2018 ◽  
pp. 2369-2379 ◽  
Author(s):  
Mark Gierl ◽  
Hollis Lai ◽  
Xinxin Zhang
Keyword(s):  
Computer Technology ◽  
Health Sciences ◽  
Design And Development ◽  
Specific Test ◽  
Item Generation ◽  
Test Items ◽  
Medical Health ◽  
Automatic Item Generation ◽  
Educational Tests

Changes to the design and development of educational tests are resulting in the unprecedented demand for a large supply of content-specific test items. One way to address this growing demand is with automatic item generation. Automatic item generation is the process of using models to create test items with the aid of computer technology. The purpose of this chapter is to describe and illustrate a method for generating test items. The method is also illustrated using an example from the medical health sciences.

Automatic Item Generation

2019 ◽  
pp. 192-203 ◽  
Author(s):  
Mark Gierl ◽  
Hollis Lai ◽  
Xinxin Zhang
Keyword(s):  
Computer Technology ◽  
Health Sciences ◽  
Design And Development ◽  
Specific Test ◽  
Item Generation ◽  
Test Items ◽  
Medical Health ◽  
Automatic Item Generation ◽  
Educational Tests

Changes to the design and development of educational tests are resulting in the unprecedented demand for a large supply of content-specific test items. One way to address this growing demand is with automatic item generation. Automatic item generation is the process of using models to create test items with the aid of computer technology. The purpose of this chapter is to describe and illustrate a method for generating test items. The method is also illustrated using an example from the medical health sciences.

A Methodology for Multilingual Automatic Item Generation

2016 ◽  
Vol 37 (3) ◽  
pp. 39-61 ◽  
Author(s):  
Mark J. Gierl ◽  
Hollis Lai
Keyword(s):  
Computer Technology ◽  
Test Development ◽  
Cost Effective ◽  
Computer Algorithms ◽  
Timely Manner ◽  
Item Generation ◽  
Assessment Task ◽  
Test Items ◽  
Large Numbers ◽  
Automatic Item Generation

Testing agencies require large numbers of high-quality items that are produced in a cost-effective and timely manner. Increasingly, these agencies also require items in different languages. In this paper we present a methodology for multilingual automatic item generation (AIG). AIG is the process of using item models to generate test items with the aid of computer technology. We describe a three-step AIG approach where, first, test development specialists identify the content that will be used for item generation. Next, the specialists create item models to specify the content in the assessment task that must be manipulated to produce new items. Finally, elements in the item model are manipulated with computer algorithms to produce new items. Language is added in the item model step to permit multilingual AIG. We illustrate our method by generating 360 English and 360 French medical education items. The importance of item banking in multilingual test development is also discussed.

scholarly journals Using Automatic Item Generation to Create Solutions and Rationales for Computerized Formative Testing

2017 ◽  
Vol 42 (1) ◽  
pp. 42-57 ◽  
Author(s):  
Mark J. Gierl ◽  
Hollis Lai
Keyword(s):  
Computer Technology ◽  
Research Area ◽  
Computerized Testing ◽  
Item Generation ◽  
Test Items ◽  
Item Development ◽  
Large Numbers ◽  
Modeling Practices ◽  
Automatic Item Generation ◽  
Formative Testing

Computerized testing provides many benefits to support formative assessment. However, the advent of computerized formative testing has also raised formidable new challenges, particularly in the area of item development. Large numbers of diverse, high-quality test items are required because items are continuously administered to students. Hence, hundreds of items are needed to develop the banks necessary for computerized formative testing. One promising approach that may be used to address this test development challenge is automatic item generation. Automatic item generation is a relatively new but rapidly evolving research area where cognitive and psychometric modeling practices are used to produce items with the aid of computer technology. The purpose of this study is to describe a new method for generating both the items and the rationales required to solve the items to produce the required feedback for computerized formative testing. The method for rationale generation is demonstrated and evaluated in the medical education domain.

Using Automated Procedures to Generate Test Items That Measure Junior High Science Achievement

2016 ◽  
pp. 590-610
Author(s):  
Mark Gierl ◽  
Syed F. Latifi ◽  
Hollis Lai ◽  
Donna Matovinovic ◽  
Keith A. Boughton
Keyword(s):  
High School ◽  
Junior High School ◽  
Science Achievement ◽  
Junior High ◽  
School Science ◽  
Future Research ◽  
High School Science ◽  
Test Items ◽  
Automatic Item Generation

The purpose of this chapter is to describe and illustrate a template-based method for automatically generating test items. This method can be used to produce a large numbers of high-quality items both quickly and efficiency. To highlight the practicality and feasibility of automatic item generation, we demonstrate the application of this method in the content area of junior high school science. We also describe the results from a study designed to evaluate the quality of the generated science items. Our chapter is divided into four sections. In section one, we describe the methodology. In the section two, we illustrate the method using items generated for a junior high school physics curriculum. In section three, we present the results from a study designed to evaluate the quality of the generated science items. In section four, we conclude the chapter and identify one important area for future research.

What Does Science Say About Orton-Gillingham Interventions? An Explanation and Commentary on the Stevens et al. (2021) Meta-Analysis

2021 ◽  
Author(s):  
Emily Solari ◽  
Yaacov Petscher ◽  
Colby Hall
Keyword(s):  
Word Reading ◽  
Reading Interventions ◽  
Meta Analysis ◽  
Reading Difficulties ◽  
Health Sciences ◽  
Future Research ◽  
Exceptional Children ◽  
Reading Research ◽  
Education Science ◽  
Clear Description

A recent meta-analysis published in Exceptional Children (Stevens et al., 2021) looked at the effects of Orton-Gillingham (OG) reading interventions on reading outcomes for students who have word reading difficulties. The results of the study have led to questions and lively conversation among practitioners and reading researchers. One of the things that is important about science is that it is constantly evolving: this is true in education science as much as it is in the health sciences. Because this journal is committed to translating empirical findings from reading research in order to make education science accessible to practitioners, the intent of this commentary is to provide a clear description of the findings reported in this recent meta-analysis, addressing the degree to which they align with those reported in similar reviews of OG interventions. We discuss the degree to which the findings represent an evolution of reading science and their implications for instructional practice, policy, and future research.

Library Impact Research Report: Understanding and Communicating Research Impact: The Needs of STEM and Health Sciences Faculty and Postdoctoral Researchers

2021 ◽  
Author(s):  
Negeen Aghassibake ◽  
Lynly Beard ◽  
Jackie Belanger ◽  
Diana Louden ◽  
Robin Chin Roemer ◽  
...  
Keyword(s):  
Research Impact ◽  
Health Sciences ◽  
Future Research ◽  
Research Report ◽  
Library Impact ◽  
The University ◽  
Postdoctoral Researchers ◽  
Impact Framework ◽  
The Impact

As part of ARL’s Research Library Impact Framework initiative, the University of Washington (UW) Libraries explored UW faculty and postdoctoral researcher needs for understanding and communicating the impact of their work, with a focus on researchers in science, technology, engineering, and math (STEM) and health sciences fields. The project was designed to understand the challenges researchers face in this area, identify how participants in these fields define and measure impact, and explore their priorities for research-impact support. The project team conducted a survey and follow-up interviews to investigate these questions. This research report presents the project team’s methodology, findings, and recommendations for future research.

What does Solitude Mean to the Aged?

1988 ◽  
Vol 7 (4) ◽  
pp. 358-371 ◽  
Author(s):  
Marc-André Delisle
Keyword(s):  
Social Isolation ◽  
The Elderly ◽  
Complex Problem ◽  
Future Research ◽  
Relative Importance ◽  
Affective Needs ◽  
Quebec Literature ◽  
Comprehensive Study

AbstractThis article examines the extent and the meaning of solitude among the aged. A comprehensive study of the foreign, Canadian and Quebec literature was undertaken to prepare this document, but priority was given to the somewhat lesser known investigations originating from Quebec. First, the concepts most often utilized in discussing the phenomena under scrutiny were defined: solitude, social isolation and the feeling of loneliness. Then, the relative importance of each phenomenon was assessed, based on the available data. In order to fully understand the meaning of the facts observed, their causes were also examined. Finally, avenues for future research were proposed. This study suggests that solitude among the elderly is a more complex problem than believed. Even if the isolated and (or) lonely aged are in the minority, this does not mean that all their socio-affective needs are being met. These people spend long periods of time alone and this affects their lives. The problem as such is largely caused by the position the elderly occupy in the society and, in turn, this position probably influences their behaviour. However, gerontologists have scarcely studied this hypothesis. This article then highlights certain aspects of the solitude phenomenon which have so far been overlooked by gerontologists.

scholarly journals Sources: ALA Guide to Medical & Health Sciences Reference

2012 ◽  
Vol 51 (3) ◽  
pp. 300-300
Author(s):  
Karen Antell ◽  
Denise Brush
Keyword(s):  
Health Sciences ◽  
Medical Health
Sign in / Sign up

Export Citation Format

Share Document