Computerized Item Modeling Practices using Computer Adaptive Formative Assessment Automatic Item Generation System: A Tutorial

Computerized testing provides many benefits to support formative assessment. However, the advent of computerized formative testing has also raised formidable new challenges, particularly in the area of item development. Large numbers of diverse, high-quality test items are required because items are continuously administered to students. Hence, hundreds of items are needed to develop the banks necessary for computerized formative testing. One promising approach that may be used to address this test development challenge is automatic item generation. Automatic item generation is a relatively new but rapidly evolving research area where cognitive and psychometric modeling practices are used to produce items with the aid of computer technology. The purpose of this study is to describe a new method for generating both the items and the rationales required to solve the items to produce the required feedback for computerized formative testing. The method for rationale generation is demonstrated and evaluated in the medical education domain.

Download Full-text

Evaluation of Automatic Item Generation Utilities in Formative Assessment Application for Korean High School Students

Journal of Educational Issues ◽

10.5296/jei.v4i1.12630 ◽

2018 ◽

Vol 4 (1) ◽

pp. 68 ◽

Cited By ~ 2

Author(s):

Jaehwa Choi ◽

HeeKyoung Kim ◽

Seohong Pak

Keyword(s):

High School ◽

High School Students ◽

Formative Assessment ◽

Empirical Evaluation ◽

Theory And Practice ◽

Assessment System ◽

School Students ◽

Item Generation ◽

Learner Centered ◽

Automatic Item Generation

The recent interests in research in the assessment field have been rapidly shifting from decision-maker-centered assessments to learner-centered assessments (i.e., diagnostic and/or formative assessments). In particular, it is a very important research topic in this field to analyze how these learner-centered assessments are developed more practical and valid by combining information (or intelligent) and communication technologies (ICT) and psychometric advances, and how these systems contribute to learning. Automatic Item Generation (AIG), which is in the spotlight recently, is a representative example of building a next-generation assessment theory and practice by integrating ICT into psychometrics.AIG has very broad and promising features in mass production, intelligent item calibration and management, especially learner-centered assessment, and so on. However, these claims have not yet been fully validated in real education settings, and it is in dire need of evaluating the utilities of AIG applications in practical educational settings. Based on these needs, the purposes of this research are, firstly, to introduce the benefits and challenges of AIG to properly assess AIG’s utilities. And, secondly, this study provides empirical evaluation results of AIG’s utilities within a formative assessment system for Korean high school students and teachers.The results of this study have important implications in that it is the first empirical study to evaluate the usefulness of AIG in the formation evaluation application of the actual educational environment, Korean high school setting. The results of the theoretical and empirical evaluation of the AIG will also be useful to researchers and practitioners who wish to evaluate the benefits and issues of future AIG-based educational services or theory development.

Download Full-text

Bi-level stochastic real-time pricing model in multi-energy generation system: A reinforcement learning approach

Energy ◽

10.1016/j.energy.2021.121926 ◽

2021 ◽

pp. 121926

Author(s):

Li Zhang ◽

Yan Gao ◽

Hongbo Zhu ◽

Li Tao

Keyword(s):

Reinforcement Learning ◽

Real Time ◽

Energy Generation ◽

Learning Approach ◽

Pricing Model ◽

Generation System ◽

System A ◽

Real Time Pricing

Download Full-text

Comparative study of a small size wind generation system efficiency for battery charging

Serbian Journal of Electrical Engineering ◽

10.2298/sjee120707003m ◽

2013 ◽

Vol 10 (2) ◽

pp. 261-274 ◽

Cited By ~ 1

Author(s):

Messaoud Mayouf ◽

Rachid Abdessemed

Keyword(s):

Control Strategies ◽

Power Converter ◽

Maximum Power ◽

Wind Generation ◽

Direct Drive ◽

Generation System ◽

Battery Charging ◽

Pulse Width Modulated ◽

System A ◽

Wind Generation System

This paper presents an energetic comparison between two control strategies of a small size wind generation system for battery charging. The output voltage of the direct drive PMSG is connected to the battery through a switch mode rectifier. A DC-DC boost converter is used to regulate the battery bank current in order to achieve maximum power from the wind. A maximum powertracking algorithm calculates the current command that corresponds to maximum power output of the turbine. The DC-DC converter uses this current to calculate the duty cycle witch is necessary to control the pulse width modulated (PWM) active switching device (IGPT). The system overview and modeling are presented including characteristics of wind turbine, generator, batteries, power converter, control system, and supervisory system. A simulation of the system is performed using MATLAB/SIMULINK.

Download Full-text

A Computational Strategy for Classification of Enem Issues Based on Item Response Theory

Revista de Informática Teórica e Aplicada ◽

10.22456/2175-2745.92406 ◽

2020 ◽

Vol 27 (1) ◽

pp. 92-111

Author(s):

Gustavo Henrique Nunes ◽

Bruno Alberto Soares Oliveira ◽

Ciniro Aparecido Leite Nametala

Keyword(s):

High School ◽

Item Response Theory ◽

Item Response ◽

Generation System ◽

Response Theory ◽

Hit Rate ◽

System A ◽

Intelligent Simulation ◽

Computational Strategy

The National High School Examination (ENEM) gains each year more importance, as it gradually, replacing traditional vestibular. Many simulations are done almost randomly by teachers or systems, with questions chosen without discretion. With this methodology, if a test needs to be reapplied, it is not possible to recreate it with questions that have the same difficulty as those used in the first evaluation. In this context, the present work presents the development of an ENEM Intelligent Simulation Generation System that calculates the parameters of Item Response Theory (TRI) of questions that have already been applied in ENEM and, based on them, classifies them. in groups of difficulty, thus enabling the generation of balanced tests. For this, the K-means algorithm was used to group the questions into three difficulty groups: easy, medium and difficult. To verify the functioning of the system, a simulation with 180 questions was generated along the ENEM model. It could be seen that in 37.7% of cases this happened. This hit rate was not greater because the algorithm confounded the difficulty of issues that are in close classes. However, the system has a hit rate of 92.8% in the classification of questions that are in distant groups.

Download Full-text

Advanced Methods in Automatic Item Generation

10.4324/9781003025634 ◽

2021 ◽

Author(s):

Mark J. Gierl ◽

Hollis Lai ◽

Vasily Tanygin

Keyword(s):

Item Generation ◽

Automatic Item Generation

Download Full-text

Three Modeling Applications to Promote Automatic Item Generation for Examinations in Dentistry

Journal of Dental Education ◽

10.1002/j.0022-0337.2016.80.3.tb06090.x ◽

2016 ◽

Vol 80 (3) ◽

pp. 339-347 ◽

Cited By ~ 2

Author(s):

Hollis Lai ◽

Mark J. Gierl ◽

B. Ellen Byrne ◽

Andrew I. Spielman ◽

David M. Waldschmidt

Keyword(s):

Item Generation ◽

Automatic Item Generation

Download Full-text

The Virtual Harmonic Power Droop Strategy to Mitigate the Output Harmonic Voltage of the Inverter

Energies ◽

10.3390/en11092196 ◽

2018 ◽

Vol 11 (9) ◽

pp. 2196 ◽

Cited By ~ 1

Author(s):

Yuan Yao ◽

Longyun Kang

Keyword(s):

Distributed Generation ◽

Second Order ◽

Droop Control ◽

Virtual Power ◽

Generation System ◽

System A ◽

Common Control ◽

Harmonic Voltage ◽

The Mathematical Model ◽

Harmonic Power

The harmonic voltage issue becomes a challenge for a distributed generation system. Considering that droop control is the most common control algorithm used in the distributed system, a virtual harmonic power droop strategy which aims to mitigate the harmonic voltage is proposed in this paper. First, the conventional droop control is analyzed. Based on that concept, the virtual power algorithm is introduced. Second, the output harmonic voltage issue and the mathematical model of the inverter are presented. In addition, the second-order generalized integrator is briefly discussed. Third, taking into consideration the algorithms and models presented, a virtual harmonic power droop strategy is proposed to implement the harmonic voltage mitigation. In this algorithm, signals in fundamental frequency and harmonic frequency are separated with the help of second-order generalized integrators. Unlike the conventional voltage–current dual loop structure which is used to mitigate system harmonics, this method only needs the virtual power feedback to mitigate the harmonic voltage. Based on these features, the system’s control structure is simplified. Simulation and experimental results verified the harmonic voltage mitigation ability of the proposed strategy.

Download Full-text