Cognitively Diagnostic Analysis Using the G-DINA Model in R

Cognitive diagnosis models (CDMs) have increasingly been applied in education and other fields. This article provides an overview of a widely used CDM, namely, the G-DINA model, and demonstrates a hands-on example of using multiple R packages for a series of CDM analyses. This overview involves a step-by-step illustration and explanation of performing Q-matrix evaluation, CDM calibration, model fit evaluation, item diagnosticity investigation, classification reliability examination, and the result presentation and visualization. Some limitations of conducting CDM analysis in R are also discussed.

Examining Enhanced Learning Diagnostics in Virtual Reality Flight Trainers

As the complexity of aircraft cockpit operations increases, training effectiveness must be improved, and learning accelerated. Virtual reality (VR) training is increasingly offered as a method for improving training efficacy given its ability to provide a rich sensory experience during learning. This paper describes a study examining how training efficacy can be improved by improving learning diagnostics. We study how varying forms of knowledge assessment are related to different types of task knowledge and task performance in a VR flight simulator. The data suggest that participants who demonstrated higher training comprehension, measured via diagnostic test questions, on conceptual (and to a lesser effect) declarative knowledge, also demonstrated superior knowledge transfer in the VR flight simulator. Findings are discussed in the context of improving cognitively diagnostic assessments that are better able to predict task performance and inform individually tailored training remediation.