Attribute Hierarchy Models in Cognitive Diagnosis: Identifiability of the Latent Attribute Space and Conditions for Completeness of the Q-Matrix

2018 ◽  
Vol 36 (3) ◽  
pp. 541-565
Author(s):  
Hans-Friedrich Köhn ◽  
Chia-Yi Chiu
2018 ◽  
Vol 44 (1) ◽  
pp. 3-24 ◽  
Author(s):  
Steven Andrew Culpepper ◽  
Yinghan Chen

Exploratory cognitive diagnosis models (CDMs) estimate the Q matrix, which is a binary matrix that indicates the attributes needed for affirmative responses to each item. Estimation of Q is an important next step for improving classifications and broadening application of CDMs. Prior research primarily focused on an exploratory version of the restrictive deterministic-input, noisy-and-gate model, and research is needed to develop exploratory methods for more flexible CDMs. We consider Bayesian methods for estimating an exploratory version of the more flexible reduced reparameterized unified model (rRUM). We show that estimating the rRUM Q matrix is complicated by a confound between elements of Q and the rRUM item parameters. A Bayesian framework is presented that accurately recovers Q using a spike–slab prior for item parameters to select the required attributes for each item. We present Monte Carlo simulation studies, demonstrating the developed algorithm improves upon prior Bayesian methods for estimating the rRUM Q matrix. We apply the developed method to the Examination for the Certificate of Proficiency in English data set. The results provide evidence of five attributes with a partially ordered attribute hierarchy.


2019 ◽  
Vol 44 (1) ◽  
pp. 65-83 ◽  
Author(s):  
Peida Zhan ◽  
Wenchao Ma ◽  
Hong Jiao ◽  
Shuliang Ding

The higher-order structure and attribute hierarchical structure are two popular approaches to defining the latent attribute space in cognitive diagnosis models. However, to our knowledge, it is still impossible to integrate them to accommodate the higher-order latent trait and hierarchical attributes simultaneously. To address this issue, this article proposed a sequential higher-order latent structural model (LSM) by incorporating various hierarchical structures into a higher-order latent structure. The feasibility of the proposed higher-order LSM was examined using simulated data. Results indicated that, in conjunction with the deterministic-inputs, noisy “and” gate model, the sequential higher-order LSM produced considerable improvement in person classification accuracy compared with the conventional higher-order LSM, when a certain attribute hierarchy existed. An empirical example was presented as well to illustrate the application of the proposed LSM.


Author(s):  
Yang Shuqun ◽  
Ding Shuliang

There is little room for doubt about that cognitive diagnosis has received much attention recently. Computerized adaptive testing (CAT) is adaptive, fair, and efficient, which is suitable to large-scale examination. Traditional cognitive diagnostic test needs quite large number of items, the efficient and tailored CAT could be a remedy for it, so the CAT with cognitive diagnosis (CD-CAT) is prospective. It is more beneficial to the students who live in the developing area without rich source of teaching, and distance education is adopted there. CD is still in its infancy (Leighton at el.2007), and some flaws exist, one of which is that the rows/columns could form a Boolean lattice in Tatsuoka’s Q-matrix theory. Formal Concept Analysis (FCA) is proved to be a useful tool for cognitive science. Based on Rule Space Model (RSM) and the Attribute Hierarchy Method (AHM), FCA is applied into CD-CAT and concept lattices are served as the models of CD. The algorithms of constructing Qr matrice and concept lattices for CAT, and the theory and methods of diagnosing examinees and offering the best remedial measure to examinees are discussed in detail. The technology of item bank construction, item selection strategies in CD-CAT and estimation method are considered to design a systemic CD-CAT, which diagnoses examinees on-line and offers remedial measure for examinees in time. The result of Monte Carlo study shows that examinees’ knowledge states are well diagnosed and the precision in examinees’ abilities estimation is satisfied.


2014 ◽  
Vol 68 (2) ◽  
pp. 268-291 ◽  
Author(s):  
Hans-Friedrich Köhn ◽  
Chia-Yi Chiu ◽  
Michael J. Brusco
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document