scholarly journals Flexible Computerized Adaptive Tests to Detect Misconceptions and Estimate Ability Simultaneously

2020 ◽  
Vol 45 (1) ◽  
pp. 3-21
Author(s):  
Yu Bao ◽  
Yawei Shen ◽  
Shiyu Wang ◽  
Laine Bradshaw

The Scaling Individuals and Classifying Misconceptions (SICM) model is an advanced psychometric model that can provide feedback to examinees’ misconceptions and a general ability simultaneously. These two types of feedback are represented by a discrete and a continuous latent variable, respectively, in the SICM model. The complex structure of the SICM model brings difficulties in estimating both misconception profile and ability efficiently in a linear test. To overcome this challenge, this study proposes a flexible computerized adaptive test (FCAT) design as a new test delivery method to increase test efficiency by administering an individualized test to examinees. We propose three item selection methods and two transition criteria to determine adaptive steps based on the needs of estimating one or two latent variables. Through two simulation studies, we demonstrate how to select an appropriate item selection method for an adaptive step and what transition criterion should be used between two adaptive steps. Results reveal the combination of the item selection method and the transition criterion could improve the estimation accuracy of a specific latent variable to a different extent and thus provide further guidance in designing an FCAT.

Methodology ◽  
2011 ◽  
Vol 7 (4) ◽  
pp. 157-164
Author(s):  
Karl Schweizer

Probability-based and measurement-related hypotheses for confirmatory factor analysis of repeated-measures data are investigated. Such hypotheses comprise precise assumptions concerning the relationships among the true components associated with the levels of the design or the items of the measure. Measurement-related hypotheses concentrate on the assumed processes, as, for example, transformation and memory processes, and represent treatment-dependent differences in processing. In contrast, probability-based hypotheses provide the opportunity to consider probabilities as outcome predictions that summarize the effects of various influences. The prediction of performance guided by inexact cues serves as an example. In the empirical part of this paper probability-based and measurement-related hypotheses are applied to working-memory data. Latent variables according to both hypotheses contribute to a good model fit. The best model fit is achieved for the model including latent variables that represented serial cognitive processing and performance according to inexact cues in combination with a latent variable for subsidiary processes.


2019 ◽  
Author(s):  
Kevin Constante ◽  
Edward Huntley ◽  
Emma Schillinger ◽  
Christine Wagner ◽  
Daniel Keating

Background: Although family behaviors are known to be important for buffering youth against substance use, research in this area often evaluates a particular type of family interaction and how it shapes adolescents’ behaviors, when it is likely that youth experience the co-occurrence of multiple types of family behaviors that may be protective. Methods: The current study (N = 1716, 10th and 12th graders, 55% female) examined associations between protective family context, a latent variable comprised of five different measures of family behaviors, and past 12 months substance use: alcohol, cigarettes, marijuana, and e-cigarettes. Results: A multi-group measurement invariance assessment supported protective family context as a coherent latent construct with partial (metric) measurement invariance among Black, Latinx, and White youth. A multi-group path model indicated that protective family context was significantly associated with less substance use for all youth, but of varying magnitudes across ethnic-racial groups. Conclusion: These results emphasize the importance of evaluating psychometric properties of family-relevant latent variables on the basis of group membership in order to draw appropriate inferences on how such family variables relate to substance use among diverse samples.


2021 ◽  
Vol 13 (2) ◽  
pp. 51
Author(s):  
Lili Sun ◽  
Xueyan Liu ◽  
Min Zhao ◽  
Bo Yang

Variational graph autoencoder, which can encode structural information and attribute information in the graph into low-dimensional representations, has become a powerful method for studying graph-structured data. However, most existing methods based on variational (graph) autoencoder assume that the prior of latent variables obeys the standard normal distribution which encourages all nodes to gather around 0. That leads to the inability to fully utilize the latent space. Therefore, it becomes a challenge on how to choose a suitable prior without incorporating additional expert knowledge. Given this, we propose a novel noninformative prior-based interpretable variational graph autoencoder (NPIVGAE). Specifically, we exploit the noninformative prior as the prior distribution of latent variables. This prior enables the posterior distribution parameters to be almost learned from the sample data. Furthermore, we regard each dimension of a latent variable as the probability that the node belongs to each block, thereby improving the interpretability of the model. The correlation within and between blocks is described by a block–block correlation matrix. We compare our model with state-of-the-art methods on three real datasets, verifying its effectiveness and superiority.


2021 ◽  
pp. 014662162110146
Author(s):  
Justin L. Kern ◽  
Edison Choe

This study investigates using response times (RTs) with item responses in a computerized adaptive test (CAT) setting to enhance item selection and ability estimation and control for differential speededness. Using van der Linden’s hierarchical framework, an extended procedure for joint estimation of ability and speed parameters for use in CAT is developed following van der Linden; this is called the joint expected a posteriori estimator (J-EAP). It is shown that the J-EAP estimate of ability and speededness outperforms the standard maximum likelihood estimator (MLE) of ability and speededness in terms of correlation, root mean square error, and bias. It is further shown that under the maximum information per time unit item selection method (MICT)—a method which uses estimates for ability and speededness directly—using the J-EAP further reduces average examinee time spent and variability in test times between examinees above the resulting gains of this selection algorithm with the MLE while maintaining estimation efficiency. Simulated test results are further corroborated with test parameters derived from a real data example.


1989 ◽  
Vol 14 (4) ◽  
pp. 335-350 ◽  
Author(s):  
Robert J. Mislevy ◽  
Kathleen M. Sheehan

The Fisher, or expected, information matrix for the parameters in a latent-variable model is bounded from above by the information that would be obtained if the values of the latent variables could also be observed. The difference between this upper bound and the information in the observed data is the “missing information.” This paper explicates the structure of the expected information matrix and related information matrices, and characterizes the degree to which missing information can be recovered by exploiting collateral variables for respondents. The results are illustrated in the context of item response theory models, and practical implications are discussed.


2019 ◽  
Vol 7 (1) ◽  
pp. 1-13
Author(s):  
Aras Jalal Mhamad ◽  
Renas Abubaker Ahmed

       Based on medical exchange and medical information processing theories with statistical tools, our study proposes and tests a research model that investigates main factors behind abortion issue. Data were collected from the survey of Maternity hospital in Sulaimani, Kurdistan-Iraq. Structural Equation Modelling (SEM) is a powerful technique as it estimates the causal relationship between more than one dependent variable and many independent variables, which is ability to incorporate quantitative and qualitative data, and it shows how all latent variables are related to each other. The dependent latent variable in SEM which have one-way arrows pointing to them is called endogenous variable while others are exogenous variables. The structural equation modeling results reveal is underlying mechanism through which statistical tools, as relationship between factors; previous disease information, food and drug information, patient address, mother’s information, abortion information, which are caused abortion problem. Simply stated, the empirical data support the study hypothesis and the research model we have proposed is viable. The data of the study were obtained from a survey of Maternity hospital in Sulaimani, Kurdistan-Iraq, which is in close contact with patients for long periods, and it is number one area for pregnant women to obtain information about the abortion issue. The results shows arrangement about factors effectiveness as mentioned at section five of the study. This gives the conclusion that abortion problem must be more concern than the other pregnancy problem.


2021 ◽  
Vol 2021 ◽  
pp. 1-18
Author(s):  
Mehdi Zolali ◽  
Babak Mirbaha ◽  
Maziyar Layegh ◽  
Hamid Reza Behnood

Driving above the speed limit is one of the factors that significantly affect safety. Many studies examined the factors affecting the speed of vehicles in the simulated environment. The present study aimed to analyze drivers’ characteristics, time and weather conditions, and geometric features’ effect on mean speed in simulated conditions simultaneously. In this regard, the simulator experiment data of 70 drivers were collected in a two-lane rural highway at six different times, and weather scenarios and their socioeconomic characteristics were collected by a questionnaire. Structural equation modeling (SEM) was used to capture the complex relationships among related variables. Eleven variables were grouped into four latent variables in the structural model. Latent variables including “Novice Drivers,” “Experienced Drivers,” “Sight Distance,” and “Geometric Design” were defined and found significant on their mean speed. The results showed that “Novice Drivers” have a positive correlation with the mean speed. Meanwhile, “Experienced Drivers,” who drive 12% slower than the novice group, negatively affect the mean speed with a standard regression weight of −0.08. This relation means that young and novice drivers are more inclined to choose higher speeds. Among variables, the latent variable “Sight Distance” has the most significant effect on the mean speed. This model shows that foggy weather conditions strongly affect the speed selection behavior and reduce the mean speed by 40%. Nighttime also reduces mean speed due to poor visibility conditions. Furthermore, “Geometric design” as the latent variable indicates the presence of curves on the simulated road, and it can be concluded that the existence of a curve on the road encourages drivers to slow down, even young drivers. It is noteworthy that the parts of the simulated road with a horizontal curve act as a speed reduction tool for drivers.


2021 ◽  
Vol 22 (2) ◽  
pp. 123-133
Author(s):  
Defrizal Hamka ◽  
Neng Sholihat

The purpose of this research is to investigate factors that influence the intent of behavior using technology in online learning. The study uses structural equation modeling using a partial least square approach to test the hypotheses. Respondents selected using purposive sampling, and the questionnaires were distributed through online surveys and received a response of 96 respondents. Results show that latent variables, performance expectations, business expectations, and facility conditions have a positive and significant relationship with the intent of individual behaviour in the use of technology in online learning. The latent variable "condition facility" is the most influential factor. This research provides an important overview and understanding for policymakers in designing frameworks to pay attention to facility conditions. Further research is suggested in the future covering samples from various provinces in Indonesia. This study adds to the literature primarily on factors affecting behavioral intent to use technology in online learning. Tujuan dari penelitian ini adalah untuk menganalisis faktor-faktor yang mempengaruhi niat perilaku guru menggunakan teknologi dalam pembelajaran online. Penelitian ini menggunakan pemodelan persamaan struktural dengan menggunakan pendekatan partial least square untuk menguji hipotesis. Berdasarkan purposive sampling, kuesioner disebarkan melalui survei online dan mendapat tanggapan dari 96 responden. Hasil penelitian menunjukkan bahwa variabel laten, ekspektasi kinerja, ekspektasi usaha, dan kondisi fasilitas memiliki hubungan positif dan signifikan dengan niat perilaku individu dalam penggunaan teknologi dalam pembelajaran online. Variabel laten “fasilitas kondisi” merupakan faktor yang paling berpengaruh. Penelitian ini memberikan gambaran dan pemahaman penting bagi pembuat kebijakan dalam merancang kerangka kerja untuk memperhatikan kondisi fasilitas. Penelitian lebih lanjut disarankan di masa depan mencakup sampel dari berbagai provinsi di Indonesia. Studi ini menambah literatur terutama pada faktor-faktor yang mempengaruhi niat perilaku untuk menggunakan teknologi dalam pembelajaran online.


Sign in / Sign up

Export Citation Format

Share Document