Computer adaptive testing to assess impairing behavioral health problems in emergency department patients

Study Objective: To assess the prevalence of several impairing behavioral health domains in stable patients presenting to the emergency department (ED) through the use of computer adaptive testing and the association among the domains, standard assessments, and ED utilization. Methods: This was a single-center observational study of 828 randomly selected adult patients presenting to the ED from May 2019 to March 2020. The main outcomes of interest were the self-administered, validated computer adaptive assessments of suicidality, depression, anxiety, PTSD, and substance abuse using computer adaptive testing, the CAT-MHTM. We estimated the association among the CAT-MHTM subscales, standard assessments, and the number of ED visits in the year prior and 30 days after enrollment. Results: The proportion of those who scored above the threshold of low/mild risk were: 24.1% (suicidality), 8.3% (depression), 16.5% (anxiety), 12.3% (PTSD), and 20.4% (substance use). While the CAT-MHTM subscales were highly correlated with other self-report assessments, they were not highly associated with standard ED assessments of suicidality. When examining associations with ED use, for example, individuals who had two or more ED visits in the prior year had 51% increased odds of being in the intermediate-high suicide risk category (95% Confidence Interval [CI], 1.03-2.23) compared to those with zero prior ED visits. Conclusion: The CAT-MHTM can document the high prevalence of mental health conditions in the ED, which were missed by standard ED practices. Mental health problems are associated with ED utilization in a population of patients presenting largely for somatic complaints.

Simulated Computer Adaptive Testing Administration with Remote Proctoring for Offsite Assessment in Mathematics

<div><p>This study examines remote proctoring as emerging practice for ascertaining the validity of offsite test administration regarding test security. While Computer Adaptive Testing (CAT) has the potentials for greater precision in determining examinees ability level, its gains can be jeopardized with off-site testing if the test is not ensured. This study simulated CAT assessment while focusing on item administration, varying the option of using pre-test items and how it impacts students' ability estimation and item exposure. Monte-Carlo simulation was employed to generate data for answering the research questions raised for the study. The study's findings revealed that CAT administration was more consistent with no pre-test items once tightly controlled at ±2theta level, upon which recommendations were made. This finding is particularly germane, with more institutions moving their assessments online and rapidly becoming a new normal as an aftermath of the Covid-19 pandemic.</p></div><div><br></div>The data for this study were generated from computer simulations using SimulCAT, a free software package designed by Dr. K. C. T. Han of Graduate Management Admission Council.<p></p>

Simulated Computer Adaptive Testing Administration with Remote Proctoring for Offsite Assessment in Mathematics

<div><p>This study examines remote proctoring as emerging practice for ascertaining the validity of offsite test administration regarding test security. While Computer Adaptive Testing (CAT) has the potentials for greater precision in determining examinees ability level, its gains can be jeopardized with off-site testing if the test is not ensured. This study simulated CAT assessment while focusing on item administration, varying the option of using pre-test items and how it impacts students' ability estimation and item exposure. Monte-Carlo simulation was employed to generate data for answering the research questions raised for the study. The study's findings revealed that CAT administration was more consistent with no pre-test items once tightly controlled at ±2theta level, upon which recommendations were made. This finding is particularly germane, with more institutions moving their assessments online and rapidly becoming a new normal as an aftermath of the Covid-19 pandemic.</p></div><div><br></div>The data for this study were generated from computer simulations using SimulCAT, a free software package designed by Dr. K. C. T. Han of Graduate Management Admission Council.<p></p>