Supplemental Material for Efficiently Measuring Dimensions of the Externalizing Spectrum Model: Development of the Externalizing Spectrum Inventory-Computerized Adaptive Test (ESI-CAT)

Abstract Objective Administrative burden often prevents clinical assessment of balance confidence in people with stroke. A computerized adaptive test (CAT) version of the Activities-specific Balance Confidence Scale (ABC CAT) can dramatically reduce this burden. The objective of this study was to test balance confidence measurement precision and efficiency in people with stroke with an ABC CAT. Methods We conducted a retrospective cross-sectional simulation study with data from 406 adults approximately 2-months post-stroke in the Locomotor-Experience Applied Post-Stroke (LEAPS) trial. Item parameters for CAT calibration were estimated with the Rasch model using a random sample of participants (n = 203). Computer simulation was used with response data from remaining 203 participants to evaluate the ABC CAT algorithm under varying stopping criteria. We compared estimated levels of balance confidence from each simulation to actual levels predicted from the Rasch model (Pearson correlations and mean standard error (SE)). Results Results from simulations with number of items as a stopping criterion strongly correlated with actual ABC scores (full item, r = 1, 12-item, r = 0.994; 8-item, r = 0.98; 4-item, r = 0.929). Mean SE increased with decreasing number of items administered (full item, SE = 0.31; 12-item, SE = 0.33; 8-item, SE = 0.38; 4-item, SE = 0.49). A precision-based stopping rule (mean SE = 0.5) also strongly correlated with actual ABC scores (r = .941) and optimized the relationship between number of items administrated with precision (mean number of items 4.37, range [4–9]). Conclusions An ABC CAT can determine accurate and precise measures of balance confidence in people with stroke with as few as 4 items. Individuals with lower balance confidence may require a greater number of items (up to 9) and attributed to the LEAPS trial excluding more functionally impaired persons. Impact Statement Computerized adaptive testing can drastically reduce the ABC’s test administration time while maintaining accuracy and precision. This should greatly enhance clinical utility, facilitating adoption of clinical practice guidelines in stroke rehabilitation. Lay Summary If you have had a stroke, your physical therapist will likely test your balance confidence. A computerized adaptive test version of the ABC scale can accurately identify balance with as few as 4 questions, which takes much less time.

Download Full-text

Using a Response Time–Based Expected A Posteriori Estimator to Control for Differential Speededness in Computerized Adaptive Test

Applied Psychological Measurement ◽

10.1177/01466216211014601 ◽

2021 ◽

pp. 014662162110146

Author(s):

Justin L. Kern ◽

Edison Choe

Keyword(s):

Response Times ◽

Real Data ◽

Joint Estimation ◽

Item Selection ◽

A Posteriori ◽

Computerized Adaptive Test ◽

Maximum Information ◽

Adaptive Test ◽

Estimation And Control ◽

And Control

This study investigates using response times (RTs) with item responses in a computerized adaptive test (CAT) setting to enhance item selection and ability estimation and control for differential speededness. Using van der Linden’s hierarchical framework, an extended procedure for joint estimation of ability and speed parameters for use in CAT is developed following van der Linden; this is called the joint expected a posteriori estimator (J-EAP). It is shown that the J-EAP estimate of ability and speededness outperforms the standard maximum likelihood estimator (MLE) of ability and speededness in terms of correlation, root mean square error, and bias. It is further shown that under the maximum information per time unit item selection method (MICT)—a method which uses estimates for ability and speededness directly—using the J-EAP further reduces average examinee time spent and variability in test times between examinees above the resulting gains of this selection algorithm with the MLE while maintaining estimation efficiency. Simulated test results are further corroborated with test parameters derived from a real data example.

Download Full-text

Development of a computerized adaptive test to assess entrepreneurial personality

Psicologia: Reflexão e Crítica ◽

10.1186/s41155-020-00144-x ◽

2020 ◽

Vol 33 (1) ◽

Author(s):

Álvaro Postigo ◽

Marcelino Cuesta ◽

Ignacio Pedrosa ◽

José Muñiz ◽

Eduardo García-Cueto

Keyword(s):

Computerized Adaptive Test ◽

Adaptive Test

Download Full-text

Convergent Validity of the Patient-Reported Outcomes Measurement Information System's Physical Function Computerized Adaptive Test for the Knee and Shoulder Injury Sports Medicine Patient Population

Arthroscopy The Journal of Arthroscopic and Related Surgery ◽

10.1016/j.arthro.2016.08.032 ◽

2017 ◽

Vol 33 (3) ◽

pp. 608-616 ◽

Cited By ~ 15

Author(s):

Richard Judd Robins ◽

Mike B. Anderson ◽

Yingying Zhang ◽

Angela P. Presson ◽

Robert T. Burks ◽

...

Keyword(s):

Patient Population ◽

Sports Medicine ◽

Convergent Validity ◽

Patient Reported Outcomes ◽

Measurement Information ◽

Shoulder Injury ◽

Computerized Adaptive Test ◽

Outcomes Measurement ◽

Adaptive Test ◽

Patient Reported

Download Full-text

Computerized adaptive test for patients with knee impairments produced valid and responsive measures of function

Journal of Clinical Epidemiology ◽

10.1016/j.jclinepi.2008.01.005 ◽

2008 ◽

Vol 61 (11) ◽

pp. 1113-1124 ◽

Cited By ~ 45

Author(s):

Dennis L. Hart ◽

Ying-Chih Wang ◽

Paul W. Stratford ◽

Jerome E. Mioduski

Keyword(s):

Computerized Adaptive Test ◽

Adaptive Test

Download Full-text

Item Pool Development for the School-Aged Life Impact Burn Recovery Evaluation (SA- LIBRE5-12) Profile Computerized Adaptive Test (CAT): An Observer-Reported Outcome Assessment Measuring the Impact of Burn Injuries in School-Aged Children

Journal of Burn Care & Research ◽

10.1093/jbcr/irab247 ◽

2021 ◽

Author(s):

Silvanys L Rodríguez-Mercedes ◽

Khushbu F Patel ◽

Camerin A Rencken ◽

Gabrielle G Grant ◽

Kate Surette ◽

...

Keyword(s):

Conceptual Framework ◽

Critical Time ◽

Cognitive Interviews ◽

Item Pool ◽

Computerized Adaptive Test ◽

School Aged Children ◽

Adaptive Test ◽

Life Impact ◽

The Impact ◽

Item Pools

Abstract Introduction The transition from early childhood to teen years (5-12) is a critical time of development, which can be made particularly challenging by a burn injury. Assessing post-burn recovery during these years is important for improving pediatric survivors’ development and health outcomes. Few validated burn-specific measures exist for this age group. The purpose of this study was to generate item pools that will be used to create a future computerized adaptive test (CAT) assessing post-burn recovery in school-aged children. Methods Item pool development was guided by the previously developed School-Aged Life Impact Burn Recovery Evaluation (SA-LIBRE5-12) Conceptual Framework. The item pool development process involved a systematic literature review, extraction of candidate items from existing legacy measures, iterative item review during expert consensus meetings, and parent cognitive interviews. Results The iterative item review with experts consisted of six rounds. A total of 10 parent cognitive interviews were conducted. The three broad themes of concern were items that needed 1) clarification, needed context or were vague, 2) age dependence and relevance, and 3) word choice. The cognitive interviews indicated that survey instructions, recall period, item stem, and response choices were interpretable by respondents. Final item pool based on parental feedback consist of 57, 81, and 60 items in Physical, Psychological, and Family and Social Functioning respectively. Conclusion Developed item pools (n=198) in three domains are consistent with the existing conceptual framework. The next step involves field-testing the item pool and calibration using item response theory to develop and validate the SA-LIBRE5-12 CAT Profile.

Download Full-text