Item Pool Development for the School-Aged Life Impact Burn Recovery Evaluation (SA- LIBRE5-12) Profile Computerized Adaptive Test (CAT): An Observer-Reported Outcome Assessment Measuring the Impact of Burn Injuries in School-Aged Children

2021 ◽  
Author(s):  
Silvanys L Rodríguez-Mercedes ◽  
Khushbu F Patel ◽  
Camerin A Rencken ◽  
Gabrielle G Grant ◽  
Kate Surette ◽  
...  
Keyword(s):  
Conceptual Framework ◽  
Critical Time ◽  
Cognitive Interviews ◽  
Item Pool ◽  
Computerized Adaptive Test ◽  
School Aged Children ◽  
Adaptive Test ◽  
Life Impact ◽  
The Impact ◽  
Item Pools

Abstract Introduction The transition from early childhood to teen years (5-12) is a critical time of development, which can be made particularly challenging by a burn injury. Assessing post-burn recovery during these years is important for improving pediatric survivors’ development and health outcomes. Few validated burn-specific measures exist for this age group. The purpose of this study was to generate item pools that will be used to create a future computerized adaptive test (CAT) assessing post-burn recovery in school-aged children. Methods Item pool development was guided by the previously developed School-Aged Life Impact Burn Recovery Evaluation (SA-LIBRE5-12) Conceptual Framework. The item pool development process involved a systematic literature review, extraction of candidate items from existing legacy measures, iterative item review during expert consensus meetings, and parent cognitive interviews. Results The iterative item review with experts consisted of six rounds. A total of 10 parent cognitive interviews were conducted. The three broad themes of concern were items that needed 1) clarification, needed context or were vague, 2) age dependence and relevance, and 3) word choice. The cognitive interviews indicated that survey instructions, recall period, item stem, and response choices were interpretable by respondents. Final item pool based on parental feedback consist of 57, 81, and 60 items in Physical, Psychological, and Family and Social Functioning respectively. Conclusion Developed item pools (n=198) in three domains are consistent with the existing conceptual framework. The next step involves field-testing the item pool and calibration using item response theory to develop and validate the SA-LIBRE5-12 CAT Profile.

3 Development of School-Aged Life Impact Burn Recovery Evaluation (SA-LIBRE 5–12) Profile: Item Pool

2021 ◽  
Vol 42 (Supplement_1) ◽  
pp. S7-S8
Author(s):  
Silvanys L Rodríguez-Mercedes ◽  
Camerin A Rencken ◽  
Khushbu F Patel ◽  
Gabrielle G Grant ◽  
Erin M Kinney ◽  
...  
Keyword(s):  
Literature Review ◽  
Health Outcomes ◽  
Burn Injury ◽  
Critical Time ◽  
Expert Consensus ◽  
World Health ◽  
Cognitive Interviews ◽  
Item Pool ◽  
School Aged Children ◽  
Life Impact

Abstract Introduction The transition from early childhood to teen years (5–12) is a critical time of development, which can be made particularly challenging by a burn injury. Currently, few validated standardized measures exist for this age group. This study aimed to generate item pools to create a computer adaptive test (CAT) assessing post-burn recovery in school-aged children. Methods Item pool development was based on the School-Aged Life Impact Burn Recovery Evaluation (SA-LIBRE5-12) Conceptual Model and the World Health Organization’s International Classification of Functioning, Disability, and Health for Children and Youth. Additional elements included a literature review, expert consensus meetings, and parent cognitive interviews. Candidate items assessing health outcomes were extracted from existing legacy measures during the literature review. Details of expert consensus meetings and parent cognitive interviews are in Table 1. Results Items assessing health outcomes (n=3,732) were extracted during the literature review. Experts binned items across three domains: 1) Physical Functioning (55 items), 2) Psychological Functioning (80 items), and 3) Family and Social Functioning (57 items). Six cognitive interviews were conducted. Qualitative data resulted in further review of 86 items. The results of the cognitive interviews indicated that item stems and response choices were interpretable by respondents. Conclusions This study developed an item pool (n=192) to assess post-burn recovery of school-aged children. The next step in the SA-LIBRE5-12 CAT Profile development will be field-testing for the calibration and item response theory-based validation of the assessment.

scholarly journals Quality of Item Pool (QIP) Index: A Novel Approach to Evaluating CAT Item Pool Adequacy

2019 ◽  
Vol 79 (6) ◽  
pp. 1133-1155
Author(s):  
Emre Gönülateş
Keyword(s):  
Simulation Studies ◽  
Item Pool ◽  
Adaptive Tests ◽  
Computerized Adaptive Test ◽  
Computerized Adaptive Tests ◽  
Adaptive Test ◽  
Test Specifications ◽  
Novel Approach ◽  
Item Pools

This article introduces the Quality of Item Pool (QIP) Index, a novel approach to quantifying the adequacy of an item pool of a computerized adaptive test for a given set of test specifications and examinee population. This index ranges from 0 to 1, with values close to 1 indicating the item pool presents optimum items to examinees throughout the test. This index can be used to compare different item pools or diagnose the deficiencies of a given item pool by quantifying the amount of deviation from a perfect item pool. Simulation studies were conducted to evaluate the capacity of this index for detecting the inadequacies of two simulated item pools. The value of this index was compared with the existing methods of evaluating the quality of computerized adaptive tests (CAT). Results of the study showed that the QIP Index can detect even slight deviations between a proposed item pool and an optimal item pool. It can also uncover shortcomings of an item pool that other outcomes of CAT cannot detect. CAT developers can use the QIP Index to diagnose the weaknesses of the item pool and as a guide for improving item pools.

Optimizing measurement of vision-related quality of life: a computerized adaptive test for the impact of vision impairment questionnaire (IVI-CAT)

2019 ◽  
Vol 29 (3) ◽  
pp. 765-774 ◽  
Author(s):  
Eva K. Fenwick ◽  
Bao Sheng Loe ◽  
Jyoti Khadka ◽  
Ryan E. K. Man ◽  
Gwyn Rees ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Vision Impairment ◽  
Computerized Adaptive Test ◽  
Adaptive Test ◽  
Related Quality ◽  
The Impact

Psychometric evaluation of the EORTC computerized adaptive test (CAT) fatigue item pool

2013 ◽  
Vol 22 (9) ◽  
pp. 2443-2454 ◽  
Author(s):  
Morten Aa. Petersen ◽  
Johannes M. Giesinger ◽  
Bernhard Holzner ◽  
Juan I. Arraras ◽  
Thierry Conroy ◽  
...  
Keyword(s):  
Psychometric Evaluation ◽  
Item Pool ◽  
Computerized Adaptive Test ◽  
Adaptive Test

776 A New Outcome Metric for Young Children with Burns: Item Pool Development for the Preschool Life Impact Burn Recovery Evaluation (LIBRE) Computer Adaptive Test (CAT) Profile

2020 ◽  
Vol 41 (Supplement_1) ◽  
pp. S222-S223
Author(s):  
Gabrielle G Grant ◽  
Keri Brady ◽  
Frederick Stoddard ◽  
Walter Meyer ◽  
Kathleen S Romanowski ◽  
...  
Keyword(s):  
Language Development ◽  
Social Functioning ◽  
Psychological Functioning ◽  
Burn Injury ◽  
Developmental Outcomes ◽  
Item Pool ◽  
Response Options ◽  
Computer Adaptive Test ◽  
Adaptive Test ◽  
Item Pools

Abstract Introduction The assessment of recovery from burn injury is critical to improving pediatric health. However, there is a lack of brief, burn-specific measures to assess preschool-aged burn survivors’ health outcomes. We developed items pools for a new, parent-reported computer adaptive test based assessment of preschool-aged children’s burn outcomes. Methods Initial item pools were informed by the Preschool LIBRE Conceptual Model based on the International Classification for Children (ICF) and the Burn Outcomes Questionnaires (BOQ 0–5) and generated from a review of existing instruments assessing health and developmental outcomes in children 1–5 years. Candidate items underwent a review process to bin items together based on the underlying construct they assessed. Items were then winnowed down and further refined based on clinical expert consensus meetings. The winnowing process focused on ensuring items assessed abilities and behaviors that could be reliably determined by parent report, were age-relevant, and focused on health and developmental concepts that are important in the assessment of children’s burn recovery. To ensure item quality, we conducted parent cognitive interviews. In final reviews, we standardized item recall periods, response options, verb tense, and literacy demands. Results A total of 9,509 items were identified and extracted. Four item pool domains were established: communication and language development (42 items), physical functioning (53 items), psychological functioning (56 items), and social functioning (37 items). The respective item pools aim to assess: children’s ability to receive meaning and produce language; children’s gross and fine motor abilities; children’s emotions and behavior (internalizing and externalizing behaviors, dysregulation, toileting, response to trauma and resilience); and children’s social participation and abilities. Recall period and response options were refined for consistency for all 188 final items. Conclusions Four item pools were developed assessing four domains 1) communication and language development, 2) physical functioning, 3) psychological functioning and 4) social functioning for preschool-aged children. The item pools are currently being field-tested for the calibration and validation of the Preschool LIBRE CAT Profile. Applicability of Research to Practice This work is relevant to researchers and practitioners evaluating the effects of burn injury on preschool-aged children’s health and developmental outcomes.

scholarly journals The Optimal Item Pool Design in Multistage Computerized Adaptive Tests With the p-Optimality Method

2020 ◽  
Vol 80 (5) ◽  
pp. 955-974
Author(s):  
Lihong Yang ◽  
Mark D. Reckase
Keyword(s):  
Exposure Control ◽  
Item Pool ◽  
Adaptive Tests ◽  
Computerized Adaptive Test ◽  
Computerized Adaptive Tests ◽  
Statistical Measures ◽  
Scoring Accuracy ◽  
Item Pools ◽  
Item Pool Design ◽  
The Rasch Model

The present study extended the p-optimality method to the multistage computerized adaptive test (MST) context in developing optimal item pools to support different MST panel designs under different test configurations. Using the Rasch model, simulated optimal item pools were generated with and without practical constraints of exposure control. A total number of 72 simulated optimal item pools were generated and evaluated by an overall sample and conditional sample using various statistical measures. Results showed that the optimal item pools built with the p-optimality method provide sufficient measurement accuracy under all simulated MST panel designs. Exposure control affected the item pool size, but not the item distributions and item pool characteristics. This study demonstrated that the p-optimality method can adapt to MST item pool design, facilitate the MST assembly process, and improve its scoring accuracy.

Sign in / Sign up

Export Citation Format

Share Document