scholarly journals Some recommendations for developing multidimensional computerized adaptive tests for patient-reported outcomes

2018 ◽  
Vol 27 (4) ◽  
pp. 1055-1063 ◽  
Author(s):  
Niels Smits ◽  
Muirne C. S. Paap ◽  
Jan R. Böhnke
2017 ◽  
Vol 44 (7) ◽  
pp. 1024-1031 ◽  
Author(s):  
Shanthini Kasturi ◽  
Jackie Szymonifka ◽  
Jayme C. Burket ◽  
Jessica R. Berman ◽  
Kyriakos A. Kirou ◽  
...  

Objective.The aims of this study were to assess the construct validity and the test-retest reliability of Patient Reported Outcomes Measurement Information System (PROMIS) computerized adaptive tests (CAT) in patients with systemic lupus erythematosus (SLE).Methods.Adults with SLE completed the Medical Outcomes Study Short Form-36, LupusQoL-US version (“legacy instruments”), and 14 selected PROMIS CAT. Using Spearman correlations, PROMIS CAT were compared with similar domains measured with legacy instruments. CAT were also correlated with the Safety of Estrogens in Lupus Erythematosus National Assessment–Systemic Lupus Erythematosus Disease Activity Index (SELENA-SLEDAI) disease activity and the Systemic Lupus International Collaborating Clinics/American College of Rheumatology Damage Index (SDI) scores. Test-retest reliability was evaluated using ICC.Results.There were 204 outpatients with SLE enrolled in the study and 162 completed a retest. PROMIS CAT showed good performance characteristics and moderate to strong correlations with similar domains in the 2 legacy instruments (r = −0.49 to 0.86, p < 0.001). However, correlations between PROMIS CAT and the SELENA-SLEDAI disease activity and SDI were generally weak and statistically insignificant. PROMIS CAT test-retest ICC were good to excellent, ranging from 0.72 to 0.88.Conclusion.To our knowledge, these data are the first to show that PROMIS CAT are valid and reliable for many SLE-relevant domains. Importantly, PROMIS scores did not correlate well with physician-derived measures. This disconnect between objective signs and symptoms and the subjective patient disease experience underscores the crucial need to integrate patient-reported outcomes into clinical care to ensure optimal disease management.


Lupus ◽  
2018 ◽  
Vol 27 (10) ◽  
pp. 1591-1599 ◽  
Author(s):  
S Kasturi ◽  
J C Burket ◽  
J R Berman ◽  
K A Kirou ◽  
A B Levine ◽  
...  

Objective The aims of this study were to assess the feasibility of administering Patient-Reported Outcomes Measurement Information System (PROMIS®) computerized adaptive tests (CATs) to outpatients with systemic lupus erythematosus (SLE). Methods Adults with SLE were recruited during routine outpatient visits at an SLE Center of Excellence. Participants completed 14 PROMIS CATs and provided feedback on their experience. Differences in socio-demographic and clinical characteristics between participants and non-participants were evaluated. Results A total of 204 (86%) of 238 socioeconomically and racially diverse SLE patients completed PROMIS CATs. There were no significant differences between participants and non-participants. Time constraints were cited most frequently as reasons for non-participation. More than 75% of individuals submitted positive comments, including approval of the content and format of questions, and the survey’s promotion of self-reflection. A minority of participants cited challenges, most often related to question phrasing (8%) and technical difficulties (6%). Conclusions The administration of PROMIS CATs was feasible and positively received in a diverse cohort of SLE outpatients. Neither socio-demographic nor disease characteristics were significant barriers to successful completion of PROMIS CATs. PROMIS CATs have great potential for efficiently measuring important patient-centered outcomes in routine clinical care of a wide range of SLE patients.


2017 ◽  
Vol 2 (3) ◽  
pp. 2473011417S0000
Author(s):  
Andrew Haskell ◽  
Todd S. Kim

Category: Outcomes Measurement Introduction/Purpose: The importance of patient reported outcomes (PROs) has become increasingly recognized as an important tool to measure our clinical value. The National Institute of Health (NIH) created the Patient-Reported Outcomes Measurement Information System (PROMIS), a series of validated item banks, to help clinicians and researches measure key clinical domains. The PROMIS computer adaptive tests (CAT) may be administered with minimal resources or administrative burden. This study describes the results of administering computer adaptive tests (CAT) to every patient in a high volume Orthopedic Surgery practice. We test the hypotheses that both non-operative treatment and operative treatments improve PRO scores. Furthermore, we test the hypothesis that preoperative scores in these domains may be used to predict chances of improvement after surgery. Methods: The PROMIS CAT was administered prospectively for all patients as part of standard clinic intake and recorded in the patient’s electronic medical record (EMR) at each clinic visit. The PROMIS item banks are normalized to mean 50±10 for the US population. De-identified data was retrospectively extracted from the EMR including PROMIS scores, demographic information, as well as surgery specific information. As of this submission, 1688 PROMIS CATs from March 2015 to September 2016 have been analyzed. Data for initial and final clinic visits, as well as for the final preoperative visit for patients who had surgery, are compared using Wilcoxon Matched Pairs Test for paired samples and Mann-Whitney U Test for unpaired samples. Linear regression is used to assess the association of initial values to change in value after treatment. The effect of stratified initial clinic domain value on odds of improving with surgery is assessed using Analysis of Variance. Results: Non-surgical and surgical patients present with similar pain intensity (49.6±7.9 vs. 49.4±7.8). Surgical patients do not improve prior to surgery, but both improve by their final visit (45.7±7.5, 43.7±8.8, p<0.05). Non-surgical and surgical patients present with similar pain interference (60.0±8.4 vs. 60.3±8.9). Surgical patients do not improve prior to surgery, but both improve by their final visit (56.9±8.8, 54.3±9.4, p<0.05). For surgical patients, change in pain intensity and pain interference correlate with initial values (R2 0.32 and 0.27, p<0.05). The percentage whose pain intensity improves after surgery when initial value is over one SD worse than mean is 96%, within one SD worse than mean is 81%, within one SD better than mean is 56%, and over one SD better than mean is 40% (p<0.05). Conclusion: Both non-operative and operative orthopedic treatments improve patient reported pain intensity and pain interference. For patients that have surgery, patients that present with more severe symptoms tend to improve more with surgery. Furthermore, the odds of improving after surgery can be calculated based on preoperative PRO scores. This may allow surgeons to counsel patients about the potential benefits of surgery with personalized precision that is currently unavailable. Measuring PROs using PROMIS CATs demonstrates the value of both non-operative and operative Orthopedic Surgery care for our patients. Preoperative PRO scores may predict the odds of successful surgical intervention.


2014 ◽  
Vol 20 (8) ◽  
pp. 1102-1111 ◽  
Author(s):  
Angela Senders ◽  
Douglas Hanes ◽  
Dennis Bourdette ◽  
Ruth Whitham ◽  
Lynne Shinto

Background: Patient-reported outcomes are important for clinical research and care, yet administering and scoring the questionnaires requires considerable effort and time. The Patient Reported Outcomes Measurement Information System (PROMIS) could considerably reduce administrative obstacles and lessen survey burden for participants. Objective: Assess the feasibility and validity of PROMIS, compared to commonly-used legacy measures for multiple sclerosis (MS). Methods: In this cross-sectional survey, 133 participants with confirmed MS completed legacy surveys and PROMIS Computerized Adaptive Tests (CATs) for depression, anxiety, pain, fatigue and physical function. We conducted a multi-trait, multi-method analysis and verified results with confirmatory factor analysis. Results: The correlations between PROMIS and the corresponding legacy measures were large (0.67 to 0.87). The multi-trait, multi-method criteria were generally well met, providing good evidence of the validity of PROMIS measures. PROMIS surveys asked fewer questions and required substantially less time to complete than the legacy scales. Conclusions: Our results provide evidence of the construct validity of PROMIS for use with MS patients. Several aspects of the PROMIS CATs made them an important resource, including: (a) less time was required to complete them; (b) missing data was reduced; and (c) the automatic scoring referenced the general population. Our findings support the use of PROMIS in MS research and may have broader implications for clinical care, as well.


Sign in / Sign up

Export Citation Format

Share Document