Measuring Duchenne muscular dystrophy impact: development of a proxy-reported measure derived from PROMIS item banks

Background Person-reported outcomes measurement development for rare diseases has lagged behind that of more common diseases. In studies of caregivers of patients with rare diseases, one relies on proxy report to characterize this disability. It is important to measure the child’s disability accurately and comprehensively because it affects caregiver burden. We aimed to create a condition-specific caregiver proxy-report measure for Duchenne Muscular Dystrophy (DMD) in order to understand the impact of DMD on the caregiver. Drawing on relevant item banks from the Patient-Reported Outcome Measurement Information System (PROMIS), we sought to confirm their reliability and validity in the target sample of DMD caregivers. Methods This web-based study recruited DMD caregivers via Rare Patient Voice, patient-advocacy groups, and word of mouth. Recruitment was stratified by age of the caregiver’s child with DMD, which broadly represents stages of DMD progression: 2–7, 8–12, 13–17, and > 18. Telephone interviews with DMD parent-caregivers pretested possible measures for content validity. The web-based study utilized an algorithm to categorize respondents’ ambulatory status for tailored administration of PROMIS Parent-Proxy items as well as some new items developed based on caregiver interviews. Item response theory analyses were implemented. Results The study sample included 521 DMD caregivers representing equally the four age strata. The proxy-report measure included the following domains: fatigue impact, strength impact, cognitive function, upper extremity function, positive affect, negative affect, sleep-device symptoms, and mobility. The first five domains had strong psychometric characteristics (unidimensionality; acceptable model fit; strong standardized factor loadings; high marginal reliability). Negative Affect, covering anger, anxiety, depressive symptoms, and psychological stress, fit a bifactor model with good model fit, high marginal reliability, and strong factor loadings. The Sleep-device symptoms domain was not unidimensional, and the mobility domain did not have a simple structure due to residual correlations among items at opposite end of the mobility-disability continuum. These two domain scores were retained as clinimetric indices (i.e., uncalibrated scales), to achieve the overall goal of having a content-valid DMD-specific measure across all stages of disease severity. Conclusions The present study derived a DMD-specific proxy-report measure from PROMIS item banks and supplemental items that could potentially be utilized in caregiver research across all stages of the care recipient’s DMD. Future research will focus on assessing the responsiveness and validity of the measure over time and its comparison to DMD patient self-report.

The sensory-reactivity PROM set: identification of a parent reported outcome measure set for autism spectrum disorder

Background Most children with autism spectrum disorder (ASD) suffer from aberrant responses to sensory stimuli that significantly impact the quality of life. To develop sensory interventions, individually tailored outcome measures are crucially needed for the domain of sensory reactivity problems. Here, we describe the identification of relevant sensory themes according to caregivers of children with ASD according to the guidelines for developing a (parent proxy) patient-reported outcome measure set. Subsequently, we identify parallels between these themes and a well-validated and supported PROMIS® portal to facilitate implementation. Interviews with clinicians and focus groups and interviews with parents of children with ASD were used in the initial phase for concept elicitation. Codes and themes were generated by qualitative thematic data analysis on the transcripts and cognitive interviews with different parents were used for revisions. The resulting themes were compared to existing generic PROMIS-item banks and other existing questionnaires. Results A total of 11 parent-reported outcomes were identified that could be either classified as directly or indirectly related to sensory reactivity. Directly related themes comprised of: (1) sensory stimulation tolerance and (2) sensitivity to sensory stimuli. Indirectly related themes were: (3) irritable behavior (4) anxiety problems (5) mood problems (6) sleep problems (7) fatigue (8) physical complaints (9) daily functioning and participation (10) routines, structure and dealing with change and (11) problems in social interaction and communication. Seven out of 11 themes could be measured with generic PROMIS item banks. The four remaining outcomes (sensory stimulation tolerance; irritable behaviour; routines, structure and dealing with change; and sensitivity to sensory stimuli) were found suitable to be inventoried by existing PROMs. Conclusion The majority of parent-reported problems seemed related to indirect consequences of sensory reactivity, which are suitable to be measured with generic item banks. In sum, we identified a sensory-reactivity PROM (parent-proxy) set consisting of PROMIS® item banks and additional domains that together form a comprehensive and readily available outcome set for sensory reactivity problems in children with ASD.

Psychometrics of three Swedish physical pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)®: pain interference, fatigue, and physical activity

Background The Patient-Reported Outcomes Measurement Information System (PROMIS®) aims to provide self-reported item banks for several dimensions of physical, mental and social health. Here we investigate the psychometric properties of the Swedish pediatric versions of the Physical Health item banks for pain interference, fatigue and physical activity which can be used in school health care and other clinical pediatric settings. Physical health has been shown to be more important for teenagers’ well-being than ever because of the link to several somatic and mental conditions. The item banks are not yet available in Sweden. Methods 12- to 19-year-old participants (n = 681) were recruited in public school settings, and at a child- and psychiatric outpatient clinic. Three one-factor models using CFA were performed to evaluate scale dimensionality. We analyzed monotonicity and local independence. The items were calibrated by fitting the graded response model. Differential Item analyses (DIF) for age, gender and language were calculated. Results As part of the three one-factor models, we found support that each item bank measures a unidimensional construct. No monotonicity or local dependence were found. We found that 11 items had significant lack of fit in the item response theory (IRT) analyses. The result also showed DIF for age (seven items) and language (nine items). However, the differences on item fits and effect sizes of McFadden were negligible. After considering the analytic results, graphical illustration, item content and clinical relevance we decided to keep all items in the item banks. Conclusions We translated and validated the U.S. PROMIS item banks pain interference, fatigue and physical activity into Swedish by applying CFA, IRT and DIF analyses. The results suggest adequacy of the translations in terms of their psychometrics. The questionnaires can be used in school health and other pediatric care. Future studies can be to use Computerized Adaptive Testing (CAT), which provide fewer but reliable items to the test person compared to classical testing.

Swedish translation and cross-cultural adaptation of eight pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)®

Background This study is part of the Swedish initiative for the establishment of standardized, modern patient-reported measures for national use in Swedish healthcare. The goal was to translate and culturally adapt eight pediatric Patient-Reported Outcomes Measurement Information System (PROMIS®) item banks (anger, anxiety, depressive symptoms, family relationships, fatigue, pain interference, peer relationships and physical activity) into Swedish. Methods Authorization to translate all currently available pediatric PROMIS item banks (autumn, 2016) into Swedish was obtained from the PROMIS Health Organization. The translation followed the Functional Assessment of Chronic Illness Therapy translation recommendations with one major modification, which was the use of a bilingual multi-professional review workshop. The following steps were applied: translation, reconciliation, a two-day multi professional reviewer workshop, back translation, and cognitive debriefing with eleven children (8–17 years) before final review. The bilingual multi-professional review workshop provided a simultaneous, in-depth assessment from different professionals. The group consisted of questionnaire design experts, researchers experienced in using patient-reported measures in healthcare, linguists, and pediatric healthcare professionals. Results All item banks had translation issues that needed to be resolved. Twenty-four items (20.7%) needed resolution at the final review stage after cognitive debriefing. The issues with translations included 1. Lack of matching definitions with items across languages (6 items); 2. Problems related to language, vocabulary, and cultural differences (6 items); and 3. Difficulties in adaptation to age-appropriate language (12 items). Conclusions The translated and adapted versions of the eight Swedish pediatric PROMIS item banks are linguistically acceptable. The next stage will be cross-cultural validation studies in Sweden. Despite the fact that there are cultural differences between Sweden and the United States, our translation processes have successfully managed to address all issues. Expert review groups from already-established networks and processes regarding pediatric healthcare throughout the country will facilitate the future implementation of pediatric PROMIS item banks in Sweden.

Patients’ and parents’ perspective on the implementation of Patient Reported Outcome Measures in pediatric clinical practice using the KLIK PROM portal

Introduction The KLIK Patient Reported Outcome Measures (PROM) portal (www.hetklikt.nu) has been implemented since 2011 in clinical practice in over 20 Dutch hospitals. Patients and/or parents complete PROMs before the outpatient consultation and answers are subsequently discussed by clinicians during consultation. This study aims to provide insight into patients’ and parents’ perspective on the use of the KLIK PROM portal in order to optimize its implementation in pediatric clinical practice. Methods Patients (12–19 years) and parents (of children 0–19 years) from the Emma Children’s Hospital were invited to participate. A mixed-method design was used; (1) Focus groups were held and analyzed using thematic analysis in psychology, (2) a questionnaire was sent out and analyzed using descriptive statistics. Results (1) Eight patients and 17 parents participated. Patients mentioned that KLIK has an attractive layout. However, PROMs were sometimes considered irrelevant and repetitive. Parents valued that KLIK provides insight into their child’s functioning, but they were not satisfied with the extent to which PROMs were discussed by clinicians. (2) 31 patients and 130 parents completed the questionnaire. Overall, patients and parents reported a satisfaction score of 7.9/10 and 7.3/10, respectively. 81% of patients and 74% of parents indicated that KLIK is easy to use. Conclusion Patients and parents are generally satisfied with KLIK, however, points of improvement were mentioned. These are currently being addressed by e.g., upgrading the KLIK website, implementing PROMIS item banks in KLIK to reduce irrelevancy and repetitiveness of PROMs, and implementation strategies to improve the discussion-rate. In this way, implementation of the KLIK PROM portal can be further optimized, with the ultimate goal to improve quality of care.

Qualitative and psychometric approaches to evaluate the PROMIS pain interference and sleep disturbance item banks for use in patients with rheumatoid arthritis

Background Patients with rheumatoid arthritis (RA) commonly experience pain despite the availability of disease-modifying treatments. Sleep disturbances are frequently reported in RA, with pain often a contributing factor. The Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference and Sleep Disturbance item banks were initially developed to provide insights into the patient experience of pain and sleep, respectively, though they were not specifically intended for use in RA populations. This study evaluated the content validity of the PROMIS Pain Interference and Sleep Disturbance item banks in RA and identified relevant content for short forms for patients with RA that achieved high measurement precision across a broad range of health. Methods A qualitative approach consisting of hybrid concept elicitation and cognitive debriefing interviews was used to evaluate the content validity of the item banks in RA. Interviews were semi-structured and open-ended, allowing a range of concepts and responses to be captured. Findings from the qualitative interviews were used to select the most relevant items for the short forms, and psychometric evaluation, using existing item-response theory (IRT) item parameters, was used to evaluate the marginal reliability and measurement precision of the short forms across the range of the latent variables (i.e. pain interference and sleep disturbance). Results Thirty-two participants were interviewed. Participants reported that RA-related pain and sleep disturbances have substantial impacts on their daily lives, particularly with physical functioning. The PROMIS Pain Interference and Sleep Disturbance item banks were easy to understand and mostly relevant to their RA experiences, and the 7-day recall period was deemed appropriate. Qualitative and IRT-based approaches identified short forms for Pain Interference (11 items) and Sleep Disturbance (7 items) that had high relevance and measurement precision, with good coverage of the concepts identified by participants during concept elicitation. Conclusion Pain and sleep disturbances affect many aspects of daily life in patients with RA and should be considered when novel treatments are developed. This study supports the use of the PROMIS Pain Interference and Sleep Disturbance item banks in RA, and the short forms developed herein have the potential to be used in clinical studies of RA.