Bridging health technology assessment and healthcare quality improvement using international consortium of health outcomes measurement standard sets

Objective Although health technology assessment (HTA) and healthcare quality improvement are distinct processes, a greater level of alignment in outcome measures used may increase the quality and efficiency of data collection. This study evaluates the agreement in outcome measures used in oncology for healthcare quality improvement and HTAs, and how these align to the International Consortium for Health Outcomes Measurement (ICHOM) standard sets. Methods We conducted a cross-sectional comparative analysis of ICHOM sets focusing on oncological indications and publicly available measures for healthcare quality and HTA reports published by the National Health Care Institute from the Netherlands and the National Institute for Health and Care Excellence from the United Kingdom. Results All ICHOM sets and HTAs used overall survival, whereas quality improvement used different survival estimates. Different progression estimates for cancer were used in HTAs, ICHOM sets, and quality improvement. Data on health-related quality of life (HRQoL) was recommended in all ICHOM sets and all HTAs, but selectively for quality improvement. In HTAs, generic HRQoL questionnaires were preferred, whereas, in quality improvement and ICHOM sets, disease-specific questionnaires were recommended. Unfavorable outcomes were included in all HTAs and all ICHOM sets, but not always for quality improvement. Conclusions Although HTA and quality improvement use outcome measures from the same domains, a greater level of alignment seems possible. ICHOM may provide input on standardized outcome measures to support this alignment. However, residual discrepancies will remain due to the different objectives of HTA and quality improvement.

Validity and reliability of patient reported outcomes measurement information system computerized adaptive tests in systemic lupus erythematous

Background The evaluation of Patient Reported Outcomes Measurement Information System (PROMIS) computerized adaptive test (CAT) in adults with systemic lupus erythematous (SLE) is an emerging field of research. We aimed to examine the test–retest reliability and construct validity of the PROMIS CAT in a Canadian cohort of patients with SLE. Methods Two hundred twenty-seven patients completed 14 domains of PROMIS CAT and seven legacy instruments during their clinical visits. Test–retest reliability of PROMIS was evaluated 7–10 days from baseline using intraclass correlation coefficient (ICC (2; 1)). The construct validity of the PROMIS CAT domains was evaluated against the commonly used legacy instruments, and also in comparison to disease activity and disease damage using Spearman correlations. A multitrait-multimethod matrix (MMM) approach was used to further assess construct validity comparing selected 10 domains of PROMIS and SF-36 domains. Results Moderate to excellent reliability was found for all domains (ICC [2;1] ranging from lowest, 0.66 for Sleep Disturbance and highest, 0.93 for the Mobility domain). Comparing seven legacy instruments with 14 domains of PROMIS CAT, moderate to strong correlations (0.51–0.91) were identified. The average time to complete all PROMIS CAT domains was 11.7 min. The MMM further established construct validity by showing moderate to strong correlations (0.55–0.87) between select PROMIS and SF-36 domains; the average correlations from similar traits (convergent validity) were significantly greater than the average correlations from different traits. Conclusions These results provide evidence on the reliability and validity of PROMIS CAT in SLE in a Canadian cohort.

Which outcomes are most important to measure in patients with COVID-19 and how and when should these be measured? Development of an international standard set of outcomes measures for clinical use in patients with COVID-19: a report of the International Consortium for Health Outcomes Measurement (ICHOM) COVID-19 Working Group

ObjectivesThe COVID-19 pandemic has resulted in widespread morbidity and mortality with the consequences expected to be felt for many years. Significant variation exists in the care even of similar patients with COVID-19, including treatment practices within and between institutions. Outcome measures vary among clinical trials on the same therapies. Understanding which therapies are of most value is not possible unless consensus can be reached on which outcomes are most important to measure. Furthermore, consensus on the most important outcomes may enable patients to monitor and track their care, and may help providers to improve the care they offer through quality improvement. To develop a standardised minimum set of outcomes for clinical care, the International Consortium for Health Outcomes Measurement (ICHOM) assembled a working group (WG) of 28 volunteers, including health professionals, patients and patient representatives.DesignA list of outcomes important to patients and professionals was generated from a systematic review of the published literature using the MEDLINE database, from review of outcomes being measured in ongoing clinical trials, from a survey distributed to patients and patient networks, and from previously published ICHOM standard sets in other disease areas. Using an online-modified Delphi process, the WG selected outcomes of greatest importance.ResultsThe outcomes considered by the WG to be most important were selected and categorised into five domains: (1) functional status and quality of life, (2) mental functioning, (3) social functioning, (4) clinical outcomes and (5) symptoms. The WG identified demographic and clinical variables for use as case-mix risk adjusters. These included baseline demographics, clinical factors and treatment-related factors.ConclusionImplementation of these consensus recommendations could help institutions to monitor, compare and improve the quality and delivery of care to patients with COVID-19. Their consistent definition and collection could also broaden the implementation of more patient-centric clinical outcomes research.

Psychometrics of three Swedish physical pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)®: pain interference, fatigue, and physical activity

Background The Patient-Reported Outcomes Measurement Information System (PROMIS®) aims to provide self-reported item banks for several dimensions of physical, mental and social health. Here we investigate the psychometric properties of the Swedish pediatric versions of the Physical Health item banks for pain interference, fatigue and physical activity which can be used in school health care and other clinical pediatric settings. Physical health has been shown to be more important for teenagers’ well-being than ever because of the link to several somatic and mental conditions. The item banks are not yet available in Sweden. Methods 12- to 19-year-old participants (n = 681) were recruited in public school settings, and at a child- and psychiatric outpatient clinic. Three one-factor models using CFA were performed to evaluate scale dimensionality. We analyzed monotonicity and local independence. The items were calibrated by fitting the graded response model. Differential Item analyses (DIF) for age, gender and language were calculated. Results As part of the three one-factor models, we found support that each item bank measures a unidimensional construct. No monotonicity or local dependence were found. We found that 11 items had significant lack of fit in the item response theory (IRT) analyses. The result also showed DIF for age (seven items) and language (nine items). However, the differences on item fits and effect sizes of McFadden were negligible. After considering the analytic results, graphical illustration, item content and clinical relevance we decided to keep all items in the item banks. Conclusions We translated and validated the U.S. PROMIS item banks pain interference, fatigue and physical activity into Swedish by applying CFA, IRT and DIF analyses. The results suggest adequacy of the translations in terms of their psychometrics. The questionnaires can be used in school health and other pediatric care. Future studies can be to use Computerized Adaptive Testing (CAT), which provide fewer but reliable items to the test person compared to classical testing.

Well-Being of Ambulatory Adults With Cerebral Palsy: Education, Employment, and Physical Function of a Cohort Who Received Specialized Pediatric Care

Introduction: The transition from pediatric health care and school systems presents enormous challenges for young adults with cerebral palsy (CP). The lack of strong societal support during this seminal life event is well-documented and leads many adults with CP to struggle with independence, higher education, and employment. Despite the relatively high prevalence of CP, information about the experiences and function of adults with CP in our society continues to be limited. The purpose of this project was to describe well-being by assessing education, employment, physical function, walking activity, and utilization of health care in an ambulatory adult cohort with CP who received specialized pediatric care at our center.Method: In this Institutional Review Board-approved prospective study, we invited former patients from our tertiary care pediatric CP center to complete a set of patient-reported outcomes including (1) the Patient-Reported Outcomes Measurement Information System domains of physical function and pain interference, (2) the Satisfaction with Life Scale, and a project-specific demographic questionnaire about education, employment, income, independence, pain, and health care utilization. Participants also wore a pedometer for 8 days to monitor community walking activity. Chi-squared pairwise or t-tests were used as appropriate to compare survey responses and walking activity data between three groups: participants who self-reported, those who reported by proxy, and published normative data from age-matched typically developing adult (TDA) samples.Results: One hundred twenty-six adults with CP consented to participate; 85 self-reported [age 29.7 ± 4.3 years; Gross Motor Function Classification System: I (28%), II (47%), and III, (25%)] and 41 reported by proxy [age 29.7 ± 4.1 years; Gross Motor Function Classification System: I (10%), II (68%), and III (22%)]. For the group who self-reported, high school graduation rate (99%) was similar to TDA (92%; p = 0.0173) but bachelor's degree achievement rate (55%) was higher than TDA (37%; p < 0.001). Despite more advanced education, the unemployment rate in this group was higher than national levels at 33% and was associated with high utilization of Social Security Disability Insurance (33%). Within the self-reporting group, 13% required a caregiver. For the group who reported by proxy, educational levels (73% high school graduates, 0 bachelor's degree) were lower than the general population (p < 0.001) and unemployment was higher than the national level, at 64%. Unemployment in this group was associated with high utilization of Social Security Disability Insurance (85%). Within the proxy-reporting group, 71% required a caregiver. The full cohort demonstrated lower levels of physical function according to the Patient-Reported Outcomes Measurement Information System and less community walking activity compared with TDA references (p < 0.001). This cohort of adults with CP reported significantly higher frequency of chronic pain (48 vs. 12% for TDA; p < 0.001), but less pain interference with daily activities than TDA based on Patient-Reported Outcomes Measurement Information System results (p < 0.001). This cohort reported good to excellent overall health (93%) and high utilization of primary care (98%), but limited utilization of specialty care, specifically orthopedic care (21%) and physical therapy (15%).Discussion: This cohort of adults with CP had similar levels of education as the general population, but had relatively high rates of unemployment, caretaker need, and Social Security Disability Insurance utilization. Although chronic pain was frequent, the impact of pain on work and independent living did not exceed reports from a typically developing reference. Better targeted societal resources for adults with physical disabilities are urgently needed to allow equitable access to employment, promote opportunities for independence, and enable full participation in community life.