Do patient-reported outcome measures measure up? A qualitative study to examine perceptions and experiences with heart failure proms among diverse, low-income patients

Background The Kansas City Cardiomyopathy Questionnaire (KCCQ) is a Patient-Reported Outcome Measure (PROM) used to evaluate the health status of patients with heart failure (HF) but has predominantly been tested in settings serving predominately white, male, and economically well-resourced populations. We sought to examine the acceptability of the shorter version of the KCCQ (KCCQ-12) among racially and ethnically diverse patients receiving care in an urban, safety-net setting. Methods We conducted cognitive interviews with a diverse population of patients with heart failure in a safety net system to assess their perceptions of the KCCQ-12. We conducted a thematic analysis of the qualitative data then mapped themes to the Capability, Opportunity, Motivation Model of Behavior framework. Results We interviewed 18 patients with heart failure and found that patients broadly endorsed the concepts of the KCCQ-12 with minor suggestions to improve the instrument’s content and appearance. Although patients accepted the KCCQ-12, we found that the instrument did not adequately measure aspects of health care and quality of life that patients identified as being important components of managing their heart failure. Patient-important factors of heart failure management coalesced into three main themes: social support, health care environment, and mental health. Conclusions Patients from this diverse, low-income, majority non-white population experience unique challenges and circumstances that impact their ability to manage disease. In this study, patients were receptive to the KCCQ-12 as a tool but perceived that it did not adequately capture key health components such as mental health and social relationships that deeply impact their ability to manage HF. Further study on the incorporation of social determinants of health into PROMs could make them more useful tools in evaluating and managing HF in diverse, underserved populations.

The endometriosis daily diary: qualitative research to explore the patient experience of endometriosis and inform the development of a patient-reported outcome (PRO) for endometriosis-related pain

Purpose Endometriosis is a chronic disorder of the female reproductive system characterized by debilitating symptoms, particularly endometriosis-related pain (ERP). Patient-reported outcome (PRO) measures of symptoms and impacts are required to assess disease severity in ERP clinical studies and clinical practice. A content-valid instrument was developed by modifying the Dysmenorrhea Daily Diary (DysDD) to form the Endometriosis Daily Diary (EDD), an electronic PRO administered via handheld device. Methods Qualitative research with US females with ERP was conducted in three stages: (1) Development of an endometriosis conceptual model based on qualitative literature and conduct of concept elicitation (CE) interviews (N = 30). (2) Cognitive debriefing (CD) interviews (N = 30) conducted across two rounds to assess relevance and understanding of the EDD, with modifications between interview rounds. (3) Pilot testing to assess usability/feasibility of administrating the EDD daily on an electronic handheld device (N = 15). Clinical experts provided guidance throughout the study. Results The conceptual model provided a comprehensive summary of endometriosis to inform modifications to the DysDD, forming the EDD. CD results demonstrated that EDD items were relevant for most participants. Instructions, items, response scales, and recall period were well-understood. The resulting daily diary assesses severity of cyclic and non-cyclic pelvic pain, dyspareunia, impact of ERP on functioning and daily life, symptoms associated with ERP, and bowel symptoms. Participants were able to complete the diary daily and found the device easy to use. Conclusion The EDD demonstrated good content validity in females experiencing ERP. The next step is to perform psychometric validation in an ERP sample.

Patient-reported outcomes version of the common terminology criteria for adverse events and quality-of-life linear analogue self-assessment in breast cancer patients receiving radiation therapy: single-institution prospective registry

Purpose/objectives We sought to investigate the impact of patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE) on overall quality-of-life (QOL) employing linear analogue self-assessment (LASA) in breast cancer (BC) patients undergoing radiation therapy (RT). Materials/methods All patients treated with RT for BC with curative intent from 2015 to 2019 at our institution were included. Breast specific PRO-CTCAE and overall QOL LASA questionnaires were administered at baseline, end-of-treatment, 3, 6, 12 months, and then annually. Minimal clinically important difference in overall QOL was a 10-point change in LASA. Hypofractionation was any treatment > 2 Gy per fraction. Mixed models for repeated measures were used to determine the association of PRO-CTCAE and overall QOL LASA. Results Three hundred thirty-one (331) patients with a median follow-up of 3.1 years (range 0.4–4.9) were included. Average overall QOL LASA scores were 78.5 at baseline, 79.8 at end-of-treatment, 79.8 at 3 months, 77.1 at 6 months, 79.4 at 12 months, and 79.7 at 24 months. On univariate analysis, patients reporting a grade ≥ 3 PRO-CTCAE had, on average, a 10.4-point reduction in overall LASA QOL (p < 0.0001). On multivariate analysis, not being treated with hypofractionation and higher BMI were predictive for worse overall LASA QOL with a 10-point reduction in LASA for patients reporting a grade ≥ 3 PRO-CTCAE (p < 0.0001). Conclusions Patients reporting a grade ≥ 3 PRO-CTCAE experienced statistically significant and clinically meaningful deterioration in overall QOL LASA. Hypofractionation improved QOL while higher BMI predicted for worse QOL. PRO-CTCAE should be integrated into future clinical trials.

Adding a fatigue item to the EQ-5D-5L improves its psychometric performance in the general population

Background Fatigue is a common and often disturbing sequela of serious chronic health conditions. In the widely applied HRQL instrument, the EQ-5D, this aspect is not included directly, for its assumed lack of additional information. We investigated the validity of this assumption by determining the gain—if any—of an additional fatigue item to the EQ-5D-5L in a general population sample. Methods A Dutch general population sample (including diseased people) completed a web-based survey including the EQ-5D-5L and the Rivermead Post-Concussion Symptoms Questionnaire (RPQ). The RPQ fatigue item was used to create the EQ-5D-5L + Fatigue. We head-to-head compared the psychometric performance contrasting the EQ-5D-5L and EQ-5D-5L + Fatigue: distribution (e.g. ceiling), informativity cf. Shannon's indices, convergent validity, domain dependency, and explanatory power. Results were compared between subgroups with and without ≥ 1 chronic health condition. Results The study population consisted of 3027 persons of whom 52% had a chronic health condition. The mean EQ-5D-5L utility score was 0.83 and 48% experienced some degree of fatigue. Adding the fatigue item to the EQ-5D-5L decreased the ceiling effect, increased absolute informativity (Hʹ = 6.44 vs. Hʹ = 4.90) and relative informativity (Jʹ = 0.46 vs. Jʹ = 0.42). The extra fatigue item slightly increased convergent validity (Spearman’s rank correlation coefficient = − 0.61 vs. − 0.62). Domain dependency analysis showed that all EQ-5D-5L domains are dominant over the fatigue item. Explanatory power of the EQ-5D-5L + Fatigue was higher compared to the EQ-5D-5L (R2 = 0.42 vs. 0.39). The gain is substantially larger in the subgroup with chronic health conditions. Conclusions Adding a fatigue item to the EQ-5D-5L improved all psychometric performance criteria of the enriched instrument in the general population. Effects are substantially larger in the subgroup with chronic health conditions, indicating that adding a fatigue item to the EQ-5D-5L is especially relevant in evaluating the HRQL of diseased people.

The promise of computer adaptive testing in collection of orthopaedic outcomes: an evaluation of PROMIS utilization

Background A crucial component to improving patient care is better clinician understanding of patients’ health-related quality of life (HRQoL). In orthopaedic surgery, HRQoL assessment instruments such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), provide surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s HRQoL. PROMIS has been demonstrated as a valuable instrument in many diseases; however, the extent to which orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research is unclear. Methods Systematic scoping methodology was used to investigate the characteristics of studies using PROMIS to assess HRQoL measures as orthopaedic surgical outcomes as well as studies validating computerized adaptive test (CAT) PROMIS physical health (PH) domains including: Physical Function (PF), Upper Extremity (UE), Lower Extremity (LE). Results A systematic search of PubMed identified 391 publications utilizing PROMIS in orthopaedics; 153 (39%) were PROMIS PH CAT validation publications. One-hundred publications were in Hand and Upper Extremity, 69 in Spine, 44 in Adult Reconstruction, 43 in Foot and Ankle, 43 in Sports, 37 in Trauma, 31 in General orthopaedics, and 24 in Tumor. From 2011 through 2020 there was an upward trend in orthopaedic PROMIS publications each year (range, 1–153) and an increase in studies investigating or utilizing PROMIS PH CAT domains (range, 1–105). Eighty-five percent (n = 130) of orthopaedic surgery PROMIS PH CAT validation publications (n = 153) analyzed PF; 30% (n = 46) analyzed UE; 3% (n = 4) analyzed LE. Conclusions PROMIS utilization within orthopaedics as a whole has significantly increased within the past decade, particularly within PROMIS CAT domains. The existing literature reviewed in this scoping study demonstrates that PROMIS PH CAT domains (PF, UE, and LE) are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. The expanded use of PROMIS CATs in orthopaedic surgery highlights the potential for improved quality of patient care. While challenges of integrating PROMIS into electronic medical records exist, expanded use of PROMIS CAT measurement instruments throughout orthopaedic surgery should be performed. Plain english summary In orthopaedic surgery, health-related quality of life tools such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), offer patients an opportunity to better understand their medical condition and be involved in their own care. Additionally, PROMIS provides surgeons with a framework to assess how a treatment or medical condition is affecting each patient’s functional status and quality of life. The efficacy of PROMIS has been demonstrated in many diseases; however, its application throughout orthopaedic care has yet to be depicted. This study sought to identify the extent to which all orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research in order to identify its potential as an applicable and valuable tool across specialties. We determined that PROMIS utilization has significantly increased within the past decade. The existing literature reviewed in this scoping study demonstrates that the PROMIS computerized adaptive test domains evaluating physical function status are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. Based on these results, this study recommends the expanded and more uniform use of PROMIS computerized adaptive test measurement instruments in the clinical care of orthopaedic patients.

Developing a patient-driven chronic obstructive pulmonary disease (COPD) research agenda in the U.S.

Background To document a generalizable process for developing a patient-prioritized chronic obstructive pulmonary disease (COPD) research agenda and to provide an overview of domains that were developed in response to people living with COPD and caregivers’ suggestions for research. Methods Adults with COPD and caregivers who are members of the COPD Patient-Powered Research Network (PPRN) provided suggestions for COPD-related research through a self-administered, online survey. These responses were analyzed with a content analysis approach: domains for categorizing all survey responses were created, then all responses were categorized independently by a group of researchers, then these categorizations were adjudicated, and finally a density map was created that represented the number of responses in each of the domains. Results At the time of analysis, 6157 adults had fully completed the baseline survey. Survey responses were categorized across seven domains as follows: 22.5% of all responses fell into the domain family/social/community research, 20.8% of all responses fell into the domain well-being, 15% of all responses fell into the domain curative research, 14.6% of all responses fell into the domain biomedical therapies, 10.5% of all responses fell into the domain policy concerns, 6% of all responses fell into the domain holistic therapies and 10.7% of all responses fell into the domain ambiguous comments that could not be translated into concrete research topics. Conclusion Using qualitative open-ended survey responses from the COPD PPRN registrants, we were able to identify six key domains of research about COPD that are considered most important by patients. These domains differ in content from prior scientist-led efforts to develop priorities for COPD research, demonstrating the ongoing importance of involving patients and their caregivers in determining research priorities. The results suggest the field can more closely align research efforts to patient priorities by considering the identified domains.

Development, psychometric evaluation and cognitive debriefing of the rheumatoid arthritis symptom and impact questionnaire (RASIQ)

Background Rheumatoid arthritis (RA) is a chronic inflammatory disease often associated with persistent pain. There is a need for a patient-reported outcome measure (PROM) that is rooted in the patient experience and psychometrically validated. We describe the development of the Rheumatoid Arthritis Symptom and Impact Questionnaire (RASIQ), a novel PROM with potential to record key symptoms and impacts of RA with a 24-h recall period. Results A literature review identified RA concepts that patients considered most important to their disease experience, including pain, fatigue, joint swelling and stiffness. From this, an initial item pool (33 items; 27 related to symptoms, 6 related to impacts) was developed with a recall period of 24 h. Two rheumatologists evaluated each item’s relevance, and the second version of the RASIQ was refined (29 items; 21 related to symptoms, 8 related to impacts). Next, three rounds of cognitive debriefing interviews were conducted with patients with RA (n = 15 overall). The RASIQ was revised to remove items deemed irrelevant or redundant, leaving 16 items measuring symptoms (joint pain, energy/tiredness, joint stiffness) and impacts (rest, sleep). A parallel series of semi-structured concept elicitation interviews (n = 30) facilitated the design of a conceptual model of RA symptoms, impacts and treatment experiences. Post-hoc comparison of the model with RASIQ revealed that all items selected were among the most important and relevant symptoms and impacts for patients. A final round of cognitive debriefing interviews (n = 12) confirmed that the final 16-item RASIQ was relevant and easy to understand, with no further changes recommended. Psychometric evaluation using data from two Phase II RA clinical trials confirmed a 3-factor structure, as well as the reliability and validity of the scale scores, and the ability of RASIQ to detect changes in symptoms and impacts when administered at specific study timepoints, using a 24-h recall period. Conclusions RASIQ is a novel, 16-item PROM developed with substantial patient input. Results from concept elicitation, cognitive debriefing, and psychometric evaluation confirmed the validity of the instrument, which has the potential to measure symptoms and impacts through a 24-h recall period and complement existing disease activity instruments with longer recall periods.

Development of the Near Vision Presbyopia Task-based Questionnaire for use in evaluating the impact of presbyopia

Background Presbyopia is a progressive condition that reduces the eye’s ability to focus on near objects with increasing age. After a systematic literature review identified no existing presbyopia-specific patient-reported outcome (PRO) instruments meeting regulatory guidance, a new PRO instrument, the Near Vision Presbyopia Task-based Questionnaire (NVPTQ), was developed. Results To explore the patient experience with presbyopia, concept elicitation interviews were conducted with 20 presbyopic participants. The most frequently reported impacts were difficulty with reading menus/books/newspapers/magazines, reading on a cell phone/caller ID, and reading small print. Based on these results, a task-based PRO instrument (the NVPTQ) was developed instructing participants to complete four near-vision, paper-based reading tasks (book, newspaper, nutrition label, menu) under standardized settings, and subsequently assess their vision-related reading ability and associated satisfaction. The draft NVPTQ was cognitively debriefed with a sample of 20 presbyopes, which demonstrated that most participants interpreted the items as intended and endorsed the relevance of the concepts being assessed. After the qualitative research, the draft instrument was psychometrically tested using data from a Phase 2 study. Based on item-level analyses, all items in the NVPTQ demonstrated expected response option patterns and lacked substantial floor or ceiling effects. The reliability, validity, and responsiveness of the NVPTQ Performance and Satisfaction domain scores were assessed. All domains scores had large Cronbach’s coefficient α values and good test–retest statistics, indicating that the scores are internally consistent and produce stable values over time. The pattern of correlations with a concurrent measure of visual functioning (National Eye Institute Visual Function Questionnaire 25) demonstrated that the NVPTQ domain scores were related to an alternative assessment of near-vision activities. The NVPTQ domain scores were able to distinguish between groups that were known to differ on the clinical outcome of uncorrected near visual acuity, supporting the construct validity of these scores. The NVPTQ domain scores showed evidence of responsiveness to change by being able to distinguish between groups defined as improved and not improved based on patient-reported and clinical outcomes. Conclusions This research has resulted in a content-valid and psychometrically sound instrument designed to evaluate vision-related reading ability and satisfaction with vision-related reading ability. Trial registration: ClinicalTrials.gov NCT02780115. Registered 23 May 2016, https://www.clinicaltrials.gov/ct2/show/NCT02780115?term=NCT02780115&draw=2&rank=1.

Results on patient-reported outcomes are underreported in summaries of product characteristics for new drugs

Background Summaries of product characteristics (SmPCs) are regulatory documents published upon drug approval. They should report all relevant study data and advise how to use drugs safely and effectively. Patient-reported outcomes (PROs) are increasingly used in clinical trials to incorporate the patient perspective—SmPCs should thus adequately report PROs. In Germany, new drugs undergo mandatory early benefit assessment. Pharmaceutical companies submit dossiers containing all evidence; the subsequent dossier assessments focus on patient-relevant outcomes and comprehensively report PROs. Objective The primary aim was to investigate to what extent PROs recorded as outcomes in clinical trials of new drugs are reported in SmPCs. Methods We analysed dossier assessments with randomized controlled trials (RCTs) of new drugs entering the market between 01/2014 and 07/2018 and the corresponding SmPCs, and compared PRO reporting in both document types. For this purpose, we evaluated dossier assessment characteristics (e.g. drug name, indication, disease category) and study characteristics (e.g. evaluable PROs available?). PROs were divided into symptoms and health-related quality of life (HRQoL). SmPCs were screened to identify RCTs. We conducted 3 main evaluation steps: (1) Did the RCT included in the dossier assessment contain evaluable PROs? (2) If yes, was the RCT included in the SmPC? (3) If yes, were the PROs reported in the SmPC? Results are presented descriptively. Results 88 dossier assessments including 143 RCTs on 72 drugs were considered: 109 (76.2%) RCTs included evaluable PROs, of which 89 were included in SmPCs. 38 RCTs (42.7%) investigated oncologics, 18 (20.2%) anti-infectives, and 33 (37.1%) other drugs. The RCTs considered symptoms more often than HRQoL (82 vs. 66 RCTs). In SmPCs, PROs were reported for 41 RCTs (46.1%), with a slightly higher reporting rate for RCTs considering HRQoL (43.9%) than for RCTs considering symptoms (41.5%). In oncologic indications, PROs were reported for 36.7% of RCTs considering HRQoL and 33.3% of RCTs considering symptoms. In infectious diseases, the rates were 21.4% (symptoms) and 0% (HRQoL), and for other diseases about 60% (symptoms) to 70% (HRQoL). Conclusion Even though a large amount of PRO data on new drugs is available from clinical trials included in SmPCs, the corresponding results are underreported.