scholarly journals Psychometric evaluation of patient-reported experience measures: is it valid?

2020 ◽  
Vol 32 (3) ◽  
pp. 219-220 ◽  
Author(s):  
Steve Sizmur ◽  
Chris Graham ◽  
Nanne Bos
Keyword(s):  
Patient Experience ◽  
Psychometric Evaluation ◽  
Validation Methods ◽  
Psychometric Methods ◽  
Patient Reported ◽  
Alternative Approaches

Abstract Multiple published studies and reviews have advocated the application of psychometric methods to the validation of patient experience measurement. Some such methods depend on measurement assumptions that may not be appropriate for patient experience. Rather than being the default approach for the validation of patient experience measurement, we argue that psychometric methods should be reviewed critically to determine their fit to the measurement application, and alternative approaches explored, so that the most appropriate validation methods can be identified.

scholarly journals Validation of The Patient-Reported Experience Measure for Care in Chinese Hospitals (PREM-CCH)

2020 ◽  
Author(s):  
Xuanxuan Wang ◽  
Jiaying Chen ◽  
Yaling Yang ◽  
Bo Burström ◽  
Kristina Burström
Keyword(s):  
Construct Validity ◽  
Patient Experience ◽  
Internal Consistency ◽  
Professional Competence ◽  
Psychometric Evaluation ◽  
Medical Costs ◽  
Public Hospitals ◽  
Patient Reported ◽  
Experience Measure ◽  
Chinese Public

Abstract Background: A psychometrically validated instrument to measure patient experience in Chinese public hospitals would be useful and is currently lacking. Our research team developed the Patient-Reported Experience Measure for Care in Chinese Hospitals (PREM-CCH). We aimed to validate this PREM-CCH in the present study.Methods: Data were drawn from a cross-sectional patient survey in 2016. Complete responses from 2,293 outpatients and 1,510 inpatients were included. Separate psychometric evaluation was carried out on outpatient and inpatient PREM-CCHs in terms of exploratory factor analysis, internal consistency, construct validity and criterion validity.Results: The validated outpatient PREM-CCH contained 22 items and five Factors, i.e. Communication and information, Professional competence, Medical costs, Efficiency, and Hospital recommendation. The validated inpatient PREM-CCH contained 19 items and six Factors, i.e. Communication and information, Professional competence, Medical costs, Efficiency, Health outcomes, and Hospital recommendation. The PREM-CCH showed satisfactory internal consistency, construct validity and criterion validity.Conclusions: The PREM-CCH is one of the first validated instruments capturing patient experience of care in the context of Chinese public hospitals. It performed well in the psychometric evaluation. It consists of a basic set of items important to patients that could be applicable to public hospitals in China and actionable to inform quality improvement initiatives.

scholarly journals Validation of the patient-reported experience measure for care in Chinese hospitals (PREM-CCH)

2021 ◽  
Vol 20 (1) ◽  
Author(s):  
Xuanxuan Wang ◽  
Jiaying Chen ◽  
Yaling Yang ◽  
Bo Burström ◽  
Kristina Burström
Keyword(s):  
Construct Validity ◽  
Patient Experience ◽  
Internal Consistency ◽  
Professional Competence ◽  
Psychometric Evaluation ◽  
Medical Costs ◽  
Public Hospitals ◽  
Patient Reported ◽  
Experience Measure ◽  
Chinese Public

Abstract Background A psychometrically validated instrument to measure patient experience in Chinese public hospitals would be useful and is currently lacking. Our research team developed the Patient-Reported Experience Measure for Care in Chinese Hospitals (PREM-CCH). We aimed to validate this PREM-CCH in the present study. Methods Data were drawn from a cross-sectional patient survey in 2016. Complete responses from 2293 outpatients and 1510 inpatients were included. Separate psychometric evaluation was carried out on outpatient and inpatient PREM-CCHs in terms of exploratory factor analysis, internal consistency, construct validity and criterion validity. Results The validated outpatient PREM-CCH contained 22 items and five Factors, i.e. Communication and information, Professional competence, Medical costs, Efficiency, and Hospital recommendation. The validated inpatient PREM-CCH contained 19 items and six Factors, i.e. Communication and information, Professional competence, Medical costs, Efficiency, Health outcomes, and Hospital recommendation. The PREM-CCH showed satisfactory internal consistency, construct validity and criterion validity. Conclusions The PREM-CCH is one of the first validated instruments capturing patient experience of care in the context of Chinese public hospitals. It performed well in the psychometric evaluation. It consists of a basic set of items important to patients that could be applicable to public hospitals in China and actionable to inform quality improvement initiatives.

Confirmatory Psychometric Evaluation of the Axillary Sweating Daily Diary: A Vaildated Patient-Reported Outcome Measure to Assess Axillary Hyperhidrosis Sweating Severity

2017 ◽  
Vol 1 ◽  
pp. s94 ◽  
Author(s):  
Dee Anna Glaser ◽  
Adelaide A Hebert ◽  
Sheri Fehnel ◽  
Dana DiBenedetti ◽  
Lauren Nelson ◽  
...  
Keyword(s):  
Outcome Measure ◽  
Daily Diary ◽  
Psychometric Evaluation ◽  
Patient Reported Outcome ◽  
Axillary Hyperhidrosis ◽  
Patient Reported Outcome Measure ◽  
Patient Reported

Abstract Not AvailableDisclosure: Study supported by Dermira.

scholarly journals Patient Experience in Home Respiratory Therapies: Where We Are and Where to Go

2019 ◽  
Vol 8 (4) ◽  
pp. 555 ◽  
Author(s):  
Cátia Caneiras ◽  
Cristina Jácome ◽  
Sagrario Mayoralas-Alises ◽  
José Ramon Calvo ◽  
João Almeida Fonseca ◽  
...  
Keyword(s):  
Clinical Research ◽  
Patient Experience ◽  
Clinical Care ◽  
Research Priorities ◽  
Specific Patient ◽  
Quality Healthcare ◽  
Body Of Knowledge ◽  
Number Of Patients ◽  
Patient Reported ◽  
System Sustainability

The increasing number of patients receiving home respiratory therapy (HRT) is imposing a major impact on routine clinical care and healthcare system sustainability. The current challenge is to continue to guarantee access to HRT while maintaining the quality of care. The patient experience is a cornerstone of high-quality healthcare and an emergent area of clinical research. This review approaches the assessment of the patient experience in the context of HRT while highlighting the European contribution to this body of knowledge. This review demonstrates that research in this area is still limited, with no example of a prescription model that incorporates the patient experience as an outcome and no specific patient-reported experience measures (PREMs) available. This work also shows that Europe is leading the research on HRT provision. The development of a specific PREM and the integration of PREMs into the assessment of prescription models should be clinical research priorities in the next several years.

scholarly journals Understanding the patient experience in hepatocellular carcinoma: a qualitative patient interview study

2021 ◽  
Author(s):  
Nikunj Patel ◽  
Joshua Maher ◽  
Xandra Lie ◽  
Chad Gwaltney ◽  
Afsaneh Barzi ◽  
...  
Keyword(s):  
Hepatocellular Carcinoma ◽  
Drug Development ◽  
Conceptual Model ◽  
Patient Experience ◽  
Outcome Measurement ◽  
Qualitative Interviews ◽  
Patient Reported Outcome ◽  
Weight Changes ◽  
Patient Reported ◽  
Pro Instruments

Abstract Purpose This study aimed to elucidate the patient experience of hepatocellular carcinoma (HCC) to guide patient-centered outcome measurement in drug development. Methods Patients with HCC participated in qualitative interviews to elicit disease-related signs/symptoms and impacts, using discussion guides developed from literature searches and discussions with oncologists. Interview participants rated the disturbance of their experiences (0–10 scale). A conceptual model was developed and mapped against patient-reported outcome (PRO) instruments identified from database reviews. Results Interviews were conducted with 25 individuals with HCC (68% were men; median age: 63 years; 12% Barcelona clinic liver cancer (BCLC) stage A; 32% stage B; and 56% stage C) in the USA. Fifty-one HCC-related concepts were identified from the interviews and were grouped into eight sign/symptom categories (eating behavior/weight changes; extremities [arms, legs]; fatigue and strength; gastrointestinal; pain; sensory; skin; other) and four impact categories (emotional; physical; cognitive function; other) for the conceptual model. The most prevalent and disturbing experiences across the disease stages were fatigue/lack of energy and emotional impacts such as frustration, fear, and depression. Abdominal pain and skin-related issues were particularly common and disturbing in individuals with HCC stage C. The EORTC QLQ-C30 and HCC18 were identified as commonly used PRO instruments in HCC studies and captured the relevant signs/symptoms associated with the patient experience. Conclusion Patients with HCC reported a range of signs/symptoms and impacts that negatively affect daily functioning and quality of life. Including PRO measures in HCC clinical trials can provide meaningful patient perspectives during drug development.

scholarly journals Psychometric evaluation of the DAILY EATS questionnaire in individuals living with obesity

2020 ◽  
Vol 4 (1) ◽  
Author(s):  
John Fastenau ◽  
Heather Rozjabek ◽  
Shanshan Qin ◽  
Lori McLeod ◽  
Lauren Nelson ◽  
...  
Keyword(s):  
Type 2 Diabetes ◽  
Severe Obesity ◽  
Short Form ◽  
Psychometric Evaluation ◽  
Health Determinants ◽  
Measurement Information ◽  
Related Factors ◽  
Patient Global Impression ◽  
Patient Reported

Abstract Background Physiological and behavioral factors including hunger, satiety, food intake, and cravings are health determinants contributing to obesity. Patient-reported outcome (PRO) measures focused on eating-related factors provide insight into the relationships between food choice and quantity, weight change, and weight-loss treatment for individuals living with obesity. The DAILY EATS is a novel 5-item, patient-reported measure evaluating key eating-related factors (Worst and Average Hunger, Appetite, Cravings, and Satiety). Methods Psychometric analyses, consistent with regulatory standards, were conducted to evaluate the DAILY EATS using data from two randomized trials that included individuals with severe obesity without diabetes (NCT03486392) and with severe obesity and type 2 diabetes (NCT03586830). Additional measures included Patient Global Impression of Status (PGIS) and Patient Global Impression of Change items, Impact of Weight on Quality of Life-Lite, Ease of Weight Management, and Patient-Reported Outcomes Measurement Information System Physical Function Short Form 8b and 10a. The reliability, validity, and responsiveness of the DAILY EATS were assessed, and a scoring algorithm and thresholds to interpret meaningful score changes were developed. Results Item-level analyses of the DAILY EATS supported computation of an Eating Drivers Index (EDI), comprising the related items Worst Hunger, Appetite, and Cravings. Internal consistency (Cronbach’s coefficient alphas ≥0.80) and test-retest reliability (coefficients > 0.7) of the EDI were robust. Construct validity correlation patterns with other PRO measures were as hypothesized, with moderate to strong significant correlations between the EDI and PGIS-Hunger (0.30 ≤ r ≤ 0.68), PGIS-Cravings (0.33 ≤ r ≤ 0.77) and PGIS-Appetite (0.52 ≤ r ≤ 0.77). Anchor- and distribution-based analyses support reductions ranging from 1.6 to 2.1 as responder thresholds for the EDI, representing meaningful within-person improvement. Conclusions The DAILY EATS individual items and the composite EDI are reliable, sensitive, and valid in evaluating the concepts of hunger, appetite, and cravings for use in individuals with severe obesity with or without type 2 diabetes.

Patient Satisfaction and Short-Term Outcome in Elective Cranial Neurosurgery

Neurosurgery ◽  
2015 ◽  
Vol 77 (5) ◽  
pp. 769-776 ◽  
Author(s):  
Elina Reponen ◽  
Hanna Tuominen ◽  
Juha Hernesniemi ◽  
Miikka Korja
Keyword(s):  
Patient Satisfaction ◽  
Quality Of Care ◽  
Health Status ◽  
Patient Experience ◽  
University Hospital ◽  
Term Outcome ◽  
Major Morbidity ◽  
Patient Reported ◽  
Relationship Of

Abstract BACKGROUND: Patient-reported experience is often used as a measure for quality of care, but no reports on patient satisfaction after cranial neurosurgery exist. OBJECTIVE: To study the association of overall patient satisfaction and surgical outcome and to evaluate the applicability of overall patient satisfaction as a proxy for quality of care in elective cranial neurosurgery. METHODS: We conducted an observational study on the relationship of overall patient satisfaction at 30 postoperative days with surgical and functional outcome (modified Rankin Scale [mRS] score) in a prospective, consecutive, and unselected cohort of 418 adult elective craniotomy patients enrolled between December 2011 and December 2012 at Helsinki University Hospital, Helsinki, Finland. RESULTS: Postoperative overall (subjective and objective) morbidity was present in 194 (46.4%) patients; yet almost 94% of all study patients reported high overall satisfaction. Low overall patient satisfaction at 30 days was not associated with postoperative major morbidity in elective cranial neurosurgery. Dependent functional status (mRS score ≥3) at 30 days, minor infections, poor postoperative subjective overall health status, and patient-reported severe symptoms (double vision, poor balance) may contribute to unsatisfactory patient experience. CONCLUSION: Overall patient satisfaction with elective cranial neurosurgery is high. Even 9 of 10 patients with postoperative major morbidity rated high overall patient satisfaction at 30 days. Overall patient satisfaction may merely reflect patient experience and subjective postoperative health status, and therefore it is a poor proxy for quality of care in elective cranial neurosurgery.

scholarly journals Visual Analogue Scales as a Tool for Initial Assessment of Tinnitus Severity: Psychometric Evaluation in a Clinical Population

2018 ◽  
Vol 23 (4) ◽  
pp. 229-237 ◽  
Author(s):  
Danuta Raj-Koziak ◽  
Elzbieta Gos ◽  
Weronika Swierniak ◽  
Joanna J. Rajchel ◽  
Lucyna Karpiesz ◽  
...  
Keyword(s):  
Correlation Coefficients ◽  
Psychometric Evaluation ◽  
Clinical Population ◽  
Initial Assessment ◽  
Tinnitus Severity ◽  
Interclass Correlation ◽  
Bland Altman Method ◽  
Patient Reported ◽  
Brief Screening ◽  
Analogue Scales

The aim of this study was to evaluate the psychometric properties of patient-reported visual analogue scale (VAS) ratings. All of the participants (100 Polish-speaking adults) completed a Tinnitus Functional Index (TFI) once and a 4-component VAS twice over a period of 3 days. Spearman’s correlation coefficients between the VAS score and global TFI ranged from ρ = 0.52 for VAS-coping (VAS-C) to ρ = 0.81 for VAS-annoyance (VAS-A). Using the Bland-Altman method, the agreement ranged from 93% for VAS-A to 96% for VAS-distress (VAS-D). Interclass correlation coefficients ranged from 0.67 for VAS-C to 0.90 for VAS-A. The VAS cutoff points representing significant tinnitus severity ranged from 45 points for VAS-C to 66 points for VAS-D. VAS scales are a valid and reliable brief screening tool for obtaining quick information about tinnitus.

scholarly journals Patient-reported outcomes in obsessive-compulsive disorder

2014 ◽  
Vol 16 (2) ◽  
pp. 239-254 ◽  
Keyword(s):  
Obsessive Compulsive Disorder ◽  
Patient Reported Outcomes ◽  
Functional Disability ◽  
Psychometric Evaluation ◽  
Patient Reported Outcome Measures ◽  
Patient Reported Outcome ◽  
Future Research ◽  
Obsessive Compulsive ◽  
Compulsive Disorder ◽  
Patient Reported

The purpose of the article was to provide an overview of patient-reported outcomes (PROs) and related measures that have been examined in the context of obsessive-compulsive disorder (OCD). The current review focused on patient-reported outcome measures (PROMs) that evaluated three broad outcome domains: functioning, health-related quality of life (HRQoL), and OCD-related symptoms. The present review ultimately included a total of 155 unique articles and 22 PROMs. An examination of the PROs revealed that OCD patients tend to suffer from significant functional disability, and report lower HRQoL than controls. OCD patients report greater symptom severity than patients with other mental disorders and evidence indicates that PROMs are sensitive to change and may be even better than clinician-rated measures at predicting treatment outcomes. Nonetheless, it should be noted that the measures reviewed lacked patient input in their development. Future research on PROMs must involve patient perspectives and include rigorous psychometric evaluation of these measures.

scholarly journals Responsiveness of the EQ-5D-3L in elective shoulder surgery: Does it adequately represent patient experience?

2018 ◽  
Vol 26 (2) ◽  
pp. 230949901877492 ◽  
Author(s):  
J Evans ◽  
Rupen Dattani ◽  
Vijayaraj Ramasamy ◽  
Vipul Patel
Keyword(s):  
Quality Of Life ◽  
Patient Experience ◽  
Characteristic Curve ◽  
Area Under The Curve ◽  
Patient Reported Outcome Measures ◽  
Change Score ◽  
Shoulder Surgery ◽  
Change Scores ◽  
Patient Reported

Aim: Generic patient-reported outcome measures (PROMs) allow comparison of health-related quality of life across populations and pathologies. For these comparisons to be valid, the PROM must be responsive; the score must change when the patient’s quality of life changes. This study aims to assess the responsiveness of the EQ-5D-three level (3L) in elective shoulder surgery. Methods: Pre- and post-operative EQ-5D-3L and Oxford Shoulder Scores (OSS) were prospectively collected across a range of 204 elective shoulder surgeries. Internal responsiveness was assessed through significance testing of mean change scores and standardized response means (SRMs). External responsiveness of the EQ-5D-3L was assessed against the minimal clinically important difference in OSS, using receiver operating characteristic curve and change score correlation. Results: Both EQ-5D-3L and OSS scores improved significantly over time ( p < 0.05). The SRM for the EQ-5D was 1.27 (95% CI 1.14–1.41) and for OSS 2.36 (2.22–2.52). Area under the curve for EQ-5D was 0.49. Only a weak correlation was found between EQ-5D and OSS change scores ( r = 0.21). Discussion: The EQ-5D-3L is adequately internally responsive to change following elective shoulder surgery but is unable to differentiate patients demonstrating minimal clinically important change. The EQ-5D therefore only partially reflects patient experience.

Sign in / Sign up

Export Citation Format

Share Document