scholarly journals Structural validity and reliability of the patient experience measure: A new approach to assessing psychosocial experience of upper limb prosthesis users

PLoS ONE ◽  
2021 ◽  
Vol 16 (12) ◽  
pp. e0261865
Author(s):  
Linda J. Resnik ◽  
Mathew L. Borgia ◽  
Melissa A. Clark ◽  
Emily Graczyk ◽  
Jacob Segil ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Social Interaction ◽  
Differential Item Functioning ◽  
Patient Experience ◽  
Upper Limb ◽  
Validity And Reliability ◽  
Structural Validity ◽  
Large Sample ◽  
Item Functioning ◽  
Experience Measure

Recent advances in upper limb prosthetics include sensory restoration techniques and osseointegration technology that introduce additional risks, higher costs, and longer periods of rehabilitation. To inform regulatory and clinical decision making, validated patient reported outcome measures are required to understand the relative benefits of these interventions. The Patient Experience Measure (PEM) was developed to quantify psychosocial outcomes for research studies on sensory-enabled upper limb prostheses. While the PEM was responsive to changes in prosthesis experience in prior studies, its psychometric properties had not been assessed. Here, the PEM was examined for structural validity and reliability across a large sample of people with upper limb loss (n = 677). The PEM was modified and tested in three phases: initial refinement and cognitive testing, pilot testing, and field testing. Exploratory factor analysis (EFA) was used to discover the underlying factor structure of the PEM items and confirmatory factor analysis (CFA) verified the structure. Rasch partial credit modeling evaluated monotonicity, fit, and magnitude of differential item functioning by age, sex, and prosthesis use for all scales. EFA resulted in a seven-factor solution that was reduced to the following six scales after CFA: social interaction, self-efficacy, embodiment, intuitiveness, wellbeing, and self-consciousness. After removal of two items during Rasch analyses, the overall model fit was acceptable (CFI = 0.973, TLI = 0.979, RMSEA = 0.038). The social interaction, self-efficacy and embodiment scales had strong person reliability (0.81, 0.80 and 0.77), Cronbach’s alpha (0.90, 0.80 and 0.71), and intraclass correlation coefficients (0.82, 0.85 and 0.74), respectively. The large sample size and use of contemporary measurement methods enabled identification of unidimensional constructs, differential item functioning by participant characteristics, and the rank ordering of the difficulty of each item in the scales. The PEM enables quantification of critical psychosocial impacts of advanced prosthetic technologies and provides a rigorous foundation for future studies of clinical and prosthetic interventions.

Confirmatory Factor Analysis, Internal Consistency, Gender Differential Item Functioning and Discriminant Validity of the Fear of COVID-5 Scale Amidst Emerging Adult University Students in Mexico

2021 ◽  
pp. 003022282110162
Author(s):  
Adalberto Campo-Arias ◽  
Andrés Felipe Tirado-Otálvaro ◽  
Isabel Álvarez-Solorza ◽  
Carlos Arturo Cassiani-Miranda
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Differential Item Functioning ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Emerging Adult ◽  
One Dimension ◽  
Item Functioning ◽  
Confirmatory Factor ◽  
Gender Differential

The study aimed to perform confirmatory factor analysis, internal consistency, gender differential item functioning, and discriminant validity of the Fear of COVID-5 Scale in emerging adult students of a university in Mexico. Confirmatory factor analysis, internal consistency (Cronbach's alpha and McDonald's omega), and gender differential item functioning were estimated (Kendall tau b correlation). The Fear of COVID-5 Scale showed a one-dimension structure (RMSEA = 0.07, CFI = 0.98, TLI = 0.96, and SRMR = 0.02), with high internal consistency (Cronbach's alpha of 0.78 and McDonald's omega of 0.81), non-gender differential item functioning (Kendall tau b between 0.07 and 0.10), and significant discriminant validity (Higher scores for fear of COVID-19 were observed in high clinical anxiety levels). In conclusion, the Fear of COVID-5 Scale presents a clear one-dimension structure similar to a previous study.

scholarly journals Structural validity of the Boston Carpal Tunnel Questionnaire and its short version, the 6-Item CTS symptoms scale: a Rasch analysis one year after surgery

2020 ◽  
Vol 21 (1) ◽  
Author(s):  
Juhani Multanen ◽  
Jari Ylinen ◽  
Teemu Karjalainen ◽  
Joona Ikonen ◽  
Arja Häkkinen ◽  
...  
Keyword(s):  
Carpal Tunnel Syndrome ◽  
Differential Item Functioning ◽  
Carpal Tunnel ◽  
Response Category ◽  
Structural Validity ◽  
Item Functioning ◽  
Boston Carpal Tunnel Questionnaire ◽  
Tunnel Syndrome ◽  
Ordered Response ◽  
Carpal Tunnel Questionnaire

Abstract Background The Boston Carpal Tunnel Questionnaire (BCTQ) and its shorter version, the Six-Item Carpal Tunnel Symptoms Scale (CTS-6), are widely used for assessing function and/or symptoms in patients with carpal tunnel syndrome. This study examined the structural validity of the BCTQ and CTS-6 among patients who had undergone surgery for treatment of carpal tunnel syndrome. Methods The data for this cross-sectional analysis were obtained from 217 adult patients who had undergone carpal tunnel release surgery 1 year earlier. All patients completed the CTS-6, Symptom Severity Scale (SSS) and Functional Status Scale (FSS) of the BCTQ at 12 months after surgery. The Rasch Measurement Theory (RMT) was applied to investigate the unidimensionality, residual correlation, differential item functioning, scale coverage/targeting, and person separation of the CTS-6, SSS and FSS of the BCTQ. Results The FSS showed unidimensionality and good scale and item fit. All items showed ordered response category thresholds. Eight of the FSS items displayed differential item functioning favoring age or gender. The multidimensional structure of the CTS-6 was absorbed by creating a testlet for frequency of symptoms or testlets for pain and numbness. The testlets supported unidimensionality in the BCTQ SSS. One item in the CTS-6 and two items in the BCTQ SSS showed differential item functioning favoring age or gender. Four items in the BCTQ SSS and two items in the CTS-6 exhibited disordered response category thresholds. Merging of the relevant response categories led to ordered response category thresholds. The person separation indices were 0.73, 0.86 and 0.77 for the CTS-6, BCTQ SSS and FSS, respectively. Conclusions Based on the RMT analysis, the CTS-6 has superior psychometric properties compared to the BCTQ SSS in surgically treated patients. The CTS-6 might be more accurate when separated into item sets measuring pain or numbness. The FSS of the BCTQ has acceptable construct validity, although gender differences at some ages were observed in responses.

scholarly journals Development and psychometric properties of the Japanese Consumer Assessment of Healthcare Providers and Systems Clinician & Group Survey (CG-CAHPS)

PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0250843
Author(s):  
Takuya Aoki ◽  
Kuichiro Taguchi ◽  
Eiichi Hama
Keyword(s):  
Psychometric Properties ◽  
Ambulatory Care ◽  
Patient Experience ◽  
Internal Consistency ◽  
Pearson Correlation ◽  
Healthcare Providers ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
Structural Validity ◽  
Consumer Assessment

The Consumer Assessment of Healthcare Providers and Systems Clinician & Group Survey (CG-CAHPS) is one of the most widely studied and endorsed patient experience measures for ambulatory care. This study aimed to develop a Japanese CG-CAHPS and examine its psychometric properties. We evaluated the structural validity, criterion-related validity, internal consistency reliability, and site-level reliability of the scale. Data were analyzed for 674 outpatients aged 18 years or older in 11 internal medicine clinics. The confirmatory factor analysis supported the scale’s structural validity and the same composites (Access, Provider Communication, Care Coordination, and Office Staff) as that of the original CG-CAHPS. All site-level Pearson correlation coefficients between the Japanese CG-CAHPS composites and overall provider rating exceeded the criteria. Results of item-total correlations and Cronbach’s alpha indicated adequate internal consistency reliability. We developed the Japanese CG-CAHPS and examined its validity and reliability to measure the quality of ambulatory care based on patient experience. The results of the Japanese CG-CAHPS survey will provide useful information to providers, organizations, and policy makers for achieving a patient-centered healthcare system in Japan.

scholarly journals Precision medicine implementation and research-practice partnerships: implications of measurement scale differential item functioning

F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 782
Author(s):  
John J. O. Mogaka ◽  
Moses J. Chimbari
Keyword(s):  
Differential Item Functioning ◽  
Precision Medicine ◽  
Measurement Invariance ◽  
Item Response ◽  
Biomedical Research ◽  
Measurement Scale ◽  
Measurement Tool ◽  
Research Practice ◽  
Validity And Reliability ◽  
Item Functioning

Background: Omics-based biomarkers (OBMs) inform precision medicine (PM). As omics-based technologies gradually move into clinical settings, however, a co-occurrence of biomedical research and clinical practice is likely an important variable in the implementation of PM. Currently, little is known about the implications of such research-practice co-occurrence. Methods: This study used data collected from a pilot study designed to inform a full-scale PM implementation study through the validation of the measurement tool. It applied item response theory (IRT) methods to assess the tool’s reliability and measurement invariance across two study subgroups associated with research and practice settings. Results: The study sample consisted of 31 participants. Measurement invariance assessment was through differential item functioning (DIF) analysis with bootstrapping through Monte Carlo simulation. Overall, 13 out of 22 items that formed the PMI scale had DIF at significance level α=0.25. Item response functions (IRFs) revealed how each subgroup members responded to scale items and their attitudes towards factors that influence PM implementation. Conclusions: Attitudinal similarities and differences towards factors influencing PM implementation amongst those in biomedical research as compared with those in practice were established. Results indicated PM implementation knowledge that is unique and common to both groups. The study established the validity and reliability of the new PM implementation measurement tool for the two subgroups.

scholarly journals 775Should pain scales be combined

2021 ◽  
Vol 50 (Supplement_1) ◽  
Author(s):  
Jessica Stanhope ◽  
Philip Weinstein
Keyword(s):  
Pain Intensity ◽  
Differential Item Functioning ◽  
Rasch Analysis ◽  
Rating Scales ◽  
Musculoskeletal Symptoms ◽  
Rasch Models ◽  
Composite Measure ◽  
Validity And Reliability ◽  
Professional Musicians ◽  
Item Functioning

Abstract Background Pain is often measured by asking people to rate their pain intensity at its worst, on average, and at its least, for the last 7 days using numeric rating scales. The three ratings are summed to produce a composite measure. The validity and reliability of this composite measure has not been examined using modern psychometric methods in any population. We examined the validity and reliability of this pain intensity measure for use with professional musicians, university music and science students, and university staff, all of whom had reported experiencing musculoskeletal symptoms in the last 7 days. Methods Data were collected using a questionnaire survey. The validity and reliability of the composite pain measure were examined using Rasch analysis. Differential item functioning was examined for age, gender, student status, musician status, and socioeconomic status. Results While the data fit one of the Rasch models, after several response categories were collapsed, differential item functioning was present. There was no solution found that fit one of the Rasch models, without differential item functioning. Conclusions Despite the recommendation for the three number ratings scales for pain to be combined, using Rasch analysis showed that this was not a valid approach for our study population. Our findings highlight the importance of using Rasch analysis to examine the utility of measures. Key messages Rasch analysis is a useful method for investigating the validity and reliability of scales. Combining pain ratings cannot be assumed to produce a valid and reliable measure.

Sign in / Sign up

Export Citation Format

Share Document