scholarly journals The Patient-Reported Outcomes Thermometer–5-Item Scale (5T-PROs): Validation of a New Tool for the Quick Assessment of Overall Health Status in Painful Rheumatic Diseases

2018 ◽  
Vol 2018 ◽  
pp. 1-16 ◽  
Author(s):  
Fausto Salaffi ◽  
Marco Di Carlo ◽  
Marina Carotti ◽  
Sonia Farah

Objective. To investigate the construct validity, reliability (internal consistency and retest reliability), and feasibility of the patient-reported outcomes thermometer–5-item scale (5T-PROs), a new tool to measure overall health status in patients with painful chronic rheumatic diseases such as rheumatoid arthritis (RA), psoriatic arthritis (PsA), axial spondyloarthritis (axialSpA), and fibromyalgia (FM). Methods. Consecutive patients have been involved in this study. The following analyses were performed to establish the validity of the 5T-PROs: (1) principal component factor analysis was used to identify the presence of a relatively small number of underlying latent factors than can be used to represent relations among sets of many variables; (2) Cronbach’s alpha was calculated as an indicator of internal consistency; and (3) Pearson product-moment correlations were conducted to assess the convergent validity. The 5T-PROs was also administered a second time (two weeks after the initial administration) to a subset of sample (n = 426) to allow for calculation of test-retest reliability. We used the intraclass correlation coefficient (ICC) as an estimate of test-retest reliability. Additionally, discriminant validity was tested using analysis of variance (ANOVA) with Bonferroni post hoc multiple comparisons, in different disease conditions. Feasibility was analyzed by the time taken in completing the 5T-PROs and the proportion of patients able to complete the 5 item. Results. 1,199 patients (572 with RA, 251 with axialSpA, 150 with PsA, and 226 with FM) were examined. The mean age was 55.7 (standard deviation: 13.1; range: 20 to 80) years. Factor analysis yielded two factors which accounted for 62.54% of the variance of the 5T-PROs. The first factor “Symptom Summary Score” (35.57% of the variance) revealed a good internal consistency (alpha = 0.88); the internal consistency of the second factor “Psychological Summary Score” (26.97% of the variance) was moderate (alpha = 0.69). The reliability of the whole instrument was good (alpha = 0.82). A very high correlation was obtained between Symptom Summary Score and SF-36 PCS and between pain thermometer intensity and SF-36 bodily pain. For all five items and summary scale scores of the SF-36, there was strong evidence that the mean rank of the scores differs significantly between the groups (Kruskal–Wallis tests, p<0.001). Discriminant validity, assessed by comparing the 5T-PRO dimensions in patients with different states of disease activity, showed that the 5T-PROs show moderate association with the presence of comorbidities. It was also noted that it was inversely correlated (p=0.01) to years of formal education. Conclusion. The 5T-PROs is easily administered, reliable and a valid instrument for evaluating the extensive multidimensional impact associated with chronic painful rheumatic conditions.

2012 ◽  
Vol 92 (1) ◽  
pp. 111-123 ◽  
Author(s):  
Margreth Grotle ◽  
Andrew M. Garratt ◽  
Hanne Krogstad Jenssen ◽  
Britt Stuge

Background There is little evidence for the measurement properties of instruments commonly used for women with pelvic girdle pain. Objective The aim of this study was to examine the internal consistency, test-retest reliability, and construct validity of instruments used for women with pelvic girdle pain. Design This was a cross-sectional methodology study, including test-retest reliability assessment. Methods Women with pelvic girdle pain in pregnancy and after delivery participated in a postal survey that included the Pelvic Girdle Questionnaire (PGQ), Oswestry Disability Index (ODI), Disability Rating Index (DRI), Fear-Avoidance Beliefs Questionnaire (FABQ), Pain Catastrophizing Scale (PCS), and 8-item version of the Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire (SF-36). Test-retest reliability was assessed with a random subsample 1 week later. Internal consistency was assessed with the Cronbach alpha, and test-retest reliability was assessed with the intraclass correlation coefficient (ICC) and minimal detectable change (MDC). Construct validity based on hypotheses was assessed by correlation analysis. Discriminant validity was assessed with the area under the receiver operating characteristic curve. Results All participants responded to the main (N=87) and test-retest (n=42) surveys. Cronbach alpha values ranged from .88 to .94, and ICCs ranged from .78 to .94. The MDC at the individual level constituted about 7% to 14% of total scores for the 8-item version of the SF-36, ODI, and PGQ activity subscale; about 18% to 22% for the DRI, PGQ symptom subscale, and PCS; and about 25% for the FABQ. Hypotheses were mostly confirmed by correlations between the instruments. The PGQ was the only instrument that significantly discriminated participants who were pregnant from participants who were not pregnant as well as pain locations. Limitations A comparison of responsiveness to change of the various instruments used in this study was not undertaken, but will be carried out in a future study. Conclusions Self-report instruments for assessing health showed good internal consistency, test-retest reliability, and construct validity for women with pelvic girdle pain. The PGQ was the only instrument with satisfactory discriminant validity, thus, it is recommended for evaluating symptoms and disability in patients with pelvic girdle pain.


2015 ◽  
Vol 8 (1) ◽  
pp. 19-25
Author(s):  
Rumyana N. Kuzmanova ◽  
Irina Z. Stefanova ◽  
Irena V. Velcheva ◽  
Katerina I. Stambolieva

Summary The aim of the study is the translation, adaptation and validation of Side effects of antiepileptic drugs questionnaire in Bulgarian language (SIDAED-BG) in order to use it for objective monitoring of patients with epilepsy. One hundred and thirty one patients (mean age 40.13±13.37 years) took part in the investigation. The internal consistency and test-retest reliability were tested by Cronbach's α and ICC estimations. The convergent construct validity was evaluated by estimating the correlation of SIDAED-BG with the QOLIE-89 and the discriminant validity - by evaluation of the difference between SIDAED-BG scores and clinical parameters such as type of epilepsy using Kruskal-Wallis ANOVA. The Cronbach's α of the total scale was 0.93. The test-retest reliability was higher and determined the strong positive correlations between the first and second examination. The SIDAED-BG questionnaire showed good internal consistency (Cronbach's alpha ranged from 0.37 to 0.86) and the scores significantly correlated with other questionnaires such as QOLIE-89 and showed a good discriminative validity between groups with different levels of self-assessed adverse effects of antiepileptic drugs. The Bulgarian version of SIDAED is a reliable and valid tool in assessing the patient-reported adverse effects of antiepileptic drugs and their impact on the patient's outcome.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.


Hand Therapy ◽  
2021 ◽  
pp. 175899832110345
Author(s):  
E Lanfranchi ◽  
T Fairplay ◽  
P Arcuri ◽  
M Lando ◽  
F Marinelli ◽  
...  

Introduction Several general hand functional assessment tools for Dupuytren’s disease have been reported, but none of the patient-reported-outcome measures specific to Dupuytren’s disease-associated disabilities are available in the Italian language. The purpose of this study was to culturally adapt the Unité Rhumatologique des Affections de la Main (URAM) into Italian (URAM-I) and determine its measurement properties. Methods Cross-cultural adaptation was performed according to the current guidelines. Construct validity (convergent and divergent validity) was measured by comparing the URAM-I with the Pain-Rated Wrist/Hand Evaluation (PRWHE-I), Short-Form 36 (SF-36-I) scale and finger range of motion, respectively. Factor analysis was used to investigate the URAM-I’s internal structure. Reliability was assessed by internal consistency (Cronbach’s alpha) and test-retest reliability by Intra-Class Correlation Coefficient (ICC). Results This study included 96 patients (males = 85%, age = 66.8 ± 9.3). Due to the cultural adaptation, we divided the original item #1 into two separate items, thus generating the URAM-I(10). Convergent validity analysis showed a strong positive (r = 0.67), significant (p < 0.01) Pearson’s correlation with the PRWHE-I. Divergent validity analysis showed a weak, negative (r < 0.3) and not significant correlation with the SF-36-I subscales, except for the physical pain subscale (r = −0.21, p < 0.05). Factor analysis revealed a 2-factor, 4-item solution that explained 76% of the total variance. The URAM-I(10) demonstrated high internal consistency (α = 0.94) and high test-retest reliability (ICC = 0.97). Conclusion The URAM-I(10) demonstrates moderate construct validity, high internal consistency and test-retest reliability, and showed a 2-factor internal structure. Its evaluative use can be suggested for the Italian Dupuytren’s population.


2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24027-e24027
Author(s):  
Jaba Kokhreidze ◽  
Veleka Allen ◽  
Cristina Ivanescu ◽  
Xiaopan Valerie Yao ◽  
Bin Zhang ◽  
...  

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]


Author(s):  
Ahmad Reza Khatoonabadi ◽  
◽  
Amin Modarres Zadeh ◽  
Azar Mehri ◽  
Elke Kalbe ◽  
...  

The Aphasia Check List (ACL) test is a comprehensive, time-saving tool for language evaluation in aphasia, including a cognitive assessment part. This cross-sectional study aimed to translate this test into Farsi and analyze the psychometric features of the translated version. The original version of the ACL was translated and adapted from German; its psychometric features were then determined. Twenty participants with aphasia (PWA) and 50 age- and education-matched, cognitively healthy controls participated. Possible floor and ceiling effects, discriminant validity, test-retest reliability, and internal consistency were analyzed in addition to the evaluation of internal correlations between the test parts (Language and Cognition). Regarding the performance of PWAs in the language section and the cognitive subtests assessing attention, memory, and reasoning, there were no floor and ceiling effects. Adequate discriminant validities for the language section of the test (i.e., total score: [Mann-Whitney U= 6.000, p<0.001]; diagnostic subtests scores: [U=3.000, p<0.001]; and each subtest individually) and for the attention subtest of the cognition section [U=16.500, p<0.001] were observed. There was no difference between the control group and the patient group in the subtests of memory [U=497.500, p=0.973] and reasoning [U=3.000, p=308]. The test-retest reliability was acceptable in all subtests (ICCagreement =0.573-0.984). The ACL-P test showed appropriate internal consistency (Cronbach’s alpha=0.761 for test and retest scores). There were also significant correlations between language and cognition in the control and patient groups. The ACL-P test showed sufficient reliability and validity for the evaluation of Farsi-speaking PWAs and used in studies on this population


2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Feifei Zhou ◽  
Shuyang Li ◽  
Yilong Zhang ◽  
Yanbin Zhao ◽  
Kevin L. Ju ◽  
...  

Abstract Background The aim of this study is to investigate the reliability, validity, and responsiveness of JOACMEQ for CSM patients in mainland China. Methods A retrospective review was performed on 91 patients with CSM in our hospital from March 2015 to June 2015. Patients completed the JOACMEQ, the mJOA and the SF-36 questionnaires during the process. Cronbach's α was used to evaluate the internal consistency reliability, and test–retest reliability was checked. An exploratory factor analysis was used to determine the correlations among the JOACMEQ questions and the construct validity. The concurrent validity was assessed by Spearman correlation coefficient. The internal responsiveness was determined by effect sizes and standardized response means. External responsiveness was determined by the area under the receiver operating characteristic curve on the basis of the Youden Index. Results The mean age of patients was 57.61 years old. The mean follow-up was 24 months. JOACMEQ showed a good internal consistency (Cronbach's α, 0.897). Test–retest reliability showing good result (Pearson's correlation, 0.695–0.905). Our data were amenable to factor analysis (KMO = 0.816, Bartlett's test, χ2(45) = 1199.99, p < 0.001), and five factors above 1 were strongly loaded and clustered for each of the five factors. Comparing the scales preoperative to those 2 years postoperative, the average scores of the subscales all increased, and both the ES and SRM showing satisfied responsiveness. In external responsiveness analysis, the recovery rate a appeared to be most responsive to post-operative improvement. Conclusions The Simplified Chinese version of JOACMEQ was well-developed with great reliability and sensitive responsiveness. Our study demonstrated that JOACMEQ has content psychometric properties to identify postoperative improvements in CSM patients.


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Madeline Romaniuk ◽  
Gina Fisher ◽  
Chloe Kidd ◽  
Philip J. Batterham

Abstract Background The transition out of military service and subsequent reintegration to civilian life has been established as a period associated with an increased risk of psychological adjustment difficulties, psychiatric disorders and suicide risk, yet no tool exists to measure cultural and psychological adjustment following permanent separation from the military. This study describes the two-phase mixed-methods development and validation of the self-report Military-Civilian Adjustment and Reintegration Measure (M-CARM). Methods In Phase I, four focus groups (n = 20) and semi-structured one-on-one interviews (n = 80) enabled thematic analysis and generation of 53 initial items that were reviewed by an expert multidisciplinary panel (n = 12) and piloted for clarity and relevance in an Australian service-veteran sample (n = 11). In Phase II, psychometric properties of the 47 items resulting from Phase I were evaluated with online assessment of a convenience sample of transitioned Australian Defence Force veterans (n = 725). Analyses included exploratory and confirmatory factor analyses, as well as evaluation of test-retest reliability, internal consistency, and convergent, divergent and discriminant validity. Results Exploratory factor analysis on a randomized split-half sample (n = 357), resulted in a 21-item, five-factor solution of Purpose and Connection, Help seeking, Beliefs about civilians, Resentment and regret, and Regimentation, explaining 53.22% of the variance. Confirmatory factor analysis (n = 368) verified this factor structure without modification (χ2 = 304.96, df = 160; CFI = .96, TLI = .94, NFI = .91, RMSEA = .05). Strong convergent, divergent and discriminant validity was demonstrated as M-CARM scores significantly correlated with related constructs assessed by standardised clinical measures as well as differentiated groups based on three binary reintegration items, with large effect sizes (d = > 1). Strong test-retest reliability for the total score (n = 186, r = .93) and excellent internal consistency (n = 725, a = .90) were also found. Conclusions Results provide promising evidence the M-CARM is a valid, reliable measure of psychological and cultural reintegration to civilian life, with potential for considerable clinical and research application.


2021 ◽  
Vol 28 (1) ◽  
Author(s):  
Siti L. Nuraini ◽  
◽  
Anton Rahardjo ◽  
Diah Ayu Maharan ◽  
◽  
...  

Previous surveys have indicated that the majority of Indonesian children have poor oral health. However, scant information is available on children’s oral health related quality of life (OHRQoL). The purpose of this study was to assess reliability as well as discriminant and convergent validity of Child Oral Health Impact Profile-Short Form 19 (COHIP-SF 19) Indonesian version. Methods: The Indonesian version of COHIP-SF 19 was developed according to the guidelines for the cross-cultural adaptation process. The instrument was tested among 529 children between 12 – 15 years old who were randomly selected from six junior high schools in Jakarta. The psychometric testing included internal consistency reliability, test-retest reliability, discriminant validity, and convergent validity. Results: Mean age of the participants was 13.3±0.9 years and 54% of the participants were female. The mean COHIP-SF 19 score was 57.8±8.8 and the median was 58 (range 27 – 75). The internal consistency and test-retest reliability was excellent for COHIP-SF 19 score with Chronbach’s alpha 0.83 and intra-class correlation coefficient 0.81. Children with active decay, untreated caries with pulpal involvement, and gingivitis had significantly lower COHIP-SF 19 scores (p-value ≤ 0.030). Correlation between COHIP-SF 19 score, subscale scores and clinical severity as well as self-rated general or oral health were very low to low (rs = 0.04 – 0.27, p-value ≤ 0.028), after adjustment for children’s age and gender. Conclusions: The Indonesian version of COHIP-SF 19 was successfully developed to be used as an OHRQoL instrument for Indonesian school-age children. The internal consistency, test-retest reliability, discriminant validity, and convergent validity of COHIP-SF 19 Indonesian version were confirmed


2020 ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background: Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test.Methods: A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s a coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed.Results: Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81-0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p<0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity.Conclusions: The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.


Sign in / Sign up

Export Citation Format

Share Document