scholarly journals Measuring Patient Experiences of Integration in Health Care Delivery: Psychometric Validation of IntegRATE Under Controlled Conditions

2021 ◽  
Vol 8 ◽  
pp. 237437352110073
Author(s):  
Rachel Thompson ◽  
Gabrielle Stevens ◽  
Glyn Elwyn

The objective of this study was to assess the psychometric properties of IntegRATE—a 4-item patient-reported measure of integration in health care delivery—under controlled conditions. Adults who reported having received health care in the previous year were exposed to a fictional health care scenario featuring good, mixed, or poor integration on 1 or 2 occasions. They were then asked to imagine themselves as a patient in the scenario and complete IntegRATE and other measures. The data collected were analyzed to assess the discriminative, concurrent, and divergent validity of IntegRATE and its test–retest reliability and responsiveness using both “sum score” and “top score” scoring approaches. Six-hundred people participated in the study with 190 taking part on 2 occasions. The IntegRATE sum score demonstrated discriminative validity, concurrent validity, divergent validity, and responsiveness and partially demonstrated test–retest reliability. The IntegRATE top score demonstrated concurrent validity, divergent validity, and responsiveness and partially demonstrated discriminative validity and test–retest reliability. We conclude that the IntegRATE sum score exhibits encouraging psychometric properties and performs more optimally than the IntegRATE top score.

2019 ◽  
pp. 174-180
Author(s):  
Fatemeh Sadat Bateni ◽  
Maryam Rahmatian ◽  
Ahmad Kaviani ◽  
Sebastian Simard ◽  
Mehdi Soleimani ◽  
...  

Background: This study aimed to translate and validate the Fear of Cancer Recurrence Inventory (FCRI) questionnaire into Persian and to investigate its psychometric properties. Methods: The FCRI was translated to Persian using a linguistic methodology according to WHO guidelines. A total of 450 breast cancer survivors who had the following inclusion criteria were included: time elapse of more than six months after the treatment prior to the study; absence ofobjective markers of recurrence, fluency in the Persian language, and signing the informed consent. Internal consistency was estimated with Cronbach's α coefficient and test-retest reliability with Interclass correlation.  Concurrent validity was estimated through Pearson’s correlation between the FCRI and Hospital Anxiety and Depression Scale (HADS). Principal component analysis (PCA) and confirmatory factor analysis (CFA) were employed to evaluate dimensionality. Results: The Persian version was acceptable for patients. The content validity index (CVI) was 0.80.  The instrument had good test-retest reliability (ICC= 0.96) and internal consistency (Cronbach’s α=0.86).  PCA and CFA indicated that the factor structure of the Persian version was similar to the original questionnaire and had acceptable goodness of fit.  Correlations between the FCRI and HADS was remarkable (r= 0.252 – 0.639), indicating acceptable concurrent validity. Conclusions: The Persian version of FCRI could be considered a good cross-cultural equivalent for the original English version. The questionnaire was a reliable and valid instrument in terms of internal consistency, test-retest reliability, and dimensionality.


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Dorottya Őri ◽  
Sándor Rózsa ◽  
Péter Szocsics ◽  
Lajos Simon ◽  
György Purebl ◽  
...  

Abstract Background The Opening Minds Stigma Scale for Health Care Providers (OMS-HC) is a widely used questionnaire to measure the stigmatising attitudes of healthcare providers towards patients with mental health problems. The psychometric properties of the scale; however, have never been investigated in Hungary. We aimed to thoroughly explore the factor structure of the OMS-HC and examine the key psychometric properties of the Hungarian version. Methods The OMS-HC is a self-report questionnaire that measures the overall stigmatising attitude by a total score, and three subscales can be calculated: Attitude, Disclosure and Help-seeking, and Social Distance. Our study population included specialists and trainees in adult and child psychiatry (n = 211). Exploratory and confirmatory factor analyses were performed, and higher-order factors were tested. We calculated the test-retest reliability on a subgroup of our sample (n = 31) with a follow-up period of 1 month. The concurrent validity of the scale was measured with the Mental Illness: Clinician’s Attitudes-4 scale (MICA-4). Results Three factors were extracted based on a parallel-analysis. A bifactor solution (a general factor and three specific factors) showed an excellent model-fit (root mean square error of approximation = 0.025, comparative fit index = 0.961, and Tucker-Lewis index = 0.944). The model-based reliability was low; however, the general factor showed acceptable reliability (coefficient omega hierarchical = 0.56). The scale demonstrated a good concurrent validity with the MICA-4 [intraclass correlation coefficient (ICC) = 0.77]. The test-retest reliability was excellent for the general factor (ICC = 0.95) and good for the specific factors (ICC = 0.90, 0.88, and 0.84, respectively). Conclusions The three dimensions of the OMS-HC was confirmed, and the scale was found to be an adequate measure of the stigmatising attitude in Hungary. The bifactor model is more favourable as compared to the three correlated factor model; however, despite the excellent internal structure, its model-based reliability was low.


2018 ◽  
Vol 29 (07) ◽  
pp. 609-625 ◽  
Author(s):  
Navshika Chandra ◽  
Kevin Chang ◽  
Arier Lee ◽  
Giriraj S. Shekhawat ◽  
Grant D. Searchfield

AbstractThe effects of treatments on tinnitus have been difficult to quantify. The Tinnitus Functional Index (TFI) has been proposed as a standard questionnaire for measurement of tinnitus treatment outcomes. For a questionnaire to achieve wide acceptance, its psychometric properties need to be confirmed in different populations.To determine if the TFI is a reliable and valid measure of tinnitus, and if its psychometric properties are suitable for use as an outcome measure.A psychometric evaluation of the TFI from secondary data obtained from a cross-sectional clinic survey and a clinical trial undertaken in New Zealand.Confirmatory factor analysis and evaluation of internal consistency reliability were undertaken on a sample of 318 patients with the primary complaint of tinnitus. In a separate sample of 40 research volunteers, test–retest reliability, convergent and divergent validity were evaluated. Both samples consisted of predominantly older Caucasian male patients with tinnitus.The internal structure of the original US TFI was confirmed. The Cronbach’s Alpha and Intraclass correlation coefficients were >0.7 for the TFI overall and each of its subscales, indicating high internal consistency and test–retest reliability. Strong Pearson correlations with the Tinnitus Handicap Questionnaire and tinnitus numerical rating scales indicated excellent convergent validity, and a moderate correlation with the Hearing Handicap Inventory, indicated moderate divergent validity. Evaluation of the clinical trial showed good test–retest reliability and agreement between no-treatment baselines with a smallest detectable change of 4.8 points.The TFI is a reliable and valid measure of tinnitus severity in the population tested and is responsive to treatment-related change. Further research as to the TFI’s responsiveness to treatment is needed across different populations.


2018 ◽  
Vol 2018 ◽  
pp. 1-7 ◽  
Author(s):  
Giovanni Galeoto ◽  
Julita Sansoni ◽  
Michela Scuccimarri ◽  
Valentina Bruni ◽  
Rita De Santis ◽  
...  

Objective. The Geriatric Depression Scale (GDS) is an evaluation tool to diagnose older adult’s depression. This questionnaire was defined by Yesavage and Brink in 1982; it was designed expressly for the older person and defines his/her degree of satisfaction, quality of life, and feelings. The objective of this study is to evaluate the psychometric properties of the Italian translation of the Geriatric Depression Scale (GDS-IT). Methods. The Italian version of the Geriatric Depression Scale was administered to 119 people (79 people with a depression diagnosis and 40 healthy ones). We examined the following psychometric characteristics: internal consistency reliability, test-retest reliability, concurrent validity, and construct validity (factor structure). Results. Cronbach’s Alpha for the GDS-IT administered to the depressed sample was 0.84. Test-retest reliability was 0.91 and the concurrent validity was 0.83. The factorial analysis showed a structure of 5 factors, and the scale cut-off is between 10 and 11. Conclusion. The GDS-IT proved to be a reliable and valid questionnaire for the evaluation of depression in an Italian population. In the present study, the GDS-IT showed good psychometric properties. Health professionals now have an assessment tool for the evaluation of depression symptoms in the Italian population.


2021 ◽  
Vol 14 (2) ◽  
pp. 15-24
Author(s):  
Aidos K. Bolatov ◽  
Telman Z. Seisembekov ◽  
Altynay Zh. Askarova ◽  
Bakhyt Igenbayeva ◽  
Dariga S. Smailova ◽  
...  

Background. The Copenhagen Burnout Inventory (CBI) has demonstrated good psychometric properties among different populations, but there is no known data on its validity among Russian-speaking medical students. The CBI-Student Survey focuses only on fatigue, but measures exhaustion in four different life domains: Personal Burnout (PB), Studies-Related Burnout (SRB), Colleague-Related Burnout (CRB), and Teacher-Related Burnout (TRB). Objective. To investigate the psychometric properties of the Russian version of the Copenhagen Burnout Inventory–Student Survey (R-CBI-S). Design. A cross-sectional study was carried out among 771 medical students at Astana Medical University (Nur-Sultan, Kazakhstan). Statistical analyses included test-retest reliability, internal consistency, item analysis, convergent and concurrent validity, and confirmatory factor analysis. Concurrent validity was evaluated by bivariate correlations of R-CBI-S with anxiety, depression, and satisfaction with the study. Results. Test-retest reliability showed an ICC of 0.81. All item-total correlations for the total scale were positive (range 0.31–0.76). The Cronbach’s alpha coefficient was 0.94 (0.896 for PB, 0.884 for SRB, 0.874 for CRB, and 0.926 for TRB). The Barlett’s sphericity test result was significant (p < 0.001), and the KMO measure of sampling adequacy exceeded 0.947. Convergent validity analysis results: PB (AVE = 0.52, CR = 0.87), SRB (AVE = 0.50, CR = 0.87), CRB (AVE = 0.51, CR = 0.86), TRB (AVE = 0.56, CR = 0.88). The R-CBI-S achieved good levels of goodness-of-fit indices (RMSEA = 0.0611; CFI = 0.940; TLI = 0.933). Conclusion. The test results indicated that the R-CBI-S scale appears to be a reliable and valid instrument. The R-CBI-S may be a useful tool in future research to identify burnout factors based on specific life domains for developing effective prevention measures among medical students.


2021 ◽  
Author(s):  
Kiyoka Enomoto ◽  
Tomonori Adachi ◽  
Akira Mibu ◽  
Katsuyoshi Tanaka ◽  
Sei Fukui ◽  
...  

Abstract Background The Patterns of Activity Measure-Pain (POAM-P) is a self-report questionnaire that measures avoidance, overdoing, and pacing in individuals with chronic pain. We aimed to develop and confirm the psychometric properties of the Japanese version of the POAM-P(POAM-P-J) in Japanese individuals with chronic pain. Methods We recruited 147 Japanese individuals with chronic pain (106 women; mean age 64.89 ± 12.13 years). The individuals completed the POAM-P-J, the Brief Pain Inventory (BPI), and the Hospital Anxiety and Depression Scale (HADS). The following psychometric properties of the POAM-P-J were confirmed: structural validity, internal consistency, test-retest reliability, and concurrent validity. Results We tested factor structure via confirmatory factor analyses (CFA). We chose the 3-factor model with six covariances. The POAM-P-J’s internal consistency and test-retest reliability were acceptable to good (α = 0.79–0.86; ICC = 0.72–0.87). The avoidance and overdoing scales were positively associated with pain severity, pain interference, and anxiety measures (all p < 0.05), but the pacing scale was not significantly associated with these pain-related measures. Conclusions Although the structural validity of the POAM-P-J remains questionable, its internal consistency, test-retest reliability, and concurrent validity were confirmed. The POAM-P-J is useful in both research and clinical practice for evaluating the activity patterns of Japanese patients with chronic pain.


2017 ◽  
Vol 2017 ◽  
pp. 1-6 ◽  
Author(s):  
Somaya H. Malkawi ◽  
Sana M. N. Abu-Dahab ◽  
Ahmad F. Amro ◽  
Nihad A. Almasri

Background. The Preschool Activity Card Sort (PACS) is an interview-based assessment tool to measure participation of preschool children with age range from 3 to 6 years. Objective of Study. The purpose of this study was to establish the psychometric properties of the recently translated Arabic PACS (A-PACS). Methods. One hundred fifty-one Jordanian parents participated in the study representing different geographical areas. Children were almost equally distributed between males and females and into three age groups. Construct and concurrent validity were examined as well as the internal consistency of the scale and the test-retest reliability. Findings. The A-PACS was able to differentiate between the participation level of young and old children in the domains of education, community mobility, and low demand leisure of the A-PACS giving evidence to its construct validity and it significantly correlated with some aspects of the Vineland Adaptive Behavior Scale (VABS) giving evidence to its concurrent validity. The A-PACS showed excellent overall internal consistency (α=.859) for all domains and good test-retest reliability (r=.976, p<.001). Conclusion. The A-PACS can be considered as a valid and reliable tool to measure participation of preschool children with normal development from Arabic cultures. Future studies should focus on the validity of the A-PACS for use with children with disabilities.


Author(s):  
Negar Nikbakht ◽  
◽  
Mehdi Rezaee ◽  
Seyed Mehdi Tabatabaee ◽  
Gholam-Ali Shahidi ◽  
...  

Introduction: There is a need to have appropriate information about the ability of Parkinson's disease (PD) patients to perform cognitive instrumental activities of daily living (IADL). The purpose of the present study was to assess the psychometric properties of the Persian version of the Penn Parkinson's Daily Activities Questionnaire-15 (PDAQ-15). Methods: A total of 165 knowledgeable informants of PD patients completed the PDAQ-15. The Clinical Dementia Rating Scale, Hoehn and Yahr staging, Hospital Anxiety and Depression Scale (HADS) and Lawton IADL scale were included in the study. Internal consistency and test-retest reliability were evaluated by Cronbach's alpha coefficient and intraclass correlation coefficient (ICC), respectively. To examine the dimensionality of the questionnaire, exploratory factor analysis was used. The construct validity was assessed using Spearman rank correlation test. To assess the discriminative validity, PDAQ-15 scores were compared across cognitive stages. Results: The PDAQ-15 showed strong internal consistency (Cronbach's α = 0.99) and test-retest reliability (ICC= 0.99). Only one dimension identified for the PDAQ-15 in the factor analysis. There was strong correlation between PDAQ-15 with depression domain of HADS scale and Lawton IADL scale. (rs = |0.71–0.95|). The correlation of PDAQ-15 with anxiety domain of HADS scale was moderate (rs = 0.66). Discriminative validity analysis showed that the PDAQ-15 has significant power to discriminate between PD patients across cognitive stages. Conclusion: These results suggest that the PDAQ-15 is a valid and reliable PD-specific instrument that can be useful in clinical and research settings.


Author(s):  
Cheng Chen ◽  
Susanne Weyland ◽  
Julian Fritsch ◽  
Alexander Woll ◽  
Claudia Niessner ◽  
...  

Objective: The purposes of this paper were to (a) develop a new short, theory-driven, version of the physical activity enjoyment scale (PACES-S) using content analysis; and (b) subsequently to measure the psychometric properties (construct validity, internal consistency, test–retest reliability, and concurrent validity) of the PACES-S for adolescents. Methods: Six experts used a four-point Likert scale to assess the content validity of each of the 16 items of the physical activity enjoyment scale according to a provided definition of physical activity enjoyment. Based on the results, exploratory factor analysis was used to analyze survey data from a longitudinal study of 182 individuals (Measure 1 of Study 1: 15.75 ± 3.39 yrs; 56.6% boys, 43.4% girls), and confirmatory factor analysis (Measure 2 of Study 1: 15.69 ± 3.44 yrs; 56.3% boys, 43.7% girls) was used to analyze the survey data from a cross-sectional study of 3219 individuals (Study 2; 15.99 ± 3.10 yrs; 47.8% boys, 52.2% girls) to assess the construct validity of the new measure. To assess the reliability, test–retest reliability was assessed in Study 1 and internal consistency in Study 1 and 2. For the concurrent validity, correlations with self-reported and device-based physical activity behavior were assessed in both studies. Results: Four out of sixteen items were selected for PACES-S. Exploratory factor analysis and confirmatory factor analyses identified and supported its factorial validity (χ2 = 53.62, df = 2, p < 0.001; RMSEA = 0.073; CFI = 0.99; RFI = 0.96; NFI = 0.99; TLI = 0.96; IFI = 0.99). Results showed good test–retest reliability (r = 0.76) and internal consistency (a = 0.82 to 0.88). Regarding concurrent validity, the results showed positive correlations with a physical activity questionnaire (Study 1: r = 0.36), with a physical activity diary (Study 1: r = 0.44), and with accelerometer-recorded data (Study 1: r = 0.32; Study 2: r = 0.21). Conclusions: The results indicate that PACES-S is a reliable and valid instrument that may be particularly useful to measure physical activity enjoyment in large-scale studies. It shows comparable measurement properties as the long version of PACES.


2004 ◽  
Vol 84 (1) ◽  
pp. 62-74 ◽  
Author(s):  
Earllaine Croarkin ◽  
Jerome Danoff ◽  
Candice Barnes

AbstractIntroduction. Tests of upper-extremity motor function used for people following a stroke have been described, but reliability and validity (psychometric properties) of measurements obtained with these tests have not been consistently established. This investigation was performed: (1) to review literature relative to upper-extremity motor function testing during rehabilitation following a stroke, (2) to develop selection criteria for identifying these tests in the literature, and (3) to rate the tests relative to their psychometric properties. Method. Literature searches were done using 2 databases. Reports of 4 psychometric properties were sought: interrater reliability, test-retest reliability, convergent validity or concurrent validity, and predictive validity. Results. Nine tests met the inclusion criteria of having psychometric properties reported in the literature. No test had evidence for all 4 psychometric properties. Only the Nine-Hole Peg Test was supported by 3 out of 4 properties. Most tests had 2 properties supported. Concurrent validity or convergent validity was most frequently described; test-retest reliability was least frequently described. Conclusions. More complete psychometric support is needed for upper-extremity motor function tests applied following a stroke. The absence of psychometric support, however, does not mean that a test has no value. Clinicians are cautioned not to generalize psychometric evidence.


Sign in / Sign up

Export Citation Format

Share Document