Validity, Internal Consistency, and Test/Retest Reliability of a Localization Disabilities and Handicaps Questionnaire

2005 ◽  
Vol 16 (08) ◽  
pp. 585-595 ◽  
Author(s):  
Melissa N. Ruscetta ◽  
Catherine V. Palmer ◽  
John D. Durrant ◽  
Judith Grayhack ◽  
Carey Ryan

Psychometric evaluations were performed on a self-perceived localization disabilities and handicaps questionnaire. Twenty individuals with normal hearing bilaterally, twenty with profound unilateral hearing impairment (UHI), and ten with any degree of bilateral hearing impairment participated. Each subject completed the questionnaire. Comparisons of the responses of the subjects with normal hearing and those with UHI revealed significant differences among the groups for both disabilities and handicaps, establishing construct validity. Cronbach's Alpha correlational analyses of the responses of all subjects with hearing impairment revealed correlations of .900 (disabilities) and .800 (handicaps), establishing internal consistency. Each participant with hearing impairment was asked to complete the questionnaire again after three weeks. Pearson's correlational analyses of the responses at time one versus time two revealed correlations of .900 (disabilities) and .700 (handicaps), establishing test/retest reliability. This questionnaire is an appropriate tool for investigating the self-perceived localization disabilities and handicaps of individuals with hearing impairment.

2020 ◽  
Vol 9 (3) ◽  
Author(s):  
Anggi Setyowati ◽  
Min-Huey Chung ◽  
Ah. Yusuf ◽  
Setya Haksama

Background: Curiosity is a personality characteristic, which fits with wellbeing and positive functioning. The objective of this study was to assess the construct validity of the Curiosity and Exploration Inventory II (CEI-II) in Indonesia.Design and Methods: The study included 256 undergraduate students who lived in Indonesia, mean age 19.8 years old. The CEI-II measures stretching and embracing using 11 items. The English version of CEI-II was translated into Bahasa. The Cronbach’s alpha coefficient and intraclass correlation coefficient (ICC) were addressed to examine internal consistency reliability and the test-retest reliability. To evaluate construct validity, exploratory factor analysis (EFA) was used to assess factor structure and confirmatory factor analysis (CFA) was used to evaluate the structural model fit of the CEI-II Indonesia version.Results: The study showed Cronbach’s alpha for the internal consistency of the overall CEI-II Indonesia version was 0.77. The ICC for the test-retest reliability ranged between 0.753-0.829. EFA showed adequate with the Kaiser-Meyer-Olkin value of 0.86 and the Bartlett’s test of sphericity was statistically significant. CFA tested the second-order model with two-order factors and showed a model fit.Conclusions: The CEI-II Indonesia version indicated acceptable construct validity to evaluate curiosity in Indonesia.


BMJ Open ◽  
2017 ◽  
Vol 7 (8) ◽  
pp. e017250 ◽  
Author(s):  
Le Cai ◽  
Gerd Ahlström ◽  
Pingfen Tang ◽  
Ke Ma ◽  
David Edvardsson ◽  
...  

ObjectivesThe aim of the study was to evaluate the psychometric properties of a Chinese translation of the English version of the Person-centred Climate Questionnaire – Staff version (PCQ-S) for Chinese palliative care staff in a hospital context.DesignThis was a cross-sectional design. The 14-item English PCQ-S was translated and backtranslated using established procedures. Construct validity and reliability including internal consistency and test-retest reliability were assessed among hospital staff. Construct validity was tested using principal component analysis (PCA), internal consistency was assessed using Cronbach’s alpha, and test-retest reliability was evaluated with the weighted kappa (Kp), Pearson correlation coefficient (r) and intra-class correlation coefficient (ICC).SettingThis study was conducted in three hospitals in Kunming, the capital of Yunnan province in south-west China.ParticipantsA sample of hospital staff (n=163) on duty in the palliative care departments of three hospitals in Kunming consented to participate in the study.ResultsThe 14-item Chinese PCQ-S consists of the three subscales also present in other language versions. It showed strong internal consistency, with a Cronbach’s alpha of 0.94 for the total scale, 0.87 for the safety subscale, 0.90 for the everydayness subscale and 0.88 for the community subscale. The Chinese PCQ-S had high test-retest reliability as evidenced by a high Kp coefficient and a high correlation coefficient for all scales between test and retest scores, on ‘a climate of safety’ (Kp=0.77, r=0.88, p<0.01), ‘a climate of everydayness’ (Kp=0.82, r=0.91, p<0.01), ‘a climate of community’ (Kp=0.75, r=0.79, p<0.01), and on overall scale scores (Kp=0.85, r=0.93, p<0.01). The ICC to evaluate the test-retest reliability was 0.97 (95% CI 0.95 to 0.98).ConclusionsThe Chinese version of the PCQ-S showed satisfactory reliability and validity for assessing staff perceptions of person-centred care in Chinese hospital environments.


Folia Medica ◽  
2013 ◽  
Vol 55 (3-4) ◽  
pp. 56-62 ◽  
Author(s):  
Stefka G. Mantarova ◽  
Irena V. Velcheva ◽  
Spaska O. Georgieva ◽  
Katerina I. Stambolieva

ABSTRACT The last twenty years have witnessed a surge of interest in the autonomic symptoms in Parkinson’s disease (PD) and the possibilities to diagnose and treat them. The specialized questionnaire assessing the autonomic symptoms in Parkinson’s disease (SCOPA-AUT) has been validated and available in English, Dutch and Spanish. In this study we aim at evaluating the validity, reliability and applicability of the Bulgarian version of SCOPAAUT (SCOPA-AUT-BG ). PATIENTS AND METHODS: The study included 55 patients with idiopathic PD (mean age 64.4 ± 8.9 yrs), and 40 healthy controls (mean age 58.5 ± 9.4 yrs). Clinical severity and disease stage were assessed by United Parkinson’s disease rating scale (UPRDS) and Hoen and Yahr (H&Y). Thirty-two of the PD patients completed SCOPA-AUT-BG again after a 7-day interval. Questionnaire reliability was analyzed by determining the internal consistency, homogeneity, discriminatory and construct validity and test-retest reliability. RESULTS: Analyses showed good internal consistency of the summary evaluation of SCOPAAUT- BG (coefficient alpha of Cronbach = 0.79), which indicates the high reliability of the questionnaire. The lowest Cronbach’s alpha coefficient (0.53) was found for the subscale “cardiovascular functions”. A dominant role belongs to the subscales for gastrointestinal and urinary functions (Cronbach’s Alpha > 0.7), where a significantly high correlation of PD with the UPDRS scale was observed. We found high test-retest reliability based on the responses associated with dysfunction of the gastrointestinal, urinary, thermoregulatory and pupillary autonomic systems. The correlation of the results of SCOPA-AUT-BG with UPDRS is higher than that with H&Y, and the construct validity is high except for the cardiovascular and pupillomotor functions subscales. CONCLUSION: The results of this study show that SCOPA-AUT-BG is a valid and reliable specialized questionnaire to evaluate autonomic function in patients with Parkinson’s disease. Using it allows for more detailed clinical evaluation of these patients and justifies the need to refer them to specialized examination of autonomic functions.


2021 ◽  
Vol 25 (1) ◽  
pp. 9-17
Author(s):  
Teresa Smith ◽  
Alyson Filipa ◽  
Samantha Riveron ◽  
Melissa Strzelinski ◽  
Mark Paterno ◽  
...  

The Dance Functional Outcome Survey (DFOS) is a dance-specific questionnaire developed for use with ballet and modern dancers at all training levels. To date, no study has assessed the psychometric properties of the DFOS in pediatric dancers. The purposes of this study were to determine: 1. the reliability of the DFOS when used with healthy and injured pediatric dancers; 2. the validity of the DFOS com- pared to a well-established generic scale, the Pediatric Quality of Life Inventory Physical Function Scale (PedsQL-PFS); and 3. the sensitivity and responsiveness to change of the DFOS in injured dancers. One hundred and two dancers completed the DFOS twice within 10 days. Intra-class correlation coefficients (ICCs) were used to assess test-retest reliability. In a sample of 148 dancers, construct validity was explored by comparing the DFOS to the PedsQL-PFS using Pearson correlations, and Exploratory Factor Analysis (EFA) and Cronbach's alpha were used for internal consistency analyses. A sub-set of 22 injured dancers was employed to examine responsiveness using repeated measures analysis of variance (p < 0.05). The DFOS demonstrated high test-retest reliability (ICC ≥ 0.90). The DFOS total score, activities of daily living (ADL), and dance technique sub-scores had strong construct validity compared to the PedsQL-PFS (r ≥ 0.79). Cronbach's alpha was high ( α = 0.92), indicating excellent internal consistency. There were significant differences across time in DFOS scores (p < 0.001), demonstrating responsiveness to change. There were no floor or ceiling effects. Thus, the DFOS demonstrates excellent reliability, strong validity, and good responsiveness over time and is a viable tool for assessing function in pediatric dancers.


2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Pichitchai Atthakomol ◽  
Worapaka Manosroi ◽  
Saran Sanguanrungsirikul ◽  
Siraphop Punoppamas ◽  
Sirapat Benjachaya ◽  
...  

Abstract Background The Michigan Hand Questionnaire (MHQ) is widely used to assess the hand/wrist conditions. We translated the original version into Thai (Thai MHQ) and evaluated its psychometric properties. Methods After receiving permission, the original MHQ was translated and cross-culturally adapted to Thai following standard guidelines. Two hundred and seventeen patients who had hand/wrist injuries or disorders were included in the study. Internal consistency was evaluated using Cronbach’s alpha. Test-retest reliability was analyzed using the intraclass correlation coefficient (ICC). Spearman’s rank correlation among the subscales of Thai MHQ, Thai DASH and Thai EQ-5D-5L and also confirmatory factor analysis (CFA) were used to explore construct validity. The standardized response mean (SRM) was used to evaluate the responsiveness of the Thai MHQ. Results All subscales showed an acceptable Cronbach’s alpha (0.79–0.98). The test-retest reliability of each subscale was good (ICC = 0.83–0.95). In related dimensions, strong correlation was demonstrated between the Activities of daily living subscale of the Thai MHQ and the Common activities subscale in the Thai DASH (r = 0.77, P < 0.0001). For unrelated dimensions, a weak correlation was found between the Aesthetics subscale in the Thai MHQ and the Mobility subscale in the Thai EQ-5D-5L (r = − 0.13, P = 0.05). The Thai MHQ had strong correlation with Thai DASH (r = − 0.79, P < 0.0001) and Thai EQ-5D-5L (r = 0.63, P < 0.0001). CFA showed that the 6-factor model demonstrated an acceptable fit to the data. The SRM of the Thai MHQ was 0.78, indicating relatively large responsiveness. The MIC of Thai MHQ using distribution methods (SEM) was 5.2. Conclusions The Thai MHQ provides adequate internal consistency in all subscales as well as good construct validity and reliability for Thai patients and a relatively large standardized response mean at 2 months after treatment.


2019 ◽  
Vol 9 (2) ◽  
pp. 137-142 ◽  
Author(s):  
Elham Javanshir ◽  
Iman Dianat ◽  
Mohammad Asghari-Jafarabadi

Background: The Copenhagen Burnout Inventory (CBI) is a commonly used tool for evaluation of job burnout in three (personal, work-related and client-related) domains. The aims of this study were to translate and investigate the psychometric properties of the Iranian (Persian) CBI. Methods: A total of 750 employees of different occupations (from educational centres, healthcare, industrial settings, and social services) participated in this descriptive methodological study. Aforward-backward procedure was applied and content validity was evaluated by a panel of10 experts. Exploratory and confirmatory factor analyses were used for construct validity. The internal consistency (using Cronbach’s alpha), test-retest reliability (using intraclass correlation coefficient – ICC), and feasibility (using ceiling and floor effect) were also assessed for this tool. Results: Content validity of the Persian CBI was established. Three-factor structure of the PersianCBI was supported by the factor analysis, and this confirmed the construct validity of the instrument. The internal consistency (Cronbach’s alpha ranged from 0.82 to 0.90) and test-retest reliability (ICC ranged from 0.85 to 0.95) were excellent and there was no ceiling or floor effect. Conclusion: The Persian CBI is a valid and reliable measurement tool for burnout in the Iranian context.


2020 ◽  
Author(s):  
Laura Elizabeth Bedford ◽  
Maegan Hon Yan Yeung ◽  
Chi Ho Au ◽  
Emily Tsui Yee Tse ◽  
Wing Yee Yim ◽  
...  

Abstract Background Patient enablement is a core tenet of patient-centred and holistic primary care. The Patient Enablement Instrument (PEI) is a transitional measure limited in its ability to measure changes over time. A modified version, PEI-2, has been developed to measure enablement at a given time-point without comparison to a recalled baseline. Objective To assess the validity, reliability, sensitivity and responsiveness of PEI-2. Methods PEI-2 was modified from the Chinese PEI to assess enablement over 4 weeks in a prospective cohort study nested within a community support programme [Trekkers Family Enhancement Scheme (TFES)] in Hong Kong. Construct validity was assessed by factor analysis and convergent validity by Spearman’s correlations with health-related quality of life and depressive symptoms. Internal reliability was assessed using Cronbach’s alpha. Test–retest reliability was assessed by intraclass correlation (ICC), responsiveness by 12–24-month change in PEI-2 score and sensitivity by differences in change of PEI-2 score between TFES participants and a control group. Results PEI-2 demonstrated construct validity with all items loading on one factor (factor loadings &gt;0.7). Convergent validity was confirmed by significant correlations with 12-item Short Form Questionnaire, version 2 (r = 0.1089–0.1919) and Patient Health Questionnaire-9 (r = −0.2030). Internal reliability was high (Cronbach’s alpha = 0.9095) and test–retest reliability moderate (ICC = 0.520, P = 0.506). Significant improvements in PEI-2 scores among the TFES group suggested good responsiveness (P &lt; 0.001). The difference in change of PEI-2 scores between TFES and control was significant (P = 0.008), indicating good sensitivity. Conclusions This study supports the validity, reliability, sensitivity and responsiveness of PEI-2 in measuring changes in enablement, making it a promising tool for evaluating enablement in cohort and intervention studies.


2020 ◽  
Author(s):  
Victoria Long ◽  
Yin Bun Cheung ◽  
Debra Qu ◽  
Katherine Lim ◽  
Guozhang Lee ◽  
...  

Abstract Context: Measurement of patient-centred outcomes enables clinicians to focus on patient and family priorities and enables quality of palliative care to be assessed.Objectives: This study aimed to evaluate the validity and reliability of the English and translated Chinese IPOS among advanced cancer patients in Singapore.Methods: IPOS was forward and backward translated from English into Chinese. Structural validity was assessed by confirmatory factor analysis; known-group validity by comparing inpatients and community patients; construct validity by correlating IPOS with Edmonton Symptom Assessment System-revised (ESAS-r) and Functional Assessment of Cancer Therapy–General (FACT-G); internal consistency by Cronbach’s alpha; inter-rater reliability between patient and staff responses; test-retest reliability of patient responses between two timepoints.Results: 111 English-responding and 109 Chinese-responding patients participated. The three-factor structure (Physical Symptoms, Emotional Symptoms and Communication and Practical Issues) was confirmed with Comparative Fit Index and Tucker-Lewis-Index > 0.9 and Root Mean Square Error of Approximation < 0.08. Inpatients scored higher than outpatients as hypothesised. Construct validity (Pearson’s correlation coefficient, r≥|0.608|) was shown between the related subscales of IPOS and FACT-G and ESAS-r. Internal consistency was confirmed for total and subscale scores (Cronbach's alpha ≥ 0.84), except for the Communication and Practical Issues subscale (Cronbach’s alpha = 0.29–0.65). Inter-rater reliability (Intra-class correlation coefficient [ICC] ≤ 0.43) between patient and staff responses was insufficient. Test-retest reliability was confirmed with Intra-class correlation coefficient ICC = 0.80 (English) and 0.88 (Chinese) for IPOS Total.Conclusion: IPOS in English and Chinese showed good validity, good internal consistency, and good test-retest reliability, except for the Communication and Practical Issues subscale. There was poor inter-rater reliability between patients and staff.


2020 ◽  
Author(s):  
Ammar Abdulrahman Jairoun ◽  
Sabaa Saleh Al-Hemyari ◽  
Moyad Shahwan ◽  
Faris El-Dahiyat ◽  
SHAZIA Jamshed

Abstract Background: Since the time of declaration of global pandemic of COVID-19 by World Health Organization (WHO), falsified hand sanitizers surfaced regularly in markets, posing possible harm to public due to unlisted inclusion of methanol. The current research is an attempt to develop and validate a tool to document falsified hand sanitizer in the UAE community.Method: A descriptive cross-sectional community-based study was conducted among 1280 randomly selected participants. Respondents were sent a web-based electronic link to the survey via email. Content validity, factor analyses and known group validity were used to develop and validate a new scale to identify falsified hand sanitizer. Test-retest reliability, internal consistency, item internal consistency (IIC), and intraclass correlation coefficients (ICCs) were used to assess the reliability of the scale. SPSS version 24 was used to conduct data analysis.Results: A total of 1280 participants were enrolled in the study. The content validity index (CVI) was 0.83 with the final scale of 12 items. The Kaiser-Meyer-Olkin (KMO) value was 0.788, with the Bartlett test of sphericity achieving statistical significance (p <0.001). Our factor analysis revealed a 3-component model. The 3-factor solution was confirmed by PCFA analysis and had associations with good fit values. The PCFA for NFI was 0.970, CFI 0.978, and TLI 0.967. All values were in excess of 0.95, with RMSEA values below 0.06 at 0.03; all of these values indicated a good model fit. The Cronbach's alpha was good overall (0.867). All factors had a Cronbach's alpha value in excess of 0.70. The instrument demonstrated that every item met the IIC correlation standard ≥ 0.40. The scale displayed good overall ICC statistics of 0.867 (95% CI 0.856 - 0.877) with statistical significance (p < 0.001). The scale's test-retest reliability was assessed through correlation of the falsified hand sanitizer identification score of respondents at the two time points. The test-retest correlation coefficient was 0.770 (p value <0.01). Participants with post-graduate education were more likely to identify the falsified hand sanitizer compared to those with high school education. (p < 0.001).Conclusions: This study developed and validated a new scale for the measurement of falsified hand sanitizer. This is expected to improve and promote collaboration between the health regulators and the public and hereby encourage customer satisfaction and participation.


2021 ◽  
pp. 003151252110497
Author(s):  
Marco Tofani ◽  
Giulia Blasetti ◽  
Luca Lucibello ◽  
Anna Berardi ◽  
Giovanni Galeoto ◽  
...  

Limitations in hand function are common among children with cerebral palsy (CP), with almost 50% presenting an arm–hand dysfunction. However, there is no standardized assessment tool available in Italian for evaluating bimanual performance for this population. Our objective in this study was to evaluate the psychometric properties of an Italian translation of the ABILHAND-Kids (ABILHAND-Kids-IT) among children with CP. We examined internal consistency using Cronbach’s Alpha and Omega coefficients, and we investigated test-retest reliability with intraclass correlation coefficients (ICC). We performed explorative factor analysis (EFA) to investigate structural validity. We calculated Pearson’s correlation coefficients between the ABILAND-Kids IT and the Manual Ability Classification System (MACS) to assess criterion validity; and, to demonstrate the score variability of the ABILHAND-Kids-IT, we used analyses of variance (ANOVAs) to compare the 181 children with CP in this sample with their levels on the MACS. We enrolled 181 children with CP in the study. EFA confirmed a uni-dimensional scale. We obtained internal consistency on both Cronbach’s Alpha and Omega coefficient of 0.98, and a one-week test-retest reliability analysis revealed an ICC with 95% of confidence interval of .992. The ANOVA revealed significant score variability ( p < 0.01) and the Pearson correlation coefficient comparing the ABILHAND-Kids-It score with the MACS was –0.929 ( p < 0.01). We conclude that the ABILHAND-Kids-IT is valid and reliable for use with Italian children with CP.


Sign in / Sign up

Export Citation Format

Share Document