scholarly journals Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e031580
Author(s):  
Cai Le ◽  
Ke Ma ◽  
Pingfen Tang ◽  
David Edvardsson ◽  
Lina Behm ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Intraclass Correlation ◽  
Psychometric Evaluation ◽  
Quality Of Healthcare ◽  
Hospital Staff ◽  
Chinese Version ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Care Assessment ◽  
Test Retest Reliability

ObjectiveThis study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties.DesignP-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made.SettingTwo hospitals covering urban and suburban areas of Kunming in the Yunnan province of China.Participants152 female hospital staff completed the survey.Main outcome measure(s)Construct validity and reliability, including internal consistency and test–retest reliability, were assessed among a sample of hospital staff.ResultsThe factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach’s alpha of 0.91–0.94 for the scales and a test–retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95).ConclusionP-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

A Novel Tool for the Assessment of Sport Climbers’ Movement Performance

2020 ◽  
Vol 15 (6) ◽  
pp. 795-800 ◽  
Author(s):  
Nicola Taylor ◽  
David Giles ◽  
Micha Panáčková ◽  
James Mitchell ◽  
Joel Chidley ◽  
...  
Keyword(s):  
Performance Assessment ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Consultation Process ◽  
Retest Reliability ◽  
Performance Factors ◽  
Sport Climbing ◽  
Movement Performance ◽  
Test Retest Reliability

Purpose: To assess the validity and reliability of a novel movement-performance assessment tool for climbing/sport climbing. Methods: First, salient climbing movement-performance factors were identified through an iterative consultation process with 10 expert climbing coaches; the resulting Climber’s Movement Performance Assessment Tool (CM-PAT) contained 14 items in 5 categories. Second, 61 intermediate to advanced climbers ascended a single route, which was video recorded. Subsequently, 4 experienced (>10 y coaching) coaches used the CM-PAT to observe and score the climbers’ performance. Interrater reliability and comparisons with existing measures of climbing performance (6-mo self-reported ability, success and failure, climbing pace [m·min−1], and geometric entropy) were made. Results: Intraclass correlation coefficient (2,k) for the 4 raters demonstrated excellent reliability (>.81) between observers and good to excellent test–retest reliability (.71–.91). Pearson correlations between self-reported ability and CM-PAT scores explained 61% of the variance in self-reported climbing performance compared with 16% for geometric entropy and 52% for climbing pace. Considering differences in successful and unsuccessful climbers, the CM-PAT (P < .0005; d = 2.14), geometric entropy (P = .014; d = 0.67), and pace (P < .0005; d = 1.88) were able to differentiate between groups. Conclusions: The CM-PAT is the first sport climbing performance observational instrument to be developed through a thorough iterative process with expert coaches. Excellent interrater and test–retest reliability and excellent agreement with self-reported ability and with existing quantitative measures of performance support its recommendation for use in coaching and research contexts. Notably, a key advantage over existing measures is the identification of coachable elements of performance.

scholarly journals Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging

Nutrients ◽  
2018 ◽  
Vol 10 (10) ◽  
pp. 1522 ◽  
Author(s):  
Anne Gilsing ◽  
Alexandra Mayhew ◽  
Hélène Payette ◽  
Bryna Shatenstein ◽  
Sharon Kirkpatrick ◽  
...  
Keyword(s):  
Longitudinal Study ◽  
Assessment Tool ◽  
Dietary Assessment ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Food Groups ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
System Usability Scale ◽  
Test Retest Reliability

This study assessed test-retest reliability and relative validity of the Short Diet Questionnaire (SDQ) and usability of an online 24 h recall among 232 participants (62 years ± 9.1; 49.6% female) from the Canadian Longitudinal Study on Aging (CLSA). Participants were asked to complete four 24 h dietary recalls (24HRs) using the Automated Self-Administered 24-h Dietary Assessment Tool (ASA24-Canada-2014), two SDQ administrations (prior to recalls one and four), and the System Usability Scale (SUS) for ASA24. For the SDQ administrations, Intraclass Correlation Coefficients ranged from 0.49 to 0.57 for nutrients and 0.35 to 0.72 for food groups. Mean intakes estimated from the SDQ were lower compared than those from the 24HRs. For nutrients, correlation coefficients were highest for fiber, calcium, and vitamin D (45–64 years: 0.59, 0.50, 0.51; >65 years: 0.29, 0.38, 0.49, p < 0.01); Kappas ranged from 0.14 to 0.37 in those 45–64 years and 0.17 to 0.32 in participants >65 years. Among the 70% who completed all recalls independently, the SUS indicated poor usability, though the majority reported feeling confident using ASA24. Overall, the SDQ captures intake with varying test-retest reliability and accuracy by nutrient and age. Further research is needed to inform use of a more comprehensive dietary measure in the CLSA.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Therapeutic Interventions ◽  
Treatment Burden ◽  
Validity And Reliability ◽  
Stroke Patients ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Validity and reliability of the Turkish version of the Patient Dignity Inventory

2021 ◽  
pp. 1-8
Author(s):  
Yasemin Eskigülek ◽  
Sultan Kav
Keyword(s):  
Palliative Care ◽  
Factor Analysis ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Turkish Version ◽  
Retest Reliability ◽  
Significant Difference ◽  
Test Retest Reliability ◽  
Fit Index ◽  
Turkish Society

Abstract Objective The aim of this study was to investigate the validity and reliability of the Patient Dignity Inventory (PDI) in the Turkish society, which was developed to evaluate dignity-related distress in palliative care patients. Methods One hundred and twenty-seven adults with advanced cancer hospitalized in several clinics of two university hospitals were included in the study. The patients whose Palliative Performance Scale score was at least 40% were recruited to study. The data were collected with a patient demographic form, the Turkish version of Hospital Anxiety and Depression Scale (HADS-TR), and the Turkish version of the PDI (PDI-TR). The PDI-TR was finalized and back-translated after translating into Turkish and obtaining 10 expert opinions. Exploratory and confirmatory factor analysis, internal consistency, concurrent validity, and test–retest reliability analysis were performed. Results The Cronbach's α coefficient of PDI-TR was 0.94. Factor analysis resulted in a five-factor solution, and all items were loaded on factors. Factors were labeled as symptom distress, existential distress, self-confidence, dependency, and supportive care needs and accounted for 68.70% of the overall variance. The model's normed fit index, comparative fit index, and X2/SD were found between acceptable range (0.90, 0.93, and 2.64, respectively). A positive and strong correlation was found between subdimension scores of HADS-TR and the total score of PDI-TR (r = 0.70 for anxiety subdimension; r = 0.73 for depression subdimension). The test–retest reliability was conducted with 32 patients within the sample two weeks after the first application, and no significant difference was found between the two application scores as the result of paired-sample t-test (p > 0.05). An intraclass correlation coefficient of test–retest reliability was r = 0.855. Significance of results PDI-TR was found to be a valid and reliable tool in palliative care patients in Turkish society.

scholarly journals Adaptation and Psychometric Evaluation of the Chinese Counseling Competencies Scale-Revised

2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Psychometric Evaluation ◽  
Counseling Competencies ◽  
Counselors In Training ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.

scholarly journals Gait Asymmetry Post-Stroke: Determining Valid and Reliable Methods Using a Single Accelerometer Located on the Trunk

Sensors ◽  
2019 ◽  
Vol 20 (1) ◽  
pp. 37 ◽  
Author(s):  
Christopher Buckley ◽  
M. Encarna Micó-Amigo ◽  
Michael Dunne-Willows ◽  
Alan Godfrey ◽  
Aodhán Hickey ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Intraclass Correlation ◽  
Future Research ◽  
Validity And Reliability ◽  
Gait Symmetry ◽  
Retest Reliability ◽  
Post Stroke ◽  
Gait Asymmetry ◽  
Test Retest Reliability ◽  
Cardinal Symptom

Asymmetry is a cardinal symptom of gait post-stroke that is targeted during rehabilitation. Technological developments have allowed accelerometers to be a feasible tool to provide digital gait variables. Many acceleration-derived variables are proposed to measure gait asymmetry. Despite a need for accurate calculation, no consensus exists for what is the most valid and reliable variable. Using an instrumented walkway (GaitRite) as the reference standard, this study compared the validity and reliability of multiple acceleration-derived asymmetry variables. Twenty-five post-stroke participants performed repeated walks over GaitRite whilst wearing a tri-axial accelerometer (Axivity AX3) on their lower back, on two occasions, one week apart. Harmonic ratio, autocorrelation, gait symmetry index, phase plots, acceleration, and jerk root mean square were calculated from the acceleration signals. Test–retest reliability was calculated, and concurrent validity was estimated by comparison with GaitRite. The strongest concurrent validity was obtained from step regularity from the vertical signal, which also recorded excellent test–retest reliability (Spearman’s rank correlation coefficients (rho) = 0.87 and Intraclass correlation coefficient (ICC21) = 0.98, respectively). Future research should test the responsiveness of this and other step asymmetry variables to quantify change during recovery and the effect of rehabilitative interventions for consideration as digital biomarkers to quantify gait asymmetry.

scholarly journals Concurrent Validity and Reliability of My Jump 2 App for Measuring Vertical Jump Height in Recreationally Active Adults

2020 ◽  
Vol 10 (11) ◽  
pp. 3805 ◽  
Author(s):  
Špela Bogataj ◽  
Maja Pajek ◽  
Slobodan Andrašić ◽  
Nebojša Trajković
Keyword(s):  
Concurrent Validity ◽  
Female Athletes ◽  
Vertical Jump ◽  
Intraclass Correlation ◽  
Jump Height ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Study Results ◽  
Test Retest Reliability ◽  
Active Adults

This study aimed to examine the reliability, validity, and usefulness of the smartphone-based application, My Jump 2, against Optojump in recreationally active adults. Participants (18 women, 28.9 ± 5.6 years, and 26 men, 30.1 ± 10.6 years) completed squat jumps (SJ), counter-movement jumps (CMJ), and CMJ with arm swing (CMJAS) on Optojump and were simultaneously recorded using My Jump 2. To evaluate concurrent validity, jump height, calculated from flight time attained from each device, was compared for each jump type. Test-retest reliability was determined by replicating data analysis of My Jump 2 recordings on two occasions separated by two weeks. High test-retest reliability (Intraclass correlation coefficient (ICC) > 0.93) was observed for all measures in both male and female athletes. Very large correlations were observed between the My Jump 2 app and Optojump for SJ (r = 0.95, p = 0.001), CMJ (r = 0.98, p = 0.001), and CMJAS (r = 0.98, p = 0.001) in male athletes. Similar results were obtained for female recreational athletes for all jumps (r > 0.94, p = 0.001). The study results suggest that My Jump 2 is a valid, reliable, and useful tool for measuring vertical jump in recreationally active adults. Therefore, due to its simplicity and practicality, it can be used by practitioners, coaches, and recreationally-active adults to measure vertical jump performance with a simple test as SJ, CMJ, and CMJAS.

Psychometric Evaluation of the Modified CARE-Q Among Chinese Nurses in Taiwan

2006 ◽  
Vol 10 (4) ◽  
pp. 8-13 ◽  
Author(s):  
Mei-Hua Lee, ◽  
Patricia J. Larson, ◽  
William L. Holzemer,
Keyword(s):  
Internal Consistency ◽  
Psychometric Evaluation ◽  
Likert Scale ◽  
Chinese Version ◽  
Coefficient Alpha ◽  
English Version ◽  
Original English Version ◽  
Retest Reliability ◽  
Caring Behaviors ◽  
Test Retest Reliability

The purpose of this study was to modify the CARE-Q into a 7-point Likert scale to measure the perceived frequency of caring behaviors from the nurse’s perspective. Potential participants were asked to self-administer a Chinese version of the questionnaire. The agreement for the equivalence of meaning between the Chinese version and the original English version was rated as 96% accurate for the 50 items. Test-retest reliability was 0.803 for the modified CARE-Q tested at a 2-week interval. The internal consistency for an overall coefficient alpha was 0.97 for the total scale of the modified CARE-Q and ranged from 0.82 to 0.92 for the subscales. Study findings suggest further research to delete overlapping items. Testing with different samples is also warranted.education are discussed.

scholarly journals Development and Validity of the Questionnaire of Patients' Experiences in Postacute Outpatient Physical Therapy Settings

2015 ◽  
Vol 95 (5) ◽  
pp. 767-777 ◽  
Author(s):  
Francesc Medina-Mirapeix ◽  
María Elena del Baño-Aledo ◽  
Jacinto Javier Martínez-Payá ◽  
María Carmen Lillo-Navarro ◽  
Pilar Escolar-Reina
Keyword(s):  
Factor Structure ◽  
Health Care Quality ◽  
Discriminant Validity ◽  
Care Delivery ◽  
Intraclass Correlation ◽  
Care Quality ◽  
Validity And Reliability ◽  
Study Objective ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundPatient feedback surveys are increasingly seen as a key component of health care quality monitoring and improvement.ObjectiveThe study objective was to describe the development and initial psychometric evaluation of a fixed-length questionnaire about the experiences of patients receiving physical therapist treatment in postacute outpatient settings.DesignThis was an instrument development study with validity and reliability testing.MethodsA total of 465 participants attending 3 rehabilitation centers for musculoskeletal conditions completed the questionnaire. A cognitive pretest was applied to the draft version (n=94), and a revised version was evaluated for test-retest reliability (n=90). Analyses to evaluate variance and nonresponse rates for items, the factor structure of the questionnaire, and the metric properties of multi-item scales were conducted.ResultsExploratory factor analyses yielded evidence for a 7-factor structure of the questionnaire, with 3 factors that may be conceptually viewed as professionals' attitudes and behavior (providing information and education, sensitivity to patients' changes, and emotional support) and 4 factors that conceptually reflect organizational environment (duration of attendance, interruptions during care delivery, waiting times, and patient safety). Item-scale correlations ranged from .70 to .93. The percentage of scaling success was 100% for all of the scales. Cronbach alpha coefficients ranged from .70 to .87. Intraclass correlation coefficients ranged from .57 to .80 (median=.68).LimitationsGeneralization to other patients is not known.ConclusionsThe questionnaire has test-retest reliability, and the scales have internal consistency and convergent and discriminant validity. All of the scales are distinct and unidimensional.

scholarly journals Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa

2013 ◽  
Vol 5 (1) ◽  
Author(s):  
Louis Jenkins ◽  
Bob Mash ◽  
Anselme Derese
Keyword(s):  
South Africa ◽  
Family Medicine ◽  
Assessment Tool ◽  
Portfolio Assessment ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Competency Based ◽  
The Difference ◽  
Test Retest Reliability

Background: Competency-based education and the validity and reliability of workplace-based assessment of postgraduate trainees have received increasing attention worldwide.Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country.Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa.Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-classcorrelation was considered to be > 0.80.Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80.Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.

Sign in / Sign up

Export Citation Format

Share Document