Development of the Teaching Interpersonal Skills for Telehealth Checklist

While interpersonal skills in telehealth may positively impact clinical practice, patient engagement and outcomes, assessment strategies are lacking. We conducted a multi-stage iterative approach to develop and test validity and reliability of the Teaching Interpersonal Skills in Telehealth checklist (TIPS-TC). First, we identified observable communication behaviors from the literature. Second, we surveyed telehealth managers and researchers (N = 11) to rate appropriateness of potential checklist items. Level of agreement (35%–91%) and Kappa statistic (0.18–0.89) confirmed items to be retained and identified items to modify. Based on response patterns and comments, we reduced 44 items to 12 critical checklist behaviors. Third, student clinicians used the checklist with video telehealth consultations and provided feedback. Fourth, we conducted reliability testing with practitioners and administrators (N = 68) who completed the TIPS-TC for two versions of a telehealth scenario. Strong interrater reliability intraclass correlation coefficient (ICC) and test-retest reliability ICC (both p < .001), along with non-significant findings of order effects supported the checklist as an acceptable instrument to differentiate high skill from low skill telehealth sessions. The TIPS-TC offers an evidence-based approach to assessing interpersonal skills in telehealth to help evaluate clinician competence and tailor learning activities across disciplinary roles.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Validity and reliability of the Turkish version of the Patient Dignity Inventory

Palliative & Supportive Care ◽

10.1017/s1478951521000948 ◽

2021 ◽

pp. 1-8

Author(s):

Yasemin Eskigülek ◽

Sultan Kav

Keyword(s):

Palliative Care ◽

Factor Analysis ◽

Intraclass Correlation ◽

Validity And Reliability ◽

Turkish Version ◽

Retest Reliability ◽

Significant Difference ◽

Test Retest Reliability ◽

Fit Index ◽

Turkish Society

Abstract Objective The aim of this study was to investigate the validity and reliability of the Patient Dignity Inventory (PDI) in the Turkish society, which was developed to evaluate dignity-related distress in palliative care patients. Methods One hundred and twenty-seven adults with advanced cancer hospitalized in several clinics of two university hospitals were included in the study. The patients whose Palliative Performance Scale score was at least 40% were recruited to study. The data were collected with a patient demographic form, the Turkish version of Hospital Anxiety and Depression Scale (HADS-TR), and the Turkish version of the PDI (PDI-TR). The PDI-TR was finalized and back-translated after translating into Turkish and obtaining 10 expert opinions. Exploratory and confirmatory factor analysis, internal consistency, concurrent validity, and test–retest reliability analysis were performed. Results The Cronbach's α coefficient of PDI-TR was 0.94. Factor analysis resulted in a five-factor solution, and all items were loaded on factors. Factors were labeled as symptom distress, existential distress, self-confidence, dependency, and supportive care needs and accounted for 68.70% of the overall variance. The model's normed fit index, comparative fit index, and X2/SD were found between acceptable range (0.90, 0.93, and 2.64, respectively). A positive and strong correlation was found between subdimension scores of HADS-TR and the total score of PDI-TR (r = 0.70 for anxiety subdimension; r = 0.73 for depression subdimension). The test–retest reliability was conducted with 32 patients within the sample two weeks after the first application, and no significant difference was found between the two application scores as the result of paired-sample t-test (p > 0.05). An intraclass correlation coefficient of test–retest reliability was r = 0.855. Significance of results PDI-TR was found to be a valid and reliable tool in palliative care patients in Turkish society.

Download Full-text

Cultural adaptation, validity and reliability of the Turkish version of the Örebro Musculoskeletal Pain Questionnaire in acute and subacute neck pain

International Journal of Therapy and Rehabilitation ◽

10.12968/ijtr.2020.0040 ◽

2021 ◽

Vol 28 (10) ◽

pp. 1-12

Author(s):

Şule Şimşek ◽

Nesrin Yağcı ◽

Hande Şenol

Keyword(s):

Neck Pain ◽

Musculoskeletal Pain ◽

Intraclass Correlation ◽

Neck Disability Index ◽

Fear Avoidance ◽

Validity And Reliability ◽

Pain Questionnaire ◽

Örebro Musculoskeletal Pain Questionnaire ◽

Neck Disability ◽

Test Retest Reliability

Background/aims The Örebro Musculoskeletal Pain Questionnaire is categorised as a ‘yellow flag’ pain-associated psychological distress screening tool, which predicts long-term disability. The aim of this study was to assess the validity and reliability of the Turkish translation of the Örebro Musculoskeletal Pain Questionnaire in patients with acute and subacute neck pain. Methods The test–retest reliability and internal consistency were assessed with the intraclass correlation coefficient and Cronbach's α. Construct validity was assessed with a visual analogue scale, the Neck Disability Index and the Fear Avoidance Belief Questionnaire. Results Cronbach's α value was found to be 0.790, test–retest reliability was 0.99. The intraclass correlation coefficient was 0.999 (95% confidence interval: 0.998–0.999; P=0.000). The Örebro Musculoskeletal Pain Questionnaire showed a moderate positive correlation with the Neck Disability Index (r=0.544; P=0.0001), a weak correlation with the Fear Avoidance Belief Questionnaire (r=0.264; P=0.0001) but no correlation with the visual analogue scale. Conclusions The Turkish version of the Örebro Musculoskeletal Pain Questionnaire is a valid, reliable and acceptable screening tool in patients with acute and subacute neck pain.

Download Full-text

A Novel Tool for the Assessment of Sport Climbers’ Movement Performance

International Journal of Sports Physiology and Performance ◽

10.1123/ijspp.2019-0311 ◽

2020 ◽

Vol 15 (6) ◽

pp. 795-800 ◽

Cited By ~ 1

Author(s):

Nicola Taylor ◽

David Giles ◽

Micha Panáčková ◽

James Mitchell ◽

Joel Chidley ◽

...

Keyword(s):

Performance Assessment ◽

Assessment Tool ◽

Intraclass Correlation ◽

Validity And Reliability ◽

Consultation Process ◽

Retest Reliability ◽

Performance Factors ◽

Sport Climbing ◽

Movement Performance ◽

Test Retest Reliability

Purpose: To assess the validity and reliability of a novel movement-performance assessment tool for climbing/sport climbing. Methods: First, salient climbing movement-performance factors were identified through an iterative consultation process with 10 expert climbing coaches; the resulting Climber’s Movement Performance Assessment Tool (CM-PAT) contained 14 items in 5 categories. Second, 61 intermediate to advanced climbers ascended a single route, which was video recorded. Subsequently, 4 experienced (>10 y coaching) coaches used the CM-PAT to observe and score the climbers’ performance. Interrater reliability and comparisons with existing measures of climbing performance (6-mo self-reported ability, success and failure, climbing pace [m·min−1], and geometric entropy) were made. Results: Intraclass correlation coefficient (2,k) for the 4 raters demonstrated excellent reliability (>.81) between observers and good to excellent test–retest reliability (.71–.91). Pearson correlations between self-reported ability and CM-PAT scores explained 61% of the variance in self-reported climbing performance compared with 16% for geometric entropy and 52% for climbing pace. Considering differences in successful and unsuccessful climbers, the CM-PAT (P < .0005; d = 2.14), geometric entropy (P = .014; d = 0.67), and pace (P < .0005; d = 1.88) were able to differentiate between groups. Conclusions: The CM-PAT is the first sport climbing performance observational instrument to be developed through a thorough iterative process with expert coaches. Excellent interrater and test–retest reliability and excellent agreement with self-reported ability and with existing quantitative measures of performance support its recommendation for use in coaching and research contexts. Notably, a key advantage over existing measures is the identification of coachable elements of performance.

Download Full-text

Gait Asymmetry Post-Stroke: Determining Valid and Reliable Methods Using a Single Accelerometer Located on the Trunk

Sensors ◽

10.3390/s20010037 ◽

2019 ◽

Vol 20 (1) ◽

pp. 37 ◽

Cited By ~ 5

Author(s):

Christopher Buckley ◽

M. Encarna Micó-Amigo ◽

Michael Dunne-Willows ◽

Alan Godfrey ◽

Aodhán Hickey ◽

...

Keyword(s):

Concurrent Validity ◽

Intraclass Correlation ◽

Future Research ◽

Validity And Reliability ◽

Gait Symmetry ◽

Retest Reliability ◽

Post Stroke ◽

Gait Asymmetry ◽

Test Retest Reliability ◽

Cardinal Symptom

Asymmetry is a cardinal symptom of gait post-stroke that is targeted during rehabilitation. Technological developments have allowed accelerometers to be a feasible tool to provide digital gait variables. Many acceleration-derived variables are proposed to measure gait asymmetry. Despite a need for accurate calculation, no consensus exists for what is the most valid and reliable variable. Using an instrumented walkway (GaitRite) as the reference standard, this study compared the validity and reliability of multiple acceleration-derived asymmetry variables. Twenty-five post-stroke participants performed repeated walks over GaitRite whilst wearing a tri-axial accelerometer (Axivity AX3) on their lower back, on two occasions, one week apart. Harmonic ratio, autocorrelation, gait symmetry index, phase plots, acceleration, and jerk root mean square were calculated from the acceleration signals. Test–retest reliability was calculated, and concurrent validity was estimated by comparison with GaitRite. The strongest concurrent validity was obtained from step regularity from the vertical signal, which also recorded excellent test–retest reliability (Spearman’s rank correlation coefficients (rho) = 0.87 and Intraclass correlation coefficient (ICC21) = 0.98, respectively). Future research should test the responsiveness of this and other step asymmetry variables to quantify change during recovery and the effect of rehabilitative interventions for consideration as digital biomarkers to quantify gait asymmetry.

Download Full-text

Concurrent Validity and Reliability of My Jump 2 App for Measuring Vertical Jump Height in Recreationally Active Adults

Applied Sciences ◽

10.3390/app10113805 ◽

2020 ◽

Vol 10 (11) ◽

pp. 3805 ◽

Cited By ~ 1

Author(s):

Špela Bogataj ◽

Maja Pajek ◽

Slobodan Andrašić ◽

Nebojša Trajković

Keyword(s):

Concurrent Validity ◽

Female Athletes ◽

Vertical Jump ◽

Intraclass Correlation ◽

Jump Height ◽

Validity And Reliability ◽

Retest Reliability ◽

Study Results ◽

Test Retest Reliability ◽

Active Adults

This study aimed to examine the reliability, validity, and usefulness of the smartphone-based application, My Jump 2, against Optojump in recreationally active adults. Participants (18 women, 28.9 ± 5.6 years, and 26 men, 30.1 ± 10.6 years) completed squat jumps (SJ), counter-movement jumps (CMJ), and CMJ with arm swing (CMJAS) on Optojump and were simultaneously recorded using My Jump 2. To evaluate concurrent validity, jump height, calculated from flight time attained from each device, was compared for each jump type. Test-retest reliability was determined by replicating data analysis of My Jump 2 recordings on two occasions separated by two weeks. High test-retest reliability (Intraclass correlation coefficient (ICC) > 0.93) was observed for all measures in both male and female athletes. Very large correlations were observed between the My Jump 2 app and Optojump for SJ (r = 0.95, p = 0.001), CMJ (r = 0.98, p = 0.001), and CMJAS (r = 0.98, p = 0.001) in male athletes. Similar results were obtained for female recreational athletes for all jumps (r > 0.94, p = 0.001). The study results suggest that My Jump 2 is a valid, reliable, and useful tool for measuring vertical jump in recreationally active adults. Therefore, due to its simplicity and practicality, it can be used by practitioners, coaches, and recreationally-active adults to measure vertical jump performance with a simple test as SJ, CMJ, and CMJAS.

Download Full-text

Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool

BMJ Open ◽

10.1136/bmjopen-2019-031580 ◽

2020 ◽

Vol 10 (7) ◽

pp. e031580

Author(s):

Cai Le ◽

Ke Ma ◽

Pingfen Tang ◽

David Edvardsson ◽

Lina Behm ◽

...

Keyword(s):

Assessment Tool ◽

Intraclass Correlation ◽

Psychometric Evaluation ◽

Quality Of Healthcare ◽

Hospital Staff ◽

Chinese Version ◽

Validity And Reliability ◽

Retest Reliability ◽

Care Assessment ◽

Test Retest Reliability

ObjectiveThis study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties.DesignP-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made.SettingTwo hospitals covering urban and suburban areas of Kunming in the Yunnan province of China.Participants152 female hospital staff completed the survey.Main outcome measure(s)Construct validity and reliability, including internal consistency and test–retest reliability, were assessed among a sample of hospital staff.ResultsThe factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach’s alpha of 0.91–0.94 for the scales and a test–retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95).ConclusionP-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

Download Full-text

Development and Validity of the Questionnaire of Patients' Experiences in Postacute Outpatient Physical Therapy Settings

Physical Therapy ◽

10.2522/ptj.20140041 ◽

2015 ◽

Vol 95 (5) ◽

pp. 767-777 ◽

Cited By ~ 3

Author(s):

Francesc Medina-Mirapeix ◽

María Elena del Baño-Aledo ◽

Jacinto Javier Martínez-Payá ◽

María Carmen Lillo-Navarro ◽

Pilar Escolar-Reina

Keyword(s):

Factor Structure ◽

Health Care Quality ◽

Discriminant Validity ◽

Care Delivery ◽

Intraclass Correlation ◽

Care Quality ◽

Validity And Reliability ◽

Study Objective ◽

Retest Reliability ◽

Test Retest Reliability

BackgroundPatient feedback surveys are increasingly seen as a key component of health care quality monitoring and improvement.ObjectiveThe study objective was to describe the development and initial psychometric evaluation of a fixed-length questionnaire about the experiences of patients receiving physical therapist treatment in postacute outpatient settings.DesignThis was an instrument development study with validity and reliability testing.MethodsA total of 465 participants attending 3 rehabilitation centers for musculoskeletal conditions completed the questionnaire. A cognitive pretest was applied to the draft version (n=94), and a revised version was evaluated for test-retest reliability (n=90). Analyses to evaluate variance and nonresponse rates for items, the factor structure of the questionnaire, and the metric properties of multi-item scales were conducted.ResultsExploratory factor analyses yielded evidence for a 7-factor structure of the questionnaire, with 3 factors that may be conceptually viewed as professionals' attitudes and behavior (providing information and education, sensitivity to patients' changes, and emotional support) and 4 factors that conceptually reflect organizational environment (duration of attendance, interruptions during care delivery, waiting times, and patient safety). Item-scale correlations ranged from .70 to .93. The percentage of scaling success was 100% for all of the scales. Cronbach alpha coefficients ranged from .70 to .87. Intraclass correlation coefficients ranged from .57 to .80 (median=.68).LimitationsGeneralization to other patients is not known.ConclusionsThe questionnaire has test-retest reliability, and the scales have internal consistency and convergent and discriminant validity. All of the scales are distinct and unidimensional.

Download Full-text

Validity and Reliability of the Movement Ability Measure: A Self-Report Instrument Proposed for Assessing Movement Across Diagnoses and Ability Levels

Physical Therapy ◽

10.2522/ptj.20060197 ◽

2007 ◽

Vol 87 (7) ◽

pp. 899-916 ◽

Cited By ~ 12

Author(s):

Diane D Allen

Keyword(s):

Physical Therapists ◽

Intraclass Correlation ◽

Self Report ◽

Functional Evaluation ◽

Evaluation Instrument ◽

Validity And Reliability ◽

Ability Levels ◽

Movement Ability ◽

Test Retest Reliability ◽

Ability Measure

Background and Purpose Physical therapists lack instruments that assess movement across diagnoses and ability levels while focusing on physical therapy–specific outcomes. This article describes the creation of a Movement Ability Measure (MAM) and initial evidence of validity and reliability. Subjects More than 300 adult volunteers with various movement levels completed the 24-item questionnaire. Methods Item response theory methods were used to create the MAM and gather evidence of content and construct validity, test-retest and other types of reliability, and concurrent validity with the California Functional Evaluation instrument and self-acknowledgement of movement problems. Results The intraclass correlation coefficient for test-retest reliability was .92. Person separation reliability was .98. Correlation (r) with the California Functional Evaluation instrument was .76. Respondents who denied having movement problems perceived a significantly higher level of movement ability than those who claimed to have a little, some, or a lot of movement problems in the preceding week. Discussion and Conclusion The MAM shows promise for documenting perceived movement ability across ability levels and diagnoses.

Download Full-text

Persian version of attitudes towards loss of hearing questionnaire

Auditory and Vestibular Research ◽

10.18502/avr.v28i2.867 ◽

2019 ◽

Author(s):

Parisa Heidari ◽

Jamileh Fatahi ◽

Reza Hoseinabadi ◽

Nematollah Rouhbakhsh ◽

Sasan Dabiri Satri ◽

...

Keyword(s):

Hearing Loss ◽

Hearing Aids ◽

Content Validity ◽

Intraclass Correlation ◽

Validity And Reliability ◽

Retest Reliability ◽

Persian Version ◽

The Mean ◽

Test Retest Reliability ◽

Loss Of Hearing

Background and Aim: Investigations have shown that the patient’s attitudes toward hearing loss and hearing aids impact hearing aid benefits and its use. In this regard, Saunders and Cienkowski (1996) developed the “attitudes towards loss of hearing questionnaire” to examine some of the psychosocial factors underlying the use of hearing aids. This study has focused on preparing a Persian version of this questionnaire and analyzing its validity and reliability. Methods: The original English version of the questionnaire was translated into Persian, and its content and face validities were determined by related experts. The final questionnaire was administered to 100 hearing impaired people (52 males and 48 females) aged 30 to 65 years with the mean (SD) age of 54.54 (12.05) years. The test-retest reliability was assessed in 20 patients. Results: The results of face validity assessment revealed that our questionnaire has a high quality in translation, intelligibility, and cultural compatibility. The mean scores of the content validity ratio and content validity index of this questionnaire was 0.71 and 0.98, respectively. The mean (SD) total score of this questionnaire was 60.46 (10.02) and the mean scores of denial of hearing loss, negative associations, negative coping strategies, manual dexterity and vision and hearing-related esteem were 15.58, 12.10, 20.40, 5.30, and 7.08, respectively. The overall Cronbach α value was 0.798. The test-retest reliability showed good results for the global score (Intraclass correlation = 0.989). Conclusion: Based on the obtained results, the Persian version of the questionnaire possesses satisfactory validity and reliability.

Download Full-text