A Novel Tool for the Assessment of Sport Climbers’ Movement Performance

2020 ◽  
Vol 15 (6) ◽  
pp. 795-800 ◽  
Author(s):  
Nicola Taylor ◽  
David Giles ◽  
Micha Panáčková ◽  
James Mitchell ◽  
Joel Chidley ◽  
...  
Keyword(s):  
Performance Assessment ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Consultation Process ◽  
Retest Reliability ◽  
Performance Factors ◽  
Sport Climbing ◽  
Movement Performance ◽  
Test Retest Reliability

Purpose: To assess the validity and reliability of a novel movement-performance assessment tool for climbing/sport climbing. Methods: First, salient climbing movement-performance factors were identified through an iterative consultation process with 10 expert climbing coaches; the resulting Climber’s Movement Performance Assessment Tool (CM-PAT) contained 14 items in 5 categories. Second, 61 intermediate to advanced climbers ascended a single route, which was video recorded. Subsequently, 4 experienced (>10 y coaching) coaches used the CM-PAT to observe and score the climbers’ performance. Interrater reliability and comparisons with existing measures of climbing performance (6-mo self-reported ability, success and failure, climbing pace [m·min−1], and geometric entropy) were made. Results: Intraclass correlation coefficient (2,k) for the 4 raters demonstrated excellent reliability (>.81) between observers and good to excellent test–retest reliability (.71–.91). Pearson correlations between self-reported ability and CM-PAT scores explained 61% of the variance in self-reported climbing performance compared with 16% for geometric entropy and 52% for climbing pace. Considering differences in successful and unsuccessful climbers, the CM-PAT (P < .0005; d = 2.14), geometric entropy (P = .014; d = 0.67), and pace (P < .0005; d = 1.88) were able to differentiate between groups. Conclusions: The CM-PAT is the first sport climbing performance observational instrument to be developed through a thorough iterative process with expert coaches. Excellent interrater and test–retest reliability and excellent agreement with self-reported ability and with existing quantitative measures of performance support its recommendation for use in coaching and research contexts. Notably, a key advantage over existing measures is the identification of coachable elements of performance.

scholarly journals Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e031580
Author(s):  
Cai Le ◽  
Ke Ma ◽  
Pingfen Tang ◽  
David Edvardsson ◽  
Lina Behm ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Intraclass Correlation ◽  
Psychometric Evaluation ◽  
Quality Of Healthcare ◽  
Hospital Staff ◽  
Chinese Version ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Care Assessment ◽  
Test Retest Reliability

ObjectiveThis study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties.DesignP-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made.SettingTwo hospitals covering urban and suburban areas of Kunming in the Yunnan province of China.Participants152 female hospital staff completed the survey.Main outcome measure(s)Construct validity and reliability, including internal consistency and test–retest reliability, were assessed among a sample of hospital staff.ResultsThe factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach’s alpha of 0.91–0.94 for the scales and a test–retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95).ConclusionP-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

scholarly journals Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging

Nutrients ◽  
2018 ◽  
Vol 10 (10) ◽  
pp. 1522 ◽  
Author(s):  
Anne Gilsing ◽  
Alexandra Mayhew ◽  
Hélène Payette ◽  
Bryna Shatenstein ◽  
Sharon Kirkpatrick ◽  
...  
Keyword(s):  
Longitudinal Study ◽  
Assessment Tool ◽  
Dietary Assessment ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Food Groups ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
System Usability Scale ◽  
Test Retest Reliability

This study assessed test-retest reliability and relative validity of the Short Diet Questionnaire (SDQ) and usability of an online 24 h recall among 232 participants (62 years ± 9.1; 49.6% female) from the Canadian Longitudinal Study on Aging (CLSA). Participants were asked to complete four 24 h dietary recalls (24HRs) using the Automated Self-Administered 24-h Dietary Assessment Tool (ASA24-Canada-2014), two SDQ administrations (prior to recalls one and four), and the System Usability Scale (SUS) for ASA24. For the SDQ administrations, Intraclass Correlation Coefficients ranged from 0.49 to 0.57 for nutrients and 0.35 to 0.72 for food groups. Mean intakes estimated from the SDQ were lower compared than those from the 24HRs. For nutrients, correlation coefficients were highest for fiber, calcium, and vitamin D (45–64 years: 0.59, 0.50, 0.51; >65 years: 0.29, 0.38, 0.49, p < 0.01); Kappas ranged from 0.14 to 0.37 in those 45–64 years and 0.17 to 0.32 in participants >65 years. Among the 70% who completed all recalls independently, the SUS indicated poor usability, though the majority reported feeling confident using ASA24. Overall, the SDQ captures intake with varying test-retest reliability and accuracy by nutrient and age. Further research is needed to inform use of a more comprehensive dietary measure in the CLSA.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Therapeutic Interventions ◽  
Treatment Burden ◽  
Validity And Reliability ◽  
Stroke Patients ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Validity and reliability of the Turkish version of the Patient Dignity Inventory

2021 ◽  
pp. 1-8
Author(s):  
Yasemin Eskigülek ◽  
Sultan Kav
Keyword(s):  
Palliative Care ◽  
Factor Analysis ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Turkish Version ◽  
Retest Reliability ◽  
Significant Difference ◽  
Test Retest Reliability ◽  
Fit Index ◽  
Turkish Society

Abstract Objective The aim of this study was to investigate the validity and reliability of the Patient Dignity Inventory (PDI) in the Turkish society, which was developed to evaluate dignity-related distress in palliative care patients. Methods One hundred and twenty-seven adults with advanced cancer hospitalized in several clinics of two university hospitals were included in the study. The patients whose Palliative Performance Scale score was at least 40% were recruited to study. The data were collected with a patient demographic form, the Turkish version of Hospital Anxiety and Depression Scale (HADS-TR), and the Turkish version of the PDI (PDI-TR). The PDI-TR was finalized and back-translated after translating into Turkish and obtaining 10 expert opinions. Exploratory and confirmatory factor analysis, internal consistency, concurrent validity, and test–retest reliability analysis were performed. Results The Cronbach's α coefficient of PDI-TR was 0.94. Factor analysis resulted in a five-factor solution, and all items were loaded on factors. Factors were labeled as symptom distress, existential distress, self-confidence, dependency, and supportive care needs and accounted for 68.70% of the overall variance. The model's normed fit index, comparative fit index, and X2/SD were found between acceptable range (0.90, 0.93, and 2.64, respectively). A positive and strong correlation was found between subdimension scores of HADS-TR and the total score of PDI-TR (r = 0.70 for anxiety subdimension; r = 0.73 for depression subdimension). The test–retest reliability was conducted with 32 patients within the sample two weeks after the first application, and no significant difference was found between the two application scores as the result of paired-sample t-test (p > 0.05). An intraclass correlation coefficient of test–retest reliability was r = 0.855. Significance of results PDI-TR was found to be a valid and reliable tool in palliative care patients in Turkish society.

scholarly journals Gait Asymmetry Post-Stroke: Determining Valid and Reliable Methods Using a Single Accelerometer Located on the Trunk

Sensors ◽  
2019 ◽  
Vol 20 (1) ◽  
pp. 37 ◽  
Author(s):  
Christopher Buckley ◽  
M. Encarna Micó-Amigo ◽  
Michael Dunne-Willows ◽  
Alan Godfrey ◽  
Aodhán Hickey ◽  
...  
Keyword(s):  
Concurrent Validity ◽  
Intraclass Correlation ◽  
Future Research ◽  
Validity And Reliability ◽  
Gait Symmetry ◽  
Retest Reliability ◽  
Post Stroke ◽  
Gait Asymmetry ◽  
Test Retest Reliability ◽  
Cardinal Symptom

Asymmetry is a cardinal symptom of gait post-stroke that is targeted during rehabilitation. Technological developments have allowed accelerometers to be a feasible tool to provide digital gait variables. Many acceleration-derived variables are proposed to measure gait asymmetry. Despite a need for accurate calculation, no consensus exists for what is the most valid and reliable variable. Using an instrumented walkway (GaitRite) as the reference standard, this study compared the validity and reliability of multiple acceleration-derived asymmetry variables. Twenty-five post-stroke participants performed repeated walks over GaitRite whilst wearing a tri-axial accelerometer (Axivity AX3) on their lower back, on two occasions, one week apart. Harmonic ratio, autocorrelation, gait symmetry index, phase plots, acceleration, and jerk root mean square were calculated from the acceleration signals. Test–retest reliability was calculated, and concurrent validity was estimated by comparison with GaitRite. The strongest concurrent validity was obtained from step regularity from the vertical signal, which also recorded excellent test–retest reliability (Spearman’s rank correlation coefficients (rho) = 0.87 and Intraclass correlation coefficient (ICC21) = 0.98, respectively). Future research should test the responsiveness of this and other step asymmetry variables to quantify change during recovery and the effect of rehabilitative interventions for consideration as digital biomarkers to quantify gait asymmetry.

scholarly journals Concurrent Validity and Reliability of My Jump 2 App for Measuring Vertical Jump Height in Recreationally Active Adults

2020 ◽  
Vol 10 (11) ◽  
pp. 3805 ◽  
Author(s):  
Špela Bogataj ◽  
Maja Pajek ◽  
Slobodan Andrašić ◽  
Nebojša Trajković
Keyword(s):  
Concurrent Validity ◽  
Female Athletes ◽  
Vertical Jump ◽  
Intraclass Correlation ◽  
Jump Height ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Study Results ◽  
Test Retest Reliability ◽  
Active Adults

This study aimed to examine the reliability, validity, and usefulness of the smartphone-based application, My Jump 2, against Optojump in recreationally active adults. Participants (18 women, 28.9 ± 5.6 years, and 26 men, 30.1 ± 10.6 years) completed squat jumps (SJ), counter-movement jumps (CMJ), and CMJ with arm swing (CMJAS) on Optojump and were simultaneously recorded using My Jump 2. To evaluate concurrent validity, jump height, calculated from flight time attained from each device, was compared for each jump type. Test-retest reliability was determined by replicating data analysis of My Jump 2 recordings on two occasions separated by two weeks. High test-retest reliability (Intraclass correlation coefficient (ICC) > 0.93) was observed for all measures in both male and female athletes. Very large correlations were observed between the My Jump 2 app and Optojump for SJ (r = 0.95, p = 0.001), CMJ (r = 0.98, p = 0.001), and CMJAS (r = 0.98, p = 0.001) in male athletes. Similar results were obtained for female recreational athletes for all jumps (r > 0.94, p = 0.001). The study results suggest that My Jump 2 is a valid, reliable, and useful tool for measuring vertical jump in recreationally active adults. Therefore, due to its simplicity and practicality, it can be used by practitioners, coaches, and recreationally-active adults to measure vertical jump performance with a simple test as SJ, CMJ, and CMJAS.

scholarly journals Development and Validity of the Questionnaire of Patients' Experiences in Postacute Outpatient Physical Therapy Settings

2015 ◽  
Vol 95 (5) ◽  
pp. 767-777 ◽  
Author(s):  
Francesc Medina-Mirapeix ◽  
María Elena del Baño-Aledo ◽  
Jacinto Javier Martínez-Payá ◽  
María Carmen Lillo-Navarro ◽  
Pilar Escolar-Reina
Keyword(s):  
Factor Structure ◽  
Health Care Quality ◽  
Discriminant Validity ◽  
Care Delivery ◽  
Intraclass Correlation ◽  
Care Quality ◽  
Validity And Reliability ◽  
Study Objective ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundPatient feedback surveys are increasingly seen as a key component of health care quality monitoring and improvement.ObjectiveThe study objective was to describe the development and initial psychometric evaluation of a fixed-length questionnaire about the experiences of patients receiving physical therapist treatment in postacute outpatient settings.DesignThis was an instrument development study with validity and reliability testing.MethodsA total of 465 participants attending 3 rehabilitation centers for musculoskeletal conditions completed the questionnaire. A cognitive pretest was applied to the draft version (n=94), and a revised version was evaluated for test-retest reliability (n=90). Analyses to evaluate variance and nonresponse rates for items, the factor structure of the questionnaire, and the metric properties of multi-item scales were conducted.ResultsExploratory factor analyses yielded evidence for a 7-factor structure of the questionnaire, with 3 factors that may be conceptually viewed as professionals' attitudes and behavior (providing information and education, sensitivity to patients' changes, and emotional support) and 4 factors that conceptually reflect organizational environment (duration of attendance, interruptions during care delivery, waiting times, and patient safety). Item-scale correlations ranged from .70 to .93. The percentage of scaling success was 100% for all of the scales. Cronbach alpha coefficients ranged from .70 to .87. Intraclass correlation coefficients ranged from .57 to .80 (median=.68).LimitationsGeneralization to other patients is not known.ConclusionsThe questionnaire has test-retest reliability, and the scales have internal consistency and convergent and discriminant validity. All of the scales are distinct and unidimensional.

scholarly journals Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa

2013 ◽  
Vol 5 (1) ◽  
Author(s):  
Louis Jenkins ◽  
Bob Mash ◽  
Anselme Derese
Keyword(s):  
South Africa ◽  
Family Medicine ◽  
Assessment Tool ◽  
Portfolio Assessment ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Competency Based ◽  
The Difference ◽  
Test Retest Reliability

Background: Competency-based education and the validity and reliability of workplace-based assessment of postgraduate trainees have received increasing attention worldwide.Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country.Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa.Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-classcorrelation was considered to be > 0.80.Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80.Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.

scholarly journals Persian version of attitudes towards loss of hearing questionnaire

2019 ◽  
Author(s):  
Parisa Heidari ◽  
Jamileh Fatahi ◽  
Reza Hoseinabadi ◽  
Nematollah Rouhbakhsh ◽  
Sasan Dabiri Satri ◽  
...  
Keyword(s):  
Hearing Loss ◽  
Hearing Aids ◽  
Content Validity ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Persian Version ◽  
The Mean ◽  
Test Retest Reliability ◽  
Loss Of Hearing

Background and Aim: Investigations have shown that the patient’s attitudes toward hearing loss and hearing aids impact hearing aid benefits and its use. In this regard, Saunders and Cien­kowski (1996) developed the “attitudes towards loss of hearing questionnaire” to examine some of the psychosocial factors underlying the use of hearing aids. This study has focused on pre­paring a Persian version of this questionnaire and analyzing its validity and reliability. Methods: The original English version of the questionnaire was translated into Persian, and its content and face validities were determined by related experts. The final questionnaire was administered to 100 hearing impaired people (52 males and 48 females) aged 30 to 65 years with the mean (SD) age of 54.54 (12.05) years. The test-retest reliability was assessed in 20 pat­ients. Results: The results of face validity assessment revealed that our questionnaire has a high quality in translation, intelligibility, and cultural compatibility. The mean scores of the content validity ratio and content validity index of this questionnaire was 0.71 and 0.98, respectively. The mean (SD) total score of this questionnaire was 60.46 (10.02) and the mean scores of denial of hearing loss, negative associations, negative coping strategies, manual dexterity and vision and hearing-related esteem were 15.58, 12.10, 20.40, 5.30, and 7.08, respectively. The overall Cronbach α value was 0.798. The test-retest reliability showed good results for the global score (Intraclass correlation = 0.989). Conclusion: Based on the obtained results, the Persian version of the questionnaire possesses satisfactory validity and reliability.

scholarly journals The Inventory of Physical Activity Barriers for Adults 50 Years and Older: Refinement and Validation

2021 ◽  
Vol 5 (Supplement_1) ◽  
pp. 789-789
Author(s):  
Mariana Wingood ◽  
Salene Jones ◽  
Nancy Gell ◽  
Denise Peters ◽  
Jennifer Brach
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Addressing physical activity (PA) barriers is an essential component of increasing PA among the 56-73% of community-dwelling adults 50 years and older who are not performing the recommended 150 minutes of moderate-to-vigorous PA. As there is no feasible, multi-factorial tool to assess PA barriers among this population, we developed and validated a PA barrier assessment tool called the Inventory of Physical Activity Barriers (IPAB). We collected cross-sectional data on 503 adults (mean age 70.1), with 79 participants completing the scale twice for test-retest reliability and 64 completing a cross-over design examining the ability to use two administration formats interchangeably. Our analyses consisted of exploratory and confirmatory factor analysis, Cronbach alpha, intraclass correlation coefficient, Bland-Altman Plot, and t-tests. Using factor analysis, we identified and confirmed an eight-factor solution consisting of 27 items. The 27-item IPAB is internally consistent (alpha= 0.91), has a high test-retest reliability (intraclass correlation coefficient=0.99), and can differentiate between individuals who meet the recommended levels of PA and those who do not (p &lt; 0.001). The IPAB scores ranged between 1.00-3.11 for the paper format (mean=1.78) and 1.07-3.48 for the electronic format (mean=1.78), with no statistical difference between the paper and electronic administration formats (p=0.94), resulting in the conclusion that the two administration formats can be used interchangeably. Participant feedback illustrates that the IPAB is easy to use, has clear instruction, and is an appropriate length. The newly validated IPAB scale can be used to develop individualized PA interventions that address PA barriers among patients 50 years and older.

Sign in / Sign up

Export Citation Format

Share Document