Measuring Eccentric Strength of the Shoulder External Rotators Using a Handheld Dynamometer: Reliability and Validity

Context Shoulder strength assessment plays an important role in the clinical examination of the shoulder region. Eccentric strength measurements are of special importance in guiding the clinician in injury prevention or return-to-play decisions after injury. Objective To examine the absolute and relative reliability and validity of a standardized eccentric strength-measurement protocol for the glenohumeral external rotators. Design Descriptive laboratory study. Setting Testing environment at the Department of Rehabilitation Sciences and Physiotherapy of Ghent University, Belgium. Patients or Other Participants Twenty-five healthy participants (9 men and 16 women) without any history of shoulder pain were tested by 2 independent assessors using a handheld dynamometer (HHD) and underwent an isokinetic testing procedure. Intervention(s) The clinical protocol used an HHD, a DynaPort accelerometer to measure acceleration and angular velocity of testing 30°/s over 90° of range of motion, and a Biodex dynamometer to measure isokinetic activity. Main Outcome Measure(s) Three eccentric strength measurements: (1) tester 1 with the HHD, (2) tester 2 with the HHD, and (3) Biodex isokinetic strength measurement. Results The intratester reliability was excellent (0.879 and 0.858), whereas the intertester reliability was good, with an intraclass correlation coefficient between testers of 0.714. Pearson product moment correlation coefficients of 0.78 and 0.70 were noted between the HHD and the isokinetic data, showing good validity of this new procedure. Conclusions Standardized eccentric rotator cuff strength can be tested and measured in the clinical setting with good-to-excellent reliability and validity using an HHD.

Download Full-text

Assessment of reliability and validity of the 5-scale grading system of the point-of-care immunoassay for tear matrix metalloproteinase-9

Scientific Reports ◽

10.1038/s41598-021-92020-6 ◽

2021 ◽

Vol 11 (1) ◽

Author(s):

Minjeong Kim ◽

Ja Young Oh ◽

Seon Ha Bae ◽

Seung Hyeun Lee ◽

Won Jun Lee ◽

...

Keyword(s):

Matrix Metalloproteinase ◽

Calibration Curve ◽

Point Of Care ◽

Interobserver Reliability ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Grading System ◽

Intraclass Correlation Coefficients ◽

The Difference

AbstractWe evaluated the reliability and validity of the 5-scale grading system to interpret the point-of-care immunoassay for tear matrix metalloproteinase (MMP)-9. Six observers graded red bands of photographs of the readout window in MMP-9 immunoassay kit (InflammaDry) two times with 2-week interval based on the 5-scale grading system (i.e. grade 0–4). Interobserver and intraobserver reliability were evaluated using intraclass correlation coefficients. The interobserver agreements were analyzed according to the severity of tear MMP-9 expression. To validate the system, a concentration calibration curve was made using MMP-9 solutions with reference concentrations, then the distribution of MMP-9 concentrations was analyzed according to the 5-scale grading system. Both intraobserver and interobserver reliability was excellent. The readout grades were significantly correlated with the quantified colorimetric densities. The interobserver variance of readout grades had no correlation with the severity of the measured densities. The band density continued to increase up to a maximal concentration (i.e. 5000 ng/mL) according to the calibration curve. The difference of grades reflected the change of MMP-9 concentrations sensitively, especially between grade 2 and 4. Together, our data indicate that the subjective 5-scale grading system in the point-of-care MMP-9 immunoassay is an easy and reliable method with acceptable accuracy.

Download Full-text

Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency

Archives of Pathology & Laboratory Medicine ◽

10.5858/arpa.2013-0046-oa ◽

2014 ◽

Vol 138 (6) ◽

pp. 809-813

Author(s):

Carolyn R. Vitek ◽

Jane C. Dale ◽

Henry A. Homburger ◽

Sandra C. Bryant ◽

Amy K. Saenger ◽

...

Keyword(s):

Critical Thinking ◽

Interrater Reliability ◽

Clinical Chemistry ◽

Core Competencies ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Thinking Skills ◽

Project Evaluation ◽

Critical Thinking Skills

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

Download Full-text

Using Smart Bracelets to Assess Heart Rate Among Students During Physical Education Lessons: Feasibility, Reliability, and Validity Study (Preprint)

10.2196/preprints.17699 ◽

2020 ◽

Author(s):

Jiangang Sun ◽

Yang Liu

Keyword(s):

Heart Rate ◽

Physical Education ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Left Wrist ◽

Intraclass Correlation Coefficients ◽

Estimate Reliability ◽

Left And Right ◽

The Right

BACKGROUND An increasing number of wrist-worn wearables are being examined in the context of health care. However, studies of their use during physical education (PE) lessons remain scarce. OBJECTIVE We aim to examine the reliability and validity of the Fizzo Smart Bracelet (Fizzo) in measuring heart rate (HR) in the laboratory and during PE lessons. METHODS In Study 1, 11 healthy subjects (median age 22.0 years, IQR 3.75 years) twice completed a test that involved running on a treadmill at 6 km/h for 12 minutes and 12 km/h for 5 minutes. During the test, participants wore two Fizzo devices, one each on their left and right wrists, to measure their HR. At the same time, the Polar Team2 Pro (Polar), which is worn on the chest, was used as the standard. In Study 2, we went to 10 schools and measured the HR of 24 students (median age 14.0 years, IQR 2.0 years) during PE lessons. During the PE lessons, each student wore a Polar device on their chest and a Fizzo on their right wrist to measure HR data. At the end of the PE lessons, the students and their teachers completed a questionnaire where they assessed the feasibility of Fizzo. The measurements taken by the left wrist Fizzo and the right wrist Fizzo were compared to estimate reliability, while the Fizzo measurements were compared to the Polar measurements to estimate validity. To measure reliability, intraclass correlation coefficients (ICC), mean difference (MD), standard error of measurement (SEM), and mean absolute percentage errors (MAPE) were used. To measure validity, ICC, limits of agreement (LOA), and MAPE were calculated and Bland-Altman plots were constructed. Percentage values were used to estimate the feasibility of Fizzo. RESULTS The Fizzo showed excellent reliability and validity in the laboratory and moderate validity in a PE lesson setting. In Study 1, reliability was excellent (ICC>0.97; MD<0.7; SEM<0.56; MAPE<1.45%). The validity as determined by comparing the left wrist Fizzo and right wrist Fizzo was excellent (ICC>0.98; MAPE<1.85%). Bland-Altman plots showed a strong correlation between left wrist Fizzo measurements (bias=0.48, LOA=–3.94 to 4.89 beats per minute) and right wrist Fizzo measurements (bias=0.56, LOA=–4.60 to 5.72 beats per minute). In Study 2, the validity of the Fizzo was lower compared to that found in Study 1 but still moderate (ICC>0.70; MAPE<9.0%). The Fizzo showed broader LOA in the Bland-Altman plots during the PE lessons (bias=–2.60, LOA=–38.89 to 33.69 beats per minute). Most participants considered the Fizzo very comfortable and easy to put on. All teachers thought the Fizzo was helpful. CONCLUSIONS When participants ran on a treadmill in the laboratory, both left and right wrist Fizzo measurements were accurate. The validity of the Fizzo was lower in PE lessons but still reached a moderate level. The Fizzo is feasible for use during PE lessons.

Download Full-text

The QardioArm App in the Assessment of Blood Pressure and Heart Rate: Reliability and Validity Study (Preprint)

10.2196/preprints.8458 ◽

2017 ◽

Author(s):

Victoria Mazoteras Pardo ◽

Marta E Losa Iglesias ◽

José López Chicharro ◽

Ricardo Becerro de Bengoa Vallejo

Keyword(s):

Blood Pressure ◽

Heart Rate ◽

European Society ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Mobile App ◽

Blood Pressure Monitor ◽

Pressure Monitor ◽

Mean Values

BACKGROUND Self-measurement of blood pressure is a priority strategy for managing blood pressure. OBJECTIVE The aim of this study was to evaluate the reliability and validity of blood pressure and heart rate following the European Society of Hypertension’s international validation protocol, as measured with the QardioArm, a fully automatic, noninvasive wireless blood pressure monitor and mobile app. METHODS A total of 100 healthy volunteers older than 25 years from the general population of Ciudad Real, Spain, participated in a test-retest validation study with two measurement sessions separated by 5 to 7 days. In each measurement session, seven systolic blood pressure, diastolic blood pressure, and heart rate assessments were taken, alternating between the two devices. The test device was the QardioArm and the previously validated criterion device was the Omron M3. Sessions took place at a single study site with an evaluation room that was maintained at an appropriate temperature and kept free from noises and distractions. RESULTS The QardioArm displayed very consistent readings both within and across sessions (intraclass correlation coefficients=0.80-0.95, standard errors of measurement=2.5-5.4). The QardioArm measurements corresponded closely to those from the criterion device (r>.96) and mean values for the two devices were nearly identical. The QardioArm easily passed all validation standards set by the European Society of Hypertension International Protocol. CONCLUSIONS The QardioArm mobile app has validity and it can be used free of major measurement error.

Download Full-text

Influence of Handgrip Stabilization During Isokinetic Knee Strength Assessment in Older Women

Perceptual and Motor Skills ◽

10.1177/0031512520914109 ◽

2020 ◽

Vol 127 (4) ◽

pp. 671-683

Author(s):

João P. Nunes ◽

Paolo M. Cunha ◽

Jerry L. Mayhew ◽

Alex S. Ribeiro ◽

Paulo S. Junior ◽

...

Keyword(s):

Older Women ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Knee Extension ◽

Convenience Sample ◽

Strength Assessment ◽

Intraclass Correlation Coefficients ◽

Knee Strength ◽

Hands On ◽

Angular Velocities

The present study aimed to evaluate the influence of holding the chair handles during the assessment of older women’s knee flexion and extension isokinetic and isometric strength. Of 57 older women (≥60 years) selected from a convenience sample for this research, 23 were randomly chosen to perform the tests twice for reliability analyses. Each participant performed maximal isokinetic knee extension and flexion at 60°/s and 180°/s angular velocities and isometric tests under two conditions: (a) holding the lateral handle of the chair (HOLD) and (b) supporting the hands on the shoulders with the arms crossed (i.e., not holding the handle [NHOLD]). Participants performed significantly better in the HOLD compared with the NHOLD condition. Slightly lower intraclass correlation coefficients (ICC = 0.870–0.956) were noted for the HOLD than for the NHOLD condition (ICC = 0.900–0.981) so that the HOLD performance on Days 1 and 2 was different on some measures. Owing to the higher reliability coefficients in the NHOLD condition, results suggest that, when assessing knee strength in older women, the evaluee should place their hands over their shoulders with arms crossed in front of the chest (NHOLD) to maximize assessment reliability (reproducibility of performance).

Download Full-text

Reliability and Validity of a Novel Wearable Device for Measuring Elbow Strength

Sensors ◽

10.3390/s20123412 ◽

2020 ◽

Vol 20 (12) ◽

pp. 3412

Author(s):

Marcus Brookshaw ◽

Andrew Sexton ◽

Chris A. McGibbon

Keyword(s):

Adult Population ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Random Order ◽

Healthy Adults ◽

Strength Measurement ◽

Intra Class Correlation ◽

Improve Measurement ◽

Elbow Flexors And Extensors ◽

Muscle Groups

Muscle strength is an important clinical outcome in rehabilitation and sport medicine, but options are limited to expensive but accurate isokinetic dynamometry (IKD) or inexpensive but less accurate hand-held dynamometers (HHD). A wearable, self-stabilizing, limb strength measurement device (LSMD) was developed to fill the current gap in portable strength measurement devices. The purpose of this study was to evaluate the reliability and validity of the LSMD in healthy adults. Twenty healthy adults were recruited to attend two strength testing sessions where elbow flexor and extensor strength was measured with the LSMD, with HHD and with IKD in random order, by two raters. Outcomes were intra-rater repeatability, inter-rater reproducibility and inter-session reproducibility using intra-class correlation coefficients (ICC). Limits of agreement and weighted least products regression were used to test the validity of the LSMD relative to the criterion standard (IKD), and calibration formulas derived to improve measurement fidelity. ICC values for the LSMD were >0.90 for all measures of reliability and for both muscle groups, but over-predicted extensor strength and under-predicted flexor strength. Validity was established by transforming the data with the criterion standard-based calibration. These data indicate that the LSMD is reliable and conditionally valid for quantifying strength of elbow flexors and extensors in a healthy adult population.

Download Full-text

Reliability and Validity of Data for 2 Newly Developed Shuttle Run Tests in Children With Cerebral Palsy

Physical Therapy ◽

10.1093/ptj/86.8.1107 ◽

2006 ◽

Vol 86 (8) ◽

pp. 1107-1117 ◽

Cited By ~ 76

Author(s):

Olaf Verschuren ◽

Tim Takken ◽

Marjolijn Ketelaar ◽

Jan Willem Gorter ◽

Paul JM Helders

Keyword(s):

Cerebral Palsy ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Treadmill Test ◽

Children With Cerebral Palsy ◽

Level I ◽

Test Retest Reliability ◽

Shuttle Run ◽

Gmfcs Level

Abstract Background and Purpose. The purpose of this study was to examine the reliability and validity of data obtained with 2 newly developed shuttle run tests (SRT-I and SRT-II) to measure aerobic power in children with cerebral palsy (CP) who were classified at level I or II on the Gross Motor Function Classification System (GMFCS). The SRT-I was developed for children at GMFCS level I, and the SRT-II was developed for children at GMFCS level II. Subjects. Twenty-five children and adolescents with CP (10 female, 15 male; mean age=11.9 years, SD=2.9), classified at GMFCS level I (n=14) or level II (n=11), participated in the study. Methods. To assess test-retest reliability of data for the 10-m shuttle run tests, the subjects performed the same test within 2 weeks. To examine validity, the shuttle run tests were compared with a GMFCS level–based treadmill test designed to measure peak oxygen uptake. Results. Statistical analyses revealed test-retest reliability for exercise time (number of levels completed) (intraclass correlation coefficients of .97 for the SRT-I and .99 for the SRT-II) and reliability for peak heart rate attained during the final level (intraclass correlation coefficients of .87 for the SRT-I and .94 for the SRT-II). High correlations were found for the relationship between data for both shuttle run tests and data for the treadmill test (r=.96 for both). Discussion and Conclusion. The results suggest that both 10-m shuttle run tests yield reliable and valid data. Moreover, the shuttle run tests have advantages over a treadmill test for children with CP who are able to walk and run (GMFCS level I or II). [Verschuren O, Takken T, Ketelaar M, et al. Reliability and validity of data for 2 newly developed shuttle run tests in children with cerebral palsy. Phys Ther. 2006;86:1107–1117.]

Download Full-text

The Reliability and Validity of the Loadsol® under Various Walking and Running Conditions

Sensors ◽

10.3390/s19020265 ◽

2019 ◽

Vol 19 (2) ◽

pp. 265 ◽

Cited By ~ 12

Author(s):

Kristen Renner ◽

DS Williams ◽

Robin Queen

Keyword(s):

Reliable Method ◽

Loading Rate ◽

Reaction Force ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Validity And Reliability ◽

Intraclass Correlation Coefficients ◽

Single Sensor ◽

Force Data

The assessment of loading during walking and running has historically been limited to data collection in laboratory settings or with devices that require a computer connection. This study aims to determine if the loadsol®—a single sensor wireless insole—is a valid and reliable method of assessing force. Thirty (17 male and 13 female) recreationally active individuals were recruited for a two visit study where they walked (1.3 m/s) and ran (3.0 and 3.5 m/s) at a 0%, 10% incline, and 10% decline, with the visits approximately one week apart. Ground reaction force data was collected on an instrumented treadmill (1440 Hz) and with the loadsol® (100 Hz). Ten individuals completed the day 1 protocol with a newer 200 Hz loadsol®. Intraclass correlation coefficients (ICC3,k) were used to assess validity and reliability and Bland–Altman plots were generated to better understand loadsol® validity. Across conditions, the peak force ICCs ranged from 0.78 to 0.97, which increased to 0.84–0.99 with the 200 Hz insoles. Similarly, the loading rate ICCs improved from 0.61 to 0.97 to 0.80–0.96 and impulse improved from 0.61 to 0.97 to 0.90–0.97. The 200 Hz insoles may be needed for loading rate and impulse in running. For both walking and running, the loadsol® has excellent between-day reliability (>0.76).

Download Full-text

Alberta Infant Motor Scale: Reliability and Validity When Used on Preterm Infants in Taiwan

Physical Therapy ◽

10.1093/ptj/80.2.168 ◽

2000 ◽

Vol 80 (2) ◽

pp. 168-178 ◽

Cited By ~ 76

Author(s):

Suh-Fang Jeng ◽

Kuo-Inn Tsou Yau ◽

Li-Chiou Chen ◽

Shu-Fang Hsiao

Keyword(s):

Preterm Infants ◽

Interrater Reliability ◽

Physical Therapist ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Intraclass Correlation Coefficients ◽

Scale Reliability ◽

Scale Scores ◽

Acceptable Reliability

Abstract Background and Purpose. The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Subjects. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. Methods. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Results. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97–.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and .90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). Conclusion and Discussion. The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.

Download Full-text

Reliability and Validity of the Posture and Fine Motor Assessment of Infants

The Occupational Therapy Journal of Research ◽

10.1177/153944928900900501 ◽

1989 ◽

Vol 9 (5) ◽

pp. 259-272 ◽

Cited By ~ 3

Author(s):

Jane Case-Smith

Keyword(s):

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Fine Motor ◽

Motor Assessment ◽

Intraclass Correlation Coefficients ◽

Highly Correlated ◽

Peabody Developmental Motor Scales ◽

The Individual ◽

Test Retest Reliability

The Posture and Fine Motor Assessment of Infants (PFMAI) (Case-Smith, 1987) is a newly developed instrument for assessing the quality of motor function in infants. The test measures components of posture and fine motor control as they first develop. The purpose of this study was to support the test's reliability and validity. Interrater reliability, analyzed with intraclass correlation coefficients (ICCs), was high (.989 for total scores). Test-retest reliability, measured by ICCs, was .853 and .913 for the two test sections. The PFMAI demonstrated concurrent validity with the Peabody Developmental Motor Scales, Revised (Folio & Fewell, 1983) (correlations were .673 and .829 for the individual sections). Scores on the PFMAI were highly correlated with the infant's ages (.892 to .941); this finding provided one indication of construct validity.

Download Full-text