Validity and Reliability of 2 Goniometric Mobile Apps: Device, Application, and Examiner Factors

2016 ◽  
Vol 25 (4) ◽  
pp. 371-379 ◽  
Author(s):  
Robert H. Wellmon ◽  
Dawn T. Gulick ◽  
Mark L. Paterson ◽  
Colleen N. Gulick
Keyword(s):  
Outcome Measures ◽  
Concurrent Validity ◽  
Interrater Reliability ◽  
Physical Therapists ◽  
Mobile Apps ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Validity And Reliability ◽  
Measurement Variability ◽  
Number Of Factors

Context:Smartphones are being used in a variety of practice settings to measure joint range of motion (ROM). A number of factors can affect the validity of the measurements generated. However, there are no studies examining smartphone-based goniometer applications focusing on measurement variability and error arising from the electromechanical properties of the device being used.Objective:To examine the concurrent validity and interrater reliability of 2 goniometric mobile applications (Goniometer Records, Goniometer Pro), an inclinometer, and a universal goniometer (UG).Design:Nonexperimental, descriptive validation study.Setting:University laboratory.Participants:3 physical therapists having an average of 25 y of experience.Main Outcome Measures:Three standardized angles (acute, right, obtuse) were constructed to replicate the movement of a hinge joint in the human body. Angular changes were measured and compared across 3 raters who used 3 different devices (UG, inclinometer, and 2 goniometric apps installed on 3 different smartphones: Apple iPhone 5, LG Android, and Samsung SIII Android). Intraclass correlation coefficients (ICCs) and Bland-Altman plots were used to examine interrater reliability and concurrent validity.Results:Interrater reliability for each of the smartphone apps, inclinometer and UG were excellent (ICC = .995–1.000). Concurrent validity was also good (ICC = .998–.999). Based on the Bland-Altman plots, the means of the differences between the devices were low (range = –0.4° to 1.2°).Conclusions:This study identifies the error inherent in measurement that is independent of patient factors and due to the smartphone, the installed apps, and examiner skill. Less than 2° of measurement variability was attributable to those factors alone. The data suggest that 3 smartphones with the 2 installed apps are a viable substitute for using a UG or an inclinometer when measuring angular changes that typically occur when examining ROM and demonstrate the capacity of multiple examiners to accurately use smartphone-based goniometers.

scholarly journals Reliability of Safe Maximum Lifting Determinations of a Functional Capacity Evaluation

2002 ◽  
Vol 82 (4) ◽  
pp. 364-371 ◽  
Author(s):  
Douglas P Gross ◽  
Michele C Battié
Keyword(s):  
Functional Capacity ◽  
Repeated Measures ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Functional Capacity Evaluation ◽  
Measurement Variability ◽  
Retest Reliability ◽  
Repeated Measures Design ◽  
Test Retest Reliability

Abstract Background and Purpose. Functional capacity evaluations (FCEs) are measurement tools used in predicting readiness to return to work following injury. The interrater and test-retest reliability of determinations of maximal safe lifting during kinesiophysical FCEs were examined in a sample of people who were off work and receiving workers' compensation. Subjects. Twenty-eight subjects with low back pain who had plateaued with treatment were enrolled. Five occupational therapists, trained and experienced in kinesiophysical methods, conducted testing. Methods. A repeated-measures design was used, with raters testing subjects simultaneously, yet independently. Subjects were rated on 2 occasions, separated by 2 to 4 days. Analyses included intraclass correlation coefficients (ICCs) and 95% confidence intervals. Results. The ICC values for interrater reliability ranged from .95 to .98. Test-retest values ranged from .78 to .94. Discussion and Conclusion. Inconsistencies in subjects' performance across sessions were the greatest source of FCE measurement variability. Overall, however, test-retest reliability was good and interrater reliability was excellent.

Reliability and Validity of Thickness Measurements of the Supraspinatus Muscle of the Shoulder: An Ultrasonography Study

2014 ◽  
Vol 23 (2) ◽  
Author(s):  
William Temes ◽  
Amy Temes Clifton ◽  
Valerie Hilton ◽  
Leslie Girard ◽  
Neisha Strait ◽  
...  
Keyword(s):  
Outcome Measures ◽  
Muscle Function ◽  
Physical Therapists ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Quantitative Measure ◽  
Ultrasound Images ◽  
Validity And Reliability ◽  
Supraspinatus Muscle ◽  
Asymptomatic Subjects

Context: The supraspinatus is the most commonly affected muscle with rotator-cuff pathology and necessary for stability of the humeral head in the glenoid fossa. Rehabilitative ultrasound imaging (RUSI) of skeletal muscles provides a safe and clinically accessible measure of intact human muscle function at rest or during contracted states. The ability to perform accurate assessment of supraspinatus function has not been studied and may be of value in assessment and treatment. Objectives: To determine the validity and reliability of measures obtained using RUSI for assessing supraspinatus muscle at rest and contracted conditions. Design: Reliability and validity Setting: Outpatient physical therapy clinic. Subjects: 15 asymptomatic subjects age 30-49 y. Main Outcome Measures: The supraspinatus muscle was measured at rest and contracted with a 0.9-kg weight with the arm positioned in 45° of abduction in the plane of the scapula. Repeated ultrasound images of the supraspinatus were collected by 3 physical therapists on 2 separate days. Main Outcome Measures: Reliability was assessed with the intraclass correlation coefficient (ICC) and standard error of measurement (SEM). Validity was tested by comparing mean difference between active and passive states for all 3 rates on both days. Results: All ICC values were found to be at .9 or above. In addition, for all days and raters, the active condition was significantly thicker than the passive condition (P < .001). Conclusions: Thickness measures of the supraspinatus using RUSI, during passive and active conditions, demonstrate high interrater and intrarater reliability and can easily distinguish between active and passive states. These findings suggest that RUSI may provide an appropriate quantitative measure for changes in the thickness of supraspinatus that are important for determining improvement or deterioration in muscle function.

scholarly journals Interrater Reliability of AM-PAC “6-Clicks” Basic Mobility and Daily Activity Short Forms

2015 ◽  
Vol 95 (5) ◽  
pp. 758-766 ◽  
Author(s):  
Diane U. Jette ◽  
Mary Stilphen ◽  
Vinoth K. Ranganathan ◽  
Sandra Passek ◽  
Frederick S. Frost ◽  
...  
Keyword(s):  
Daily Activity ◽  
Interrater Reliability ◽  
Physical Therapists ◽  
Short Form ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Occupational Therapists ◽  
Weighted Kappa ◽  
Item Scores ◽  
Mean Differences

BackgroundThe interrater reliability of 2 new inpatient functional short-form measures, Activity Measure for Post-Acute Care (AM-PAC) “6-Clicks” basic mobility and daily activity scores, has yet to be established.ObjectiveThe purpose of this study was to examine the interrater reliability of AM-PAC “6-Clicks” measures.DesignA prospective observational study was conducted.MethodsFour pairs of physical therapists rated basic mobility and 4 pairs of occupational therapists rated daily activity of patients in 1 of 4 hospital services. One therapist in a pair was the primary therapist directing the assessment while the other therapist observed. Each therapist was unaware of the other's AM-PAC “6-Clicks” scores. Reliability was assessed with intraclass correlation coefficients (ICCs), Bland-Altman plots, and weighted kappa.ResultsThe ICCs for the overall reliability of basic mobility and daily activity were .849 (95% confidence interval [CI]=.784, .895) and .783 (95% CI=.696, .847), respectively. The ICCs for the reliability of each pair of raters ranged from .581 (95% CI=.260, .789) to .960 (95% CI=.897, .983) for basic mobility and .316 (95% CI=−.061, .611) to .907 (95% CI=.801, .958) for daily activity. The weighted kappa values for item agreement ranged from .492 (95% CI=.382, .601) to .712 (95% CI=.607, .816) for basic mobility and .251 (95% CI=.057, .445) to .751 (95% CI=.653, .848) for daily activity. Mean differences between raters' scores were near zero.LimitationsRaters were from one health system. Each pair of raters assessed different patients in different services.ConclusionsThe ICCs for AM-PAC “6-Clicks” total scores were very high. Levels of agreement varied across pairs of raters, from large to nearly perfect for physical therapists and from moderate to nearly perfect for occupational therapists. Levels of agreement for individual item scores ranged from small to very large.

scholarly journals Reliability of the Function in Sitting Test (FIST)

2014 ◽  
Vol 2014 ◽  
pp. 1-6 ◽  
Author(s):  
Sharon L. Gorman ◽  
Monica Rivera ◽  
Lise McCarthy
Keyword(s):  
Interrater Reliability ◽  
Physical Therapists ◽  
Physical Therapist ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Inpatient Rehabilitation ◽  
Neurological Dysfunction ◽  
Retest Reliability ◽  
Reliability Characteristics ◽  
Test Retest Reliability

The function in sitting test (FIST) is a newly developed, performance-based measure examining deficits in seated postural control. The FIST has been shown to be internally consistent and valid in persons with neurological dysfunction but intra- and interrater reliability and test-retest reliability have not been previously described. Seven patients with chronic neurologic dysfunction were tested and videotaped performing the FIST on two consecutive days. Seventeen acute care and inpatient rehabilitation physical therapist raters scored six of the videotaped performance of the FIST on two occasions at least 2 weeks apart. Intraclass correlation coefficients were used to calculate the test-retest and intra- and interrater reliability of the FIST. ICC of 0.97 (95% CI 0.847–0.995) indicated excellent test-retest reliability of the FIST. Intra- and interrater reliability was also excellent with ICCs of 0.99 (95% CI 0.994–0.997) and 0.99 (95% CI 0.988–0.994), respectively. Physical therapists and other rehabilitation professionals can confidently use the FIST in a variety of clinical practice and research settings due to its favorable reliability characteristics. More studies are needed to describe the responsiveness and minimal clinically important level of change in FIST scores to further enhance clinical usefulness of this measure.

scholarly journals A Digital Photographic Measurement Method for Quantifying Foot Posture: Validity, Reliability, and Descriptive Data

2011 ◽  
Vol 46 (1) ◽  
pp. 20-30 ◽  
Author(s):  
Stephen C. Cobb ◽  
C. Roger James ◽  
Matthew Hjertstedt ◽  
James Kruk
Keyword(s):  
Concurrent Validity ◽  
Measurement Method ◽  
Injury Risk ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Validity And Reliability ◽  
Descriptive Data ◽  
Data Set ◽  
Intraclass Correlation Coefficients ◽  
Foot Posture

Abstract Context: Although abnormal foot posture long has been associated with lower extremity injury risk, the evidence is equivocal. Poor intertester reliability of traditional foot measures might contribute to the inconsistency. Objectives: To investigate the validity and reliability of a digital photographic measurement method (DPMM) technology, the reliability of DPMM-quantified foot measures, and the concurrent validity of the DPMM with clinical-measurement methods (CMMs) and to report descriptive data for DPMM measures with moderate to high intratester and intertester reliability. Design: Descriptive laboratory study. Setting: Biomechanics research laboratory. Patients or Other Participants: A total of 159 people participated in 3 groups. Twenty-eight people (11 men, 17 women; age  =  25 ± 5 years, height  =  1.71 ± 0.10 m, mass  =  77.6 ± 17.3 kg) were recruited for investigation of intratester and intertester reliability of the DPMM technology; 20 (10 men, 10 women; age  =  24 ± 2 years, height  =  1.71 ± 0.09 m, mass  =  76 ± 16 kg) for investigation of DPMM and CMM reliability and concurrent validity; and 111 (42 men, 69 women; age  =  22.8 ± 4.7 years, height  =  168.5 ± 10.4 cm, mass  =  69.8 ± 13.3 kg) for development of a descriptive data set of the DPMM foot measurements with moderate to high intratester and intertester reliabilities. Intervention(s): The dimensions of 10 model rectangles and the 28 participants' feet were measured, and DPMM foot posture was measured in the 111 participants. Two clinicians assessed the DPMM and CMM foot measures of the 20 participants. Main Outcome Measure(s): Validity and reliability were evaluated using mean absolute and percentage errors and intraclass correlation coefficients. Descriptive data were computed from the DPMM foot posture measures. Results: The DPMM technology intratester and intertester reliability intraclass correlation coefficients were 1.0 for each tester and variable. Mean absolute errors were equal to or less than 0.2 mm for the bottom and right-side variables and 0.1° for the calculated angle variable. Mean percentage errors between the DPMM and criterion reference values were equal to or less than 0.4%. Intratester and intertester reliabilities of DPMM-computed structural measures of arch and navicular indices were moderate to high (&gt;0.78), and concurrent validity was moderate to strong. Conclusions: The DPMM is a valid and reliable clinical and research tool for quantifying foot structure. The DPMM and the descriptive data might be used to define groups in future studies in which the relationship between foot posture and function or injury risk is investigated.

Validity and reliability of a smartphone goniometer application for measuring hip range of motions

Work ◽  
2021 ◽  
pp. 1-6
Author(s):  
Devrim Can Sarac ◽  
Gamze Yalcinkaya ◽  
Bayram Unver
Keyword(s):  
Concurrent Validity ◽  
External Rotation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Smartphone Application ◽  
Validity And Reliability ◽  
Cross Sectional ◽  
Minimum Detectable Change ◽  
Observer Reliability ◽  
Hip Flexion

BACKGROUND: Mobile applications which are designed to assess the range of motion (ROM) are widely used. OBJECTIVE: The aim of this cross-sectional observational study was to determine the inter-observer and intra-observer reliability of a smartphone application “PT Goniometer” (PTG) and determine the correlation between PTG and universal goniometer (UG) regarding active ROMs of the hip in healthy participants. METHODS: Thirty-four healthy young participants were included in the study. Two physiotherapists performed active hip flexion, abduction, internal rotation and external rotation ROM measurements of dominant legs of the participants by using PTG and UG. Intraclass correlation coefficients (ICC) were calculated to determine the intra-observer and inter-observer reliability. Level of correlations between PTG and UG were used to establish concurrent validity of PTG. RESULTS: The PTG demonstrated excellent inter-observer and intra-observer reliability (ICC >  0.90) for all measured hip movements. The minimum detectable change (MDC95) was ranged from 3.29° to 5.1° for the intra-observer reliability, and from 2.55° to 3.21° for the inter-observer reliability. Additionally, the concurrent validity was found excellent (r = 0.91–0.93). CONCLUSION: The results of the present study suggest that PTG is a valid and a reliable mobile technology for measuring hip ROMs.

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

scholarly journals Validity of Inertial Sensors for Assessing Balance Kinematics and Mobility during Treadmill-Based Perturbation and Dance Training

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3065
Author(s):  
Ernest Kwesi Ofori ◽  
Shuaijie Wang ◽  
Tanvi Bhatt
Keyword(s):  
Concurrent Validity ◽  
Inertial Sensors ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Human Motion ◽  
Intraclass Correlation Coefficients ◽  
Dance Training ◽  
Silver Standard ◽  
Mean Square Errors ◽  
Reactive Balance

Inertial sensors (IS) enable the kinematic analysis of human motion with fewer logistical limitations than the silver standard optoelectronic motion capture (MOCAP) system. However, there are no data on the validity of IS for perturbation training and during the performance of dance. The aim of this present study was to determine the concurrent validity of IS in the analysis of kinematic data during slip and trip-like perturbations and during the performance of dance. Seven IS and the MOCAP system were simultaneously used to capture the reactive response and dance movements of fifteen healthy young participants (Age: 18–35 years). Bland Altman (BA) plots, root mean square errors (RMSE), Pearson’s correlation coefficients (R), and intraclass correlation coefficients (ICC) were used to compare kinematic variables of interest between the two systems for absolute equivalency and accuracy. Limits of agreements (LOA) of the BA plots ranged from −0.23 to 0.56 and −0.21 to 0.43 for slip and trip stability variables, respectively. The RMSE for slip and trip stabilities were from 0.11 to 0.20 and 0.11 to 0.16, respectively. For the joint mobility in dance, LOA varied from −6.98–18.54, while RMSE ranged from 1.90 to 13.06. Comparison of IS and optoelectronic MOCAP system for reactive balance and body segmental kinematics revealed that R varied from 0.59 to 0.81 and from 0.47 to 0.85 while ICC was from 0.50 to 0.72 and 0.45 to 0.84 respectively for slip–trip perturbations and dance. Results of moderate to high concurrent validity of IS and MOCAP systems. These results were consistent with results from similar studies. This suggests that IS are valid tools to quantitatively analyze reactive balance and mobility kinematics during slip–trip perturbation and the performance of dance at any location outside, including the laboratory, clinical and home settings.

Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency

2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  
Keyword(s):  
Critical Thinking ◽  
Interrater Reliability ◽  
Clinical Chemistry ◽  
Core Competencies ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Thinking Skills ◽  
Project Evaluation ◽  
Critical Thinking Skills

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

Development of a Model for the Acquisition and Assessment of Advanced Laparoscopic Suturing Skills Using an Automated Device

2018 ◽  
Vol 25 (3) ◽  
pp. 286-290 ◽  
Author(s):  
Elif Bilgic ◽  
Madoka Takao ◽  
Pepa Kaneva ◽  
Satoshi Endo ◽  
Toshitatsu Takao ◽  
...  
Keyword(s):  
Laparoscopic Surgery ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Instructional Video ◽  
Validity Evidence ◽  
Laparoscopic Suturing ◽  
Intraclass Correlation Coefficients ◽  
Operative Assessment ◽  
Suturing Skills

Background. Needs assessment identified a gap regarding laparoscopic suturing skills targeted in simulation. This study collected validity evidence for an advanced laparoscopic suturing task using an Endo StitchTM device. Methods. Experienced (ES) and novice surgeons (NS) performed continuous suturing after watching an instructional video. Scores were based on time and accuracy, and Global Operative Assessment of Laparoscopic Surgery. Data are shown as medians [25th-75th percentiles] (ES vs NS). Interrater reliability was calculated using intraclass correlation coefficients (confidence interval). Results. Seventeen participants were enrolled. Experienced surgeons had significantly greater task (980 [964-999] vs 666 [391-711], P = .0035) and Global Operative Assessment of Laparoscopic Surgery scores (25 [24-25] vs 14 [12-17], P = .0029). Interrater reliability for time and accuracy were 1.0 and 0.9 (0.74-0.96), respectively. All experienced surgeons agreed that the task was relevant to practice. Conclusion. This study provides validity evidence for the task as a measure of laparoscopic suturing skill using an automated suturing device. It could help trainees acquire the skills they need to better prepare for clinical learning.

Sign in / Sign up

Export Citation Format

Share Document