scholarly journals Teleassessment of Gait and Gait Aids: Validity and Interrater Reliability

2020 ◽  
Vol 100 (4) ◽  
pp. 708-717
Author(s):  
Kavita Venkataraman ◽  
Kristopher Amis ◽  
Lawrence R Landerman ◽  
Kevin Caves ◽  
Gerald C Koh ◽  
...  
Keyword(s):  
Repeated Measures ◽  
Interrater Reliability ◽  
Video Quality ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Slow Motion ◽  
Frame Rate ◽  
Normal Speed ◽  
Lower Frame ◽  
Rehabilitation Needs

Abstract Background Gait and mobility aid assessments are important components of rehabilitation. Given the increasing use of telehealth to meet rehabilitation needs, it is important to examine the feasibility of such assessments within the constraints of telerehabilitation. Objective The objective of this study was to examine the reliability and validity of the Tinetti Performance-Oriented Mobility Assessment gait scale (POMA-G) and cane height assessment under various video and transmission settings to demonstrate the feasibility of teleassessment. Design This repeated-measures study compared the test performances of in-person, slow motion (SM) review, and normal-speed (NS) video ratings at various fixed frame rates (8, 15, and 30 frames per second) and bandwidth (128, 384, and 768 kB/s) configurations. Methods Overall bias, validity, and interrater reliability were assessed for in-person, SM video, and NS video ratings, with SM video rating as the gold standard, as well as for different frame rate and bandwidth configurations within NS videos. Results There was moderate to good interrater reliability for the POMA-G (intraclass correlation coefficient [ICC] = 0.66–0.77 across all configurations) and moderate validity for in-person (β = 0.62; 95% confidence interval [CI] = 0.37–0.87) and NS video (β = 0.74; 95% CI = 0.67–0.80) ratings compared with the SM video rating. For cane height, interrater reliability was good (ICC = 0.66–0.77), although it was significantly lower at the lowest frame rate (8 frames per second) (ICC = 0.66; 95% CI = 0.54–0.76) and bandwidth (128 kB/s) (ICC = 0.69; 95% CI = 0.57–0.78) configurations. Validity for cane height was good for both in-person (β = 0.80; 95% CI = 0.62–0.98) and NS video (β = 0.86; 95% CI = 0.81–0.90) ratings compared with SM video rating. Limitations Some lower frame rate and bandwidth configurations may limit the reliability of remote cane height assessments. Conclusions Teleassessment for POMA-G and cane height using typically available internet and video quality is feasible, valid, and reliable.

scholarly journals Testing fine motor coordination via telehealth: Effects of video characteristics on reliability and validity

2017 ◽  
Vol 24 (5) ◽  
pp. 365-372 ◽  
Author(s):  
Helen M Hoenig ◽  
Kristopher Amis ◽  
Carol Edmonds ◽  
Michelle S Morgan ◽  
Lawrence Landerman ◽  
...  
Keyword(s):  
Repeated Measures ◽  
Motor Coordination ◽  
Reliability And Validity ◽  
Slow Motion ◽  
Criterion Validity ◽  
Fine Motor ◽  
Clinical Practices ◽  
Rater Reliability ◽  
Fine Motor Coordination ◽  
Normal Speed

Background There is limited research about the effects of video quality on the accuracy of assessments of physical function. Methods A repeated measures study design was used to assess reliability and validity of the finger–nose test (FNT) and the finger-tapping test (FTT) carried out with 50 veterans who had impairment in gross and/or fine motor coordination. Videos were scored by expert raters under eight differing conditions, including in-person, high definition video with slow motion review and standard speed videos with varying bit rates and frame rates. Results FTT inter-rater reliability was excellent with slow motion video (ICC 0.98–0.99) and good (ICC 0.59) under the normal speed conditions. Inter-rater reliability for FNT ‘attempts’ was excellent (ICC 0.97–0.99) for all viewing conditions; for FNT ‘misses’ it was good to excellent (ICC 0.89) with slow motion review but substantially worse (ICC 0.44) on the normal speed videos. FTT criterion validity (i.e. compared to slow motion review) was excellent (β = 0.94) for the in-person rater and good ( β = 0.77) on normal speed videos. Criterion validity for FNT ‘attempts’ was excellent under all conditions ( r ≥ 0.97) and for FNT ‘misses’ it was good to excellent under all conditions ( β = 0.61–0.81). Conclusions In general, the inter-rater reliability and validity of the FNT and FTT assessed via video technology is similar to standard clinical practices, but is enhanced with slow motion review and/or higher bit rate.

Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency

2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  
Keyword(s):  
Critical Thinking ◽  
Interrater Reliability ◽  
Clinical Chemistry ◽  
Core Competencies ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Thinking Skills ◽  
Project Evaluation ◽  
Critical Thinking Skills

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

scholarly journals Reliability of Safe Maximum Lifting Determinations of a Functional Capacity Evaluation

2002 ◽  
Vol 82 (4) ◽  
pp. 364-371 ◽  
Author(s):  
Douglas P Gross ◽  
Michele C Battié
Keyword(s):  
Functional Capacity ◽  
Repeated Measures ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Functional Capacity Evaluation ◽  
Measurement Variability ◽  
Retest Reliability ◽  
Repeated Measures Design ◽  
Test Retest Reliability

Abstract Background and Purpose. Functional capacity evaluations (FCEs) are measurement tools used in predicting readiness to return to work following injury. The interrater and test-retest reliability of determinations of maximal safe lifting during kinesiophysical FCEs were examined in a sample of people who were off work and receiving workers' compensation. Subjects. Twenty-eight subjects with low back pain who had plateaued with treatment were enrolled. Five occupational therapists, trained and experienced in kinesiophysical methods, conducted testing. Methods. A repeated-measures design was used, with raters testing subjects simultaneously, yet independently. Subjects were rated on 2 occasions, separated by 2 to 4 days. Analyses included intraclass correlation coefficients (ICCs) and 95% confidence intervals. Results. The ICC values for interrater reliability ranged from .95 to .98. Test-retest values ranged from .78 to .94. Discussion and Conclusion. Inconsistencies in subjects' performance across sessions were the greatest source of FCE measurement variability. Overall, however, test-retest reliability was good and interrater reliability was excellent.

Bioimpedance Spectroscopy Is a Valid and Reliable Measure of Edema Following Hand Burn Injury (Part 1—Method Validation)

2020 ◽  
Vol 41 (4) ◽  
pp. 780-787 ◽  
Author(s):  
Dale O Edwick ◽  
Dana A Hince ◽  
Jeremy M Rawlins ◽  
Fiona M Wood ◽  
Dale W Edgar
Keyword(s):  
Repeated Measures ◽  
Burn Injury ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Whole Body ◽  
Bioimpedance Spectroscopy ◽  
Water Displacement ◽  
Reliable Measure ◽  
Minimum Detectable Difference

Abstract The assessment of swelling following burn injury is complicated by the presence of wounds and dressings and due to patients experiencing significant pain and impaired movement. There remains a lack of sensitive objective measures for edema in patients presenting with hand burn injury. Bioimpedance spectroscopy (BIS) is a measure of body composition that has been demonstrated by our group to be reliable for measuring whole body and limb edema during resuscitation and to be sensitive to edema changes within healing wounds. The aim of this study was to determine the reliability and validity of BIS as a measure of edema following hand burn injury specifically. One hundred patients presenting with burn injury including a portion of a hand were recruited to this trial. Repeated measures of the hand were recorded using a novel application of BIS and in parallel with water displacement volumetry (WDV). The results were analyzed using mixed-effects regressions. Paired repeated measures were obtained for 195 hands, using four electrode configurations. BIS demonstrated high reliability in measuring hand BIS—Intraclass Correlation Coefficient 0.995 to 0.999 (95% CI 0.992–1.000) and sensitivity—Minimum Detectable Difference 0.74 to 3.86 Ω (0.09–0.48 Ω/cm). A strong correlation was shown with WDV, Pearson’s r = −0.831 to −0.798 (P < .001). BIS is a sensitive and reliable measure of edema following acute hand burn injury.

scholarly journals Alberta Infant Motor Scale: Reliability and Validity When Used on Preterm Infants in Taiwan

2000 ◽  
Vol 80 (2) ◽  
pp. 168-178 ◽  
Author(s):  
Suh-Fang Jeng ◽  
Kuo-Inn Tsou Yau ◽  
Li-Chiou Chen ◽  
Shu-Fang Hsiao
Keyword(s):  
Preterm Infants ◽  
Interrater Reliability ◽  
Physical Therapist ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Intraclass Correlation Coefficients ◽  
Scale Reliability ◽  
Scale Scores ◽  
Acceptable Reliability

Abstract Background and Purpose. The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Subjects. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. Methods. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Results. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97–.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and .90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). Conclusion and Discussion. The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.

scholarly journals Reliability of a Measurement of Neck Flexor Muscle Endurance

2005 ◽  
Vol 85 (12) ◽  
pp. 1349-1355 ◽  
Author(s):  
Kevin D Harris ◽  
Darren M Heer ◽  
Tanja C Roy ◽  
Diane M Santos ◽  
Julie M Whitman ◽  
...  
Keyword(s):  
Neck Pain ◽  
Repeated Measures ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Test Session ◽  
Muscle Endurance ◽  
Flexor Muscle ◽  
Endurance Test ◽  
Initial Session ◽  
Standard Error Of Measurement

Abstract Background and Purpose. Neck flexor muscle endurance has been negatively correlated with cervical pain and dysfunction. The purposes of this study were to determine rater reliability in subjects both withand without neck pain and to determine whether there was a difference in neck flexor muscle endurance between the 2 groups. Subjects. Forty-one subjects with and without neck pain were enrolled in this repeated-measures reliability study. Methods. Two raters used an isometric neck retraction test to assess neck flexor muscle endurancefor all subjects during an initial session, and subjects without neck pain returned for testing 1 week later. Results. For the group without neck pain, intrarater reliability was good to excellent (intraclass correlation coefficient [ICC(3,1)]=.82–.91), and interrater reliability was moderate to good (ICC[2,1]=.67–.78). The associated standard error of measurement (SEM) ranged from 8.0 to 11.0 seconds and from 12.6 to 15.3 seconds, respectively. For the group with neck pain, interrater reliability was moderate(ICC[2,1]=.67, SEM=11.5). Neck flexor muscle endurance test results for the group without neck pain (X̄=38.95 seconds, SD=26.4) and the group with neck pain (X̄=24.1 seconds, SD=12.8) were significantly different. Discussion and Conclusion. Reliability coefficients differed between the 2 groups and ranged from moderate to excellent and improved after the first test session. The interrater reliability of data obtained with the neck flexor muscle endurance test in people with neck pain must be improved in order for clinicians to distinguish a clinically meaningful change from measurement error. Neck flexor muscle endurance was both statistically and clinically greater for subjects without neck pain than for those with neck pain.

scholarly journals The reliability and validity of goniometric elbow measurements in adults: A systematic review of the literature

2018 ◽  
Vol 10 (4) ◽  
pp. 274-284 ◽  
Author(s):  
Suzanne F van Rijn ◽  
Elisa L Zwerus ◽  
Koen LM Koenraadt ◽  
Wilco CH Jacobs ◽  
Michel PJ van den Bekerom ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Interrater Reliability ◽  
Literature Search ◽  
Meta Analysis ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Diagnostic Reliability ◽  
Measuring Tool ◽  
Simple Measuring

Background The universal goniometer is a simple measuring tool. With this review we aimed to investigate the reliability and validity of the universal goniometer in measurements of the adults' elbow. Methods Preferred Reporting Items for Systematic reviews and Meta-Analysis guidelines were followed and our study protocol was published online at PROSPERO. A literature search was conducted on relevant studies. Methodological quality was assessed using the Quality Appraisal of Diagnostic Reliability (QAREL) scoring system. Results Out of 697 studies yielded from our literature search, 12 were included. Six studies were rated as high quality. The intrarater reliability intraclass correlation coefficient ranged from 0.45 to 0.99, the interrater reliability ranged from intraclass correlation coefficient 0.53–0.97. One study providing instructions on goniometric alignment did not find a difference in expert versus non-expert examiners. Another study in which examiners were not instructed found a higher interrater reliability in expert examiners. One study investigating the validity of the goniometer in elbow measurements found a maximum standard error of the mean of 11.5° for total range of motion. Discussion Overall, the studies showed high intra- and interrater reliability of the universal goniometer. The reliability of the universal goniometer in non-expert examiners can be increased by clear instructions on goniometric alignment.

scholarly journals Measurement of Scapular Asymmetry and Assessment of Shoulder Dysfunction Using the Lateral Scapular Slide Test: A Reliability and Validity Study

2001 ◽  
Vol 81 (2) ◽  
pp. 799-809 ◽  
Author(s):  
Corrie J Odom ◽  
Andrea B Taylor ◽  
Christine E Hurd ◽  
Craig R Denegar
Keyword(s):  
Sensitivity And Specificity ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Distance Measures ◽  
Intrarater Reliability ◽  
Shoulder Dysfunction ◽  
Difference Measurement ◽  
Slide Test ◽  
The Difference

Abstract Background and Purpose. The Lateral Scapular Slide Test (LSST) is used to determine scapular position with the arm abducted 0, 45, and 90 degrees in the coronal plane. Assessment of scapular position is based on the derived difference measurement of bilateral scapular distances. The purpose of this study was to assess the reliability of measurements obtained using the LSST and whether they could be used to identify people with and without shoulder impairments. Subjects. Forty-six subjects ranging in age from 18 to 65 years (X̄=30.0, SD=11.1) participated in this study. One group consisted of 20 subjects being treated for shoulder impairments, and one group consisted of 26 subjects without shoulder impairments. Methods. Two measurements in each test position were obtained bilaterally. From the bilateral measurements, we derived the difference measurement. Intraclass correlation coefficients (ICC [1,1]) and the standard error of measurement (SEM) were calculated for intrarater and interrater reliability of the difference in side-to-side measures of scapular distance. Sensitivity and specificity of the LSST for classifying subjects with and without shoulder impairments were also determined. Results. The ICCs for intrarater reliability were .75, .77, and .80 and .52, .66, and .62, respectively, for subjects without and with shoulder impairments in 0, 45, and 90 degrees of abduction. The ICCs for interrater reliability were .67, .43, and .74 and .79, .45, and .57, respectively, for subjects without and with shoulder impairments in 0, 45 and 90 degrees of abduction. The SEMs ranged from 0.57 to 0.86 cm for intrarater reliability and from 0.79 to 1.20 cm for interrater reliability. Using the criterion of greater than 1.0 cm difference, sensitivity and specificity were 35% and 48%, 41% and 54%, and 43% and 56%, respectively, for 0, 45, and 90 degrees of abduction. Sensitivity and specificity based on the criterion of greater than 1.5 cm difference were 28% and 53%, 50% and 58%, and 34% and 52%, respectively, for the 3 scapular positions. Conclusion and Discussion. Our results suggest that measurements of scapular positioning based on the difference in side-to-side scapular distance measures are not reliable. Furthermore, the results suggest that sensitivity and specificity of the LSST measurements are poor and that the LSST should not be used to identify people with and without shoulder dysfunction.

scholarly journals Reliability and Validity of Three Clinical Methods to Measure Lower Extremity Muscle Power

2020 ◽  
Vol 9 (1) ◽  
pp. 1
Author(s):  
Mattie E. Pontiff ◽  
Li Li ◽  
Noelle G. Moreau
Keyword(s):  
Lower Extremity ◽  
Repeated Measures ◽  
Muscle Power ◽  
Intraclass Correlation ◽  
Force Plate ◽  
Reliability And Validity ◽  
Cross Sectional ◽  
Position Transducer ◽  
Lower Extremity Muscle ◽  
Highly Correlated

Background: Lower extremity muscle power is critical for daily activities and athletic performance in clinical populations. Objective: The purpose of this study was to determine the reliability and validity of 3 clinically feasible methods to measure lower extremity muscle power during a leg press. Methods: Ten of 26 subjects performed 2 sessions of 5 submaximal leg presses separated by 3-7 days in this repeated-measures cross-sectional design; the remaining performed 1 test session. Power was calculated independently for each method [simple video, linear position transducer, and accelerometer] and compared to the reference force plate. Test-retest reliability was evaluated using intraclass correlation coefficients (ICC). Pearson’s correlation coefficient (r), Bland-Altman plots with 95% limits of agreement (LOA), and mean bias percentages (%) were used to determine relative and absolute validity. Results: Power measures were reliable for all methods (ICC=.97-.99). All were highly correlated with the force plate (r=.96-.98). Mean bias was -0.8% (LOA: -16.57% to 14.98%) (video), -13.21% (LOA: -23.81% to -2.61%) (position transducer) compared to the force plate. Proportional bias was observed for accelerometry. Conclusion: All methods were reliable and highly correlated with the force plate. Only the video and position transducer demonstrated absolute validity. The position transducer was the most feasible method because of its simplicity and accuracy in measuring power.

Assessment of Reliability and Validity of the Cochlear Implant Skills Review: A New Measure to Evaluate Cochlear Implant Users' Device Skills and Knowledge

2021 ◽  
pp. 1-23
Author(s):  
Kara Vasil ◽  
Jessica Lewis ◽  
Christin Ray ◽  
Jodi Baxter ◽  
Claire Bernstein ◽  
...  
Keyword(s):  
Construct Validity ◽  
Cochlear Implant ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Valid Assessment ◽  
Device Use

Purpose The Cochlear Implant Skills Review (CISR) was developed as a measure of cochlear implant (CI) users' skills and knowledge regarding device use. This study aimed to determine intra- and interrater reliability and agreement and establish construct validity for the CISR. Method In this study, the CISR was developed and administered to a cohort of 30 adult CI users. Participants included new CI users with less than 1 year of CI experience and experienced CI users with greater than 1 year of CI experience. The CISR administration required participants to demonstrate skills using the various features of their CI processors. Intra- and interrater reliability were assessed using intraclass correlation coefficients, agreement was assessed using Cohen's kappa, and construct validity was assessed by relating CISR performance to duration of CI use. Results Overall reliability for the entire instrument was 92.7%. Inter- and intrarater agreement were generally substantial or higher. Duration of CI use was a significant predictor of CISR performance. Conclusions The CISR is a reliable and valid assessment measure of device skills and knowledge for adult CI users. Clinicians can use this tool to evaluate areas of needed instruction and counseling and to assess users' skills over time.

Sign in / Sign up

Export Citation Format

Share Document