Interrater Reliability of a Novel Goniometric Technique to Measure Scapular Protraction and Retraction

2022 ◽  
Vol 76 (1) ◽  
Author(s):  
Nathan Short ◽  
Thomas Almonreoder ◽  
Michelle Mays ◽  
Abigail Baist ◽  
Tony Clifton ◽  
...  

Importance: Scapular protraction and retraction are often essential for occupational performance; however, clinical assessment of these movements is uniquely challenging. Objective: To analyze the interrater reliability of a novel goniometric method to measure scapular protraction and retraction. Design: An observational, descriptive design was implemented to evaluate interrater reliability between two experienced occupational therapists who were also certified hand therapists. Setting: Academic institution. Participants: Convenience sample of graduate students (N = 80). Outcomes and Measures: The hypothesis, developed before study implementation, was that the technique would demonstrate clinically acceptable interrater reliability, defined as a standard error of measurement (SEM) <8°. Goniometric measurements of the scapula at rest, in maximal protraction, and in maximal retraction were independently obtained from each participant by each evaluator. The goniometer was aligned on the scapula using the superior angle as the axis of motion to measure the movement of the acromion relative to the frontal plane. The SEM was calculated in each position using the intraclass correlation coefficient values and the average of the standard deviations from the two raters. Results: The SEM values between the two evaluators for the resting, protracted, and retracted positions were 3.46°, 2.93°, and 2.74°, respectively. Conclusions and Relevance: The SEM between the two evaluators for each scapular position was <4°, suggesting that the technique may be clinically reliable. However, additional research regarding the reliability and validity of the technique is recommended. What This Article Adds: The findings of this study support the use of goniometry to measure scapular protraction and retraction in relation to occupational performance. The technique provides a way to quantify baseline scapular mobility and track progress.

2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.


2020 ◽  
Vol 100 (4) ◽  
pp. 708-717
Author(s):  
Kavita Venkataraman ◽  
Kristopher Amis ◽  
Lawrence R Landerman ◽  
Kevin Caves ◽  
Gerald C Koh ◽  
...  

Abstract Background Gait and mobility aid assessments are important components of rehabilitation. Given the increasing use of telehealth to meet rehabilitation needs, it is important to examine the feasibility of such assessments within the constraints of telerehabilitation. Objective The objective of this study was to examine the reliability and validity of the Tinetti Performance-Oriented Mobility Assessment gait scale (POMA-G) and cane height assessment under various video and transmission settings to demonstrate the feasibility of teleassessment. Design This repeated-measures study compared the test performances of in-person, slow motion (SM) review, and normal-speed (NS) video ratings at various fixed frame rates (8, 15, and 30 frames per second) and bandwidth (128, 384, and 768 kB/s) configurations. Methods Overall bias, validity, and interrater reliability were assessed for in-person, SM video, and NS video ratings, with SM video rating as the gold standard, as well as for different frame rate and bandwidth configurations within NS videos. Results There was moderate to good interrater reliability for the POMA-G (intraclass correlation coefficient [ICC] = 0.66–0.77 across all configurations) and moderate validity for in-person (β = 0.62; 95% confidence interval [CI] = 0.37–0.87) and NS video (β = 0.74; 95% CI = 0.67–0.80) ratings compared with the SM video rating. For cane height, interrater reliability was good (ICC = 0.66–0.77), although it was significantly lower at the lowest frame rate (8 frames per second) (ICC = 0.66; 95% CI = 0.54–0.76) and bandwidth (128 kB/s) (ICC = 0.69; 95% CI = 0.57–0.78) configurations. Validity for cane height was good for both in-person (β = 0.80; 95% CI = 0.62–0.98) and NS video (β = 0.86; 95% CI = 0.81–0.90) ratings compared with SM video rating. Limitations Some lower frame rate and bandwidth configurations may limit the reliability of remote cane height assessments. Conclusions Teleassessment for POMA-G and cane height using typically available internet and video quality is feasible, valid, and reliable.


2000 ◽  
Vol 80 (2) ◽  
pp. 168-178 ◽  
Author(s):  
Suh-Fang Jeng ◽  
Kuo-Inn Tsou Yau ◽  
Li-Chiou Chen ◽  
Shu-Fang Hsiao

Abstract Background and Purpose. The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Subjects. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. Methods. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Results. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97–.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and .90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). Conclusion and Discussion. The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.


2008 ◽  
Vol 16 (3) ◽  
pp. 292-315 ◽  
Author(s):  
Dawn P. Gill ◽  
Gareth R. Jones ◽  
GuangYong Zou ◽  
Mark Speechley

The purpose of this study was to develop a brief physical activity interview for older adults (Phone-FITT) and evaluate its test–retest reliability and validity. Summary scores were derived for household, recreational, and total PA. Reliability was evaluated in a convenience sample from a fall-prevention study (N= 43, 79.4 ± 2.9 years, 51% male), and validity, in a random sample of individuals in older adult exercise programs (N= 48, 77.4 ± 4.7 years, 25% male). Mean time to complete the Phone-FITT was 10 min for participants sampled from exercise programs. Evaluation of test–retest reliability indicated substantial to almost perfect agreement for all scores, with intraclass correlation coefficients (95% confidence intervals) ranging from .74 (.58–.85) to .88 (.8–.94). For validity, Spearman’s rho correlations of Phone-FITT scores with accelerometer counts ranged from .29 (.01–.53) to .57 (.34–.73). Correlations of Phone-FITT recreational scores with age and seconds to complete a self-paced step test ranged from –.29 (–.53 to –.01) to –.45 (–.68 to –.14). This study contributes preliminary evidence of the reliability and validity of the Phone-FITT.


2018 ◽  
Vol 10 (4) ◽  
pp. 274-284 ◽  
Author(s):  
Suzanne F van Rijn ◽  
Elisa L Zwerus ◽  
Koen LM Koenraadt ◽  
Wilco CH Jacobs ◽  
Michel PJ van den Bekerom ◽  
...  

Background The universal goniometer is a simple measuring tool. With this review we aimed to investigate the reliability and validity of the universal goniometer in measurements of the adults' elbow. Methods Preferred Reporting Items for Systematic reviews and Meta-Analysis guidelines were followed and our study protocol was published online at PROSPERO. A literature search was conducted on relevant studies. Methodological quality was assessed using the Quality Appraisal of Diagnostic Reliability (QAREL) scoring system. Results Out of 697 studies yielded from our literature search, 12 were included. Six studies were rated as high quality. The intrarater reliability intraclass correlation coefficient ranged from 0.45 to 0.99, the interrater reliability ranged from intraclass correlation coefficient 0.53–0.97. One study providing instructions on goniometric alignment did not find a difference in expert versus non-expert examiners. Another study in which examiners were not instructed found a higher interrater reliability in expert examiners. One study investigating the validity of the goniometer in elbow measurements found a maximum standard error of the mean of 11.5° for total range of motion. Discussion Overall, the studies showed high intra- and interrater reliability of the universal goniometer. The reliability of the universal goniometer in non-expert examiners can be increased by clear instructions on goniometric alignment.


2015 ◽  
Vol 95 (5) ◽  
pp. 758-766 ◽  
Author(s):  
Diane U. Jette ◽  
Mary Stilphen ◽  
Vinoth K. Ranganathan ◽  
Sandra Passek ◽  
Frederick S. Frost ◽  
...  

BackgroundThe interrater reliability of 2 new inpatient functional short-form measures, Activity Measure for Post-Acute Care (AM-PAC) “6-Clicks” basic mobility and daily activity scores, has yet to be established.ObjectiveThe purpose of this study was to examine the interrater reliability of AM-PAC “6-Clicks” measures.DesignA prospective observational study was conducted.MethodsFour pairs of physical therapists rated basic mobility and 4 pairs of occupational therapists rated daily activity of patients in 1 of 4 hospital services. One therapist in a pair was the primary therapist directing the assessment while the other therapist observed. Each therapist was unaware of the other's AM-PAC “6-Clicks” scores. Reliability was assessed with intraclass correlation coefficients (ICCs), Bland-Altman plots, and weighted kappa.ResultsThe ICCs for the overall reliability of basic mobility and daily activity were .849 (95% confidence interval [CI]=.784, .895) and .783 (95% CI=.696, .847), respectively. The ICCs for the reliability of each pair of raters ranged from .581 (95% CI=.260, .789) to .960 (95% CI=.897, .983) for basic mobility and .316 (95% CI=−.061, .611) to .907 (95% CI=.801, .958) for daily activity. The weighted kappa values for item agreement ranged from .492 (95% CI=.382, .601) to .712 (95% CI=.607, .816) for basic mobility and .251 (95% CI=.057, .445) to .751 (95% CI=.653, .848) for daily activity. Mean differences between raters' scores were near zero.LimitationsRaters were from one health system. Each pair of raters assessed different patients in different services.ConclusionsThe ICCs for AM-PAC “6-Clicks” total scores were very high. Levels of agreement varied across pairs of raters, from large to nearly perfect for physical therapists and from moderate to nearly perfect for occupational therapists. Levels of agreement for individual item scores ranged from small to very large.


2015 ◽  
Vol 9 (1) ◽  
pp. 38-41 ◽  
Author(s):  
Robert Waller ◽  
Leon Straker ◽  
Peter O’Sullivan ◽  
Michele Sterling ◽  
Anne Smith

AbstractBackground and aimsInvestigation of the multidimensional correlates of pressure pain threshold (PPT) requires the study of large cohorts, and thus the use of multiple raters, for sufficient statistical power. Although PPT testing has previously been shown to be reliable, the reliability of multiple raters and investigation for systematic bias between raters has not been reported.The aim of this study was to evaluate the intrarater and interrater reliability of PPT measurement by handheld algometer at the wrist, leg, cervical spine and lumbar spine. Additionally the study aimed to calculate sample sizes required for parallel and cross-over studies for various effect sizes accounting for measurement error.MethodsFive research assistants (RAs) each tested 20 pain free subjects at the wrist, leg, cervical and lumbar spine. Intraclass correlation coefficient (ICC), standard error of measurement (SEM) and systematic bias were calculated.ResultsBoth intrarater reliability (ICC = 0.81–0.99) and interrater reliability (ICC = 0.92–0.95) were excellent and intrarater SEM ranged from 79 to 100 kPa. There was systematic bias detected at three sites with no single rater tending to consistently rate higher or lower than others across all sites.ConclusionThe excellent ICCs observed in this study support the utility of using multiple RAs in large cohort studies using standardised protocols, with the caveat that an absence of any confounding of study estimates by rater is checked, due to systematic rater bias identified in this study.ImplicationsThorough training of raters using PPT results in excellent interrater reliability. Clinical trials using PPT as an outcome measure should utilise a priori sample size calculations.


2016 ◽  
Vol 41 (1) ◽  
pp. 3-24 ◽  
Author(s):  
Li Cheng ◽  
Doris Y. P. Leung ◽  
Yu-Ning Wu ◽  
Janet W. H. Sit ◽  
Miao-Yan Yang ◽  
...  

This study examined the psychometric properties of the Chinese version of the Personal Diabetes Questionnaire (C-PDQ). The PDQ was translated into Chinese using a forward and backward translation approach. After being reviewed by an expert panel, the C-PDQ was administered to a convenience sample of 346 adults with Type 2 diabetes. The Chinese version of the Summary of Diabetes Self-Care Activities (C-SDSCA) was also administered. The results of the exploratory factor analysis revealed a one-factor structure for the Diet Knowledge, Decision-Making, and Eating Problems subscales and a two-factor structure for the barriers-related subscales. The criterion and convergent validity were supported by significant correlations of the subscales of the C-PDQ with the glycated hemoglobin values and the parallel subscales in the C-SDSCA, respectively. The C-PDQ subscales also showed acceptable internal consistency (α = .61–.89) and excellent test–retest reliability (intraclass correlation coefficients: .73–.96). The results provide preliminary support for the reliability and validity of the C-PDQ. This comprehensive, patient-centered instrument could be useful to identify the needs, concerns, and priorities of Chinese patients with type 2 diabetes.


2001 ◽  
Vol 81 (2) ◽  
pp. 799-809 ◽  
Author(s):  
Corrie J Odom ◽  
Andrea B Taylor ◽  
Christine E Hurd ◽  
Craig R Denegar

Abstract Background and Purpose. The Lateral Scapular Slide Test (LSST) is used to determine scapular position with the arm abducted 0, 45, and 90 degrees in the coronal plane. Assessment of scapular position is based on the derived difference measurement of bilateral scapular distances. The purpose of this study was to assess the reliability of measurements obtained using the LSST and whether they could be used to identify people with and without shoulder impairments. Subjects. Forty-six subjects ranging in age from 18 to 65 years (X̄=30.0, SD=11.1) participated in this study. One group consisted of 20 subjects being treated for shoulder impairments, and one group consisted of 26 subjects without shoulder impairments. Methods. Two measurements in each test position were obtained bilaterally. From the bilateral measurements, we derived the difference measurement. Intraclass correlation coefficients (ICC [1,1]) and the standard error of measurement (SEM) were calculated for intrarater and interrater reliability of the difference in side-to-side measures of scapular distance. Sensitivity and specificity of the LSST for classifying subjects with and without shoulder impairments were also determined. Results. The ICCs for intrarater reliability were .75, .77, and .80 and .52, .66, and .62, respectively, for subjects without and with shoulder impairments in 0, 45, and 90 degrees of abduction. The ICCs for interrater reliability were .67, .43, and .74 and .79, .45, and .57, respectively, for subjects without and with shoulder impairments in 0, 45 and 90 degrees of abduction. The SEMs ranged from 0.57 to 0.86 cm for intrarater reliability and from 0.79 to 1.20 cm for interrater reliability. Using the criterion of greater than 1.0 cm difference, sensitivity and specificity were 35% and 48%, 41% and 54%, and 43% and 56%, respectively, for 0, 45, and 90 degrees of abduction. Sensitivity and specificity based on the criterion of greater than 1.5 cm difference were 28% and 53%, 50% and 58%, and 34% and 52%, respectively, for the 3 scapular positions. Conclusion and Discussion. Our results suggest that measurements of scapular positioning based on the difference in side-to-side scapular distance measures are not reliable. Furthermore, the results suggest that sensitivity and specificity of the LSST measurements are poor and that the LSST should not be used to identify people with and without shoulder dysfunction.


2021 ◽  
pp. 1-23
Author(s):  
Kara Vasil ◽  
Jessica Lewis ◽  
Christin Ray ◽  
Jodi Baxter ◽  
Claire Bernstein ◽  
...  

Purpose The Cochlear Implant Skills Review (CISR) was developed as a measure of cochlear implant (CI) users' skills and knowledge regarding device use. This study aimed to determine intra- and interrater reliability and agreement and establish construct validity for the CISR. Method In this study, the CISR was developed and administered to a cohort of 30 adult CI users. Participants included new CI users with less than 1 year of CI experience and experienced CI users with greater than 1 year of CI experience. The CISR administration required participants to demonstrate skills using the various features of their CI processors. Intra- and interrater reliability were assessed using intraclass correlation coefficients, agreement was assessed using Cohen's kappa, and construct validity was assessed by relating CISR performance to duration of CI use. Results Overall reliability for the entire instrument was 92.7%. Inter- and intrarater agreement were generally substantial or higher. Duration of CI use was a significant predictor of CISR performance. Conclusions The CISR is a reliable and valid assessment measure of device skills and knowledge for adult CI users. Clinicians can use this tool to evaluate areas of needed instruction and counseling and to assess users' skills over time.


Sign in / Sign up

Export Citation Format

Share Document