scholarly journals Simple Assessment of Height and Length of Flight in Complex Gymnastic Skills: Validity and Reliability of a Two-Dimensional Video Analysis Method

2019 ◽  
Vol 9 (19) ◽  
pp. 3975 ◽  
Author(s):  
Christoph Schärer ◽  
Luca von Siebenthal ◽  
Ishbel Lomax ◽  
Micah Gross ◽  
Wolfgang Taube ◽  
...  
Keyword(s):  
Video Analysis ◽  
Interrater Reliability ◽  
Average Length ◽  
Low Cost ◽  
Peak Height ◽  
3D Analysis ◽  
Random Errors ◽  
Validity And Reliability ◽  
Intrarater Reliability ◽  
2D And 3D

In artistic gymnastics, the possibility of using 2D video analysis to measure the peak height (hpeak) and length of flight (L) during routine training in order to monitor the execution and development of difficult elements is intriguing. However, the validity and reliability of such measurements remain unclear. Therefore, in this study, the hpeak and L of 38 vaults, performed by top-level gymnasts, were assessed by 2D and 3D analysis in order to evaluate criterion validity and both intrarater and interrater reliability of the 2D method. Validity calculations showed higher accuracy for hpeak (±95% LoA: ±3.6% of average peak height) than for L (±95% LoA: ±7.6% of average length). Minor random errors, but no systematic errors, were observed in the examination of intrarater reliability (hpeak: CV% = 0.44%, p = 0.81; L: CV% = 0.87%, p = 0.14) and interrater reliability (hpeak: CV% = 0.51%, p = 0.55; L: CV% = 0.72%, p = 0.44). In conclusion, the validity and reliability of the 2D method are deemed sufficient (particularly for hpeak, but with some limitations for L) to justify its use in routine training of the vault. Due to its simplicity and low cost, this method could be an attractive monitoring tool for gymnastics coaches.

Determination of Ethnic Variation in Infant Nasolabial Anthropometry Using 3D Photographs: Implications for Bilateral Cleft Lip Nasal Correction

2021 ◽  
pp. 105566562110244
Author(s):  
Diana S. Jodeh ◽  
Jacqueline M. Ross ◽  
Maria Leszczynska ◽  
Fatima Qamar ◽  
Rachel L. Dawkins ◽  
...  
Keyword(s):  
African American ◽  
Interrater Reliability ◽  
Cleft Lip ◽  
Pearson Correlation ◽  
Statistical Significance ◽  
3D Analysis ◽  
Pediatric Clinic ◽  
Bilateral Cleft Lip ◽  
Post Hoc

Objective: We aimed to assess significant ethnic variabilities in infants’ nasolabial anthropometry to motivate variations in surgical correction of a synchronous bilateral cleft lip/nasal anomaly, specifically whether a long columella is a European feature, therefore accepting a short columella and/or delayed columellar lengthening suitable for reconstruction in ethnic patients. Methods: Thirty-three infants without craniofacial pathology (10 African American [AA], 7 Hispanic [H], and 16 of European descent [C]), ages 3 to 8 months, presenting to the Johns Hopkins All Children’s general pediatric clinic were recruited. Four separate 3D photographs (2 submental and frontal views each) were taken using the Vectra H1 handheld camera (Canfield Imaging). Eighteen linear facial distances were measured using Mirror 3D analysis (Canfield Imaging Systems). Difference between ethnicities was measured using analysis of variance with the Bonferroni/Dunn post hoc comparisons. Pearson correlation was employed for interrater reliability. All statistical analyses were carried out using SPSS version 21.0 (IBM Corp), with statistical significance set at P < .05. Results: Nasal projection (sn-prn) and columella length (sn-c) did not differ significantly between groups ( P = .9). Significant differences were seen between ethnic groups in nasal width (sbal-sbal [C-AA; P = .02]; ac-ac [C-AA; P = .00; H-AA; P = .04]; al-al [C-AA; P = .00; H-AA; P = .001]) and labial length (sn-ls [C-AA; P = .041]; sn-sto [C-AA; P = .005]; Cphs-Cphi L [C-AA; P = .013]; Cphs-Cphi R [C-AA; P = .015]). Interrater reliability was good to excellent and significantly correlated for all measures. Conclusions: African American infants exhibited wider noses and longer lips. No difference was noted in nasal projection or columella length, indicating that these structures should be corrected during the primary cleft lip and nasal repair for all patients and should not be deferred to secondary correction.

scholarly journals Reliability Assessment of Scores From Video-Recorded TGMD-3 Performances

2017 ◽  
Vol 5 (1) ◽  
pp. 59-68 ◽  
Author(s):  
Pauli Olavi Rintala ◽  
Arja Kaarina Sääkslahti ◽  
Susanna Iivonen
Keyword(s):  
Motor Development ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Intrarater Reliability ◽  
Gross Motor ◽  
Gross Motor Development ◽  
Percent Agreement ◽  
Two Samples ◽  
Ball Skills

This study examined the intrarater and interrater reliability of the Test of Gross Motor Development—3rd Edition (TGMD-3). Participants were 60 Finnish children aged between 3 and 9 years, divided into three separate samples of 20. Two samples of 20 were used to examine the intrarater reliability of two different assessors, and the third sample of 20 was used to establish interrater reliability. Children’s TGMD-3 performances were video-recorded and later assessed using an intraclass correlation coefficient, a kappa statistic, and a percent agreement calculation. The intrarater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.69 to 0.77, and percent agreement ranged from 87 to 91%. The interrater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.56 to 0.64. Percent agreement of 83% was observed for locomotor skills, ball skills, and total skills, respectively. Hop, horizontal jump, and two-hand strike assessments showed the most difference between the assessors. These results show acceptable reliability for the TGMD-3 to analyze children’s gross motor skills.

scholarly journals A standardized nomenclature for cervical spine soft-tissue release and osteotomy for deformity correction

2013 ◽  
Vol 19 (3) ◽  
pp. 269-278 ◽  
Author(s):  
Christopher P. Ames ◽  
Justin S. Smith ◽  
Justin K. Scheer ◽  
Christopher I. Shaffrey ◽  
Virginie Lafage ◽  
...  
Keyword(s):  
Cervical Spine ◽  
Soft Tissue ◽  
Interrater Reliability ◽  
Soft Tissue Release ◽  
Spine Deformity ◽  
Intrarater Reliability ◽  
Perfect Agreement ◽  
Moderate Agreement ◽  
Posterior Anterior ◽  
Anterior Posterior

Object Cervical spine osteotomies are powerful techniques to correct rigid cervical spine deformity. Many variations exist, however, and there is no current standardized system with which to describe and classify cervical osteotomies. This complicates the ability to compare outcomes across procedures and studies. The authors' objective was to establish a universal nomenclature for cervical spine osteotomies to provide a common language among spine surgeons. Methods A proposed nomenclature with 7 anatomical grades of increasing extent of bone/soft tissue resection and destabilization was designed. The highest grade of resection is termed the major osteotomy, and an approach modifier is used to denote the surgical approach(es), including anterior (A), posterior (P), anterior-posterior (AP), posterior-anterior (PA), anterior-posterior-anterior (APA), and posterior-anterior-posterior (PAP). For cases in which multiple grades of osteotomies were performed, the highest grade is termed the major osteotomy, and lower-grade osteotomies are termed minor osteotomies. The nomenclature was evaluated by 11 reviewers through 25 different radiographic clinical cases. The review was performed twice, separated by a minimum 1-week interval. Reliability was assessed using Fleiss kappa coefficients. Results The average intrarater reliability was classified as “almost perfect agreement” for the major osteotomy (0.89 [range 0.60–1.00]) and approach modifier (0.99 [0.95–1.00]); it was classified as “moderate agreement” for the minor osteotomy (0.73 [range 0.41–1.00]). The average interrater reliability for the 2 readings was the following: major osteotomy, 0.87 (“almost perfect agreement”); approach modifier, 0.99 (“almost perfect agreement”); and minor osteotomy, 0.55 (“moderate agreement”). Analysis of only major osteotomy plus approach modifier yielded a classification that was “almost perfect” with an average intrarater reliability of 0.90 (0.63–1.00) and an interrater reliability of 0.88 and 0.86 for the two reviews. Conclusions The proposed cervical spine osteotomy nomenclature provides the surgeon with a simple, standard description of the various cervical osteotomies. The reliability analysis demonstrated that this system is consistent and directly applicable. Future work will evaluate the relationship between this system and health-related quality of life metrics.

scholarly journals The validity and reliability of a novel mobile app to measure agility performance in the physically active youth population

2020 ◽  
Vol 45 ◽  
pp. 85-92
Author(s):  
Juan A. Escobar-Alvarez ◽  
Rocio Carrasco ◽  
Pedro R. Olivares ◽  
Sebastián Feu ◽  
Robinson Ramírez-Velez ◽  
...  
Keyword(s):  
Correlation Analysis ◽  
Confidence Interval ◽  
Standard Error ◽  
Low Cost ◽  
Intraclass Correlation ◽  
Mobile App ◽  
Validity And Reliability ◽  
Physically Active ◽  
Youth Population ◽  
Acceptable Reliability

Agility is a key component of physical fitness in adolescents. However, the measurement of this variable is usually complex, requiring high cost instruments and complex software. To test the validity and reliability of a novel iPhone app (Lap Tracker Auto-timer) to measure agility performance among adolescents. Twenty-four physically active adolescents (15.7 ± 2.3 years old) participated in two testing sessions (separated by 7 days). They performed three 4 x 10 m agility test trials measured by Photocell or the iPhone app. The correlation analysis revealed high validity (r = .92; 95% confidence interval [CI] = .88 – .95), with a standard error of the estimate of 0.56 s (p < 0.001). The coefficient of variation (CV; 0.09) and intraclass correlation coefficient (ICC; .93; 95% CI = .85 – .97) showed an acceptable reliability. This study demonstrated that the iPhone App Lap Tracker Auto-timer could be a valid, reliable and low-cost tool to evaluate agility performance in adolescents. However, more studies are required to guarantee the utility of this app.

scholarly journals Intrarater and interrater reliability of the pediatric arteriovenous malformation compactness score in children

2013 ◽  
Vol 11 (5) ◽  
pp. 547-551 ◽  
Author(s):  
Fabio A. Frisoli ◽  
Shih-Shan Lang ◽  
Arastoo Vossough ◽  
Anne Marie Cahill ◽  
Gregory G. Heuer ◽  
...  
Keyword(s):  
Arteriovenous Malformation ◽  
Recurrence Rate ◽  
Arteriovenous Malformations ◽  
Interrater Reliability ◽  
Intrarater Reliability ◽  
Cerebral Arteriovenous Malformations ◽  
Perfect Agreement ◽  
Interventional Radiologist ◽  
Κ Statistic

Object Cerebral arteriovenous malformations (AVMs) have a higher postresection recurrence rate in children than in adults. The authors' previous study demonstrated that a diffuse AVM (low compactness score) predicts postresection recurrence. The aims of this study were to evaluate the intra- and interrater reliability of the AVM compactness score. Methods Angiograms of 24 patients assigned a preoperative compactness score (scale of 1–3; 1 = most diffuse, 3 = most compact) in the authors' previous study were rerated by the same pediatric neuroradiologist 9 months later. A pediatric neurosurgeon, pediatric neuroradiology fellow, and interventional radiologist blinded to each other's ratings, the original ratings, and AVM recurrence also rated each AVM's compactness. Intrarater and interrater reliability were calculated using the κ statistic. Results Of the 24 AVMs, scores by the original neuroradiologist were 1 in 6 patients, 2 in 16 patients, and 3 in 2 patients. Intrarater reliability was 1.0. The κ statistic among the 4 raters was 0.69 (95% CI 0.44–0.89), which indicates substantial reliability. The interrater reliability between the neuroradiologist and neuroradiology fellow was moderate (κ = 0.59 [95%CI 0.20–0.89]) and was substantial between the neuroradiologist and neurosurgeon (κ = 0.74 [95% CI 0.41–1.0]). The neuroradiologist and interventional radiologist had perfect agreement (κ = 1.0). Conclusions Intrarater and interrater reliability of the AVM compactness score were excellent and substantial, respectively. These results demonstrate that the AVM compactness score is reproducible. However, the neuroradiologist and interventional radiologist had perfect agreement, which indicates that the compactness score is applied most accurately by those with extensive angiography experience.

Scoring Second Signed Language Assessment

2021 ◽  
pp. 315-328
Author(s):  
Tobias Haug ◽  
Eveline Boers-Visker ◽  
Wolfgang Mann ◽  
Geoffrey Poor ◽  
Beppie Van den Bogaerde
Keyword(s):  
Language Production ◽  
Interrater Reliability ◽  
Language Assessment ◽  
Rating System ◽  
Assessment Instruments ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Signed Language ◽  
Assessment Research

There exists a scarcity in signed language assessment research, especially on scoring issues and interrater reliability. This chapter describes two related assessment instruments, the SLPI and the NFA, which offer scoring criteria. Raters are provided with scales for evaluating the different components of the language production of the candidate. Through its use, the rating system has been proved successful; there is, however, hardly any data on interrater reliability. In this chapter, the authors describe reliability issues with attention to raters’ training and score resolution techniques and discuss how to identify and increase rater reliability. The dearth of knowledge on signed language assessment, and in particular its validity and reliability, indicates an urgent need for more research in this area.

scholarly journals Influence of Rater Training on Inter- and Intrarater Reliability When Using the Rat Grimace Scale

2019 ◽  
Vol 58 (2) ◽  
pp. 178-183 ◽  
Author(s):  
Emily Q Zhang ◽  
Vivian SY Leung ◽  
Daniel SJ Pang
Keyword(s):  
Acute Pain ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Training Group ◽  
Intrarater Reliability ◽  
Rater Training ◽  
Trainee Group ◽  
Pain Models ◽  
Ongoing Pain ◽  
And Performance

Rodent grimace scales facilitate assessment of ongoing pain. Reported rater training using these scales varies considerably and may contribute to the observed variability in interrater reliability. This study evaluated the effect of training on interrater reliability with the Rat Grimace Scale (RGS). Two training sets (42 and 150 images) were prepared from acute pain models. Four trainee raters progressed through 2 rounds of training, scoring 42 images (set 1) followed by 150 images (set 2a). After each round, trainees reviewed the RGS and any problematic images with an experienced rater. The 150 images were then rescored (set 2b). Four years later, trainees rescored the 150 images (set 2c). A second group of raters (no-training group) scored the same image sets without review with the experienced rater. Inter- and intrarater reliability were evaluated by using the intraclass correlation coefficient (ICC), and ICC values were compared by using the Feldt test. In the trainee group, interrater reliability increased from moderate to very good between sets 1 and 2b and increased between sets 2a and 2b. Action units with the highest and lowest ICC at set 2b were orbital tightening and whiskers, respectively. In comparison to an experienced rater, the ICC for all trainees improved, ranging from 0.88 to 0.91 at set 2b. Four years later, very good interrater reliability was retained, and intrarater reliability was good or very good). The interrater reliability of the no-training group was moderate and did not improve from set 1 to set 2b. Training improved interrater reliability, with an associated reduction in 95%CI. In addition, training improved interrater reliability with an experienced rater, and performance was retained.

Could Residents Adequately Assess the Severity of Hidradenitis Suppurativa? Interrater and Intrarater Reliability Assessment of Major Scoring Systems

Dermatology ◽  
2019 ◽  
Vol 236 (1) ◽  
pp. 8-14 ◽  
Author(s):  
Katarzyna Włodarek ◽  
Aleksandra Stefaniak ◽  
Łukasz Matusiak ◽  
Jacek C. Szepietowski
Keyword(s):  
Interrater Reliability ◽  
Hidradenitis Suppurativa ◽  
Intraclass Correlation ◽  
Scoring Systems ◽  
Staging System ◽  
Severity Index ◽  
Assessment Tools ◽  
Intrarater Reliability ◽  
Global Assessment Scale ◽  
Interrater Variability

A wide variety of assessment tools have been proposed for hidradenitis suppurativa (HS) until now, but none of them meets the criteria for an ideal score. Because there is no gold standard scoring system, the choice of the measure instrument depends on the purpose of use and even on the physician’s experience in the subject of HS. The aim of this study was to assess the intrarater and interrater reliability of 6 scoring systems commonly used for grading severity of HS: the Hurley Staging System, the Refined Hurley Staging, the Hidradenitis Suppurativa Severity Score System (IHS4), the Hidradenitis Suppurativa Severity Index (HSSI), the Sartorius Hidradenitis Suppurativa Score and the Hidradenitis Suppurativa Physician’s Global Assessment Scale (HS-PGA). On the scoring day, 9 HS patients underwent a physical examination and disease severity assessment by a group of 16 dermatology residents using all evaluated instruments. Then, intrarater reliability was calculated using intraclass correlation coefficient (ICC), and interrater variability was evaluated using the coefficient of variation (CV). In all 6 scorings the ICCs were >0.75, indicating high intrarater reliability of all presented scales. The study has also demonstrated moderate agreement between raters in most of the evaluated measure instruments. The most reproducible methods, according to CVs, seem to be the Hurley staging, IHS4, and HSSI. None of the 6 evaluated scoring systems showed a significant advantage over the other when comparing ICCs, and all the instruments seem to be very reliable methods. The interrater reliability was usually good, but the most repeatable results between researchers were obtained for the easiest scales, including Hurley scoring, IHS4 and HSSI.

Self-Managed Surveillance for Breast Cancer–Related Upper Body Issues: A Feasibility and Reliability Study

2020 ◽  
Vol 100 (3) ◽  
pp. 468-476 ◽  
Author(s):  
Bolette S Rafn ◽  
Chiara A Singh ◽  
Julie Midtgaard ◽  
Pat G Camp ◽  
Margaret L McNeely ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Interrater Reliability ◽  
Physical Therapist ◽  
Retention Rates ◽  
Upper Body ◽  
Intrarater Reliability ◽  
Prospective Surveillance ◽  
Reliability Study ◽  
Shoulder Flexion ◽  
Arm Circumference

Abstract Background Early identification of breast cancer–related upper body issues is important to enable timely physical therapist treatment. Objective This study evaluated the feasibility and reliability of women performing self-managed prospective surveillance for upper body issues in the early postoperative phase as part of a hospital-based physical therapy program. Design This was a prospective, single-site, single-group feasibility and reliability study. Methods Presurgery arm circumference measurements were completed at home and at the hospital by participants and by a physical therapist. Instruction in self-measurement was provided using a video guide. After surgery, all circumference measurements were repeated along with self-assessment and therapist assessment for shoulder flexion and abduction active range of motion. Feasibility was determined by recruitment/retention rates and participant-reported ease of performing self-measurements (1 [very difficult] to 10 [very easy]). Reliability was determined as intrarater reliability, interrater reliability, and agreement. Results Thirty-three women who were 53.4 (SD = 11.4) years old participated, with recruitment and retention rates of 79% and 94%, respectively. Participant-reported ease of measurement was 8.2 (SD = 2.2) before surgery and 8.0 (SD = 1.9) after surgery. The intrarater reliability and interrater reliability were excellent before surgery (intraclass correlation coefficient [ICC] ≥ 0.94; 95% confidence interval = 0.87–0.97) and after surgery (ICC ≥ 0.91; 95% confidence interval = 0.76–0.96). Agreement between self-assessed and therapist-assessed active shoulder flexion (κ = 0.79) and abduction (κ = 0.71) was good. Limitations Further testing is needed using a prospective design with a longer follow-up to determine whether self-managed prospective surveillance and timely treatment can hinder the development of chronic breast cancer–related upper body issues Conclusions Self-measured arm circumference and shoulder range of motion are reliable, and their inclusion in a hospital-based program of prospective surveillance for upper body issues seems feasible. This approach may improve early detection and treatment

Sign in / Sign up

Export Citation Format

Share Document