Reliability of 5 Novel Reaction Time and Cognitive Load Protocols

2018 ◽  
Vol 27 (5) ◽  
Author(s):  
Kelsey Picha ◽  
Carolina Quintana ◽  
Amanda Glueck ◽  
Matt Hoch ◽  
Nicholas R. Heebner ◽  
...  
Keyword(s):  
Reaction Time ◽  
Cognitive Load ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Repeated Measures ◽  
Sports Medicine ◽  
Intraclass Correlation ◽  
Minimal Detectable Change ◽  
Good Reliability ◽  
Medicine Research

Context: Reaction time (RT) is crucial to athletic performance. Therefore, when returning athletes to play following injury, it is important to evaluate RT characteristics ensuring a safe return. The Dynavision D2® system may be utilized as an assessment and rehabilitation aid in the determination of RT under various levels of cognitive load. Previous research has demonstrated good reliability of simple protocols when assessed following a 24- to 48-hour test–retest window. Expanding reliable test–retest intervals may further refine novel RT protocols for use as a diagnostic and rehabilitation tool. Objective: To investigate the test–retest reliability of a battery of 5 novel RT protocols at different time intervals. Design: Repeated measures/reliability. Setting: Interdisciplinary sports medicine research laboratory. Participants: Thirty healthy individuals. Methods: Participants completed a battery of protocols increasing in difficulty in terms of reaction speed requirement and cognitive load. Prior to testing, participants were provided 3 familiarization trials. All protocols required participants to hit as many lights as quickly as possible in 60 seconds. After completing the initial testing session (session 1), participants waited 1 hour before completing the second session (session 2). Approximately 2 weeks later (average 14 [4] d), the participants completed the same battery of tasks for the third session (session 3). Main Outcome Measures: The intraclass correlation coefficient, standard error of measurement, minimal detectable change, and repeated-measures analysis of variance were calculated for RT. Results: The intraclass correlation coefficient values for each of the 5 protocols illustrated good to excellent reliability between sessions 1, 2, and 3 (.75–.90). There were no significant differences across time points (F < 0.105, P > .05). Conclusions: The 1-hour and 14-day test–retest intervals are reliable for clinical assessment, expanding the time frames previously reported in the literature of when assessments can be completed reliably. This study provides novel protocols that challenge cognition in unique ways.

scholarly journals Tibial Accelerations During the Single-Leg Hop Test: Influence of Fixation

2020 ◽  
pp. 1-4
Author(s):  
Hannah W. Tucker ◽  
Emily R. Tobin ◽  
Matthew F. Moran
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Repeated Measures ◽  
Inertial Measurement Unit ◽  
Intraclass Correlation ◽  
Return To Sport ◽  
Fixation Method ◽  
Measurement Unit ◽  
Inertial Measurement ◽  
Hop Test

Context: Performance on single-leg hopping (SLH) assessments is commonly included within return-to-sport criteria for rehabilitating athletes. Triaxial accelerometers have been used to quantify impact loading in a variety of movements, including hopping; however, they have never been attached to the tibia during SLH, and their method of fixation has not been investigated. Objective: The purpose of this study was to quantify triaxial accelerations and evaluate the influence of the fixation method of a lightweight inertial measurement unit (Blue Trident) mounted to the tibia during SLH performance. Design: Single cohort, repeated-measures experimental design. Participants: Sixteen healthy participants (10 females and 6 males; 20 [0.9] y; 1.67 [0.08] m; 66.0 [8.5] kg) met the inclusion criteria, volunteered, and completed this study. Interventions: Participants performed 2 sets of 3 SLH trials with an inertial measurement unit (1500 Hz) fixated to the tibia, each set with 1 of 2 attachment methods (double-sided tape [DST] with athletic tape and silicon strap [SS] with Velcro adhesion). Main Outcome Measures: Hop distance, peak tibial acceleration (PTA), time to PTA, and the acceleration slope were assessed during each hop landing. Results: Repeated-measures analysis of variance determined no significant effect of the attachment method on hop metrics (P = .252). Across 3 trials, both fixation methods (DST and SS) had excellent reliability values (intraclass correlation coefficient: .868–.941) for PTA and acceleration slope but not for time to PTA (intraclass correlation coefficient: .397–.768). The PTA for DST (27.22 [7.94] g) and SS (26.21 [10.48] g) was comparable and had a moderate, positive relationship (DST: r = .72, P < .01; SS: r = .77, P < .01) to SLH distance. Conclusions: Tibial inertial measurement units with triaxial accelerometers can reliably assess PTA during performance of the SLH, and SS is a viable alternative tibial attachment to DST.

scholarly journals Intra-rater reliability of transversus abdominis measurement by a novice examiner: Comparison of “freehand” to “probe force device” method of real-time ultrasound imaging

Ultrasound ◽  
2019 ◽  
Vol 27 (3) ◽  
pp. 156-166 ◽  
Author(s):  
Vanessa L Kennedy ◽  
Carol A Flavell ◽  
Kenji Doma
Keyword(s):  
Measurement Error ◽  
Real Time ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Coefficient Of Variation ◽  
Repeated Measures ◽  
Intraclass Correlation ◽  
Transversus Abdominis ◽  
Rater Reliability ◽  
Transverse Abdominis

A “free hand” real-time-ultrasound method is commonly applied to measure transversus abdominis. Potentially, this increases transversus abdominis measurement error due to uncontrolled variability in probe to skin force, inclination, and roll, particularly for novice examiners. This single-group repeated-measures reliability study compared the intra-rater reliability of transversus abdominis thickness and activation measurement by a novice examiner between free hand and a standardized probe force device method. The examiner captured ultrasound videos of transversus abdominis in a single session in healthy participants ( n =  33). Free hand ultrasound featured uncontrolled probe force, inclination, and roll, while probe force device method ultrasound standardized these parameters. Images of transversus abdominis at rest and contracted were measured and transversus abdominis activation calculated. Intraclass correlation coefficient, coefficient of variation, standard error of measurement, and worthwhile differences were calculated. The probe force device method resulted in greater reliability (intraclass correlation coefficient = 0.75–0.96) and lower measurement error (coefficient of variation = 8.89–28.7%) compared to free hand (intraclass correlation coefficient = 0.63–0.93; coefficient of variation = 6.52–29.4%). Reliability was good for all measurements except free hand TrA-C, which was moderate. TrA-C had the lowest reliability, followed by contracted thickness of the transverse abdominis, with resting thickness of the transverse abdominis being highest. Worthwhile differences were lower using a probe force device method versus free hand for resting thickness of the transverse abdominis and contracted thickness of the transverse abdominis and similar for TrA-C. Standardization using probe force device method ultrasound to measure transversus abdominis improved intra-rater reliability in a novice examiner. Use of a probe force device method is recommended to improve reliability through reduced sources of measurement error. Probe force device method intra- and inter-rater reliability in examiners of varying experience, in clinical populations, and to visualize other structures merits exploration.

scholarly journals The Reliability of an Upper- and Lower-Extremity Visuomotor Reaction Time Task

2020 ◽  
pp. 1-4
Author(s):  
Caitlin Brinkman ◽  
Shelby E. Baez ◽  
Carolina Quintana ◽  
Morgan L. Andrews ◽  
Nick R. Heebner ◽  
...  
Keyword(s):  
Reaction Time ◽  
Lower Extremity ◽  
Injury Risk ◽  
Random Sequence ◽  
Intraclass Correlation ◽  
Sports Participation ◽  
Future Research ◽  
Minimal Detectable Change ◽  
Good Reliability ◽  
Left Limb

Context: Fast visuomotor reaction time (VMRT), the time required to recognize and respond to sequentially appearing visual stimuli, allows an athlete to successfully respond to stimuli during sports participation, while slower VMRT has been associated with increased injury risk. Light-based systems are capable of measuring both upper- and lower-extremity VMRT; however, the reliability of these assessments are not known. Objective: To determine the reliability of an upper- and lower-extremity VMRT task using a light-based trainer system. Design: Reliability study. Setting: Laboratory. Patients (or Other Participants): Twenty participants with no history of injury in the last 12 months. Methods: Participants reported to the laboratory on 2 separate testing sessions separated by 1 week. For both tasks, participants were instructed to extinguish a random sequence of illuminated light-emitting diode disks, which appeared one at a time as quickly as possible. Participants were provided a series of practice trials before completing the test trials. VMRT was calculated as the time in seconds between target hits, where higher VMRT represented slower reaction time. Main Outcome Measures: Separate intraclass correlation coefficients (ICCs) with corresponding 95% confidence intervals (CIs) were calculated to determine test–retest reliability for each task. The SEM and minimal detectable change values were determined to examine clinical applicability. Results: The right limb lower-extremity reliability was excellent (ICC2,1 = .92; 95% CI, .81–.97). Both the left limb (ICC2,1 = .80; 95% CI, .56–.92) and upper-extremity task (ICC2,1 = .86; 95% CI, .65–.95) had good reliability. Conclusions: Both VMRT tasks had clinically acceptable reliability in a healthy, active population. Future research should explore further applications of these tests as an outcome measure following rehabilitation for health conditions with known VMRT deficits.

The Reliability of the Manual Supination Resistance Test

2003 ◽  
Vol 93 (3) ◽  
pp. 185-189 ◽  
Author(s):  
Hazel Noakes ◽  
Craig Payne
Keyword(s):  
Clinical Outcomes ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Resistance Test ◽  
Foot Orthoses ◽  
Good Reliability ◽  
Intraclass Correlation Coefficients ◽  
Foot Pronation

Several decisions need to be made when prescribing foot orthoses for abnormal foot pronation. One of these decisions is how much force is needed from orthoses to supinate the foot. The supination resistance test has been described as one technique to help determine the amount of force needed. The aim of this project was to determine the reliability of the manual supination resistance test. Four clinicians of differing levels of experience performed the test on 44 subjects (88 feet) on 2 separate days. The test had good reliability overall, with an intertester intraclass correlation coefficient of 0.89. For the two more experienced clinicians, the intratester intraclass correlation coefficients were good (0.82 and 0.78), but for the two inexperienced clinicians they were poor (0.56 and 0.62). The supination resistance test may be clinically useful in the prescription of foot orthoses, but more work is needed to determine its validity and its relationship to clinical outcomes. (J Am Podiatr Med Assoc 93(3): 185-189, 2003)

Repeatability and reproducibility of corneal biomechanical parameters derived from Corvis ST

2019 ◽  
Vol 30 (6) ◽  
pp. 1287-1294
Author(s):  
Nermin Serbecic ◽  
Sven Beutelspacher ◽  
Lovro Markovic ◽  
Abhijit Sina Roy ◽  
Rohit Shetty
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Coefficient Of Variation ◽  
Intraclass Correlation ◽  
Diurnal Changes ◽  
Good Reliability ◽  
Good Repeatability ◽  
Repeatability And Reproducibility ◽  
Biomechanical Parameters ◽  
High Intraclass Correlation Coefficient

Introduction: The aim of this study was to evaluate repeatability and reproducibility of newly calculated biomechanical parameters of the cornea, developed by our research group. Methods: One eye from each of the 23 healthy subjects was measured three times consecutively, three times at different daytimes and on three different days. The within-subject standard deviation and coefficient of variation, as well as the intraclass correlation coefficient, were calculated for every parameter in each group. Results: Excellent repeatability and reproducibility (coefficient of variation < 5%, intraclass correlation coefficient > 0.75) was found for corrected values measured at A1, HC, and A2 time points (2nd A2 Time, 2nd A1 Time, 2nd HC Time, 2nd HC Def Amp and 2nd A1 Def Amp). Corneal-specific stiffness parameters, which showed good repeatability and reliability, were DA_cor (coefficient of variation = 4.02%, intraclass correlation coefficient = 0.919), KcLinear (coefficient of variation = 4.03%, intraclass correlation coefficient = 0.895), areaForceCornea (coefficient of variation = 3.34%, intraclass correlation coefficient = 0.853) and E2 (coefficient of variation = 4.1%, intraclass correlation coefficient = 0.78). Overall, most parameters fell into the category of good reliability (high intraclass correlation coefficient) and poor reproducibility (low coefficient of variation), including all the parameters describing extraocular deformation (DA_ext, AEPvED, AUC EDef, areaForceExtra, Kg and μg). Comparing the coefficient of variation values for intrasession, intersession and daytime measurements, there were no indices for diurnal changes. Conclusion: Most parameters showed good repeatability and reliability. The extraocular stiffness parameters showed poor reproducibility. KcLinear can serve as a very reliable and repeatable indicator of corneal stiffness.

scholarly journals Reliability and Validity of the Belt-Stabilized Handheld Dynamometer in Hip- and Knee-Strength Tests

2017 ◽  
Vol 52 (9) ◽  
pp. 809-819 ◽  
Author(s):  
Jaqueline Martins ◽  
Janaina Rodrigues da Silva ◽  
Marcelo Rodrigues Barbosa da Silva; ◽  
Débora Bevilaqua-Grossi
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Isokinetic Dynamometer ◽  
Hip Muscle ◽  
Bland Altman Method ◽  
Muscle Groups

Context:  The belt-stabilized handheld dynamometer (HHD) has been used to assess the strength of knee- and hip-muscle groups. However, few researchers have examined its reliability and validity for assessing the strength of these muscles. Objective:  To evaluate the intra-examiner reliability of the belt-stabilized HHD and its validity and agreement with the isokinetic dynamometer for assessing the strength of knee- and hip-muscle groups. Design:  Cross-sectional study. Setting:  University laboratory. Patients or Other Participants:  We evaluated 26 healthy participants (13 men, 13 women; age = 23.5 ± 2.8 years, height = 1.7 ± 0.1 m, mass = 68.6 ± 12.4 kg) in 2 sessions using the belt-stabilized HHD and an isokinetic dynamometer for maximum strength of the hip adductors, abductors, flexors, extensors, internal rotators, and external rotators and the knee flexors and extensors. Main Outcome Measure(s):  We used reliability values provided by the intraclass correlation coefficient (2,3), standard error of measurement (SEM and percentage SEM), and minimal detectable change; correlation values comparing the belt-stabilized HHD and the isokinetic instrument using the Pearson correlation coefficient (r); and the mean difference in values comparing the 2 instruments using the Bland-Altman method. Results:  The intrarater HHD reliability was excellent for most measurements (range = 0.80–0.96; SEM = 1.3–5.3 kilograms of force or 4.8−18.9 Nm, percentage SEM = 7.0%–22.0%, minimal detectable change = 3.6–18.8 kilograms of force or 13.2−52.4 Nm) and was moderate only for bilateral knee flexion and left hip internal rotation (intraclass correlation coefficient [2,3] = 0.62–0.66 and 0.70, respectively). Correlation with the isokinetic dynamometer was moderate to high (r = 0.60–0.90), but the absolute values did not demonstrate concordance between results using the Bland-Altman method. Conclusions:  The belt-stabilized HHD measurements were reliable, and although they did not agree with those from the isokinetic dynamometer, the values were correlated for the hip- and knee-muscle groups.

scholarly journals Diagnostic Yield of Transabdominal Ultrasonography for Evaluation of Pancreatic Cystic Lesions Compared with Endoscopic Ultrasonography

2021 ◽  
Vol 10 (19) ◽  
pp. 4616
Author(s):  
Yu Ji Li ◽  
Gil Ho Lee ◽  
Min Jae Yang ◽  
Jae Chul Hwang ◽  
Byung Moo Yoo ◽  
...  
Keyword(s):  
Pancreatic Duct ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Endoscopic Ultrasonography ◽  
Diagnostic Yield ◽  
Intraclass Correlation ◽  
Cystic Lesions ◽  
Good Reliability ◽  
Detection Rates ◽  
Cystic Wall

Detection rates of pancreatic cystic lesions (PCLs) have increased, resulting in greater requirements for regular monitoring using imaging modalities. We aimed to evaluate the capability of ultrasonography (US) for morphological characterization of PCLs as a reference standard using endoscopic ultrasonography (EUS). A retrospective analysis was conducted of 102 PCLs from 92 patients who underwent US immediately prior to EUS between January 2014 and May 2017. The intermodality reliability and agreement of the PCL morphologic findings of the two techniques were analyzed and compared using the intraclass correlation coefficient and κ values. The success rates of US for delineating PCLs in the head, body, and tail of the pancreas were 77.8%, 91.8%, and 70.6%, respectively. The intraclass correlation coefficient for US and the corresponding EUS lesion size showed very good reliability (0.978; p < 0.001). The κ value between modalities was 0.882 for pancreatic duct dilation, indicating good agreement. The κ values for solid components and cystic wall and septal thickening were 0.481 and 0.395, respectively, indicating moderate agreement. US may be useful for monitoring PCL growth and changes in pancreatic duct dilation, but it has limited use in the diagnosis and surveillance of mural nodules or cystic wall thickness changes.

Parallel Comparison of Grip Strength Measures Obtained with a Microfet 4 and a Jamar Dynamometer

2005 ◽  
Vol 100 (3) ◽  
pp. 795-798 ◽  
Author(s):  
Richard W. Bohannon
Keyword(s):  
Grip Strength ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Repeated Measures ◽  
Intraclass Correlation ◽  
Highly Correlated ◽  
Jamar Dynamometer

Repeated measures of grip strength obtained bilaterally with a Jamar and a MicroFET 4 dynamometer were compared. Measurements obtained with the MicroFET 4 tended to be slightly (2.2–3.1 lb.) higher but were highly correlated ( r ≥ .96) with those obtained with the Jamar. Parallel reliability for the two devices was excellent (intraclass correlation coefficient ≥ .96). Although clinicians should be cautious about using the devices interchangeably, the MicroFET 4 appears to be a legitimate alternative to the Jamar dynamometer.

scholarly journals Reliability and Validity of the Measurement of Scapular Position Using the Protractor Method

2016 ◽  
Vol 96 (4) ◽  
pp. 502-510 ◽  
Author(s):  
Aidan O'Shea ◽  
Rory Kelly ◽  
Sian Williams ◽  
Leanda McKenna
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Standard Error ◽  
Assessment Tool ◽  
Spinous Process ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Minimal Detectable Change ◽  
Detectable Change ◽  
Inferior Angle

Background The protractor method is a proposed clinical assessment tool, the first to measure vertical scapular position, that directly compares scapular and spinal landmarks. This tool has the potential to reliably and accurately measure excessive scapular elevation or depression. Objective The purpose of this study was to determine reliability and validity of the protractor method to measure resting scapular position. Design An interrater and intratester reliability and validity study was conducted. Methods Testing was conducted on the same day by 2 physical therapists who were blinded to each other's results. The vertical distances between the spinous process of C7 and the superior margin of the medial aspect of the spine of the scapula (C7 method) and the spinous process of T8 and the inferior angle of the scapula (T8 method) were palpated and measured on the symptomatic shoulder in 34 people with current shoulder pain using the protractor method. Measurements were compared with 2-dimensional camera analysis to assess validity. Results For intertester reliability, the standard error of measure, minimal detectable change, and intraclass correlation coefficient were 6.3 mm, 17.3 mm, and .78, respectively, for the C7 method and 5.7 mm, 15.7 mm, and .82, respectively, for the T8 method. For intratester reliability, the standard error of measure, minimal detectable change, and intraclass correlation coefficient were &lt;0.9 mm, &lt;2.5 mm, and .99, respectively. For validity, significant correlations (r) and mean differences were .83 and 10.1 mm, respectively, for the C7 method and .92 and 2.2 mm, respectively, for the T8 method. Limitation The results of this study are limited to static measurement of the scapula in one plane. Conclusion Both protractor methods were shown to have good reliability and acceptable validity, with the T8 method demonstrating superior clinical utility. The clinical use of the T8 method is recommended for measurement of excessive resting scapular elevation or depression.

Sign in / Sign up

Export Citation Format

Share Document