Assessing agreement with intraclass correlation coefficient and concordance correlation coefficient for data with repeated measures

2013 ◽  
Vol 60 ◽  
pp. 132-145 ◽  
Author(s):  
Chia-Cheng Chen ◽  
Huiman X. Barnhart
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Repeated Measures ◽  
Intraclass Correlation ◽  
Concordance Correlation Coefficient ◽  
Concordance Correlation

scholarly journals AB0798 IS THERE A REPRODUCIBILITY OF THE HISTOGRAM AND GRAY SCALE IN ECOEXTRUCTURAL DAMAGES IN RHEUMATOTOLOGICAL DISEASES?

2021 ◽  
Vol 80 (Suppl 1) ◽  
pp. 1423.2-1424
Author(s):  
J. A. Mendonça ◽  
I. Siste de Almeida Aoki ◽  
C. C. Cavuto ◽  
V. A. Leandro-Merhi ◽  
J. L. B. D. Aquino
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Rheumatic Diseases ◽  
Femoral Condyle ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Concordance Correlation Coefficient ◽  
Image Method ◽  
Concordance Correlation ◽  
Gray Scale

Background:The gray scale (GS) in high resolution ultrasound is already well validated for use in rheumatological diseases, but the color map or the histogram, can be considered a new proposal, to better define and complement the echotextural damages detection1.Objectives:To calculate the lesions area measures reproducibility index in arthropathies, between 3 blind evaluators and correlate these measures using the GS and the histogram.Methods:Observational and retrospective study approved by the ethics committee of the Pontifical Catholic University of Campinas, with the opinion number: 1.526.307. A total of 29 patients have been assessed (31% males and 69% females) on period 2014 to 2019 in Rheumatology service. A MyLab 50 -Esaote equipment was used with frequency transducer that ranged between 6.0 and 18.0 MHz, 10 different area measures were performed from each recorded images previously, by the GS and the histogram. Statistical analysis: Spearman’s correlation coefficients, Lin’s concordance coefficient (CCC) and the intraclass correlation coefficient (ICC) and their respective 95% confidence intervals, with the SPSS software package for Windows v. 17.0 (SPSS Inc., Chicago, IL, USA).Results:Average age 43.5 ± 21.5 years of age; with disease duration that varied between ≤ 1 month (48.3%) and ≥36 months (24.1%); with the following diseases: juvenile idiopathic arthritis (17.24%); osteoarthritis (13.79%); psoriatic arthritis (13.79%); undifferentiated spondyloarthritis (3.44%); gout (20.68%); rheumatoid arthritis (27.58%) and reactive arthritis (3.44%). A total of 840 measures of exudative (27.58%), proliferative (27.58%) and snowstorm appearance (6.89%) synovitis were performed; femoral-condyle cartilage (3.44%); synovial cyst (3.44%); paratendinitis (6.89%); calcification (3.44%); nail enthesitis (3.44%); tenosynovitis (6.89%) and tophi (10.34%) (Figure 1). The concordance correlation coefficient showed values closer to 1; p <0.001, the intraclass correlation coefficients with excellent reproducibility (ICC ≥ 0.75); p <0.001, always in relation to the three evaluators (Table 1) and the Spearman correlation between the GS and the histogram ranged from rs = 0.665 to rs = 1,000; p <0.001.Conclusion:The histogram can be considered an image method to better identify echotextural damages.References:[1]Mendonça J, Provenza J, Guissa V, et al AB1059 2D Histogram Ultrasound and 3D Ultrasound Correlation in Rheumatic Diseases Annals of the Rheumatic Diseases 2015; 74:1253-1254.Table 1.Concordance Correlation Coefficient (CCC) and Intraclass Correlation Coefficient (ICC):EvaluatorsGS - CCC(IC 95%)p-valorHistogram (IC 95%)p-valor1 e 20,998(0,994-0,999)<0,0010,999(0,995-1,000)<0,0011 e 30,998(0,995-0,999)<0,0010,999(0,995-1,000)<0,0012 e 30,992(0,980-0,997)<0,010,996(0,979-0,999)<0,01Standard by US 2DICCp-valorGS0,997(0,992-0,999)<0,001Histogram0,998(0,992-0,999)<0,001Legends: Gray Scale (GS).Figure 1.Patient with gout: A and B: Tophi area measures (star) in right metatarsos and efusion (arrow) by GS (45 mm2) and histogram (39 mm2), respectively.Disclosure of Interests:José Alexandre Mendonça Speakers bureau: Novartis, Janssen, Bristol, UCB, Isabella Siste de Almeida Aoki: None declared, Caique Chagas Cavuto: None declared, Vânia Aparecida Leandro-Merhi: None declared, José Luis Braga de Aquino: None declared

scholarly journals Combining F-Scan and GAITRite® for use in Clinical Gait Analysis: A Validation Study.

2020 ◽  
Author(s):  
Stephanie Speight ◽  
Selina Reidy ◽  
John Stephenson ◽  
Sarah Reel
Keyword(s):  
Gait Analysis ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Cost Effective ◽  
Quality Data ◽  
Concordance Correlation Coefficient ◽  
Concordance Correlation ◽  
Mean Values ◽  
Level Of Agreement

Abstract BackgroundClinical gait analysis is widely used to aid the assessment and diagnosis of symptomatic pathologies. Equipment based analysis provides clinicians with a more comprehensive assessment using pressure systems such as F-scan, or analysis of the spatial-temporal parameters of gait using GAITRite. There are systems however such as Strideway™ that can measure these parameters simultaneously, but can be expensive. This study aimed to determine whether standalone systems can be used collectively while still providing quality data, as a cost-effective alternative.MethodsTwenty-six participants walked on a standard floor and a GAITRite walkway, three times wearing the F-Scan system. Mid gait protocols were utilised by analysing the contact pressure of the 2 nd metatarsophalangeal joint of the third, fifth and seventh step from each walk. The Bland-Altman method was used to determine a level of agreement between the two surfaces, using mean values from all walks of all participants who successfully completed all required walks. The intraclass correlation coefficient and Lin’s concordance correlation coefficient were calculated as indices of reliability.ResultsThe intraclass correlation coefficient was calculated to be 0.991 and Lin’s concordance correlation coefficient for the data was calculated to be 0.956, indicating very good reproducibility.ConclusionsThe level of agreement in plantar pressures observed on the two surfaces was very high, suggesting that it is feasible to use F-Scan and GAITRite® together in a clinical setting, as an alternative to other less cost-effective standalone systems.

A repeated measures concordance correlation coefficient

2007 ◽  
Vol 26 (16) ◽  
pp. 3095-3113 ◽  
Author(s):  
Tonya S. King ◽  
Vernon M. Chinchilli ◽  
Josep L. Carrasco
Keyword(s):  
Correlation Coefficient ◽  
Repeated Measures ◽  
Concordance Correlation Coefficient ◽  
Concordance Correlation

scholarly journals Tibial Accelerations During the Single-Leg Hop Test: Influence of Fixation

2020 ◽  
pp. 1-4
Author(s):  
Hannah W. Tucker ◽  
Emily R. Tobin ◽  
Matthew F. Moran
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Repeated Measures ◽  
Inertial Measurement Unit ◽  
Intraclass Correlation ◽  
Return To Sport ◽  
Fixation Method ◽  
Measurement Unit ◽  
Inertial Measurement ◽  
Hop Test

Context: Performance on single-leg hopping (SLH) assessments is commonly included within return-to-sport criteria for rehabilitating athletes. Triaxial accelerometers have been used to quantify impact loading in a variety of movements, including hopping; however, they have never been attached to the tibia during SLH, and their method of fixation has not been investigated. Objective: The purpose of this study was to quantify triaxial accelerations and evaluate the influence of the fixation method of a lightweight inertial measurement unit (Blue Trident) mounted to the tibia during SLH performance. Design: Single cohort, repeated-measures experimental design. Participants: Sixteen healthy participants (10 females and 6 males; 20 [0.9] y; 1.67 [0.08] m; 66.0 [8.5] kg) met the inclusion criteria, volunteered, and completed this study. Interventions: Participants performed 2 sets of 3 SLH trials with an inertial measurement unit (1500 Hz) fixated to the tibia, each set with 1 of 2 attachment methods (double-sided tape [DST] with athletic tape and silicon strap [SS] with Velcro adhesion). Main Outcome Measures: Hop distance, peak tibial acceleration (PTA), time to PTA, and the acceleration slope were assessed during each hop landing. Results: Repeated-measures analysis of variance determined no significant effect of the attachment method on hop metrics (P = .252). Across 3 trials, both fixation methods (DST and SS) had excellent reliability values (intraclass correlation coefficient: .868–.941) for PTA and acceleration slope but not for time to PTA (intraclass correlation coefficient: .397–.768). The PTA for DST (27.22 [7.94] g) and SS (26.21 [10.48] g) was comparable and had a moderate, positive relationship (DST: r = .72, P < .01; SS: r = .77, P < .01) to SLH distance. Conclusions: Tibial inertial measurement units with triaxial accelerometers can reliably assess PTA during performance of the SLH, and SS is a viable alternative tibial attachment to DST.

scholarly journals Intra-rater reliability of transversus abdominis measurement by a novice examiner: Comparison of “freehand” to “probe force device” method of real-time ultrasound imaging

Ultrasound ◽  
2019 ◽  
Vol 27 (3) ◽  
pp. 156-166 ◽  
Author(s):  
Vanessa L Kennedy ◽  
Carol A Flavell ◽  
Kenji Doma
Keyword(s):  
Measurement Error ◽  
Real Time ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Coefficient Of Variation ◽  
Repeated Measures ◽  
Intraclass Correlation ◽  
Transversus Abdominis ◽  
Rater Reliability ◽  
Transverse Abdominis

A “free hand” real-time-ultrasound method is commonly applied to measure transversus abdominis. Potentially, this increases transversus abdominis measurement error due to uncontrolled variability in probe to skin force, inclination, and roll, particularly for novice examiners. This single-group repeated-measures reliability study compared the intra-rater reliability of transversus abdominis thickness and activation measurement by a novice examiner between free hand and a standardized probe force device method. The examiner captured ultrasound videos of transversus abdominis in a single session in healthy participants ( n =  33). Free hand ultrasound featured uncontrolled probe force, inclination, and roll, while probe force device method ultrasound standardized these parameters. Images of transversus abdominis at rest and contracted were measured and transversus abdominis activation calculated. Intraclass correlation coefficient, coefficient of variation, standard error of measurement, and worthwhile differences were calculated. The probe force device method resulted in greater reliability (intraclass correlation coefficient = 0.75–0.96) and lower measurement error (coefficient of variation = 8.89–28.7%) compared to free hand (intraclass correlation coefficient = 0.63–0.93; coefficient of variation = 6.52–29.4%). Reliability was good for all measurements except free hand TrA-C, which was moderate. TrA-C had the lowest reliability, followed by contracted thickness of the transverse abdominis, with resting thickness of the transverse abdominis being highest. Worthwhile differences were lower using a probe force device method versus free hand for resting thickness of the transverse abdominis and contracted thickness of the transverse abdominis and similar for TrA-C. Standardization using probe force device method ultrasound to measure transversus abdominis improved intra-rater reliability in a novice examiner. Use of a probe force device method is recommended to improve reliability through reduced sources of measurement error. Probe force device method intra- and inter-rater reliability in examiners of varying experience, in clinical populations, and to visualize other structures merits exploration.

Matrix-based Concordance Correlation Coefficient for Repeated Measures

Biometrics ◽  
2011 ◽  
Vol 67 (3) ◽  
pp. 1007-1016 ◽  
Author(s):  
Sasiprapa Hiriote ◽  
Vernon M. Chinchilli
Keyword(s):  
Correlation Coefficient ◽  
Repeated Measures ◽  
Concordance Correlation Coefficient ◽  
Concordance Correlation

scholarly journals Accuracy of Apple Watch Heart Rate Measurements in Patients with Obstructive Sleep Apnea and Atrial Fibrillation: A Prospective Observational Study (Preprint)

2020 ◽  
Author(s):  
Pauline Huynh ◽  
Rongzi Shan ◽  
Ngozi Osuji ◽  
Jie Ding ◽  
Nino Isakadze ◽  
...  
Keyword(s):  
Atrial Fibrillation ◽  
Heart Rate ◽  
Obstructive Sleep Apnea ◽  
Sleep Apnea ◽  
Correlation Coefficient ◽  
Repeated Measures ◽  
Concordance Correlation Coefficient ◽  
Concordance Correlation ◽  
Obstructive Sleep ◽  
Acceptable Agreement

BACKGROUND Patients with obstructive sleep apnea (OSA) are at higher risk for atrial fibrillation (AF). Consumer wearable heart rate (HR) sensors may be a means for passive HR monitoring in patients with AF. OBJECTIVE To assess the Apple Watch’s agreement with telemetry in measuring HR in patients with OSA in AF. METHODS Patients with OSA in AF were prospectively recruited prior to cardioversion/ablation procedures. HR was sampled every 10 seconds for 60 seconds using telemetry and an Apple Watch concomitantly. Agreement between devices was assessed using modified Bland-Altman analysis accounting for repeated measures per patient, mixed-effects regression modeling with the patient as a random effect while controlling for rapid ventricular response, and Lin's concordance correlation coefficient. RESULTS 20 patients (mean 66 +/- 6.5 years, 85% male, 3 (15%) with RVR) participated in this study, yielding 134 HR observations per device. The Apple Watch had 95% of differences fall within 18.5 beats per minute (bpm) above and 18.3 bpm below telemetry measurements, with a mean bias of 0.26 bpm. After controlling for RVR, 95% of differences fell between -14.3 and 14.5 bpm with a mean bias of 0.23 bpm. Lin’s concordance correlation coefficient was 0.88 (95% CI 0.85-0.91), suggesting acceptable agreement between the Apple Watch and telemetry. CONCLUSIONS In OSA patients in AF, the Apple Watch provided acceptable agreement with HR measurements by telemetry. Further studies with larger sample populations and wider range of HR are needed to confirm these findings.

Estimation of the concordance correlation coefficient for repeated measures using SAS and R

2013 ◽  
Vol 109 (3) ◽  
pp. 293-304 ◽  
Author(s):  
Josep L. Carrasco ◽  
Brenda R. Phillips ◽  
Josep Puig-Martinez ◽  
Tonya S. King ◽  
Vernon M. Chinchilli
Keyword(s):  
Correlation Coefficient ◽  
Repeated Measures ◽  
Concordance Correlation Coefficient ◽  
Concordance Correlation

Reliability of 5 Novel Reaction Time and Cognitive Load Protocols

2018 ◽  
Vol 27 (5) ◽  
Author(s):  
Kelsey Picha ◽  
Carolina Quintana ◽  
Amanda Glueck ◽  
Matt Hoch ◽  
Nicholas R. Heebner ◽  
...  
Keyword(s):  
Reaction Time ◽  
Cognitive Load ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Repeated Measures ◽  
Sports Medicine ◽  
Intraclass Correlation ◽  
Minimal Detectable Change ◽  
Good Reliability ◽  
Medicine Research

Context: Reaction time (RT) is crucial to athletic performance. Therefore, when returning athletes to play following injury, it is important to evaluate RT characteristics ensuring a safe return. The Dynavision D2® system may be utilized as an assessment and rehabilitation aid in the determination of RT under various levels of cognitive load. Previous research has demonstrated good reliability of simple protocols when assessed following a 24- to 48-hour test–retest window. Expanding reliable test–retest intervals may further refine novel RT protocols for use as a diagnostic and rehabilitation tool. Objective: To investigate the test–retest reliability of a battery of 5 novel RT protocols at different time intervals. Design: Repeated measures/reliability. Setting: Interdisciplinary sports medicine research laboratory. Participants: Thirty healthy individuals. Methods: Participants completed a battery of protocols increasing in difficulty in terms of reaction speed requirement and cognitive load. Prior to testing, participants were provided 3 familiarization trials. All protocols required participants to hit as many lights as quickly as possible in 60 seconds. After completing the initial testing session (session 1), participants waited 1 hour before completing the second session (session 2). Approximately 2 weeks later (average 14 [4] d), the participants completed the same battery of tasks for the third session (session 3). Main Outcome Measures: The intraclass correlation coefficient, standard error of measurement, minimal detectable change, and repeated-measures analysis of variance were calculated for RT. Results: The intraclass correlation coefficient values for each of the 5 protocols illustrated good to excellent reliability between sessions 1, 2, and 3 (.75–.90). There were no significant differences across time points (F < 0.105, P > .05). Conclusions: The 1-hour and 14-day test–retest intervals are reliable for clinical assessment, expanding the time frames previously reported in the literature of when assessments can be completed reliably. This study provides novel protocols that challenge cognition in unique ways.

Sign in / Sign up

Export Citation Format

Share Document