Confidence Intervals and F Tests for Intraclass Correlation Coefficients Based on Three-Way Mixed Effects Models

2011 ◽  
Vol 36 (5) ◽  
pp. 638-671 ◽  
Author(s):  
Hong Zhou ◽  
Paige Muellerleile ◽  
Debra Ingram ◽  
Seok P. Wong
Keyword(s):  
Confidence Intervals ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Mixed Effects ◽  
Mixed Effects Models ◽  
Intraclass Correlation Coefficients

scholarly journals Is there a relationship between the overhead press and split jerk maximum performance? Influence of sex

2021 ◽  
pp. 174795412110204
Author(s):  
Marcos A Soriano ◽  
G Gregory Haff ◽  
Paul Comfort ◽  
Francisco J Amaro-Gahete ◽  
Antonio Torres-González ◽  
...  
Keyword(s):  
Confidence Intervals ◽  
Body Mass ◽  
Upper Limb ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Training Experience ◽  
Maximum Performance ◽  
Repetition Maximum ◽  
Intraclass Correlation Coefficients

The aims of this study were to (I) determine the differences and relationship between the overhead press and split jerk performance in athletes involved in weightlifting training, and (II) explore the magnitude of these differences in one-repetition maximum (1RM) performances between sexes. Sixty-one men (age: 30.4 ± 6.7 years; height: 1.8 ± 0.5 m; body mass 82.5 ± 8.5 kg; weightlifting training experience: 3.7 ± 3.5 yrs) and 21 women (age: 29.5 ± 5.2 yrs; height: 1.7 ± 0.5 m; body mass: 62.6 ± 5.7 kg; weightlifting training experience: 3.0 ± 1.5 yrs) participated. The 1RM performance of the overhead press and split jerk were assessed for all participants, with the overhead press assessed on two occasions to determine between-session reliability. The intraclass correlation coefficients (ICC) and 95% confidence intervals showed a high reliability for the overhead press ICC = 0.98 (0.97 – 0.99). A very strong correlation and significant differences were found between the overhead press and split jerk 1RM performances for all participants (r = 0.90 [0.93 – 0.85], 60.2 ± 18.3 kg, 95.7 ± 29.3 kg, p ≤ 0.001). Men demonstrated stronger correlations between the overhead press and split jerk 1RM performances (r = 0.83 [0.73-0.90], p ≤ 0.001) compared with women (r = 0.56 [0.17-0.80], p = 0.008). These results provide evidence that 1RM performance of the overhead press and split jerk performance are highly related, highlighting the importance of upper-limb strength in the split jerk maximum performance.

scholarly journals DOING L2 SPEECH RESEARCH ONLINE: WHY AND HOW TO COLLECT ONLINE RATINGS DATA

2021 ◽  
pp. 1-24
Author(s):  
Charles L. Nagle ◽  
Ivana Rehman
Keyword(s):  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Control Measures ◽  
Mixed Effects Models ◽  
Amazon Mechanical Turk ◽  
Intraclass Correlation Coefficients ◽  
Online Ratings ◽  
Speech Research ◽  
Future Work ◽  
Local Laboratory

Abstract Listener-based ratings have become a prominent means of defining second language (L2) users’ global speaking ability. In most cases, local listeners are recruited to evaluate speech samples in person. However, in many teaching and research contexts, recruiting local listeners may not be possible or advisable. The goal of this study was to hone a reliable method of recruiting listeners to evaluate L2 speech samples online through Amazon Mechanical Turk (AMT) using a blocked rating design. Three groups of listeners were recruited: local laboratory raters and two AMT groups, one inclusive of the dialects to which L2 speakers had been exposed and another inclusive of a variety of dialects. Reliability was assessed using intraclass correlation coefficients, Rasch models, and mixed-effects models. Results indicate that online ratings can be highly reliable as long as appropriate quality control measures are adopted. The method and results can guide future work with online samples.

Reliability of an Active-Knee-Extension Test for Determining Hamstring Muscle Flexibility

1992 ◽  
Vol 1 (3) ◽  
pp. 181-187 ◽  
Author(s):  
Teddy W. Worrell ◽  
Michael K. Sullivan ◽  
Joseph J. DeJulia
Keyword(s):  
Confidence Interval ◽  
Confidence Intervals ◽  
Intraclass Correlation ◽  
Muscle Length ◽  
Correlation Coefficients ◽  
Accurate Method ◽  
Knee Extension ◽  
Hamstring Muscle ◽  
Intraclass Correlation Coefficients ◽  
Hamstring Flexibility

This study examined the intratester and intertester reliability of an active-knee-extension test (AKET) for determining hamstring muscle length (flexibility). Three testers performed repeated AKET measurements on 22 subjects. Intraclass correlation coefficients (ICC were used to calculate intratester and intertester reliability. Also, standard error of measurements (SEM) were calculated. The ICC and SEM were .96 and 1.82°, respectively, for Tester 1, .99 and 1.75° for Tester 2, and .99 and 1.80° for Tester 3. Intratester 95% confidence intervals ranged from 60.54 to 69.82°. Intertester ICC and SEM for two testers were .93 and 4.81°, respectively. A 95% intertester confidence interval ranged from 56.35 to 75.21 °; this reveals that intertester AKET values contained more error and suggests that only intratester AKET values should be used when comparing hamstring flexibility values. The AKET may provide a more accurate method for determining hamstring flexibility and quantifying changes that occur as a result of injury and stretching procedures.

583 THE INTER- AND INTRA-OBSERVER RELIABILITY OF A NOVEL VIDEO-FLUOROSCOPY PROTOCOL FOR GASTRO-ESOPHAGEAL JUNCTION ANATOMY POST-FUNDOPLICATION

2020 ◽  
Vol 33 (Supplement_1) ◽  
Author(s):  
S Gan ◽  
N Lee ◽  
S Tan ◽  
S Edwards ◽  
G Kiroff ◽  
...  
Keyword(s):  
Clinical Utility ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Mixed Effects ◽  
Partial Fundoplication ◽  
Anatomical Changes ◽  
Intraclass Correlation Coefficients ◽  
Observer Reliability ◽  
Swallow Study ◽  
Video Fluoroscopy

Abstract   Despite modifications in surgical technique, the occurrence of troublesome dysphagia after fundoplication remains difficult to predict. Objective measurements on video-fluoroscopy swallow study (VFSS) may hold the key to understanding post-fundoplication dysphagia. This study reports the inter- and intra-observer reliability of video-fluoroscopic anatomical measurements of the post-fundoplication gastro-esophageal junction (GEJ). Methods Thirty-one patients underwent structured VFSS 6–12 months after laparoscopic total or partial fundoplication. VFSS protocol included six views: standing AP, 2x standing oblique, 2x prone oblique (POb), and prone oblique with continuous drinking. The primary observer recorded two sets of 11 variables of GEJ anatomy (3 mo interval between set 1- set 2). Further datasets (one each) were obtained from two medical students trained in two 2-hour sessions. Inter-observer reliability was determined from datasets of three observers and intra-observer reliability from primary observer. Intraclass correlation coefficients (ICC) two-way mixed-effects model was used (ICC agreement: 0.40–0.59 “fair”; 0.60–0.74 “good”; 0.75–1.00 “excellent”). Results ICC for inter-observer reliability was good-excellent in 47/66 measurements. All measures of maximal esophageal diameter, maximal esophageal diameter cf. wrap opening diameter and posterior distal esophageal angulation were good-excellent (ICC range 0.74–0.78; 0.84–0.91; 0.68–0.80 respectively). Four parameters recorded 83% good-excellent ICC: wrap closing diameter, minimal wrap diameter, GEJ anterior displacement and degree of axis deviation (GEJ cf. esophagus) (ICC range 0.50–0.85; 0.58–0.93; 0.56–0.79; 0.41–0.77 respectively). Absolute and axial wrap length showed low reproducibility: “good” ICC in 25% of measurements. POb measurements were most reliable: good-excellent ICC 86% of times. Intra-observer reliability was excellent in 98% of measurements (ICC range 0.74–0.99). Conclusion Following a structured protocol, VFSS measurements of GEJ post-fundoplication anatomy are reliable between observers except for measures of absolute and axial wrap length. Measures from the POb view showed the greatest inter-observer reliability and may have higher clinical utility. Further studies using structured VFSS are warranted to determine the correlation between troublesome dysphagia and anatomical changes of the gastro-esophageal junction post-fundoplication.

Confidence intervals on intraclass correlation coefficients in a balanced two-factor random design

2007 ◽  
Vol 137 (4) ◽  
pp. 1199-1212 ◽  
Author(s):  
Kye Gilder ◽  
Naitee Ting ◽  
Lili Tian ◽  
Joseph C. Cappelleri ◽  
R. Choudary Hanumara
Keyword(s):  
Confidence Intervals ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Random Design ◽  
Intraclass Correlation Coefficients

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

scholarly journals Patient-Reported Dysphagia in Adults with Eosinophilic Esophagitis: Translation and Validation of the Swedish Eosinophilic Esophagitis Activity Index

Dysphagia ◽  
2021 ◽  
Author(s):  
Sofie Albinsson ◽  
Lisa Tuomi ◽  
Christine Wennerås ◽  
Helen Larsson
Keyword(s):  
Eosinophilic Esophagitis ◽  
Activity Index ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Control Group ◽  
Cronbach’S Alpha ◽  
Intraclass Correlation Coefficients ◽  
Cronbach's Alpha ◽  
Patient Reported ◽  
Eortc Qlq

AbstractThe lack of a Swedish patient-reported outcome instrument for eosinophilic esophagitis (EoE) has limited the assessment of the disease. The aims of the study were to translate and validate the Eosinophilic Esophagitis Activity Index (EEsAI) to Swedish and to assess the symptom severity of patients with EoE compared to a nondysphagia control group. The EEsAI was translated and adapted to a Swedish cultural context (S-EEsAI) based on international guidelines. The S-EEsAI was validated using adult Swedish patients with EoE (n = 97) and an age- and sex-matched nondysphagia control group (n = 97). All participants completed the S-EEsAI, the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Oesophageal Module 18 (EORTC QLQ-OES18), and supplementary questions regarding feasibility and demographics. Reliability and validity of the S-EEsAI were evaluated by Cronbach’s alpha and Spearman correlation coefficients between the domains of the S-EEsAI and the EORTC QLQ-OES18. A test–retest analysis of 29 patients was evaluated through intraclass correlation coefficients. The S-EEsAI had sufficient reliability with Cronbach’s alpha values of 0.83 and 0.85 for the “visual dysphagia question” and the “avoidance, modification and slow eating score” domains, respectively. The test–retest reliability was sufficient, with good to excellent intraclass correlation coefficients (0.60–0.89). The S-EEsAI domains showed moderate correlation to 6/10 EORTC QLQ-OES18 domains, indicating adequate validity. The patient S-EEsAI results differed significantly from those of the nondysphagia controls (p < 0.001). The S-EEsAI appears to be a valid and reliable instrument for monitoring adult patients with EoE in Sweden.

scholarly journals Diagnosis of left ventricular hypertrophy using non-ECG-gated 15O-water PET

2021 ◽  
Author(s):  
Jens Sörensen ◽  
Jonny Nordström ◽  
Tomasz Baron ◽  
Stellan Mörner ◽  
Sven-Olof Granstam ◽  
...  
Keyword(s):  
Method Development ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Roc Curves ◽  
Left Ventricular ◽  
Intraclass Correlation Coefficients ◽  
Concentric Hypertrophy ◽  
2D Echocardiography ◽  
Positron Emission ◽  
Septal Wall Thickness

Abstract Aim To develop a method for diagnosing left ventricular (LV) hypertrophy from cardiac perfusion 15O-water positron emission tomography (PET). Methods We retrospectively pooled data from 139 subjects in four research cohorts. LV remodeling patterns ranged from normal to severe eccentric and concentric hypertrophy. 15O-water PET scans (n = 197) were performed with three different PET devices. A low-end scanner (66 scans) was used for method development, and remaining scans with newer devices for a blinded evaluation. Dynamic data were converted into parametric images of perfusable tissue fraction for semi-automatic delineation of the LV wall and calculation of LV mass (LVM) and septal wall thickness (WT). LVM and WT from PET were compared to cardiac magnetic resonance (CMR, n = 47) and WT to 2D-echocardiography (2DE, n = 36). PET accuracy was tested using linear regression, Bland–Altman plots, and ROC curves. Observer reproducibility were evaluated using intraclass correlation coefficients. Results High correlations were found in the blinded analyses (r ≥ 0.87, P < 0.0001 for all). AUC for detecting increased LVM and WT (> 12 mm and > 15 mm) was ≥ 0.95 (P < 0.0001 for all). Reproducibility was excellent (ICC ≥ 0.93, P < 0.0001). Conclusion 15O-water PET might detect LV hypertrophy with high accuracy and precision.

Sign in / Sign up

Export Citation Format

Share Document