Agreement among High School Diving Judges
The analysis of aesthetic sports by a panel of judges has received some attention in past literature, but more studies have employed interclass correlations to arrive at judges' agreement or relative consistency. The purpose of this study was to determine raters' agreement and relative consistency of five male diving judges at the Kansas State Boys' Swimming and Diving Championships using intraclass correlation. Furthermore, one-sided confidence intervals were formed for analysis of sample variance. A total of 249 dives were performed and these dives were categorized into 16 position × type combinations for the analysis. Judges' variance was significant for 5 of the 16 type × position combinations. As expected divers' variance was significant for 14 of the 16 type × position combinations. Judges appeared to be somewhat consistent across dives but they were unable to agree upon the score of each dive. In other words the point estimates for consistency were generally greater than the point estimates for raters' agreement. Yet in neither case, consistency or raters' agreement, were lower confidence bounds impressively close to the actual point estimates.