A Perspective on Tachibana's Eta-Squared Analyses of the Results of the Nctr Collaborative Behavioral Teratology Study
The NCTR Collaborative Behavioral Teratology Study (CBTS) data have been reanalyzed by Tachibana (1989) using the strength of association statistic η2 as a means of examining the reliability of the data. This is an important issue, because determining the reliability of behavioral teratological measures was one of the CBTS's principal aims. The η2 approach is a useful one, but its value is critically dependent on the assumption that it is applied to the data appropriately. The CBTS was a project which involved large numbers of pregnant rats and their offspring, tested postnatally on a large number of physical and behavioral tests. The project was conducted in six laboratories and involved two experiments with four treatment groups/experiment, 16 dams/group, and 8 offspring/dam. For practical more than theoretical reasons, each of these large experiments was conducted in balanced replicates of 4 dams/group. Since this had to be done, replicate was included in the statistical models used to evaluate the data. Tachibana (1989) has performed a series of η2 analyses on the CBTS data as if each replicate constituted an independent experiment and concluded that the reproducibility of the CBTS data was not particularly good. Tachibana's η2 analyses are discussed as problematic because the data should have been analyzed as intended, by experiment ( n = 16/group), not by replicates. There are well-known problems associated with the reliability of small sample sizes in any experiment and Tachibana's conclusion, based as it is on replicates, offers little insight into the reproducibility of behavioral teratogenicity data generally or from the CBTS project specifically.