A systematic assessment of preclinical multilaboratory studies and a comparison to single laboratory studies
Multicentric approaches are widely used in clinical trials to assess generalizability of findings, however they are novel in preclinical experimentation. We synthesized characteristics of multilaboratory studies and quantitatively compared them to single laboratory studies. We systematically identified sixteen in vivo interventional multilaboratory studies and matched them to 100 single laboratory studies by intervention and disease. Differences in standardized mean differences (DSMD) were calculated to compare treatment effects based on study design. The multilaboratory study design was applied across a range of diseases (e.g. stroke, diabetes, trauma). The median number of labs was 4 (range 2-6) and the median sample size was 111 (range 23-384). Multilaboratory studies adhered to practices that reduce risk of bias and were transparently reported. These studies demonstrated significantly smaller treatment effects than single lab studies (DSMD 0.72 [95% confidence interval 0.43-1]). Preclinical multilaboratory studies demonstrate trends that have been well recognized in clinical research (i.e. smaller treatment effects with greater rigour in study design). This approach may provide a method to robustly assess interventions and reproducibility of findings between laboratories.