Practical Multiple Testing Methods in Clinical Trials

Author(s):  
Mark Chang ◽  
John Balser ◽  
Jim Roach ◽  
Robin Bliss
1982 ◽  
Vol 3 (2) ◽  
pp. 136
Author(s):  
Daniel G. Seigel ◽  
Roy C. Milton

2020 ◽  
Vol 10 (2) ◽  
pp. 199-248 ◽  
Author(s):  
Campbell R Harvey ◽  
Yan Liu ◽  
Alessio Saretto

Abstract In almost every area of empirical finance, researchers confront multiple tests. One high-profile example is the identification of outperforming investment managers, many of whom beat their benchmarks purely by luck. Multiple testing methods are designed to control for luck. Factor selection is another glaring case in which multiple tests are performed, but numerous other applications do not receive as much attention. One important example is a simple regression model testing five variables. In this case, because five variables are tried, a t-statistic of 2.0 is not enough to establish significance. Our paper provides a guide to various multiple testing methods and details a number of applications. We provide simulation evidence on the relative performance of different methods across a variety of testing environments. The goal of our paper is to provide a menu that researchers can choose from to improve inference in financial economics. (JEL G0, G1, G3, G5, M4, C1)


2016 ◽  
Vol 23 (1) ◽  
pp. 34-35 ◽  
Author(s):  
Maria Pia Sormani

Subgroup analysis is often conducted as a post-hoc evaluation of clinical trials. The aim of a subgroup analysis is the evaluation of the treatment effect that was tested in the trial, in a specific subgroups of patients. It can be run both on positive trials (to provide information about patients receiving the highest benefit from the treatment) and on negative trials (to test whether the treatment that had no effect on the overall population can be of any benefit in a specific subset of patients). A subgroup analysis is aimed at generating hypotheses for future research. Subgroup analyses have statistical challenges involving multiple testing and unplanned and low powered analyses; however the main issue, at least in subgroup analysis conducted so far in MS studies, seems to be related to the reporting and interpretation of results. In this viewpoint I will try to show the misleading ways of reporting subgroup analysis in MS trials, along with the correct approach based on an interaction test.


Sign in / Sign up

Export Citation Format

Share Document