# Multiplicity Issues in Clinical Trials 2010

### From MultXpert

Full-day course taught by Frank Bretz and Alex Dmitrienko at a Société Francaise de Statistique (SFdS) meeting in Paris, France on October 14-15, 2010.

Back to Short Courses.

## Textbook

Dmitrienko A, Tamhane A, Bretz F (editors). Multiple Testing Problems in Pharmaceutical Statistics. Chapman and Hall/CRC, 2009.

## SAS programs

Download ZIP archive with R programs for Lectures 2, 7 and 8 in this course.

For more information on software implementation of commonly used multiple testing procedures and gatekeeping procedures, see Implementation of Multiple Testing Procedures and Implementation of Gatekeeping Procedures.

## References

Alosh, M., Huque, M. (2010). A consistency-adjusted alpha-adaptive strategy for sequential testing. Statistics in Medicine. 29, 1559-1571.

Berger, J. (1982). Multi-parameter hypothesis testing and acceptance sampling. Technometrics. 24, 295-300.

Bretz, F., Maurer, W., Brannath, W., Posch, M. (2009). A graphical approach to sequentially rejective multiple test procedures. Statistics in Medicine. 28, 586-604.

Bretz, Maurer, Hommel (2010). Test and power considerations for multiple endpoint analyses using sequentially rejective graphical procedures. Statistics in Medicine (in press).

Burman, Sonesson, Guilbaud (2009). A recycling framework for the construction of Bonferroni-based multiple tests. Statistics in Medicine. 28, 739-761.

Dmitrienko, A., Kordzakhia, G., Tamhane, A.C. (2011). Multistage and mixture parallel gatekeeping procedures in clinical trials. Journal of Biopharmaceutical Statistics (in press).

Dmitrienko, A., Offen, W.W., Westfall, P.H. (2003). Gatekeeping strategies for clinical trials that do not require all primary effects to be significant. Statistics in Medicine. 22, 2387-2400. See Dmitrienko Offen Westfall 2003.

Dmitrienko, A., Soulakova, J., Millen, B. (2011). Three methods for constructing parallel gatekeeping procedures in clinical trials. Journal of Biopharmaceutical Statistics (in press).

Dmitrienko, A., Tamhane, A.C. (2007). Gatekeeping procedures with clinical trial applications. Pharmaceutical Statistics. 6, 171-180. See Dmitrienko Tamhane 2007.

Dmitrienko, A., Tamhane, A.C. (2009). Gatekeeping procedures in clinical trials. Multiple Testing Problems in Pharmaceutical Statistics. Dmitrienko, A., Tamhane, A.C., Bretz, F. (editors). Chapman and Hall/CRC Press, New York. See Dmitrienko Tamhane 2009.

Dmitrienko, A., Tamhane, A.C. (2010). Mixtures of multiple testing procedures for gatekeeping applications in clinical trials. Statistics in Medicine (in press). See Dmitrienko Tamhane 2010.

Dmitrienko, A., Tamhane, A.C., Wiens, B.L. (2008). General multistage gatekeeping procedures. Biometrical Journal. 50, 667-677. See Dmitrienko Tamhane Wiens 2008.

Dunnett, C.W. (1955). A multiple comparison procedure for comparing several treatments with a control. Journal of the American Statistical Association. 50, 1096-1121.

Dunnett, C.W., Tamhane, A.C. (1992). A step-up multiple test procedure. Journal of the American Statistical Association. 87,162-170.

EMEA (2002). CPMP Points to Consider on multiplicity issues in clinical trials.

Finner, H., Strassburger, K. (2002). The partitioning principle: A powerful tool in multiple decision theory. Annals of Statistics, 30, 1194-1213.

Glimm, Maurer, Bretz (2010). Hierarchical testing of multiple endpoints in group-sequential trials. Statistics in Medicine. 29, 219-228.

Guilbaud, O. (2008). Simultaneous confidence regions corresponding to Holm’s stepdown procedure and other closed testing procedures. Biometrical Journal. 50, 678-692.

Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple significance testing. Biometrika. 75, 800-802.

Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics. 6, 65-70.

Hommel, G. (1988). A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika. 75, 383-386.

Hommel, G., Bretz, F. (2008). Aesthetics and power considerations in multiple testing - a contradiction? Biometrical Journal. 50, 657-666.

Hommel, G., Bretz, F., Maurer, W. (2007). Powerful short-cuts for multiple testing procedures with special reference to gatekeeping strategies. Statistics in Medicine. 26, 4063-4073.

Hothorn, T., Bretz, F., Westfall, P. (2008). Simultaneous inference in general parametric models. Biometrical Journal. 50, 346-363.

Hung, J., Wang, S.J. (2009). Some controversial multiple testing problems in regulatory applications. Journal of Biopharmaceutical Statistics. 19, 1-11.

Hung, J., Wang, S.J. (2010). Challenges to multiple testing in clinical trials. Biometrical Journal (in press).

Hung, J., Wang, S.J., O'Neill, R. (2007). Statistical considerations for testing multiple endpoints in group sequential or adaptive clinical trials. Journal of Biopharmaceutical Statistics. 17, 1201-1210.

Huque, M.F., Alosh, M. (2008). A flexible fixed-sequence testing method for hierarchically ordered correlated multiple endpoints in clinical trials. Journal of Statistical Planning and Inference. 138, 321-335.

ICH (1998). ICH Topic E9 (Statistical principles for clinical trials).

Laska, Meisner (1989). Testing whether an identified treatment is best. Biometrics, 45, 1139-1151.

Maca, J., Gallo, P., Branson, M., Maurer, W. (2002). Reconsidering some aspects of the two-trials paradigm. Journal of Biopharmaceutical Statistics. 12, 107-119.

Marcus, R., Peritz, E., Gabriel, K.R. (1976). On closed testing procedures with special reference to ordered analysis of variance. Biometrika. 63, 655-660.

Maurer, Glimm, Bretz (2010). Multiple and repeated testing of primary, co-primary and secondary hypotheses. Statistics in Biopharmaceutical Research (in press).

Maurer, W., Hothorn, L. A., Lehmacher, W. (1995). Multiple comparisons in drug clinical trials and preclinical assays: a priori ordered hypotheses. Biometrie in der Chemisch-in-Pharmazeutischen Industrie. 6. Vollman, J. (editor). Fischer-Verlag, Stuttgart, 3-18.

Naik, U.D. (1975). Some selection rules for comparing p processes with a standard. Communications in Statistics. Series A. 4, 519-535.

O'Neill, R.T. (1997). Secondary endpoints cannot be validly analyzed if the primary endpoint does not demonstrate clear statistical significance. Controlled Clinical Trials. 18, 550-556.

Proschan, M. (2008). Multiple comparisons. Encyclopedia of Clinical Trials. R. D’Agostino, L. Sullivan and J. Massaro (editors). Wiley, New York.

Rohmeyer (2010). gMCP: Graphical approach to multiple comparison procedures. R package on CRAN.

Roy (1953). On a heuristic method of test construction and its use in multivariate analysis. Annals of Mathematical Statistics. 24, 220-238.

Roy, Bose (1953). Simultaneous confidence interval estimation. Annals of Mathematical Statistics, 24, 513-536.

Sarkar, S., Chang, C.K. (1997). Simes' method for multiple hypothesis testing with positively dependent test statistics. Journal of the American Statistical Association. 92, 1601-1608.

Sarkar, S.K. (1998). Some probability inequalities for censored MTP2 random variables: A proof of the Simes conjecture. The Annals of Statistics. 26, 494-504.

Simes, R.J. (1986). An improved Bonferroni procedure for multiple tests of significance. Biometrika. 63, 655-660.

Stefansson, Kim, Hsu, J. (1988). On confidence sets in multiple comparisons. Statistical Decision Theory and Related Topics IV. S. S. Gupta and J. O. Berger (editors). New York: Academic Press, 89-104.

Strassburger, K., Bretz, F. (2008). Compatible simultaneous lower confidence bounds for the Holm procedure and other Bonferroni based closed tests. Statistics in Medicine. 27, 4914-4927.

Tamhane, A.C., Mehta, C., Liu, L. (2010) Testing a primary and a secondary endpoint in a group sequential design. Biometrics (in press).

Westfall, P. H., Krishen, A. (2001). Optimally weighted, fixed sequence, and gatekeeping multiple testing procedures. Journal of Statistical Planning and Inference. 99, 25-40.

Westfall, P.H., Bretz, F. (2010). Multiplicity in clinical trials. Encyclopedia of Biopharmaceutical Statistics (3rd edition). Chow, S.C. (editor), Marcel Dekker, New York.

Wiens, B. (2003). A fixed sequence Bonferroni procedure for testing multiple endpoints. Pharmaceutical Statistics. 2, 211-215.

Wiens, B., Dmitrienko, A. (2005). The fallback procedure for evaluating a single family of hypotheses. Journal of Biopharmaceutical Statistics. 15, 929-942.