How well do multiple testing methods scale up when both n and k increase?

Peter H. Westfall, Ananda Manage

Research output: Contribution to journalArticlepeer-review

Abstract

With increasingly massive data sets in biopharmaceutical research, particularly in genomic and related applications, there is concern about how well multiple comparisons methods scale up with increasing number of tests (k). Familywise error rate-controlling methods do not scale up well, and false discovery rate-controlling methods do scale up well with increasing k. But neither method scales up well with increasing sample size (n) when testing point nulls. We develop a loss function approach to investigate scale-up properties of various methods; we find that while Efron's recent proposal scales up best when both sample size n and number of tests k increase, but its performance otherwise can be erratic.

Original languageEnglish
Pages (from-to)583-594
Number of pages12
JournalJournal of Biopharmaceutical Statistics
Volume21
Issue number4
DOIs
StatePublished - Jul 2011

Keywords

  • Efron's method
  • False discovery rate
  • Familywise error rate
  • Sample size

Fingerprint Dive into the research topics of 'How well do multiple testing methods scale up when both n and k increase?'. Together they form a unique fingerprint.

Cite this