How well do multiple testing methods scale up when both n and k increase?

Peter H. Westfall, Ananda Manage

Research output: Contribution to journalArticle

Abstract

With increasingly massive data sets in biopharmaceutical research, particularly in genomic and related applications, there is concern about how well multiple comparisons methods scale up with increasing number of tests (k). Familywise error rate-controlling methods do not scale up well, and false discovery rate-controlling methods do scale up well with increasing k. But neither method scales up well with increasing sample size (n) when testing point nulls. We develop a loss function approach to investigate scale-up properties of various methods; we find that while Efron's recent proposal scales up best when both sample size n and number of tests k increase, but its performance otherwise can be erratic.

Original languageEnglish
Pages (from-to)583-594
Number of pages12
JournalJournal of Biopharmaceutical Statistics
Volume21
Issue number4
DOIs
StatePublished - Jul 1 2011

    Fingerprint

Keywords

  • Efron's method
  • False discovery rate
  • Familywise error rate
  • Sample size

Cite this