Skip to main navigation Skip to search Skip to main content

Controlling the false-discovery rate in astrophysical data analysis

  • Christopher J. Miller
  • , Christopher Genovese
  • , Robert C. Nichol
  • , Larry Wasserman
  • , Andrew Connolly
  • , Daniel Reichart
  • , Andrew Hopkins
  • , Jeff Schneider
  • , Andrew Moore

Research output: Contribution to journal › Article › peer-review

Abstract

The false-discovery rate (FDR) is a new statistical procedure to control the number of mistakes made when performing multiple hypothesis tests, i.e., when comparing many data against a given model hypothesis. The key advantage of FDR is that it allows one to a priori control the average fraction of false rejections made (when comparing with the null hypothesis) over the total number of rejections performed. We compare FDR with the standard procedure of rejecting all tests that do not match the null hypothesis above some arbitrarily chosen confidence limit, e.g., 2 σ, or at the 95% confidence level. We find a similar rate of correct detections, but with significantly fewer false detections. Moreover, the FDR procedure is quick and easy to compute and can be trivially adapted to work with correlated data. The purpose of this paper is to introduce the FDR procedure to the astrophysics community. We illustrate the power of FDR through several astronomical examples, including the detection of features against a smooth one-dimensional function, e.g., seeing the "baryon wiggles" in a power spectrum of matter fluctuations, and source pixel detection in imaging data. In this era of large data sets and high-precision measurements, FDR provides the means to adaptively control a scientifically meaningful quantity—the fraction of false discoveries over total discoveries.
Original languageEnglish
Pages (from-to)3492-3505
Number of pages14
JournalThe Astronomical Journal
Volume122
Issue number6
DOIs
Publication statusPublished - 2004
Externally publishedYes

Keywords

  • methods : analytical
  • methods : data analysis
  • methods : statistical
  • techniques : image processing

Fingerprint

Dive into the research topics of 'Controlling the false-discovery rate in astrophysical data analysis'. Together they form a unique fingerprint.

Cite this