Cross-validation to select Bayesian hierarchical models in phylogenetics

Sebastián Duchêne*, David A. Duchêne, Francesca Di Giallonardo, John Sebastian Eden, Jemma L. Geoghegan, Kathryn E. Holt, Simon Y W Ho, Edward C. Holmes

*Corresponding author for this work

Research output: Contribution to journalArticle

10 Citations (Scopus)
9 Downloads (Pure)

Abstract

Background: Recent developments in Bayesian phylogenetic models have increased the range of inferences that can be drawn from molecular sequence data. Accordingly, model selection has become an important component of phylogenetic analysis. Methods of model selection generally consider the likelihood of the data under the model in question. In the context of Bayesian phylogenetics, the most common approach involves estimating the marginal likelihood, which is typically done by integrating the likelihood across model parameters, weighted by the prior. Although this method is accurate, it is sensitive to the presence of improper priors. We explored an alternative approach based on cross-validation that is widely used in evolutionary analysis. This involves comparing models according to their predictive performance. Results: We analysed simulated data and a range of viral and bacterial data sets using a cross-validation approach to compare a variety of molecular clock and demographic models. Our results show that cross-validation can be effective in distinguishing between strict- and relaxed-clock models and in identifying demographic models that allow growth in population size over time. In most of our empirical data analyses, the model selected using cross-validation was able to match that selected using marginal-likelihood estimation. The accuracy of cross-validation appears to improve with longer sequence data, particularly when distinguishing between relaxed-clock models. Conclusions: Cross-validation is a useful method for Bayesian phylogenetic model selection. This method can be readily implemented even when considering complex models where selecting an appropriate prior for all parameters may be difficult.
Original languageEnglish
Article number115
Pages (from-to)1-8
Number of pages8
JournalBMC Evolutionary Biology
Volume16
DOIs
Publication statusPublished - 2016
Externally publishedYes

Bibliographical note

Copyright the Author(s) 2016. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

  • Bayesian phylogenetics
  • cross-validation
  • demographic models
  • marginal likelihood
  • model selection
  • molecular clock

Fingerprint Dive into the research topics of 'Cross-validation to select Bayesian hierarchical models in phylogenetics'. Together they form a unique fingerprint.

Cite this