Abstract
The cross-entropy (CE) method is a simple and versatile technique for optimization, based on Kullback-Leibler (or cross-entropy) minimization. The method can be applied to a wide range of optimization tasks, including continuous, discrete, mixed and constrained optimization problems. The new package CEoptim provides the R implementation of the CE method for optimization. We describe the general CE methodology for optimization and well as some useful modifications. The usage and efficacy of CEoptim is demonstrated through a variety of optimization examples, including model fitting, combinatorial optimization, and maximum likelihood estimation.
Original language | English |
---|---|
Pages (from-to) | 1-29 |
Number of pages | 29 |
Journal | Journal of Statistical Software |
Volume | 76 |
Issue number | 8 |
DOIs | |
Publication status | Published - Feb 2017 |
Externally published | Yes |
Bibliographical note
Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.Keywords
- constrained optimization
- continuous optimization
- cross-entropy
- discrete optimization
- Kullback-Leibler divergence
- lasso
- maximum likelihood
- R
- regression