Maximum Entropy Density Estimation with Generalized Regularization and an Application to Species Distribution Modeling

Abstract

We present a unified and complete account of maximum entropy density estimation subject to constraints represented by convex potential functions or, alternatively, by convex regularization. We provide fully general performance guarantees and an algorithm with a complete convergence proof. As special cases, we easily derive performance guarantees for many known regularization types, including `1, `2, `2, and `1+ ` 2 2 style regularization. We propose an algorithm solving a large and general subclass of generalized maximum entropy problems, including all discussed in the paper, and prove its convergence. Our approach generalizes and unifies techniques based on information geometry and Bregman divergences as well as those based more directly on compactness. Our work is motivated by a novel application of maximum entropy to species distribution modeling, an important problem in conservation biology and ecology. In a set of experiments on real-world data, we demonstrate the utility of maximum entropy in this setting. We explore effects of different feature types, sample sizes, and regularization levels on the performance of maxent, and discuss interpretability of the resulting models.

Extracted Key Phrases

9 Figures and Tables

01020'05'06'07'08'09'10'11'12'13'14'15'16'17
Citations per Year

95 Citations

Semantic Scholar estimates that this publication has 95 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Dudk2007MaximumED, title={Maximum Entropy Density Estimation with Generalized Regularization and an Application to Species Distribution Modeling}, author={Miroslav Dud{\'i}k and Steven J. Phillips and Robert E. Schapire}, journal={Journal of Machine Learning Research}, year={2007}, volume={8}, pages={1217-1260} }