Maximum likelihood estimation of a multi‐dimensional log‐concave density
@article{Cule2008MaximumLE, title={Maximum likelihood estimation of a multi‐dimensional log‐concave density}, author={Madeleine L. Cule and Richard J. Samworth and Michael I. Stewart}, journal={Journal of the Royal Statistical Society: Series B (Statistical Methodology)}, year={2008}, volume={72} }
Summary. Let X1,…,Xn be independent and identically distributed random vectors with a (Lebesgue) density f. We first prove that, with probability 1, there is a unique log‐concave maximum likelihood estimator of f. The use of this estimator is attractive because, unlike kernel density estimation, the method is fully automatic, with no smoothing parameters to choose. Although the existence proof is non‐constructive, we can reformulate the issue of computing in terms of a non‐differentiable…
190 Citations
Maximum Likelihood Estimation of a Multi-Dimensional Log-Concave Density Through SOS-Convexity
- Mathematics, Computer Science
- 2014
An algorithm using projected stochastic gradient method is proposed, in which biased gradient estimates are obtained through an Markov chain Monte Carlo sampling procedure that is efficient for log-concave densities.
Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
- Mathematics
- 2009
We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in R d . Our study covers both the case where…
A new computational framework for log-concave density estimation
- Computer Science, Mathematics
- 2021
Enhanced understanding of the structural properties of this optimization problem is provided, which motivates the proposal of new algorithms, based on both randomized and Nesterov smoothing, combined with an appropriate integral discretization of increasing accuracy.
Maximum likelihood estimation for totally positive log‐concave densities
- MathematicsScandinavian Journal of Statistics
- 2020
We study nonparametric maximum likelihood estimation for two classes of multivariate distributions that imply strong forms of positive dependence; namely log‐supermodular (MTP2) distributions and…
Maximum likelihood estimation of a multivariate log-concave density
- Computer Science, Mathematics
- 2010
This paper proposes an alternative approach using maximum likelihood under a qualitative assumption on the shape of the density, specifically log-concavity, and introduces a method for assessing the suitability of this shape constraint and applies it to several simulated datasets and one real dataset.
A Polynomial Time Algorithm for Maximum Likelihood Estimation of Multivariate Log-concave Densities
- Computer Science, MathematicsArXiv
- 2018
This work studies the problem of computing the maximum likelihood estimator (MLE) of multivariate log-concave densities and presents the first computationally efficient algorithm for this problem, based on a natural convex optimization formulation of the underlying problem and a projected stochastic subgradient method.
Adaptation in log-concave density estimation
- Computer Science, Mathematics
- 2016
This paper proves a sharp oracle inequality, which implies that the rate of convergence with respect to various global loss functions, including Kullback--Leibler divergence, is O(n^{-4/5}) when the true density is log-concave and its logarithm is close to k-affine.
Exact Solutions in Log-Concave Maximum Likelihood Estimation
- Mathematics
- 2020
We study probability density functions that are log-concave. Despite the space of all such densities being infinite-dimensional, the maximum likelihood estimate is the exponential of a piecewise…
Global rates of convergence in log-concave density estimation
- Computer Science, Mathematics
- 2014
It is proved that when $d \leq 3$ the log-concave maximum likelihood estimator achieves the minimax optimal rate (up to logarithmic factors when d = 2,3$) with respect to squared Hellinger loss.
APPROXIMATION BY LOG-CONCAVE DISTRIBUTIONS, WITH APPLICATIONS TO REGRESSION
- Mathematics, Computer Science
- 2011
It is shown that an approximation of arbitrary distributions P on d-dimensional space by distributions with log-concave density exists if and only if P has finite first moments and is not supported by some hyperplane, and that this approximation depends continuously on P with respect to Mallows distance D 1.
References
SHOWING 1-10 OF 200 REFERENCES
Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
- Mathematics
- 2009
We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in R d . Our study covers both the case where…
Maximum likelihood estimation of a multivariate log-concave density
- Computer Science, Mathematics
- 2010
This paper proposes an alternative approach using maximum likelihood under a qualitative assumption on the shape of the density, specifically log-concavity, and introduces a method for assessing the suitability of this shape constraint and applies it to several simulated datasets and one real dataset.
Limit Distribution Theory for Maximum Likelihood Estimation of a Log-Concave Density.
- MathematicsAnnals of statistics
- 2009
It is shown that the limiting distributions of the nonparametric maximum likelihood estimator (MLE) of a log-concave density and its derivative are, under comparable smoothness assumptions, the same (up to sign) as in the convex density estimation problem.
Computing maximum likelihood estimators of a log-concave density function
- Mathematics, Computer Science
- 2007
It is shown that the maximum likelihood estimator for the log-density is always a piecewise linear function with at most as many knots as observations, but typically much less, and can be exploited to design a linearly constrained optimization problem whose iteratively calculated solution yields the estimator.
Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency
- Mathematics
- 2007
We study nonparametric maximum likelihood estimation of a log-concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two…
Nonparametric likelihood based estimation for a multivariate Lipschitz density
- MathematicsJ. Multivar. Anal.
- 2009
NONPARAMETRIC ESTIMATION OF MULTIVARIATE CONVEX-TRANSFORMED DENSITIES.
- MathematicsAnnals of statistics
- 2010
We study estimation of multivariate densities p of the form p(x) = h(g(x)) for x ∈ ℝ(d) and for a fixed monotone function h and an unknown convex function g. The canonical example is h(y) = e(-y) for…
Multivariate density estimation: A comparative study
- Computer ScienceNeural Computing & Applications
- 2005
Simulations confirm the earlier conjecture that this last estimator proivdes a way of effectively estimating arbitrary and highly structured continuous densities on Rd, at least for small d, by using this estimator itself or by using it as a pilot estimator for a newly proposed plug-in estimator.
Multivariate log-concave distributions as a nearly parametric model
- Mathematics
- 2009
Abstract In this paper we show that the family Pd(lc) of probability distributions on ℝd with log-concave densities satisfies a strong continuity condition. In particular, it turns out that weak…
LogConcDEAD: An R Package for Maximum Likelihood Estimation of a Multivariate Log-Concave Density
- Mathematics
- 2009
The R package LogConcDEAD (Log-concave density estimation in arbitrary dimensions) is introduced, its main function is to compute the nonparametric maximum likelihood estimator of a log-conCave density.