• Corpus ID: 88514169

Nonparametric density estimation by histogram trend filtering

  title={Nonparametric density estimation by histogram trend filtering},
  author={Oscar Hernan Madrid Padilla and James G. Scott},
  journal={arXiv: Methodology},
We propose a novel approach for density estimation called histogram trend filtering. Our estimator arises from looking at surrogate Poisson model for counts of observations in a partition of the support of the data. We begin by showing consistency for a variational estimator for this density estimation problem. We then study a discrete estimator that can be efficiently found via convex optimization. We show that the estimator enjoys strong statistical guarantees, yet is much more practical and… 

Figures from this paper

Fused density estimation: theory and methods

  • R. BassettJ. Sharpnack
  • Mathematics, Computer Science
    Journal of the Royal Statistical Society: Series B (Statistical Methodology)
  • 2019
A method for non‐parametric density estimation on geometric networks that reduces the original variational formulation to transform it into a tractable, finite dimensional quadratic program and compares the performance of various optimization techniques to solve the problem.

A deconvolution path for mixtures

We propose a class of estimators for deconvolution in mixture models based on a simple two-step "bin-and-smooth" procedure applied to histogram counts. The method is both statistically and

An adaptive approach to non-parametric estimation of dynamic probability density functions

An adaptive version of the Histogram Trend Filtering (HTF) is proposed, which is a relatively new method used for non-parametric density estimation and can deal with estimating both stationary and non-stationary distributions.

A deconvolution path for mixtures

: We propose a class of estimators for deconvolution in mixture models based on a simple two-step “bin-and-smooth” procedure applied to histogram counts. The method is both statistically and

Multivariate Trend Filtering for Lattice Data

A multivariate version of trend filtering, called Kronecker trend filtering or KTF, for the case in which the design points form a lattice in d dimensions is studied, revealing a number of interesting phenomena, including the dominance of KTF over linear smoothers in estimating heterogeneously smooth functions.

Constrained estimation via the fused lasso and some generalizations



Multiscale Poisson Intensity and Density Estimation

Nonparametric Poisson intensity and density estimation methods studied in this paper offer near minimax convergence rates for broad classes of densities and intensities with arbitrary levels of smoothness and it is demonstrated that platelet-based estimators in two dimensions exhibit similar near-optimal error convergence rates.

Nonparametric Maximum Likelihood Estimation of Probability Densities by Penalty Function Methods

When it is known a priori exactly to which finite dimensional manifold the probability density function gives rise to a set of samples, the parametric maximum likelihood estimation procedure leads to

Density Estimation by Total Variation Penalized Likelihood Driven by the Sparsity ℓ1 Information Criterion

Abstract.  We propose a non‐linear density estimator, which is locally adaptive, like wavelet estimators, and positive everywhere, without a log‐ or root‐transform. This estimator is based on

Nonparametric Maximum Likelihood Estimation by the Method of Sieves

Maximum likelihood estimation often fails when the parameter takes values in an infinite dimensional space. For example, the maximum likelihood method cannot be applied to the completely


L1 penalties have proven to be an attractive regularization device for nonparametric regression, image reconstruction, and model selection. For function estimation, L1 penalties, interpreted as

On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood Method

Abstract : A class of probability density estimates can be obtained by penalizing the likelihood by a functional which depends on the roughness of the logarithm of the density. The limiting case of

Adaptive piecewise polynomial estimation via trend filtering

Empirically, it is discovered that trend filtering estimates adapt to the local level of smoothness much better than smoothing splines, and further, they exhibit a remarkable similarity to locally adaptive regression splines.

Fast and Flexible ADMM Algorithms for Trend Filtering

This article presents a fast and robust algorithm for trend filtering, a recently developed nonparametric regression tool, that is competitive with the specialized interior point methods that are currently in use, and yet is far more numerically robust.

Nonparametric roughness penalties for probability densities

Given a number of observations xlt ...,xN, a nonparametric method is suggested for estimating the entire probability density curve. The method is to subtract a roughness penalty from the log

1 Trend Filtering

This paper proposes a variation on Hodrick-Prescott (H-P) filtering, a widely used method for trend estimation that substitutes a sum of absolute values for the sum of squares used in H-P filtering to penalize variations in the estimated trend.