Sharp asymptotic and finite-sample rates of convergence of empirical measures in Wasserstein distance

@article{Weed2017SharpAA,
  title={Sharp asymptotic and finite-sample rates of convergence of empirical measures in Wasserstein distance},
  author={Jonathan Weed and Francis R. Bach},
  journal={Bernoulli},
  year={2017}
}
  • J. WeedF. Bach
  • Published 1 July 2017
  • Mathematics, Computer Science
  • Bernoulli
The Wasserstein distance between two probability measures on a metric space is a measure of closeness with applications in statistics, probability, and machine learning. In this work, we consider the fundamental question of how quickly the empirical measure obtained from $n$ independent samples from $\mu$ approaches $\mu$ in the Wasserstein distance of any order. We prove sharp asymptotic and finite-sample results for this rate of convergence for general measures on general compact metric… 
View PDF on arXiv
307 Citations
Highly Influential Citations
37
Background Citations
157
Methods Citations
48
Results Citations
13

307 Citations

Convergence and concentration of empirical measures under Wasserstein distance in unbounded functional spaces

  • Jing Lei
  • Mathematics, Computer Science
    Bernoulli
  • 2020
Upper bounds of the expected Wasserstein distance between a probability measure and its empirical version are provided, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces and covering the important case of Gaussian processes in separable Hilbert spaces.

Convergence of the empirical measure in expected Wasserstein distance: non asymptotic explicit bounds in $\mathbb{R}^d$

Some non asymptotic bounds are provided that measure the rate of convergence, in expected Wasserstein distance, of the empirical measure associated to an i.i.d. N -sample of a given probability distribution on R d .

Convergence rates for empirical measures of Markov chains in dual and Wasserstein distances

Minimax estimation of smooth densities in Wasserstein distance

The first minimax-optimal rates for this problem for general Wasserstein distances are given, and it is shown that, unlike classical nonparametric density estimation, these rates depend on whether the densities in question are bounded below.

Distributional Convergence of the Sliced Wasserstein Process

A framework is obtained in which to prove distributional limit results for all Wasserstein distances based on one-dimensional projections and illustrates these results on a number of examples where no distributional limits were previously known.

Limit distribution theory for smooth $p$-Wasserstein distances

The limit distribution theory is used to study applications to generative modeling via minimum distance estimation with the smooth Wasserstein distance, showing asymptotic normality of optimal solutions for the quadratic cost.

Empirical measures and random walks on compact spaces in the quadratic Wasserstein metric

. Estimating the rate of convergence of the empirical measure of an i.i.d. sample to the reference measure is a classical problem in probability theory. Extending recent results of Ambrosio, Stra and…

Wasserstein Convergence for Conditional Empirical Measures of Subordinated Dirichlet Diffusions on Riemannian Manifolds

The asymptotic behaviour of empirical measures has plenty of studies. However, the research on conditional empirical measures is limited. Being the development of Wang [26], under the quadratic…

Smooth p-Wasserstein Distance: Structure, Empirical Approximation, and Statistical Applications

It is proved that W p enjoys a parametric empirical convergence rate of n−1/2, which contrasts the n−2/d rate for unsmoothed Wp when d ≥ 3, and asymptotic guarantees for two-sample testing and minimum distance estimation using W p are provided.

Estimation of smooth densities in Wasserstein distance

It is proved the first minimax rates for estimation of smooth densities for general Wasserstein distances, thereby showing how the curse of dimensionality can be alleviated for sufficiently regular measures.
...

References

SHOWING 1-10 OF 66 REFERENCES

On the mean speed of convergence of empirical and occupation measures in Wasserstein distance

It is found that rates for empirical or occupation measures match or are close to previously known optimal quantization rates in several cases, notably highlighted in the example of infinite-dimensional Gaussian measures.

Simple Bounds for the Convergence of Empirical and Occupation Measures in 1-Wasserstein Distance

We study the problem of non-asymptotic deviations between a reference measure and its empirical version, in the 1-Wasserstein metric, under the standing assumption that the reference measure…

Learning Probability Measures with respect to Optimal Transport Metrics

By establishing a precise connection between optimal transport metrics, optimal quantization, and learning theory, new probabilistic bounds are derived for the performance of a classic algorithm in unsupervised learning (k-means), when used to produce a probability measure derived from the data.

Constructive quantization: Approximation by empirical measures

This article shows that quantization by empirical measures is of optimal order under weak assumptions, and provides a universal estimate based on moments, a so-called Pierce type estimate.

A sharp estimate of the binomial mean absolute deviation with applications

Approximation by finitely supported measures

We consider the problem of approximating a probability measure defined on a metric space by a measure supported on a finite number of points. More specifically we seek the asymptotic behavior of the…

Matrix random products with singular harmonic measure

Any Zariski dense countable subgroup of $${SL(d, \mathbb {R})}$$ is shown to carry a non-degenerate finitely supported symmetric random walk such that its harmonic measure on the flag space is…

Concentration of measure and isoperimetric inequalities in product spaces

The concentration of measure phenomenon in product spaces roughly states that, if a set A in a product ΩN of probability spaces has measure at least one half, “most” of the points of Ωn are “close”…

On the rate of convergence in Wasserstein distance of the empirical measure

Let $$\mu _N$$μN be the empirical measure associated to a $$N$$N-sample of a given probability distribution $$\mu $$μ on $$\mathbb {R}^d$$Rd. We are interested in the rate of convergence of $$\mu…

Multiscale geometric methods for data sets I: Multiscale SVD, noise and curvature

...