Minimax estimation of the L1 distance
@article{Jiao2016MinimaxEO, title={Minimax estimation of the L1 distance}, author={J. Jiao and Y. Han and T. Weissman}, journal={2016 IEEE International Symposium on Information Theory (ISIT)}, year={2016}, pages={750-754} }
We consider the problem of estimating the L1 distance between two discrete probability measures P and Q from empirical data in a nonasymptotic and large alphabet setting. We construct minimax rate-optimal estimators for L1(P,Q) when Q is either known or unknown, and show that the performance of the optimal estimators with n samples is essentially that of the Maximum Likelihood Estimators (MLE) with n ln n samples. Hence, we demonstrate that the effective sample size enlargement phenomenon… CONTINUE READING
Topics from this paper
55 Citations
Minimax rate-optimal estimation of KL divergence between discrete distributions
- Computer Science, Mathematics
- 2016 International Symposium on Information Theory and Its Applications (ISITA)
- 2016
- 30
- PDF
Adaptive estimation of Shannon entropy
- Mathematics, Computer Science
- 2015 IEEE International Symposium on Information Theory (ISIT)
- 2015
- 20
- PDF
On Estimation of L{r}-Norms in Gaussian White Noise Models
- Mathematics, Computer Science
- ArXiv
- 2017
- 17
- PDF
Minimax optimal estimators for additive scalar functionals of discrete distributions
- Mathematics, Computer Science
- 2017 IEEE International Symposium on Information Theory (ISIT)
- 2017
- 5
- PDF
Adaptive Estimation of Generalized Distance to Uniformity
- Mathematics, Computer Science
- 2018 IEEE International Symposium on Information Theory (ISIT)
- 2018
- 6
Efficient profile maximum likelihood for universal symmetric property estimation
- Mathematics, Computer Science
- STOC
- 2019
- 23
- PDF
The Nearest Neighbor Information Estimator is Adaptively Near Minimax Rate-Optimal
- Computer Science, Mathematics
- NeurIPS
- 2018
- 29
- PDF
References
SHOWING 1-10 OF 30 REFERENCES
Minimax Estimation of Discrete Distributions Under $\ell _{1}$ Loss
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2015
- 42
- PDF
Minimax Estimation of Functionals of Discrete Distributions
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2015
- 193
- PDF
Minimax Rates of Entropy Estimation on Large Alphabets via Best Polynomial Approximation
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2016
- 175
- PDF
The Power of Linear Estimators
- Mathematics, Computer Science
- 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science
- 2011
- 136
- PDF
TESTING COMPOSITE HYPOTHESES, HERMITE POLYNOMIALS AND OPTIMAL ESTIMATION OF A NONSMOOTH FUNCTIONAL
- Mathematics
- 2011
- 76
- PDF
Estimation of the entropy based on its polynomial representation.
- Mathematics, Medicine
- Physical review. E, Statistical, nonlinear, and soft matter physics
- 2012
- 21
- PDF