Maximum Likelihood Estimation of Functionals of Discrete Distributions
@article{Jiao2017MaximumLE, title={Maximum Likelihood Estimation of Functionals of Discrete Distributions}, author={J. Jiao and K. Venkat and Y. Han and T. Weissman}, journal={IEEE Transactions on Information Theory}, year={2017}, volume={63}, pages={6774-6798} }
We consider the problem of estimating functionals of discrete distributions, and focus on a tight (up to universal multiplicative constants for each specific functional) nonasymptotic analysis of the worst case squared error risk of widely used estimators. We apply concentration inequalities to analyze the random fluctuation of these estimators around their expectations and the theory of approximation using positive linear operators to analyze the deviation of their expectations from the true… CONTINUE READING
78 Citations
Maximum Likelihood Estimation of information measures
- Mathematics, Computer Science
- 2015 IEEE International Symposium on Information Theory (ISIT)
- 2015
- 5
Minimax Estimation of Functionals of Discrete Distributions
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2015
- 193
- PDF
Minimax Estimation of Discrete Distributions Under $\ell _{1}$ Loss
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2015
- 42
- PDF
Does dirichlet prior smoothing solve the Shannon entropy estimation problem?
- Mathematics, Computer Science
- ISIT
- 2015
- 1
Does dirichlet prior smoothing solve the Shannon entropy estimation problem?
- Mathematics, Computer Science
- 2015 IEEE International Symposium on Information Theory (ISIT)
- 2015
- 6
- PDF
Minimax estimation of discrete distributions
- Mathematics, Computer Science
- 2015 IEEE International Symposium on Information Theory (ISIT)
- 2015
- 12
Minimax estimation of information measures
- Mathematics, Computer Science
- 2015 IEEE International Symposium on Information Theory (ISIT)
- 2015
- 1
Chernoff-Type Concentration of Empirical Probabilities in Relative Entropy
- Computer Science, Mathematics
- IEEE Transactions on Information Theory
- 2021
- PDF
Minimax Optimal Additive Functional Estimation with Discrete Distribution: Slow Divergence Speed Case
- Mathematics, Computer Science
- 2018 IEEE International Symposium on Information Theory (ISIT)
- 2018
- PDF
References
SHOWING 1-10 OF 106 REFERENCES
Minimax Estimation of Functionals of Discrete Distributions
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2015
- 193
- PDF
Minimax Estimation of KL Divergence between Discrete Distributions
- Computer Science, Mathematics
- ArXiv
- 2016
- 16
- PDF
Minimax Estimation of Discrete Distributions Under $\ell _{1}$ Loss
- Mathematics, Computer Science
- IEEE Transactions on Information Theory
- 2015
- 42
- PDF
Minimax estimation of discrete distributions
- Mathematics, Computer Science
- 2015 IEEE International Symposium on Information Theory (ISIT)
- 2015
- 12
Bayesian estimation of discrete entropy with mixtures of stick-breaking priors
- Computer Science, Mathematics
- NIPS
- 2012
- 12
- PDF
Some worst-case bounds for Bayesian estimators of discrete distributions
- Mathematics, Computer Science
- 2013 IEEE International Symposium on Information Theory
- 2013
- 8
Estimation of Entropy and Mutual Information
- Mathematics, Computer Science
- Neural Computation
- 2003
- 1,107
- Highly Influential
- PDF