# Maximum Likelihood Estimation of Functionals of Discrete Distributions

@article{Jiao2017MaximumLE,
title={Maximum Likelihood Estimation of Functionals of Discrete Distributions},
author={J. Jiao and K. Venkat and Y. Han and T. Weissman},
journal={IEEE Transactions on Information Theory},
year={2017},
volume={63},
pages={6774-6798}
}
• J. Jiao, +1 author T. Weissman
• Published 2017
• Mathematics, Computer Science
• IEEE Transactions on Information Theory
• We consider the problem of estimating functionals of discrete distributions, and focus on a tight (up to universal multiplicative constants for each specific functional) nonasymptotic analysis of the worst case squared error risk of widely used estimators. We apply concentration inequalities to analyze the random fluctuation of these estimators around their expectations and the theory of approximation using positive linear operators to analyze the deviation of their expectations from the true… CONTINUE READING
78 Citations

#### Explore Further: Topics Discussed in This Paper

Maximum Likelihood Estimation of information measures
• Mathematics, Computer Science
• 2015 IEEE International Symposium on Information Theory (ISIT)
• 2015
• 5
Minimax Estimation of Functionals of Discrete Distributions
• Mathematics, Computer Science
• IEEE Transactions on Information Theory
• 2015
• 193
• PDF
Minimax Estimation of Discrete Distributions Under $\ell _{1}$ Loss
• Mathematics, Computer Science
• IEEE Transactions on Information Theory
• 2015
• 42
• PDF
Does dirichlet prior smoothing solve the Shannon entropy estimation problem?
• Mathematics, Computer Science
• 2015 IEEE International Symposium on Information Theory (ISIT)
• 2015
• 6
• PDF
Minimax estimation of discrete distributions
• Mathematics, Computer Science
• 2015 IEEE International Symposium on Information Theory (ISIT)
• 2015
• 12
Ensemble Estimation of Information Divergence †
• Mathematics, Computer Science
• Entropy
• 2018
• 12
• PDF
Minimax estimation of information measures
• Mathematics, Computer Science
• 2015 IEEE International Symposium on Information Theory (ISIT)
• 2015
• 1
Chernoff-Type Concentration of Empirical Probabilities in Relative Entropy
• Computer Science, Mathematics
• IEEE Transactions on Information Theory
• 2021
• PDF
Minimax Optimal Additive Functional Estimation with Discrete Distribution: Slow Divergence Speed Case
• Mathematics, Computer Science
• 2018 IEEE International Symposium on Information Theory (ISIT)
• 2018
• PDF

#### References

SHOWING 1-10 OF 106 REFERENCES
Minimax Estimation of Functionals of Discrete Distributions
• Mathematics, Computer Science
• IEEE Transactions on Information Theory
• 2015
• 193
• PDF
Minimax Estimation of Discrete Distributions Under $\ell _{1}$ Loss
• Mathematics, Computer Science
• IEEE Transactions on Information Theory
• 2015
• 42
• PDF
Minimax estimation of discrete distributions
• Mathematics, Computer Science
• 2015 IEEE International Symposium on Information Theory (ISIT)
• 2015
• 12
Some worst-case bounds for Bayesian estimators of discrete distributions
• S. Schober
• Mathematics, Computer Science
• 2013 IEEE International Symposium on Information Theory
• 2013
• 8
Estimation of Entropy and Mutual Information
• L. Paninski
• Mathematics, Computer Science
• Neural Computation
• 2003
• 1,107
• Highly Influential
• PDF