Asymptotically minimax Bayesian predictive densities for multinomial models

@article{Komaki2011AsymptoticallyMB,
  title={Asymptotically minimax Bayesian predictive densities for multinomial models},
  author={Fumiyasu Komaki},
  journal={arXiv: Statistics Theory},
  year={2011}
}
  • F. Komaki
  • Published 5 December 2011
  • Mathematics, Computer Science
  • arXiv: Statistics Theory
One-step ahead prediction for the multinomial model is considered. The performance of a predictive density is evaluated by the average Kullback-Leibler divergence from the true density to the predictive density. Asymptotic approximations of risk functions of Bayesian predictive densities based on Dirichlet priors are obtained. It is shown that a Bayesian predictive density based on a specific Dirichlet prior is asymptotically minimax. The asymptotically minimax prior is different from known… 
View PDF on arXiv
8 Citations
Highly Influential Citations
1
Background Citations
6
Methods Citations
1

8 Citations

Citation Type

Citation Type

Asymptotically Constant-Risk Predictive Densities When the Distributions of Data and Target Variables Are Different
TLDR
This work investigates the asymptotic construction of constant-risk Bayesian predictive densities under the Kullback–Leibler risk and applies the theory to the subminimax estimator problem and the prediction based on the binary regression model.
Bayesian shrinkage approaches to unbalanced problems of estimation and prediction on the basis of negative multinomial samples
  • Y. Hamura
  • Mathematics
    Japanese Journal of Statistics and Data Science
  • 2021
In this paper, we treat estimation and prediction problems where negative multinomial variables are observed and in particular consider unbalanced settings. First, the problem of estimating multiple…
Bayesian point estimation and predictive density estimation for the binomial distribution with a restricted probability parameter
  • Y. Hamura
  • Mathematics
    Communications in Statistics - Theory and Methods
  • 2021
In this paper, we consider Bayesian point estimation and predictive density estimation in the binomial case. First, preliminary results on these problems are presented. Next, we compare the risk…
Relations Between the Conditional Normalized Maximum Likelihood Distributions and the Latent Information Priors
TLDR
The relations between the conditional normalized maximum likelihood (CNML) distributions and Bayesian predictive densities based on the latent information priors (LIPs) are revealed and it is proved that the sum of the Bayes projection divergence of CNML3 and the conditional mutual information is asymptotically constant.
Bayesian Estimation of Multinomial Cell Probabilities Incorporating Information from Aggregated Observations
In this note, we consider the problem of estimating multinomial cell probabilities under the entropy loss when side information in aggregated data is available. We use the Jeffreys prior to obtain…
Achievability of Asymptotic Minimax Regret in Online and Batch Prediction
TLDR
The numerical experiments support the conjecture about non-achievability by so called last-step minimax algorithms, which are independent of n and show that in the multinomial model, a Bayes mixture dened by the conjugate Dirichlet prior with a simple dependency on n achieves asymptotic minimaxity for all sequences, thus providing a simpler asymptic minimax strategy compared to earlier work by Xie and Barron.
Achievability of Asymptotic Minimax Regret in Online and Batch Prediction
TLDR
The numerical experiments support the conjecture about non-achievability by so called last-step minimax algorithms, which are independent of n and show that in the multinomial model, a Bayes mixture defined by the conjugate Dirichlet prior with a simple dependency on n achieves asymptotic minimaxity for all sequences.
Mathematical Analysis of propensity of aberration on the methods for interval estimation of the multinomial proportions
The multinomial distribution has found applications in many practical situations that deal with a discrete random variable with k possibilities (k > 2). Interval estimation for the proportion…

References

SHOWING 1-10 OF 13 REFERENCES
Bayesian predictive densities based on latent information priors
Simultaneous prediction of independent Poisson observables
Simultaneous predictive distributions for independent Poisson observables are investigated. A class of improper prior distributions for Poisson means is introduced. The Bayesian predictive…
On asymptotic properties of predictive distributions
SUMMARY Second-order asymptotic theory of predictive distributions is investigated. It is shown that estimative distributions with asymptotically efficient estimators can be improved to predictive…
Jeffreys' prior is asymptotically least favorable under entropy risk
Reference Posterior Distributions for Bayesian Inference
SUMMARY A procedure is proposed to derive reference posterior distributions which approximately describe the inferential content of the data without incorporating any other information. More…
Information optimality and Bayesian modelling
Goodness of prediction fit
SUMMARY Fitting a parametric model or estimating a parametric density function plays an important role in a number of statistical applications. Two widely-used methods, one replacing the unknown…
Estimating a Product of Means: Bayesian Analysis with Reference Priors
Abstract Suppose that we observe X ∼ N(α, 1) and, independently, Y ∼ N(β, 1), and are concerned with inference (mainly estimation and confidence statements) about the product of means θ = αβ. This…
Reference Analysis
Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory
We describe and develop a close relationship between two problems that have customarily been regarded as distinct: that of maximizing entropy, and that of minimizing worst-case expected loss. Using a…
...
1
2
...