PAC-Bayesian Bounds based on the Rényi Divergence

  title={PAC-Bayesian Bounds based on the R{\'e}nyi Divergence},
  author={Luc B{\'e}gin and Pascal Germain and François Laviolette and Jean-Francis Roy},
We propose a simplified proof process for PAC-Bayesian generalization bounds, that allows to divide the proof in four successive inequalities, easing the “customization” of PAC-Bayesian theorems. We also propose a family of PAC-Bayesian bounds based on the Rényi divergence between the prior and posterior distributions, whereas most PACBayesian bounds are based on the KullbackLeibler divergence. Finally, we present an empirical evaluation of the tightness of each inequality of the simplified… CONTINUE READING

From This Paper

Figures, tables, and topics from this paper.

Explore Further: Topics Discussed in This Paper

Similar Papers

Loading similar papers…