PAC-Bayesian Aggregation without Cross-Validation


We propose a new PAC-Bayesian procedure for aggregating prediction models and a new way of constructing a hypothesis space with which the procedure works particularly well. The procedure is based on alternating minimization of a new PAC-Bayesian bound, which is convex in the posterior distribution used for aggregation and also convex in a trade-off… (More)