Dimensionality Dependent PAC-Bayes Margin Bound

  title={Dimensionality Dependent PAC-Bayes Margin Bound},
  author={Chi Jin and Liwei Wang},
Margin is one of the most important concepts in machine learning. Previous margin bounds, both for SVM and for boosting, are dimensionality independent. A major advantage of this dimensionality independency is that it can explain the excellent performance of SVM whose feature spaces are often of high or infinite dimension. In this paper we address the problem whether such dimensionality independency is intrinsic for the margin bounds. We prove a dimensionality dependent PAC-Bayes margin bound… CONTINUE READING