Agnostic PAC-Learning of Functions on Analog Neural Nets

We consider learning on multilayer neural nets with piecewise polynomial activation functions and a fixed number k of numerical inputs. We exhibit arbitrarily large network architectures for which efficient and provably successful learning algorithms exist in the rather realistic refinement of Valiant’s model for probably approximately correct learning… CONTINUE READING