Learn More
I describe a framework for interpreting Support Vector Machines (SVMs) as maximum a posteriori (MAP) solutions to inference problems with Gaussian Process priors. This probabilistic interpretation can provide intuitive guidelines for choosing a 'good' SVM kernel. Beyond this, it allows Bayesian methods to be used for tackling two of the outstanding(More)
We attribute similarities in the rheology of many soft materials (foams, emulsions, slurries, etc.) to the shared features of structural disorder and metastability. A generic model for the mesoscopic dynamics of " soft glassy matter " is introduced, with interactions represented by a mean-field noise temperature x. We find power-law fluid behavior either(More)
We study the dynamics of the East model, comprising a chain of uncoupled spins in a downward-pointing field. Glassy effects arise at low temperatures T from the kinetic constraint that spins can only flip if their left neighbor is up. We give details of our previous solution of the nonequilibrium coarsening dynamics after a quench to low T [Phys. Rev. Lett.(More)
Within the context of learning a rule from examples, we study the general characteristics of learning with ensembles. The generalization performance achieved by a simple model ensemble of linear students is calculated exactly in the thermodynamic limit of a large number of input components and shows a surprisingly rich behavior. Our main findings are the(More)
I consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. A simple expression for the generalization error in terms of the eigenvalue decomposition of the covariance function is derived, and used as the starting point for several approximation schemes. I identify where these(More)
The equivalent kernel [1] is a way of understanding how Gaussian process regression works for large sample sizes based on a continuum limit. In this paper we show (1) how to approximate the equivalent kernel of the widely-used squared exponential (or Gaussian) kernel and related kernels , and (2) how analysis using the equivalent kernel helps to understand(More)