An Empirical Analysis of the Laplace and Neural Tangent Kernels

@article{Lenceviius2022AnEA,
  title={An Empirical Analysis of the Laplace and Neural Tangent Kernels},
  author={Ronald Lencevi{\vc}ius},
  journal={ArXiv},
  year={2022},
  volume={abs/2208.03761}
}
The neural tangent kernel is a kernel function defined over the parameter distribution of an infinite width neural network. Despite the impracticality of this limit, the neural tangent kernel has allowed for a more direct study of neural networks and a gaze through the veil of their black box. More recently, it has been shown theoretically that the Laplace kernel and neural tangent kernel share the same reproducing kernel Hilbert space in the space of $\mathbb{S}^{d-1}$ alluding to their…