Streaming kernel regression with provably adaptive mean, variance, and regularization
@article{Durand2018StreamingKR, title={Streaming kernel regression with provably adaptive mean, variance, and regularization}, author={A. Durand and O. Maillard and Joelle Pineau}, journal={ArXiv}, year={2018}, volume={abs/1708.00768} }
We consider the problem of streaming kernel regression, when the observations arrive sequentially and the goal is to recover the underlying mean function, assumed to belong to an RKHS. The variance of the noise is not assumed to be known. In this context, we tackle the problem of tuning the regularization parameter adaptively at each time step, while maintaining tight confidence bounds estimates on the value of the mean function at each point. To this end, we first generalize existing results… CONTINUE READING
Figures and Topics from this paper
17 Citations
No-regret Bayesian Optimization with Unknown Hyperparameters
- Computer Science, Mathematics
- J. Mach. Learn. Res.
- 2019
- 16
- PDF
Online Learning in Kernelized Markov Decision Processes
- Computer Science, Mathematics
- AISTATS
- 2019
- 10
- PDF
Bridging Exploration and General Function Approximation in Reinforcement Learning: Provably Efficient Kernel and Neural Value Iterations
- Computer Science
- ArXiv
- 2020
- 3
No-regret Algorithms for Multi-task Bayesian Optimization
- Computer Science, Mathematics
- ArXiv
- 2020
- 1
- Highly Influenced
- PDF
References
SHOWING 1-10 OF 26 REFERENCES
Empirical Bernstein Bounds and Sample-Variance Penalization
- Mathematics, Computer Science
- COLT
- 2009
- 265
- Highly Influential
- PDF
Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design
- Computer Science, Mathematics
- ICML
- 2010
- 1,194
- Highly Influential
- PDF
Finite-Time Analysis of Kernelised Contextual Bandits
- Computer Science, Mathematics
- UAI
- 2013
- 90
- Highly Influential
- PDF
Thompson Sampling for Contextual Bandits with Linear Payoffs
- Computer Science, Mathematics
- ICML
- 2013
- 486
- PDF
Gaussian Processes for Machine Learning
- Computer Science
- Adaptive computation and machine learning
- 2009
- 13,775
- PDF
Practical Bayesian Optimization of Machine Learning Algorithms
- Computer Science, Mathematics
- NIPS
- 2012
- 3,642
- PDF
Theoretical Analysis of Bayesian Optimisation with Unknown Gaussian Process Hyper-Parameters
- Computer Science, Mathematics
- ArXiv
- 2014
- 44
- PDF