Generalization Bounds for Uniformly Stable Algorithms
@inproceedings{Feldman2018GeneralizationBF, title={Generalization Bounds for Uniformly Stable Algorithms}, author={V. Feldman and J. Vondr{\'a}k}, booktitle={NeurIPS}, year={2018} }
Uniform stability of a learning algorithm is a classical notion of algorithmic stability introduced to derive high-probability bounds on the generalization error (Bousquet and Elisseeff, 2002. [...] Key Result Our proofs are based on new analysis techniques and our results imply substantially stronger generalization guarantees for several well-studied algorithms.Expand Abstract
Supplemental Video
Topics from this paper
25 Citations
High probability generalization bounds for uniformly stable algorithms with nearly optimal rate
- Computer Science, Mathematics
- COLT
- 2019
- 38
- PDF
An Exponential Efron-Stein Inequality for Lq Stable Learning Rules
- Mathematics, Computer Science
- ArXiv
- 2019
- 1
- PDF
Sharper bounds for uniformly stable algorithms
- Mathematics, Computer Science
- COLT
- 2020
- 21
- Highly Influenced
- PDF
High probability convergence and uniform stability bounds for nonconvex stochastic gradient descent
- Mathematics
- 2020
- 2
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses
- Computer Science, Mathematics
- NeurIPS
- 2020
- 11
- PDF
Sharper Generalization Bounds for Pairwise Learning
- Computer Science, Mathematics
- NeurIPS
- 2020
- 1
- Highly Influenced
- PDF
References
SHOWING 1-10 OF 40 REFERENCES
High probability generalization bounds for uniformly stable algorithms with nearly optimal rate
- Computer Science, Mathematics
- COLT
- 2019
- 38
- PDF
On the Complexity of Linear Prediction: Risk Bounds, Margin Bounds, and Regularization
- Computer Science, Mathematics
- NIPS
- 2008
- 269
- PDF
Stability of Randomized Learning Algorithms
- Mathematics, Computer Science
- J. Mach. Learn. Res.
- 2005
- 103
- PDF
Stability and Convergence Trade-off of Iterative Optimization Algorithms
- Mathematics, Computer Science
- ArXiv
- 2018
- 34
- PDF
Generalization of ERM in Stochastic Convex Optimization: The Dimension Strikes Back
- Computer Science, Mathematics
- NIPS
- 2016
- 26
- PDF
On the Generalization Ability of Online Learning Algorithms for Pairwise Loss Functions
- Computer Science, Mathematics
- ICML
- 2013
- 70
- PDF
On the generalization ability of on-line learning algorithms
- Computer Science, Mathematics
- IEEE Transactions on Information Theory
- 2004
- 472
- PDF