Compressive Statistical Learning with Random Feature Moments
@article{Gribonval2017CompressiveSL, title={Compressive Statistical Learning with Random Feature Moments}, author={R. Gribonval and G. Blanchard and N. Keriven and Y. Traonmilin}, journal={ArXiv}, year={2017}, volume={abs/1706.07180} }
We describe a general framework --compressive statistical learning-- for resource-efficient large-scale learning: the training collection is compressed in one pass into a low-dimensional sketch (a vector of random empirical generalized moments) that captures the information relevant to the considered learning task. A near-minimizer of the risk is computed from the sketch through the solution of a nonlinear least squares problem. We investigate sufficient sketch sizes to control the… CONTINUE READING
Paper Mentions
40 Citations
Statistical Learning Guarantees for Compressive Clustering and Compressive Mixture Modeling
- Computer Science, Mathematics
- ArXiv
- 2020
- 1
- PDF
Compressive Learning for Semi-Parametric Models
- Computer Science, Mathematics
- ArXiv
- 2019
- 1
- Highly Influenced
- PDF
Quantized Compressive K-Means
- Computer Science, Mathematics
- IEEE Signal Processing Letters
- 2018
- 10
- Highly Influenced
- PDF
Sketching for large-scale learning of mixture models
- Computer Science, Mathematics
- 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- 2016
- 48
- PDF
When compressive learning fails: blame the decoder or the sketch?
- Computer Science, Mathematics
- ArXiv
- 2020
- Highly Influenced
- PDF
Differentially Private Compressive K-means
- Computer Science
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- 2019
- 6
- PDF
Compressive Independent Component Analysis
- Mathematics, Computer Science
- 2019 27th European Signal Processing Conference (EUSIPCO)
- 2019
- 3
- Highly Influenced
Compressive Learning of Generative Networks
- Computer Science, Mathematics
- ESANN
- 2020
- Highly Influenced
- PDF
Support Localization and the Fisher Metric for off-the-grid Sparse Regularization
- Computer Science, Mathematics
- AISTATS
- 2019
- 10
- PDF
A Dual Certificates Analysis of Compressive Off-the-Grid Recovery
- Computer Science, Mathematics
- ArXiv
- 2018
- 7
References
SHOWING 1-10 OF 105 REFERENCES
Sketching for large-scale learning of mixture models
- Computer Science, Mathematics
- 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- 2016
- 48
- PDF
Compressive Gaussian Mixture estimation
- Computer Science
- 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
- 2013
- 16
- PDF
New Analysis of Manifold Embeddings and Signal Recovery from Compressive Measurements
- Mathematics, Computer Science
- ArXiv
- 2013
- 56
- PDF
Online Learning for Matrix Factorization and Sparse Coding
- Computer Science, Mathematics
- J. Mach. Learn. Res.
- 2010
- 2,336
- PDF
A spectral algorithm for learning mixture models
- Computer Science, Mathematics
- J. Comput. Syst. Sci.
- 2004
- 190
- PDF
Compressive K-means
- Computer Science, Mathematics
- 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- 2017
- 31
- PDF
Learning mixtures of spherical gaussians: moment methods and spectral decompositions
- Computer Science, Mathematics
- ITCS '13
- 2013
- 265
- PDF
The More, the Merrier: the Blessing of Dimensionality for Learning Large Gaussian Mixtures
- Computer Science, Mathematics
- COLT
- 2014
- 73
- PDF