Federated Learning of Deep Networks using Model Averaging
@article{McMahan2016FederatedLO, title={Federated Learning of Deep Networks using Model Averaging}, author={H. B. McMahan and Eider Moore and D. Ramage and B. A. Y. Arcas}, journal={ArXiv}, year={2016}, volume={abs/1602.05629} }
Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. [...] Key Method We term this decentralized approach Federated Learning.
We present a practical method for the federated learning of deep networks that proves robust to the unbalanced and non-IID data distributions that naturally arise.Expand
Figures, Tables, and Topics from this paper
271 Citations
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
- Computer Science, Mathematics
- CCS
- 2017
- 401
- Highly Influenced
- PDF
Federated Learning: Strategies for Improving Communication Efficiency
- Computer Science
- ArXiv
- 2016
- 1,172
- PDF
Network Update Compression for Federated Learning
- Computer Science
- 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP)
- 2020
Fidel: Reconstructing Private Training Samples from Weight Updates in Federated Learning
- Computer Science
- ArXiv
- 2021
- PDF
Evaluating the Communication Efficiency in Federated Learning Algorithms
- Computer Science
- ArXiv
- 2020
- 4
- Highly Influenced
- PDF
Decentralized Deep Learning with Arbitrary Communication Compression
- Computer Science, Mathematics
- ICLR
- 2020
- 49
- PDF
Accelerating DNN Training in Wireless Federated Edge Learning Systems
- Computer Science, Engineering
- IEEE Journal on Selected Areas in Communications
- 2021
- 34
- PDF
Crowdlearning: Crowded Deep Learning with Data Privacy
- Computer Science
- 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)
- 2018
- 4
- PDF
Distributed generation of privacy preserving data with user customization
- Computer Science, Mathematics
- ArXiv
- 2019
- 6
- PDF
Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraints
- Computer Science, Mathematics
- IEEE transactions on neural networks and learning systems
- 2020
- 44
- PDF
References
SHOWING 1-10 OF 41 REFERENCES
Privacy-preserving deep learning
- Computer Science
- 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)
- 2015
- 893
- PDF
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Computer Science
- ICML
- 2015
- 21,924
- PDF
Dropout: a simple way to prevent neural networks from overfitting
- Computer Science
- J. Mach. Learn. Res.
- 2014
- 21,726
- Highly Influential
- PDF
Distributed Learning, Communication Complexity and Privacy
- Computer Science, Mathematics
- COLT
- 2012
- 159
- PDF
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
- Computer Science
- CCS
- 2015
- 811
- PDF
ImageNet classification with deep convolutional neural networks
- Computer Science
- Commun. ACM
- 2012
- 60,860
- PDF
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization
- Computer Science, Mathematics
- J. Mach. Learn. Res.
- 2011
- 6,625
- PDF
Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss
- Mathematics, Computer Science
- ArXiv
- 2015
- 46
- PDF