Corpus ID: 211076268

# On the Communication Latency of Wireless Decentralized Learning

@article{Naderializadeh2020OnTC,
title={On the Communication Latency of Wireless Decentralized Learning},
journal={ArXiv},
year={2020},
volume={abs/2002.04069}
}
• Published in ArXiv 2020
• Computer Science, Mathematics
• We consider a wireless network comprising $n$ nodes located within a circular area of radius $R$, which are participating in a decentralized learning algorithm to optimize a global objective function using their local datasets. To enable gradient exchanges across the network, we assume each node communicates only with a set of neighboring nodes, which are within a distance $R n^{-\beta}$ of itself, where $\beta\in(0,\frac{1}{2})$. We use tools from network information theory and random… CONTINUE READING

Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

#### References

##### Publications referenced by this paper.
SHOWING 1-10 OF 27 REFERENCES

## MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling

• Mathematics, Computer Science
• ArXiv
• 2019
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

## Scheduling Policies for Federated Learning in Wireless Networks

• Computer Science, Mathematics, Engineering
• IEEE Transactions on Communications
• 2020

## Update Aware Device Scheduling for Federated Learning at the Wireless Edge

• Computer Science, Mathematics
• ArXiv
• 2020
VIEW 1 EXCERPT

## Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication

• Mathematics, Computer Science
• ICML
• 2019
VIEW 1 EXCERPT

## Energy-Efficient Radio Resource Allocation for Federated Edge Learning

• Mathematics, Computer Science
• ArXiv
• 2019

## Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air

• Computer Science
• 2019 IEEE International Symposium on Information Theory (ISIT)
• 2019

## Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification, and Local Computations

• Mathematics, Computer Science
• NeurIPS
• 2019
VIEW 1 EXCERPT

## Robust and Communication-Efficient Collaborative Learning

• Computer Science, Mathematics
• NeurIPS
• 2019
VIEW 1 EXCERPT

## Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

• Mathematics, Computer Science
• 2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)
• 2019

## Efficient Decentralized Deep Learning by Dynamic Model Averaging

VIEW 1 EXCERPT