# Accelerated Distributed Nesterov Gradient Descent

@inproceedings{Qu2019AcceleratedDN,
author={Guannan Qu and Ning Li},
year={2019}
}
• Published 2019
• Mathematics
• This paper considers the distributed optimization problem over a network, where the objective is to optimize a global function formed by a sum of local functions, using only local computation and communication. We develop an Accelerated Distributed Nesterov Gradient Descent (Acc-DNGD) method. When the objective function is convex and $L$ -smooth, we show that it achieves a $O(\frac{1}{t^{1.4-\epsilon}})$ convergence rate for all $\epsilon\in(0,1.4)$ . We also show the convergence rate can be… CONTINUE READING

Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

#### Citations

##### Publications citing this paper.
SHOWING 1-10 OF 36 CITATIONS

## A Sharp Convergence Rate Analysis for Distributed Accelerated Gradient Methods

• Mathematics
• 2018
VIEW 8 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

## Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

• Mathematics, Computer Science
• ArXiv
• 2019
VIEW 7 EXCERPTS
CITES METHODS, RESULTS & BACKGROUND
HIGHLY INFLUENCED

## A Dual Approach for Optimal Algorithms in Distributed Optimization over Networks

• Mathematics, Computer Science
• ArXiv
• 2018
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

## Gradient-Consensus Method for Distributed Optimization in Directed Multi-Agent Networks

• Computer Science, Engineering
• ArXiv
• 2019
VIEW 5 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

## Optimal distributed convex optimization on slowly time-varying graphs

• Mathematics
• 2019
VIEW 7 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

## A Unification, Generalization, and Acceleration of Exact Distributed First Order Methods

VIEW 6 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

## D-DistADMM: A O(1/k) Distributed ADMM for Distributed Optimization in Directed Graph Topologies

• Engineering, Computer Science, Mathematics
• ArXiv
• 2020
VIEW 1 EXCERPT
CITES METHODS

## Distributed Adaptive Newton Methods with Globally Superlinear Convergence

• Computer Science, Mathematics, Engineering
• ArXiv
• 2020
VIEW 1 EXCERPT
CITES METHODS

## Revisiting EXTRA for Smooth Distributed Optimization

• Mathematics, Computer Science
• ArXiv
• 2020
VIEW 3 EXCERPTS
CITES METHODS

## A Flexible Distributed Optimization Framework for Service of Concurrent Tasks in Processing Networks

• Computer Science
• IEEE INFOCOM 2019 - IEEE Conference on Computer Communications
• 2019
VIEW 1 EXCERPT
CITES METHODS

#### References

##### Publications referenced by this paper.
SHOWING 1-10 OF 36 REFERENCES

• Mathematics, Computer Science
• IEEE Transactions on Automatic Control
• 2011
VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

## Introductory Lectures on Convex Optimization - A Basic Course

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

## Harnessing smoothness to accelerate distributed optimization

• Computer Science
• 2016 IEEE 55th Conference on Decision and Control (CDC)
• 2016
VIEW 5 EXCERPTS

## Accelerated Distributed Nesterov Gradient Descent

• Mathematics
• 2019

## ADD-OPT: Accelerated Distributed Directed Optimization

• Computer Science, Mathematics
• IEEE Transactions on Automatic Control
• 2018
VIEW 3 EXCERPTS

## Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs

• Mathematics, Computer Science
• SIAM Journal on Optimization
• 2016
VIEW 3 EXCERPTS

## Geometrically convergent distributed optimization with uncoordinated step-sizes

• Mathematics, Computer Science
• 2017 American Control Conference (ACC)
• 2016
VIEW 3 EXCERPTS

## NEXT: In-Network Nonconvex Optimization

• Computer Science, Mathematics
• IEEE Transactions on Signal and Information Processing over Networks
• 2016
VIEW 2 EXCERPTS

## Augmented distributed gradient methods for multi-agent optimization under uncoordinated constant stepsizes

• Computer Science
• 2015 54th IEEE Conference on Decision and Control (CDC)
• 2015
VIEW 2 EXCERPTS

## Distributed nonconvex optimization over networks

• Mathematics, Computer Science
• 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)
• 2015
VIEW 2 EXCERPTS