# On the Suboptimality of Proximal Gradient Descent for $\ell^{0}$ Sparse Approximation

@article{Yang2017OnTS,
title={On the Suboptimality of Proximal Gradient Descent for \$\ell^\{0\}\$ Sparse Approximation},
author={Yingzhen Yang and Jiashi Feng and Nebojsa Jojic and Jianchao Yang and Thomas S. Huang},
journal={CoRR},
year={2017},
volume={abs/1709.01230}
}
We study the proximal gradient descent (PGD) method for l sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded gap between the sub-optimal solution by PGD and the globally optimal solution for the l sparse approximation problem under conditions weaker than Restricted Isometry Property widely used in compressive sensing literature. Moreover, we propose randomized algorithms to… CONTINUE READING
Related Discussions
This paper has been referenced on Twitter 4 times. VIEW TWEETS

#### Citations

##### Publications citing this paper.
Showing 1-2 of 2 extracted citations

## Improved Solution to the $\ell_{0}$ Regularized Optimization Problem via Dictionary-Reduced Initial Guess

2018 IEEE 13th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP) • 2018
View 8 Excerpts
Highly Influenced

## FAST CONVOLUTIONAL SPARSE CODING WITH ℓ0 PENALTY

2018 IEEE XXV International Conference on Electronics, Electrical Engineering and Computing (INTERCON) • 2018
View 2 Excerpts

#### References

##### Publications referenced by this paper.
Showing 1-8 of 8 references

COLT • 2018

## ISSN 0025-5610

August
doi: 10.1007/s10107-013-0701-9. Kristian Bredies and Dirk A. Lorenz. Iterated hard shrinkage for minimization problems • 2014

## B

Oct
K. Natarajan. Sparse approximate solutions to linear systems. SIAM Journal on Com- • 2006

## Improved Approximation Algorithms for Large Matrices via Random Projections

2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06) • 2006

## An elementary proof of a theorem of Johnson and Lindenstrauss

Random Struct. Algorithms • 2003

## ISSN 0022-0000

June
doi: 10.1016/S0022-0000(03)00025-4. URL • 2003

## The Johnson-Lindenstrauss lemma and the sphericity of some graphs

J. Comb. Theory, Ser. B • 1988