• Corpus ID: 235253864

A Note On The Randomized Kaczmarz Method With A Partially Weighted Selection Step

@article{Gro2021ANO,
  title={A Note On The Randomized Kaczmarz Method With A Partially Weighted Selection Step},
  author={J{\"u}rgen Gro{\ss}},
  journal={ArXiv},
  year={2021},
  volume={abs/2105.14583}
}
  • J. Groß
  • Published 30 May 2021
  • Mathematics
  • ArXiv
In this note we reconsider two known algorithms which both usually converge faster than the randomized Kaczmarz method introduced by Strohmer and Vershynin(2009), but require the additional computation of all residuals of an iteration at each step. As already indicated in the literature, e.g. arXiv:2007.02910 and arXiv:2011.14693, it is shown that the non-randomized version of the two algorithms converges at least as fast as the randomized version, while still requiring computation of all… 

Figures and Tables from this paper

References

SHOWING 1-10 OF 32 REFERENCES
A Weighted Randomized Kaczmarz Method for Solving Linear Systems
TLDR
It is proved that if the $i-$th row is selected with likelihood proportional to $\left|\langle a_i, x_k \right\rangle - b_i\right|^{p}$, then the method de-randomizes and explains, among other things, why the maximal correction method works well.
A Randomized Kaczmarz Algorithm with Exponential Convergence
TLDR
A randomized version of the Kaczmarz method for consistent, overdetermined linear systems and it is proved that it converges with expected exponential rate and is the first solver whose rate does not depend on the number of equations in the system.
A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2021
  • URL https: //www.R-project.org/
  • 2021
Convergence of Adaptive, Randomized, Iterative Linear Solvers
TLDR
This work provides a general set of assumptions under which highly adapted, randomized or deterministic, row-action or column-action linear solvers are guaranteed to converge with probability one, and provides worst case rates of convergence.
Greed Works: An Improved Analysis of Sampling Kaczmarz-Motkzin
TLDR
This analysis improves upon previous known convergence bounds for SKM, capturing the benefit of partially greedy selection schemes and further generalizes previous known results, removing the theoretical assumptions that $\beta$ must be fixed at every iteration and that $A$ must have normalized rows.
A Kaczmarz Method with Simple Random Sampling for Solving Large Linear Systems
TLDR
Numerical experiments demonstrate the superiority of the new algorithms over many state-of-the-art randomized Kaczmarz methods for large linear systems problems and ridge regression problems.
A Note On Convergence Rate of Randomized Kaczmarz Method
TLDR
An alternative version of the randomized Kaczmarz method, which chooses each row of the coefficient matrix A with probability proportional to the square of the Euclidean norm of the residual of each corresponding equation is proposed.
Adaptive Sketch-and-Project Methods for Solving Linear Systems
TLDR
New adaptive sampling rules for the sketch-and-project method for solving linear systems are presented and it is concluded that the max-distance sampling rule is superior both experimentally and theoretically to the capped sampling rule.
...
1
2
3
4
...