# A Note On The Randomized Kaczmarz Method With A Partially Weighted Selection Step

@article{Gro2021ANO, title={A Note On The Randomized Kaczmarz Method With A Partially Weighted Selection Step}, author={J{\"u}rgen Gro{\ss}}, journal={ArXiv}, year={2021}, volume={abs/2105.14583} }

In this note we reconsider two known algorithms which both usually converge faster than the randomized Kaczmarz method introduced by Strohmer and Vershynin(2009), but require the additional computation of all residuals of an iteration at each step. As already indicated in the literature, e.g. arXiv:2007.02910 and arXiv:2011.14693, it is shown that the non-randomized version of the two algorithms converges at least as fast as the randomized version, while still requiring computation of all…

## References

SHOWING 1-10 OF 32 REFERENCES

A Weighted Randomized Kaczmarz Method for Solving Linear Systems

- MathematicsMath. Comput.
- 2021

It is proved that if the $i-$th row is selected with likelihood proportional to $\left|\langle a_i, x_k \right\rangle - b_i\right|^{p}$, then the method de-randomizes and explains, among other things, why the maximal correction method works well.

A Randomized Kaczmarz Algorithm with Exponential Convergence

- Computer Science
- 2007

A randomized version of the Kaczmarz method for consistent, overdetermined linear systems and it is proved that it converges with expected exponential rate and is the first solver whose rate does not depend on the number of equations in the system.

Paved with Good Intentions: Analysis of a Randomized Block Kaczmarz Method

- MathematicsArXiv
- 2012

A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2021

- URL https: //www.R-project.org/
- 2021

Convergence of Adaptive, Randomized, Iterative Linear Solvers

- Computer Science, MathematicsArXiv
- 2021

This work provides a general set of assumptions under which highly adapted, randomized or deterministic, row-action or column-action linear solvers are guaranteed to converge with probability one, and provides worst case rates of convergence.

Greed Works: An Improved Analysis of Sampling Kaczmarz-Motkzin

- Computer ScienceSIAM J. Math. Data Sci.
- 2021

This analysis improves upon previous known convergence bounds for SKM, capturing the benefit of partially greedy selection schemes and further generalizes previous known results, removing the theoretical assumptions that $\beta$ must be fixed at every iteration and that $A$ must have normalized rows.

A Kaczmarz Method with Simple Random Sampling for Solving Large Linear Systems

- Computer Science, MathematicsArXiv
- 2020

Numerical experiments demonstrate the superiority of the new algorithms over many state-of-the-art randomized Kaczmarz methods for large linear systems problems and ridge regression problems.

A Note On Convergence Rate of Randomized Kaczmarz Method

- Mathematics, Computer Science
- 2020

An alternative version of the randomized Kaczmarz method, which chooses each row of the coefficient matrix A with probability proportional to the square of the Euclidean norm of the residual of each corresponding equation is proposed.

A new greedy Kaczmarz algorithm for the solution of very large linear systems

- Computer Science, MathematicsAppl. Math. Lett.
- 2019

Adaptive Sketch-and-Project Methods for Solving Linear Systems

- Mathematics, Computer ScienceArXiv
- 2019

New adaptive sampling rules for the sketch-and-project method for solving linear systems are presented and it is concluded that the max-distance sampling rule is superior both experimentally and theoretically to the capped sampling rule.