Fast sparse matrix multiplication


Let <i>A</i> and <i>B</i> two <i>n</i>&#215;<i>n</i> matrices over a ring <i>R</i> (e.g., the reals or the integers) each containing at most <i>m</i> nonzero elements. We present a new algorithm that multiplies <i>A</i> and <i>B</i> using <i>O</i>(<i>m</i><sup>0.7</sup><i>n</i><sup>1.2</sup>+<i>n</i><sup>2+<i>o</i>(1)</sup>) algebraic operations (i.e., multiplications, additions and subtractions) over <i>R</i>. The na&#239;ve matrix multiplication algorithm, on the other hand, may need to perform &ohm;(<i>mn</i>) operations to accomplish the same task. For <i>m</i>&#8804;<i>n</i><sup>1.14</sup>, the new algorithm performs an almost optimal number of only <i>n</i><sup>2+<i>o</i>(1)</sup> operations. For <i>m</i>&#8804;<i>n</i><sup>1.68</sup>, the new algorithm is also faster than the best known matrix multiplication algorithm for dense matrices which uses <i>O</i>(<i>n</i><sup>2.38</sup>) algebraic operations. The new algorithm is obtained using a surprisingly straightforward combination of a simple combinatorial idea and existing fast <i>rectangular</i> matrix multiplication algorithms. We also obtain improved algorithms for the multiplication of more than two sparse matrices. As the known fast rectangular matrix multiplication algorithms are far from being practical, our result, at least for now, is only of theoretical value.

DOI: 10.1145/1077464.1077466

Extracted Key Phrases

3 Figures and Tables

Citations per Year

139 Citations

Semantic Scholar estimates that this publication has 139 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Yuster2004FastSM, title={Fast sparse matrix multiplication}, author={Raphael Yuster and Uri Zwick}, journal={ACM Trans. Algorithms}, year={2004}, volume={1}, pages={2-13} }