Constructing Fast Approximate Eigenspaces With Application to the Fast Graph Fourier Transforms

@article{Rusu2021ConstructingFA,
  title={Constructing Fast Approximate Eigenspaces With Application to the Fast Graph Fourier Transforms},
  author={Cristian Rusu and Lorenzo Rosasco},
  journal={IEEE Transactions on Signal Processing},
  year={2021},
  volume={69},
  pages={5037-5050}
}
  • Cristian Rusu, L. Rosasco
  • Published 22 February 2020
  • Computer Science, Engineering, Mathematics
  • IEEE Transactions on Signal Processing
We investigate numerically efficient approximations of eigenspaces associated with symmetric and general matrices. The eigenspaces are factored into a fixed number of fundamental components that can be efficiently manipulated which we consider to be extended orthogonal Givens or scaling and shear transformations. The number of these components controls the trade-off between approximation accuracy and the computational complexity of projecting on the eigenspaces. We write minimization problems… 

Figures from this paper

An iterative Jacobi-like algorithm to compute a few sparse eigenvalue-eigenvector pairs
TLDR
A new algorithm to compute the extreme eigenvalue/eigenvector pairs of a symmetric matrix and shows applications to random symmetric matrices, graph Fourier transforms, and with the sparse principal component analysis in image classification experiments.
An iterative coordinate descent algorithm to compute sparse low-rank approximations
  • Cristian Rusu
  • Computer Science, Engineering
    IEEE Signal Processing Letters
  • 2021
TLDR
The proposed algorithm can be viewed as an extension of the Kogbetliantz algorithm to build an approximate singular value decomposition for a few principal components and perform dimensionality reduction for classification applications.

References

SHOWING 1-10 OF 28 REFERENCES
An algorithm for the machine calculation of complex Fourier series
An efficient method for the calculation of the interactions of a 2' factorial ex- periment was introduced by Yates and is widely known by his name. The generaliza- tion to 3' was given by Box et al.
Approximating Orthogonal Matrices with Effective Givens Factorization
TLDR
It is shown that minimizing a sparsity-inducing objective with a coordinate descent algorithm on the unitary group yields good factorizations for structured matrices, including the graph Fourier transform, which is the matrix obtained when diagonalizing a graph Laplacian.
Fast approximation of orthogonal matrices and application to PCA
TLDR
An efficient greedy algorithm is proposed to solve the problem of approximating orthogonal matrices so that their application is numerically fast and yet accurate, and it strikes a balance between approximation accuracy and speed of computation.
Asymmetric Multiresolution Matrix Factorization
TLDR
Techniques for extending MMF to any square matrix are explored, and it is shown that a combined low-rank and MMF approach, which amounts to removing a small global-scale component of the matrix and then extracting hierarchical structure from the residual, is even more effective than each of the two complementary methods for matrix compression.
Approximate Fast Graph Fourier Transforms via Multilayer Sparse Approximations
TLDR
This paper proposes a method to obtain approximate graph Fourier transforms that can be applied rapidly and stored efficiently, carried out using a modified version of the famous Jacobi eigenvalues algorithm.
Learning Multiplication-free Linear Transformations
In this paper, we propose several dictionary learning algorithms for sparse representations that also impose specific structures on the learned dictionaries such that they are numerically efficient
Learning Fast Sparsifying Transforms
TLDR
This paper constructs orthogonal and nonorthogonal dictionaries that are factorized as a product of a few basic transformations and shows how the proposed transforms can balance very well data representation performance and computational complexity.
Approximate Gaussian Elimination for Laplacians - Fast, Sparse, and Simple
  • Rasmus Kyng, Sushant Sachdeva
  • Mathematics, Computer Science
    2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS)
  • 2016
TLDR
This work gives the first nearly linear time solver for Laplacian systems that is based purely on random sampling, and does not use any graph theoretic constructions such as low-stretch trees, sparsifiers, or expanders.
PyGSP: Graph Signal Processing in Python
  • 2015
...
1
2
3
...