Beyond Nyströmformer - Approximation of self-attention by Spectral Shifting.

Madhusudan Verma

Published in: CoRR (2021)

Keyphrases

theoretical analysis
approximation algorithms
low rank matrix approximation
eigendecomposition
spectral clustering
manifold learning
spectral methods
data sets
visual attention
error bounds
spectral analysis
relative error
closed form
np hard
approximation schemes
laplacian matrix
feature extraction