Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention.
Yunyang XiongZhanpeng ZengRudrasis ChakrabortyMingxing TanGlenn FungYin LiVikas SinghPublished in: CoRR (2021)
Keyphrases
- theoretical analysis
- times faster
- experimental evaluation
- detection algorithm
- learning algorithm
- optimal solution
- computational complexity
- k means
- improved algorithm
- cost function
- dynamic programming
- computational cost
- high accuracy
- simulated annealing
- recognition algorithm
- spectral clustering
- worst case
- significant improvement
- search space
- expectation maximization
- linear programming
- matching algorithm
- convex hull
- data clustering
- data structure
- theoretical guarantees