Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention.
Yunyang XiongZhanpeng ZengRudrasis ChakrabortyMingxing TanGlenn FungYin LiVikas SinghPublished in: AAAI (2021)
Keyphrases
- theoretical analysis
- computational complexity
- np hard
- experimental evaluation
- learning algorithm
- improved algorithm
- times faster
- k means
- cost function
- dynamic programming
- high accuracy
- computational cost
- expectation maximization
- significant improvement
- search space
- worst case
- simulated annealing
- particle filter
- segmentation algorithm
- matching algorithm
- preprocessing
- optimal solution