SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences.
Guan ShenJieru ZhaoQuan ChenJingwen LengChao LiMinyi GuoPublished in: CoRR (2022)
Keyphrases
- long sequences
- spatial information
- spatio temporal
- spatial data
- high dimensional
- sparse data
- spatial and temporal
- data sets
- sparse representation
- spatial databases
- parallel implementation
- spatial temporal
- mechanism design
- hybrid approaches
- mining sequential patterns
- real time
- spatial frequency
- spatial structure
- spatial reasoning
- random projections
- spatial relationships
- visual attention
- space time
- denoising