SALO: an efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences.
Guan ShenJieru ZhaoQuan ChenJingwen LengChao LiMinyi GuoPublished in: DAC (2022)
Keyphrases
- long sequences
- spatial data
- spatial and temporal
- spatial information
- sparse data
- parallel implementation
- data streams
- computationally efficient
- high dimensional
- spatio temporal
- spatial databases
- sparse representation
- spatial relationships
- hybrid approaches
- short term memory
- mining sequential patterns
- real time
- mechanism design
- focus of attention
- spatial temporal
- data mining