Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level.

Ali Hassani Wen-Mei Hwu Humphrey Shi

Published in: CoRR (2024)

Keyphrases

data structure
focus of attention
database
learning algorithm
information systems
case study
high level
reinforcement learning
video sequences
digital libraries