Scatterbrain: Unifying Sparse and Low-rank Attention.

Beidi Chen Tri Dao Eric Winsor Zhao Song Atri Rudra Christopher Ré

Published in: NeurIPS (2021)

Keyphrases

focus of attention
visual attention
genetic algorithm
social networks
search algorithm
learning algorithm
cooperative
image retrieval