SEA: Sparse Linear Attention with Estimated Attention Mask.

Heejun Lee Jina Kim Jeffrey Willette Sung Ju Hwang

Published in: ICLR (2024)

Keyphrases

sparse linear
small number
higher order
markov random field