FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness.

Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré

Published in: CoRR (2022)

Keyphrases

memory efficient
multiple sequence alignment
iterative deepening
external memory
neural network
integral image
real time
databases
social networks
search algorithm
pattern growth