The I/O Complexity of Attention, or How Optimal is Flash Attention?

Barna Saha Christopher Ye

Published in: CoRR (2024)

Keyphrases

computational complexity
social networks
optimal solution
evolutionary algorithm
worst case
input output
main memory
database
real time
artificial intelligence
vision system
disk drives