HyperAttention: Long-context Attention in Near-Linear Time.

Insu Han Rajesh Jayaram Amin Karbasi Vahab Mirrokni David P. Woodruff Amir Zandieh

Published in: ICLR (2024)

Keyphrases

contextual information
context sensitive
information retrieval
expert systems
context dependent
context aware
context awareness
artificial intelligence
multimedia
reinforcement learning
relational databases
worst case
long sequences