Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention.

Tsendsuren Munkhdalai Manaal Faruqui Siddharth Gopal

Published in: CoRR (2024)

Keyphrases

contextual information
cost effective
data sets
context aware
context dependent
database
three dimensional
wide range
preprocessing
lightweight
context sensitive
knowledge retrieval