Memorization Capacity of Multi-Head Attention in Transformers.

Sadegh Mahdavi Renjie Liao Christos Thrampoulidis

Published in: ICLR (2024)

Keyphrases

object recognition
visual attention
visual field
data sets
databases
decision making
case study
search algorithm
limited capacity