Memory-efficient Transformers via Top-k Attention.

Ankit Gupta Guy Dar Shaya Goodman David Ciprut Jonathan Berant

Published in: CoRR (2021)

Keyphrases

memory efficient
external memory
multiple sequence alignment
iterative deepening
query processing
user defined
genetic algorithm
search engine
search space
focus of attention
highly relevant
integral image