Pretraining Without Attention.

Junxiong Wang Jing Nathan Yan Albert Gu Alexander M. Rush

Published in: CoRR (2022)

Keyphrases

focus of attention
neural network
artificial intelligence
visual attention
information retrieval
genetic algorithm
high level
optimal solution
preprocessing
digital images
selective attention