Synthesizer: Rethinking Self-Attention in Transformer Models.

Yi Tay Dara Bahri Donald Metzler Da-Cheng Juan Zhe Zhao Che Zheng

Published in: CoRR (2020)

Keyphrases

statistical models
experimental data
probabilistic model
least squares
information retrieval
learning algorithm
search engine
three dimensional
computational intelligence
complex systems
computational models