Linear Transformers Are Secretly Fast Weight Programmers.

Imanol Schlag Kazuki Irie Jürgen Schmidhuber

Published in: ICML (2021)

Keyphrases

source code
linear systems
decision trees
evolutionary algorithm
weight function
artificial intelligence
general purpose
programming language
sufficient conditions
closed form