Linear Transformers Are Secretly Fast Weight Memory Systems.

Imanol Schlag Kazuki Irie Jürgen Schmidhuber

Published in: CoRR (2021)

Keyphrases

complex systems
linear systems
expert systems
distributed systems
building blocks
intelligent systems
management system
distributed shared memory
learning systems
software engineering
data sets
digital libraries
reinforcement learning
genetic algorithm
data mining
neural network
databases