Transformers are Multi-State RNNs.

Matanel Oren Michael Hassid Yossi Adi Roy Schwartz

Published in: CoRR (2024)

Keyphrases

recurrent neural networks
real time
social networks
search algorithm
echo state networks
databases
state space
input output
fuzzy neural network