Approximating Two-Layer Feedforward Networks for Efficient Transformers.

Róbert Csordás Kazuki Irie Jürgen Schmidhuber

Published in: CoRR (2023)

Keyphrases

feed forward
back propagation
neural nets
artificial neural networks
recurrent networks
neural network
visual cortex
hidden layer
neural architecture
social networks
recurrent neural networks
multi layer
biologically plausible
input output
adaptive neural