Approximating Two-Layer Feedforward Networks for Efficient Transformers.

Róbert Csordás Kazuki Irie Jürgen Schmidhuber

Published in: EMNLP (Findings) (2023)

Keyphrases

feed forward
back propagation
recurrent networks
neural nets
adaptive neural
hidden layer
recurrent neural networks
neural network
multi layer
biologically plausible
neural architecture
social networks
artificial intelligence
artificial neural networks
expert systems
activation function
output layer