Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers.
Zihan QiuZeyu HuangYoucheng HuangJie FuPublished in: Tiny Papers @ ICLR (2024)
Keyphrases
- empirical studies
- feed forward
- back propagation
- neural nets
- artificial neural networks
- empirical analysis
- recurrent neural networks
- neural network
- real world data sets
- fuzzy logic
- hidden layer
- feed forward neural networks
- fault diagnosis
- visual cortex
- biologically plausible
- experimental design
- activation function
- neural architecture
- error back propagation
- recurrent networks
- real time
- input output