Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers.
Zihan QiuZeyu HuangYoucheng HuangJie FuPublished in: CoRR (2024)
Keyphrases
- empirical studies
- feed forward
- back propagation
- artificial neural networks
- real world data sets
- neural nets
- neural network
- empirical analysis
- fuzzy logic
- biologically plausible
- visual cortex
- recurrent neural networks
- artificial neural
- hidden layer
- neural architecture
- neuron model
- activation function
- power system
- artificial intelligence
- feed forward neural networks
- error back propagation
- real time
- primate visual cortex
- uci datasets
- multi layer
- genetic algorithm
- data mining