Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space.
Mor GevaAvi CaciularuKevin Ro WangYoav GoldbergPublished in: CoRR (2022)
Keyphrases
- feed forward
- neural nets
- artificial neural networks
- back propagation
- neural network
- recurrent neural networks
- concept space
- feed forward neural networks
- fuzzy logic
- biologically plausible
- visual cortex
- hidden layer
- vector space
- space time
- low dimensional
- search space
- neural architecture
- activation function
- multilayer perceptron
- spiking neurons
- artificial neural
- error back propagation
- feedforward neural networks
- fault diagnosis
- keywords
- decision making
- artificial intelligence
- data mining