Kformer: Knowledge Injection in Transformer Feed-Forward Layers.
Yunzhi YaoShaohan HuangLi DongFuru WeiHuajun ChenNingyu ZhangPublished in: NLPCC (1) (2022)
Keyphrases
- feed forward
- back propagation
- neural nets
- artificial neural networks
- neural network
- hidden layer
- knowledge base
- prior knowledge
- knowledge representation
- fuzzy logic
- neural architecture
- visual cortex
- multi layer
- domain experts
- knowledge acquisition
- knowledge discovery
- domain knowledge
- data mining
- recurrent neural networks
- feed forward neural networks
- biologically plausible
- artificial neural
- error back propagation
- recurrent networks
- knowledge sharing
- control system