Drop Redundant, Shrink Irrelevant: Selective Knowledge Injection for Language Pretraining.
Ningyu ZhangShumin DengXu ChengXi ChenYichi ZhangWei ZhangHuajun ChenPublished in: IJCAI (2021)
Keyphrases
- knowledge acquisition
- knowledge base
- expert systems
- knowledge representation
- prior knowledge
- formal representation
- representation language
- knowledge extraction
- cognitive models
- knowledge management
- knowledge sharing
- data mining techniques
- irrelevant attributes
- probabilistic knowledge
- linguistic knowledge
- specification language
- language learning
- neural network
- case based reasoning
- domain knowledge
- natural language
- case study
- artificial intelligence