Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.
Raphael TangYao LuLinqing LiuLili MouOlga VechtomovaJimmy LinPublished in: CoRR (2019)
Keyphrases
- neural network
- knowledge base
- knowledge extraction
- knowledge based systems
- expert systems
- knowledge acquisition
- knowledge sharing
- real world
- information retrieval
- genetic algorithm
- feed forward
- digital libraries
- domain knowledge
- knowledge representation
- learning systems
- cellular neural networks
- domain experts
- raw data
- expert knowledge
- data sets
- design process
- knowledge management
- knowledge discovery
- recommender systems
- multi agent systems
- e learning
- computer vision
- databases