EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation.
Chenhe DongGuangrun WangHang XuJiefeng PengXiaozhe RenXiaodan LiangPublished in: EMNLP (Findings) (2021)
Keyphrases
- multilayer perceptron
- neural network
- back propagation
- artificial neural networks
- radial basis function
- input vector
- domain knowledge
- knowledge acquisition
- modular neural network
- probabilistic neural networks
- hidden layer
- neural network model
- knowledge management
- knowledge representation
- expert systems
- decision making
- data mining
- real time
- knowledge base
- computer vision
- genetic algorithm
- machine learning
- input vectors