EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation.
Chenhe DongGuangrun WangHang XuJiefeng PengXiaozhe RenXiaodan LiangPublished in: CoRR (2021)
Keyphrases
- multilayer perceptron
- neural network
- artificial neural networks
- radial basis function
- knowledge acquisition
- domain knowledge
- back propagation
- hidden layer
- probabilistic neural networks
- radial basis function neural network
- genetic algorithm
- image processing
- knowledge representation
- knowledge base
- small number
- artificial intelligence
- data sets
- decision making
- machine learning
- high dimensional
- activation function
- feedforward neural networks
- expert systems