Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification.
Yidi JiangBidisha SharmaMaulik C. MadhaviHaizhou LiPublished in: Interspeech (2021)
Keyphrases
- fuzzy logic
- fault diagnosis
- power transformers
- pattern recognition
- classification accuracy
- expert systems
- classification method
- knowledge base
- decision trees
- training set
- prior knowledge
- domain knowledge
- support vector machine
- text classification
- machine learning
- classification systems
- speech recognition
- decision rules
- classification scheme
- automatic classification
- feature vectors
- image classification
- knowledge management
- unsupervised learning
- supervised learning
- knowledge discovery
- data mining
- feature extraction
- feature selection
- machine learning methods
- pattern classification
- distribution network
- partial discharge
- audio visual
- classification models
- knowledge sharing
- classification algorithm
- benchmark datasets
- data mining techniques
- knowledge representation
- support vector