Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification.
Yidi JiangBidisha SharmaMaulik C. MadhaviHaizhou LiPublished in: CoRR (2021)
Keyphrases
- knowledge acquisition
- machine learning
- expert systems
- knowledge representation
- knowledge base
- fault diagnosis
- fuzzy logic
- classification accuracy
- support vector
- feature extraction
- classification method
- automatic classification
- decision trees
- power transformers
- high voltage
- pattern classification
- classification algorithm
- classification systems
- classification scheme
- data sets
- partial discharge
- machine learning algorithms
- feature set
- feature space
- pattern recognition
- decision making
- feature selection
- speech recognition
- unsupervised learning
- machine learning methods
- classification rules
- classification models
- audio visual
- preprocessing
- automatic speech recognition
- spectral features
- artificial intelligence