Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains.
Haojie PanChengyu WangMinghui QiuYichang ZhangYaliang LiJun HuangPublished in: CoRR (2020)
Keyphrases
- language model
- meta knowledge
- probabilistic model
- language modeling
- n gram
- query expansion
- information retrieval
- speech recognition
- mixture model
- document retrieval
- knowledge base
- retrieval model
- smoothing methods
- meta rules
- prediction accuracy
- supervised learning
- prior knowledge
- relevance model
- translation model
- training data