Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains.
Haojie PanChengyu WangMinghui QiuYichang ZhangYaliang LiJun HuangPublished in: ACL/IJCNLP (1) (2021)
Keyphrases
- language model
- meta knowledge
- probabilistic model
- language modeling
- n gram
- meta rules
- speech recognition
- relevance model
- document retrieval
- ad hoc information retrieval
- context sensitive
- query expansion
- information retrieval
- domain knowledge
- retrieval model
- image classification
- meta learning
- translation model
- natural language
- data mining