HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression.
Chenhe DongYaliang LiYing ShenMinghui QiuPublished in: CoRR (2021)
Keyphrases
- language model
- cross domain
- knowledge transfer
- language modeling
- n gram
- multiple domains
- probabilistic model
- test collection
- transfer learning
- knowledge sharing
- information retrieval
- knowledge management
- retrieval model
- ad hoc information retrieval
- sentiment classification
- query expansion
- query terms
- text categorization
- mixture model
- nearest neighbor
- knowledge discovery
- prior knowledge