DDK: Distilling Domain Knowledge for Efficient Large Language Models.
Jiaheng LiuChenchen ZhangJinyang GuoYuanxing ZhangHaoran QueKen DengZhiqi BaiJie LiuGe ZhangJiakai WangYanan WuCongnan LiuWenbo SuJiamang WangLin QuBo ZhengPublished in: CoRR (2024)
Keyphrases
- language model
- domain knowledge
- language modeling
- probabilistic model
- n gram
- information retrieval
- speech recognition
- test collection
- document retrieval
- language modelling
- statistical language models
- retrieval model
- machine learning
- query expansion
- okapi bm
- context sensitive
- query terms
- translation model
- ad hoc information retrieval
- language modeling approaches