Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks.
Minki KangSeanie LeeJinheon BaekKenji KawaguchiSung Ju HwangPublished in: NeurIPS (2023)
Keyphrases
- knowledge intensive
- language model
- knowledge acquisition
- language modeling
- information retrieval
- probabilistic model
- knowledge representation
- language modelling
- n gram
- knowledge base
- knowledge management
- statistical language models
- law enforcement
- speech recognition
- document retrieval
- test collection
- retrieval model
- query expansion
- human resources
- pseudo relevance feedback
- query terms
- context sensitive
- document ranking
- artificial intelligence
- e learning
- knowledge workers
- smoothing methods
- machine learning