Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective.
Ming ZhongChenxin AnWeizhu ChenJiawei HanPengcheng HePublished in: ICLR (2024)
Keyphrases
- language model
- knowledge transfer
- language modeling
- transfer learning
- cross domain
- speech recognition
- document retrieval
- knowledge sharing
- query expansion
- probabilistic model
- retrieval model
- n gram
- language modelling
- neural network
- information retrieval
- context sensitive
- test collection
- document ranking
- statistical language models
- semi supervised
- pseudo relevance feedback
- learning tasks
- relevance model
- case study
- statistical language modeling
- spoken term detection
- broadcast news
- smoothing methods
- active learning
- language models for information retrieval
- mutual adaptation