Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data.
Haoran LiXinyuan ZhaoDadi GuoHanlin GuZiqian ZengYuxing HanYangqiu SongLixin FanQiang YangPublished in: CoRR (2024)
Keyphrases
- knowledge transfer
- synthetic data
- language model
- domain specific
- language modeling
- knowledge sharing
- retrieval model
- probabilistic model
- cross domain
- information retrieval
- transfer learning
- data sets
- document retrieval
- n gram
- speech recognition
- real world
- real image data
- language modelling
- query expansion
- digital libraries
- test collection
- learning tasks
- statistical language models
- relevance model
- federated search
- smoothing methods
- reinforcement learning
- information systems
- context sensitive
- data mining
- database
- pseudo relevance feedback
- language models for information retrieval