Gradual Further Pre-training Architecture for Economics/Finance Domain Adaptation of Language Model.
Hiroki SakajiMasahiro SuzukiKiyoshi IzumiHiroyuki MitsugiPublished in: Big Data (2022)
Keyphrases
- language model
- domain adaptation
- language modeling
- n gram
- probabilistic model
- semi supervised
- labeled data
- document retrieval
- query expansion
- information retrieval
- cross domain
- retrieval model
- multiple sources
- training examples
- test collection
- supervised learning
- unlabeled data
- test data
- training set
- target domain
- sentiment classification
- translation model
- semi supervised learning
- transfer learning
- cross lingual
- test set
- active learning
- machine learning
- information extraction