Making Pre-trained Language Models Good Long-tailed Learners.
Chen ZhangLei RenJingang WangWei WuDawei SongPublished in: CoRR (2022)
Keyphrases
- machine learning
- language model
- pre trained
- language modeling
- n gram
- document retrieval
- query expansion
- probabilistic model
- training data
- information retrieval
- e learning
- speech recognition
- statistical language models
- retrieval model
- training examples
- learning environment
- learning algorithm
- test collection
- language modelling
- smoothing methods
- control signals
- decision trees
- learning process
- document ranking
- speech signal
- multi modal
- small number
- pairwise
- bayesian networks
- feature extraction
- neural network