Instruction Pre-Training: Language Models are Supervised Multitask Learners.
Daixuan ChengYuxian GuShaohan HuangJunyu BiMinlie HuangFuru WeiPublished in: CoRR (2024)
Keyphrases
- language model
- multi task
- language modeling
- supervised learning
- multitask learning
- n gram
- speech recognition
- probabilistic model
- multi task learning
- document retrieval
- language modelling
- feature selection
- learning tasks
- learning problems
- retrieval model
- post test
- information retrieval
- query expansion
- test collection
- e learning
- statistical language models
- learning algorithm
- relevance model
- learning environment
- smoothing methods
- multiple tasks
- learning process
- gaussian processes
- language models for information retrieval
- multi class
- semi supervised
- training set
- instructional strategies
- feature extraction
- transfer learning
- unsupervised learning
- bayesian networks
- information gain
- model selection
- machine learning