Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey.
Bonan MinHayley RossElior SulemAmir Pouran Ben VeysehThien Huu NguyenOscar SainzEneko AgirreIlana HeintzDan RothPublished in: CoRR (2021)
Keyphrases
- recent advances
- language model
- pre trained
- natural language processing
- language modeling
- training data
- information extraction
- n gram
- probabilistic model
- retrieval model
- speech recognition
- training examples
- information retrieval
- machine learning
- natural language
- control signals
- query expansion
- named entity recognition
- word sense disambiguation
- question answering
- text mining
- machine translation
- statistical language models
- wordnet
- smoothing methods
- language models for information retrieval
- hidden markov models
- learning algorithm