A Short Survey of Pre-trained Language Models for Conversational AI-A New Age in NLP.
Munazza ZaibQuan Z. ShengWei Emma ZhangPublished in: ACSW (2020)
Keyphrases
- language model
- pre trained
- language modeling
- natural language processing
- natural language
- training data
- n gram
- information retrieval
- document retrieval
- training examples
- language modelling
- probabilistic model
- speech recognition
- information extraction
- test collection
- query expansion
- retrieval model
- question answering
- control signals
- statistical language models
- text mining
- document ranking
- smoothing methods
- language models for information retrieval
- machine translation
- machine learning
- multi modal
- support vector
- wordnet
- feature selection
- neural network
- data sets