A Short Survey of Pre-trained Language Models for Conversational AI-A NewAge in NLP.
Munazza ZaibQuan Z. ShengWei Emma ZhangPublished in: CoRR (2021)
Keyphrases
- language model
- pre trained
- language modeling
- natural language
- natural language processing
- n gram
- training data
- probabilistic model
- document retrieval
- statistical language models
- information retrieval
- speech recognition
- language modelling
- training examples
- machine learning
- query expansion
- multi modal
- retrieval model
- test collection
- question answering
- translation model
- smoothing methods
- control signals
- machine translation
- language models for information retrieval
- information extraction
- data sets
- speech signal
- spoken term detection
- decision trees
- face recognition
- wordnet