Deepening Hidden Representations from Pre-trained Language Models for Natural Language Understanding.
Junjie YangHai ZhaoPublished in: CoRR (2019)
Keyphrases
- language model
- natural language understanding
- pre trained
- semantic representations
- language modeling
- knowledge representation
- n gram
- semantic analysis
- probabilistic model
- training data
- natural language
- speech recognition
- natural language processing
- information retrieval
- query expansion
- retrieval model
- training examples
- dialogue system
- statistical language models
- language models for information retrieval
- control signals
- relevance model
- smoothing methods
- artificial intelligence
- machine learning
- small number
- data points
- data sets