On the Sentence Embeddings from Pre-trained Language Models.
Bohan LiHao ZhouJunxian HeMingxuan WangYiming YangLei LiPublished in: EMNLP (1) (2020)
Keyphrases
- language model
- pre trained
- document level
- language modeling
- sentence retrieval
- training data
- n gram
- document retrieval
- training examples
- retrieval model
- speech recognition
- probabilistic model
- information retrieval
- natural language
- language modelling
- control signals
- test collection
- query expansion
- translation model
- pseudo relevance feedback
- relevance model
- vector space model
- dimensionality reduction
- smoothing methods
- low dimensional
- vector space
- sentence level
- small number
- document ranking
- supervised learning
- statistical language models
- multi modal
- neural network
- training set
- feature selection