Softmax Bottleneck Makes Language Models Unable to Represent Multi-mode Word Distributions.
Haw-Shiuan ChangAndrew McCallumPublished in: ACL (1) (2022)
Keyphrases
- language model
- n gram
- translation model
- language modeling
- document retrieval
- word error rate
- probabilistic model
- query expansion
- speech recognition
- statistical language modeling
- out of vocabulary
- word clouds
- information retrieval
- language modelling
- test collection
- retrieval model
- multiword
- spoken term detection
- statistical language models
- vector space model
- mixture model
- word segmentation
- language models for information retrieval
- term weighting
- query terms
- relevance model
- context sensitive
- ad hoc information retrieval
- co occurrence
- language model for information retrieval
- pseudo relevance feedback
- term dependencies
- document ranking
- document level
- language independent
- smoothing methods
- retrieval effectiveness
- information retrieval systems
- keywords
- bayesian networks