A Masked Segmental Language Model for Unsupervised Natural Language Segmentation.
C. M. DowneyFei XiaGina-Anne LevowShane Steinert-ThrelkeldPublished in: CoRR (2021)
Keyphrases
- language model
- natural language
- language modeling
- speech recognition
- n gram
- information retrieval
- document retrieval
- probabilistic model
- language modelling
- retrieval model
- test collection
- query expansion
- ad hoc information retrieval
- context sensitive
- query terms
- smoothing methods
- unsupervised learning
- natural language processing
- machine learning
- statistical language models
- pseudo relevance feedback
- language model for information retrieval
- vector space model
- supervised learning
- mixture model
- word segmentation
- query specific
- image segmentation
- translation model
- document ranking
- term dependencies
- semi supervised
- document length
- prior information
- question answering