Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale.
Xiang HuPengyu JiQingyang ZhuWei WuKewei TuPublished in: ACL (1) (2024)
Keyphrases
- language model
- language modeling
- unsupervised learning
- probabilistic model
- document retrieval
- speech recognition
- n gram
- retrieval model
- language modelling
- information retrieval
- query expansion
- generative model
- statistical language models
- dependency structure
- test collection
- natural language
- smoothing methods
- query terms
- semi supervised
- ad hoc information retrieval
- vector space model
- supervised learning
- language models for information retrieval
- language modeling framework
- bayesian networks
- term dependencies
- document length
- document ranking
- pseudo relevance feedback
- structured data
- definitional question answering
- agglomerative clustering
- active learning
- language model for information retrieval