Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise.
Zhenghao LinYeyun GongYelong ShenTong WuZhihao FanChen LinNan DuanWeizhu ChenPublished in: ICML (2023)
Keyphrases
- language model
- text generation
- language modeling
- n gram
- information retrieval
- probabilistic model
- natural language generation
- document retrieval
- document level
- language modelling
- query expansion
- speech recognition
- denoising
- ad hoc information retrieval
- context sensitive
- training set
- statistical language models
- language model for information retrieval
- vector space model
- retrieval model
- relevance model
- test collection
- translation model
- document ranking
- smoothing methods
- natural language
- language models for information retrieval
- query terms
- theorem prover
- machine translation
- artificial intelligence
- document collections
- information extraction
- okapi bm
- machine learning