WuDaoCorpora: A super large-scale Chinese corpora for pre-training language models.
Sha YuanHanyu ZhaoZhengxiao DuMing DingXiao LiuYukuo CenXu ZouZhilin YangJie TangPublished in: AI Open (2021)
Keyphrases
- language model
- language modeling
- n gram
- probabilistic model
- document retrieval
- retrieval model
- speech recognition
- language modelling
- information retrieval
- statistical machine translation
- query expansion
- statistical language models
- chinese english
- context sensitive
- test collection
- word segmentation
- natural language processing
- relevance model
- translation model
- smoothing methods
- ad hoc information retrieval
- query terms
- vector space model
- document ranking
- query specific
- statistical language modeling
- language models for information retrieval
- term dependencies
- pseudo relevance feedback
- text retrieval
- image retrieval
- training set