Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model.
Xinrun DuZhouliang YuSongyang GaoDing PanYuyang ChengZiyang MaRuibin YuanXingwei QuJiaheng LiuTianyu ZhengXinchen LuoGuorui ZhouBinhang YuanWenhu ChenJie FuGe ZhangPublished in: CoRR (2024)
Keyphrases
- language model
- language modeling
- n gram
- word segmentation
- probabilistic model
- statistical language models
- retrieval model
- query expansion
- information retrieval
- mixture model
- speech recognition
- test collection
- context sensitive
- document retrieval
- statistical machine translation
- ad hoc information retrieval
- text summarization
- pseudo relevance feedback
- vector space model
- language modelling
- language model for information retrieval