CPM-2: Large-scale Cost-effective Pre-trained Language Models.
Zhengyan ZhangYuxian GuXu HanShengqi ChenChaojun XiaoZhenbo SunYuan YaoFanchao QiJian GuanPei KeYanzheng CaiGuoyang ZengZhixing TanZhiyuan LiuMinlie HuangWentao HanYang LiuXiaoyan ZhuMaosong SunPublished in: CoRR (2021)
Keyphrases
- cost effective
- language model
- pre trained
- language modeling
- document retrieval
- low cost
- n gram
- speech recognition
- probabilistic model
- language modelling
- information retrieval
- cost effectiveness
- retrieval model
- training data
- statistical language models
- training examples
- test collection
- query expansion
- language models for information retrieval
- smoothing methods
- control signals
- statistical language modeling
- e learning