PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation.
Wei ZengXiaozhe RenTeng SuHui WangYi LiaoZhiwei WangXin JiangZhenZhang YangKaisheng WangXiaoda ZhangChen LiZiyan GongYifan YaoXinjing HuangJun WangJianfeng YuQi GuoYue YuYan ZhangJin WangHengtao TaoDasen YanZexuan YiFang PengFangqing JiangHan ZhangLingfeng DengYehong ZhangZhe LinChao ZhangShaojie ZhangMingyue GuoShanzhi GuGaojun FanYaowei WangXuefeng JinQun LiuYonghong TianPublished in: CoRR (2021)
Keyphrases
- language model
- autoregressive
- parallel computation
- parallel algorithm
- language modeling
- non stationary
- document retrieval
- gaussian markov random field
- n gram
- parallel processing
- parallel implementation
- speech recognition
- probabilistic model
- parallel computing
- retrieval model
- random fields
- language modelling
- statistical language models
- information retrieval
- sar images
- test collection
- query expansion
- word segmentation
- language models for information retrieval
- translation model
- smoothing methods
- shared memory
- higher order