PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation.
Yunhe WangHanting ChenYehui TangTianyu GuoKai HanYing NieXutao WangHailin HuZheyuan BaiYun WangFangcheng LiuZhicheng LiuJianyuan GuoSinan ZengYinchen ZhangQinghua XuQun LiuJun YaoChao XuDacheng TaoPublished in: CoRR (2023)
Keyphrases
- language model
- language modeling
- n gram
- probabilistic model
- query expansion
- document retrieval
- information retrieval
- test collection
- language modelling
- retrieval model
- ad hoc information retrieval
- speech recognition
- query terms
- smoothing methods
- mixture model
- vector space model
- document length
- word error rate
- statistical language models
- information retrieval systems
- statistical models
- error rate
- pseudo relevance feedback
- document ranking
- maximum likelihood