ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation.
Shuohuan WangYu SunYang XiangZhihua WuSiyu DingWeibao GongShikun FengJunyuan ShangYanbin ZhaoChao PangJiaxiang LiuXuyi ChenYuxiang LuWeixin LiuXi WangYangfan BaiQiuliang ChenLi ZhaoShiyong LiPeng SunDianhai YuYanjun MaHao TianHua WuTian WuWei ZengGe LiWen GaoHaifeng WangPublished in: CoRR (2021)
Keyphrases
- larger scale
- language understanding
- commonsense knowledge
- general knowledge
- knowledge acquisition
- machine learning
- natural language understanding
- knowledge representation
- small scale
- language processing
- knowledge base
- natural language
- expert systems
- knowledge based systems
- logic programming
- spoken dialogue systems