MPNet: Masked and Permuted Pre-training for Language Understanding.

Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu

Published in: CoRR (2020)

Keyphrases

language understanding
natural language understanding
language processing
contextual constraints
semantic interpretation
dialogue system
spoken dialogue systems
machine learning
user interface
online learning
semantic analysis
speech acts