Rethinking Denoised Auto-Encoding in Language Pre-Training.

Fuli Luo Pengcheng Yang Shicheng Li Xuancheng Ren Xu Sun Songfang Huang Fei Huang

Published in: EMNLP (1) (2021)

Keyphrases

denoising
training set
programming language
language processing
natural language
training process
training algorithm
language learning
image denoising
online learning
training phase
training samples
serious games
data sets
motion estimation
xml documents
neural network