Taking Notes on the Fly Helps Language Pre-Training.

Qiyu Wu Chen Xing Yatao Li Guolin Ke Di He Tie-Yan Liu

Published in: ICLR (2021)

Keyphrases

training process
training set
language learning
test set
programming language
natural language
online learning
training examples
language processing
training phase
serious games
small number
active learning
relational databases
expert systems
training algorithm
multi agent
databases