Taking Notes on the Fly Helps BERT Pre-training.

Qiyu Wu Chen Xing Yatao Li Guolin Ke Di He Tie-Yan Liu

Published in: CoRR (2020)

Keyphrases

training process
data mining
test set
training algorithm
image segmentation
hidden markov models
training examples
training phase
real world
genetic algorithm
computer vision
case study
reinforcement learning
data structure
artificial neural networks