Pre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text.

Koichi Nagatsuka Clifford Broni-Bediako Masayasu Atsumi

Published in: RANLP (2021)

Keyphrases

block size
training set
elementary school
feature selection
feature extraction
multiscale
multiresolution
image compression