Emerging Property of Masked Token for Effective Pre-training.

Hyesong Choi Hunsang Lee Seyoung Joung Hyejin Park Jiyeong Kim Dongbo Min

Published in: CoRR (2024)

Keyphrases

data mining
computationally efficient
training set
supervised learning
training examples
database
machine learning
information retrieval
information systems
face recognition
similarity measure
high quality
digital libraries
test set
training algorithm
training phase