Sign in
TOCOL: Improving Contextual Representation of Pre-trained Language Models via Token-Level Contrastive Learning.
Keheng Wang
Chuantao Yin
Rumei Li
Sirui Wang
Yunsen Xian
Wenge Rong
Zhang Xiong
Published in:
DSAA (2023)
Keyphrases
</>
language model
learning process
context sensitive
learning algorithm
probabilistic model
supervised learning
pre trained
machine learning
prior knowledge
n gram
speech recognition
principal component analysis
test collection
language modeling