TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning.
Yixuan SuFangyu LiuZaiqiao MengLei ShuEhsan ShareghiNigel CollierPublished in: CoRR (2021)
Keyphrases
- online learning
- learning systems
- learning speed
- supervised learning
- learning algorithm
- reinforcement learning
- active learning
- unsupervised learning
- learning machines
- cognitive load
- learning scheme
- learning problems
- learning process
- machine learning
- learning community
- training process
- knowledge acquisition
- mobile robot
- structured prediction
- multi agent
- computer based training