DisCo: Effective Knowledge Distillation For Contrastive Learning of Sentence Embeddings.
Xing WuChaochen GaoJue WangLiangjun ZangZhongyuan WangSonglin HuPublished in: CoRR (2021)
Keyphrases
- learning systems
- knowledge acquisition
- effective learning
- learning process
- prior knowledge
- background knowledge
- domain knowledge
- reinforcement learning
- learned knowledge
- knowledge level
- learning tasks
- acquire knowledge
- neural network
- organizational learning
- solving problems
- knowledge representation
- natural language
- learning algorithm
- online learning
- knowledge transfer
- low dimensional
- supervised learning
- learning mechanism
- procedural knowledge
- bayesian networks