Efficient Sentence Representation Learning via Knowledge Distillation with Maximum Coding Rate Reduction.
Domagoj SeverdijaTomislav PrusinaLuka BorozanDomagoj MatijevicPublished in: J. Comput. Inf. Technol. (2023)
Keyphrases
- learning systems
- knowledge acquisition
- prior knowledge
- solving problems
- effective learning
- reinforcement learning
- knowledge transfer
- learning tasks
- knowledge representation
- online learning
- acquire knowledge
- multiple representations
- subject matter
- representation language
- coding scheme
- learning process
- expert systems
- natural language
- learning algorithm
- machine learning
- knowledge based systems
- supervised learning
- background knowledge
- domain knowledge
- human experts
- knowledge level
- video sequences
- knowledge base
- neural network