Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates.
Shirley KokaneMostofa Rafid UddinMin XuPublished in: CoRR (2024)
Keyphrases
- transfer learning
- knowledge transfer
- learning rate
- transfer knowledge
- transferring knowledge
- learning tasks
- learning algorithm
- labeled data
- reinforcement learning
- cross domain
- knowledge sharing
- domain adaptation
- active learning
- previously learned
- machine learning
- collaborative filtering
- prior knowledge
- machine learning algorithms
- convergence rate
- information retrieval
- text categorization
- semi supervised learning
- text classification
- learning process
- data sets