Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning.
Mitchell A. GordonKevin DuhNicholas AndrewsPublished in: CoRR (2020)
Keyphrases
- transfer learning
- learning tasks
- knowledge transfer
- cross domain
- reinforcement learning
- active learning
- structure learning
- manifold alignment
- labeled data
- machine learning
- collaborative filtering
- text classification
- domain adaptation
- semi supervised learning
- machine learning algorithms
- learning algorithm
- multi task learning
- transfer knowledge
- multi task
- neural network
- transferring knowledge
- unlabeled data
- supervised learning
- object recognition
- decision trees
- knowledge sharing
- target domain
- model selection
- text mining