Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning.
Mitchell A. GordonKevin DuhNicholas AndrewsPublished in: RepL4NLP@ACL (2020)
Keyphrases
- transfer learning
- learning tasks
- knowledge transfer
- labeled data
- reinforcement learning
- machine learning
- active learning
- transfer knowledge
- cross domain
- collaborative filtering
- text classification
- semi supervised learning
- text categorization
- manifold alignment
- domain adaptation
- structure learning
- multi task learning
- multi task
- transferring knowledge
- machine learning algorithms
- semi supervised
- learning algorithm
- information extraction
- bayesian networks