oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes.
Daniel CamposAlexandre MarquesMark KurtzChengXiang ZhaiPublished in: SustaiNLP (2023)
Keyphrases
- transfer learning
- learning tasks
- knowledge transfer
- reinforcement learning
- cross domain
- collaborative filtering
- labeled data
- machine learning
- transfer knowledge
- domain adaptation
- structure learning
- semi supervised learning
- active learning
- text categorization
- manifold alignment
- text classification
- machine learning algorithms
- high dimensional
- multi task learning
- k means
- neural network
- target domain
- information retrieval
- databases
- learning problems
- text mining