Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
Jakub HoscilowiczMarcin SowanskiPiotr CzubowskiArtur JanickiPublished in: CoRR (2023)
Keyphrases
- fine tuning
- fine tune
- knowledge discovery
- knowledge extraction
- domain knowledge
- knowledge base
- viable alternative
- knowledge acquisition
- knowledge representation
- knowledge management
- acquire knowledge
- fine tuned
- expert systems
- prior knowledge
- knowledge sharing
- share knowledge
- deeper understanding
- higher level
- knowledge based systems