Can We Use Probing to Better Understand Fine-Tuning and Knowledge Distillation of the BERT NLU?
Jakub HoscilowiczMarcin SowanskiPiotr CzubowskiArtur JanickiPublished in: ICAART (3) (2023)
Keyphrases
- fine tuning
- fine tune
- knowledge base
- domain knowledge
- deeper understanding
- knowledge management
- knowledge discovery
- viable alternative
- domain experts
- knowledge acquisition
- high level
- knowledge representation
- knowledge extraction
- computer vision
- real time
- general purpose
- prior knowledge
- artificial neural networks
- learning systems
- decision trees
- artificial intelligence
- machine learning