On the Interplay Between Fine-tuning and Sentence-Level Probing for Linguistic Knowledge in Pre-Trained Transformers.
Marius MosbachAnna KhokhlovaMichael A. HedderichDietrich KlakowPublished in: BlackboxNLP@EMNLP (2020)
Keyphrases
- linguistic knowledge
- fine tuning
- sentence level
- pre trained
- sentiment analysis
- natural language processing
- training data
- natural language
- novelty detection
- word sense disambiguation
- sentiment classification
- dialogue system
- multi document summarization
- training examples
- data sets
- information extraction
- neural network
- noun phrases
- information retrieval
- question answering
- knowledge base
- feature selection
- search engine