Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution.
Ananya KumarAditi RaghunathanRobbie JonesTengyu MaPercy LiangPublished in: CoRR (2022)
Keyphrases
- fine tuning
- spatial distribution
- prior knowledge
- feature extraction
- low level
- fine tune
- information retrieval
- viable alternative
- extracted features
- co occurrence
- structural information
- domain specific
- specific features
- classification models
- gabor filters
- spatial information
- face detection
- neural network
- video sequences
- training data
- case study
- decision trees
- search engine
- machine learning