Don't Sweep your Learning Rate under the Rug: A Closer Look at Cross-modal Transfer of Pretrained Transformers.
Danielle RothermelMargaret LiTim RocktäschelJakob N. FoersterPublished in: CoRR (2021)
Keyphrases
- learning rate
- cross modal
- multi modal
- convergence rate
- multimedia retrieval
- rapid convergence
- learning algorithm
- convergence speed
- image retrieval
- transfer learning
- visual recognition
- delta bar delta
- visual similarity
- multimedia databases
- perceptual information
- visual data
- image collections
- learning tasks
- multi class
- search engine
- neural network