AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop.
Yunfei TengJing WangAnna ChoromanskaPublished in: CoRR (2021)
Keyphrases
- learning rate
- learning models
- learning algorithm
- multilayer neural networks
- adaptive learning rate
- training examples
- machine learning algorithms
- learning tasks
- supervised learning
- machine learning
- convergence rate
- loss function
- rapid convergence
- training samples
- semi supervised learning
- classification models
- training data
- learning problems
- conditional random fields
- convergence speed
- delta bar delta
- data points
- data sets
- reinforcement learning
- active learning
- multi objective
- training set
- high dimensional
- genetic algorithm