Enhanced Gradient and Adaptive Learning Rate for Training Restricted Boltzmann Machines.
KyungHyun ChoTapani RaikoAlexander IlinPublished in: ICML (2011)
Keyphrases
- restricted boltzmann machine
- adaptive learning rate
- contrastive divergence
- learning rate
- deep learning
- learning algorithm
- hidden layer
- deep belief networks
- probabilistic graphical models
- neural network
- semi supervised
- conditional random fields
- training examples
- optical flow
- loopy belief propagation
- training set
- back propagation
- transfer learning
- convergence rate
- reinforcement learning