Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning.
Yuandong TianPublished in: CoRR (2022)
Keyphrases
- learning algorithm
- knowledge acquisition
- learning systems
- learning process
- online learning
- supervised learning
- prior knowledge
- training examples
- data sets
- learning tasks
- deep architectures
- computer based training
- minimum error rate
- learning speed
- structured prediction
- elementary school
- feedforward neural networks
- solving problems
- positive examples
- training process
- incremental learning
- learning problems
- mobile learning
- unsupervised learning
- active learning
- training set
- bayesian networks