Inductive Bias of Gradient Descent for Weight Normalized Smooth Homogeneous Neural Nets.
Depen MorwaniHarish G. RamaswamyPublished in: ALT (2022)
Keyphrases
- neural nets
- inductive bias
- inductive learning
- machine learning
- feed forward
- learning tasks
- neural network
- hypothesis space
- back propagation
- pac learning
- prior knowledge
- artificial neural networks
- supervised learning
- domain knowledge
- training set
- domain theory
- objective function
- multitask learning
- artificial intelligence
- training examples
- similarity measure
- feature space
- learning problems
- learning theory
- learning algorithm
- uniform distribution
- semi supervised learning
- knowledge acquisition
- pairwise
- data sets