Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice.

Jeffrey Pennington Samuel S. Schoenholz Surya Ganguli

Published in: NIPS (2017)

Keyphrases

deep learning
unsupervised learning
unsupervised feature learning
machine learning
weakly supervised
probabilistic model
mental models
neural network
image segmentation
pattern recognition
feature space
image features
deep architectures