Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice.

Jeffrey Pennington Samuel S. Schoenholz Surya Ganguli

Published in: CoRR (2017)

Keyphrases

deep learning
unsupervised learning
unsupervised feature learning
machine learning
deep architectures
computer vision
weakly supervised