Large Scale Distributed Hessian-Free Optimization for Deep Neural Network.
Xi HeDheevatsa MudigereMikhail SmelyanskiyMartin TakácPublished in: CoRR (2016)
Keyphrases
- neural network
- image reconstruction from projections
- artificial neural networks
- optimization algorithm
- data intensive
- distributed systems
- neural network model
- optimization process
- self organizing maps
- optimization problems
- real life
- autonomy oriented computing
- distributed data
- pattern recognition
- computer networks
- training algorithm
- constrained optimization
- training process
- deep learning
- distributed network
- computing environments
- mobile agents
- fuzzy logic
- multi agent
- neural nets
- small scale
- global optimization
- optimization method
- fault diagnosis
- lightweight
- search algorithm
- heterogeneous environments
- iterative methods
- cooperative
- high scalability
- objective function