PSO-PS: Parameter Synchronization with Particle Swarm Optimization for Distributed Training of Deep Neural Networks.
Qing YeYuxuan HanYanan SunJiancheng LvPublished in: CoRR (2020)
Keyphrases
- particle swarm optimization
- pso algorithm
- inertia weight
- neural network
- particle swarm optimization pso
- particle swarm optimization algorithm
- training process
- training algorithm
- global optimization
- multi objective
- particle swarm
- particle swarm optimizer
- genetic algorithm
- feedforward neural networks
- swarm intelligence
- differential evolution
- convergence speed
- hybrid algorithm
- ant colony optimization
- feed forward neural networks
- back propagation
- distributed systems
- multi layer perceptron
- economic dispatch
- distributed environment
- multilayer neural network
- error back propagation
- deep architectures
- bp neural network
- backpropagation algorithm
- global search
- artificial neural networks
- premature convergence
- pattern recognition
- pid controller
- multilayer perceptron
- training set
- fuzzy logic
- population diversity
- metaheuristic
- concurrent processes
- neural network model
- spatial clustering with obstacles constraints
- control system
- multi agent
- recurrent networks
- hidden layer
- optimization algorithm
- hybrid pso
- shuffled frog leaping algorithm