Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts.
Max RyabininAnton GusevPublished in: NeurIPS (2020)
Keyphrases
- neural network
- training algorithm
- training process
- feed forward neural networks
- feedforward neural networks
- back propagation
- multi layer perceptron
- training set
- training phase
- mixture model
- artificial neural networks
- training samples
- pattern recognition
- neural network training
- genetic algorithm
- backpropagation algorithm
- radial basis function network
- training patterns
- domain experts
- neural network model
- feed forward
- peer to peer
- distributed systems
- fuzzy logic
- subject matter experts
- learning algorithm
- information retrieval
- error back propagation
- recurrent networks
- gaussian mixture model
- video annotation
- multilayer perceptron
- training examples
- multi agent
- knowledge base
- machine learning