Weighted Sigmoid Gate Unit for an Activation Function of Deep Neural Network.
Masayuki TanakaPublished in: CoRR (2018)
Keyphrases
- activation function
- neural network
- back propagation
- hidden layer
- artificial neural networks
- feed forward neural networks
- neural nets
- feed forward
- hidden neurons
- connection weights
- multilayer perceptron
- sigmoid function
- network architecture
- hidden nodes
- feedforward neural networks
- learning rate
- single hidden layer
- basis functions
- backpropagation algorithm
- radial basis function
- multi layer perceptron
- single layer
- fuzzy logic
- training algorithm
- pattern recognition
- neural network model
- small number
- training phase
- fuzzy neural network
- bp neural network
- extreme learning machine
- expert systems
- machine learning