ProbAct: A Probabilistic Activation Function for Deep Neural Networks.
Joonho LeeKumar ShridharHideaki HayashiBrian Kenji IwanaSeokjun KangSeiichi UchidaPublished in: CoRR (2019)
Keyphrases
- activation function
- neural network
- hidden layer
- back propagation
- feed forward
- feed forward neural networks
- artificial neural networks
- neural nets
- multilayer perceptron
- backpropagation algorithm
- feedforward neural networks
- hidden neurons
- radial basis function
- learning rate
- chaotic neural network
- network architecture
- single hidden layer
- hidden nodes
- probabilistic model
- bayesian networks
- single layer
- generative model
- multi layer perceptron
- hidden units
- sigmoid function
- genetic algorithm
- fuzzy neural network
- multi layer
- uncertain data
- basis functions
- fault diagnosis
- pattern recognition
- training algorithm
- rbf neural network
- extreme learning machine
- prior knowledge