Amplifying Sine Unit: An Oscillatory Activation Function for Deep Neural Networks to Recover Nonlinear Oscillations Efficiently.
Jamshaid Ul RahmanFaiza MakhdoomDianchen LuPublished in: CoRR (2023)
Keyphrases
- activation function
- neural network
- hidden layer
- feed forward
- back propagation
- feed forward neural networks
- nonlinear functions
- artificial neural networks
- hidden neurons
- recurrent neural networks
- multilayer perceptron
- learning rate
- feedforward neural networks
- backpropagation algorithm
- neural nets
- radial basis function
- chaotic neural network
- single hidden layer
- network architecture
- basis functions
- multi layer
- extreme learning machine
- hidden nodes
- multi layer perceptron
- pattern recognition
- hidden units
- single layer
- sigmoid function
- genetic algorithm
- fuzzy neural network
- rbf network
- bp neural network
- fuzzy sets
- trained neural network
- decision making
- learning algorithm