On the Activation Function Dependence of the Spectral Bias of Neural Networks.
Qingguo HongQinyang TanJonathan W. SiegelJinchao XuPublished in: CoRR (2022)
Keyphrases
- activation function
- neural network
- feed forward
- back propagation
- hidden layer
- feed forward neural networks
- artificial neural networks
- multilayer perceptron
- neural nets
- backpropagation algorithm
- hidden neurons
- single hidden layer
- learning rate
- fuzzy neural network
- feedforward neural networks
- network architecture
- basis functions
- chaotic neural network
- recurrent neural networks
- single layer
- sigmoid function
- hidden nodes
- multi layer perceptron
- pattern recognition
- genetic algorithm
- extreme learning machine
- neural network model
- multi layer