Smoothing piecewise linear activation functions based on mollified square root functions.
Tony Yuxiang PanGuangyu YangJunli ZhaoJieyu DingPublished in: Math. Found. Comput. (2024)
Keyphrases
- piecewise linear
- square root
- activation function
- neural network
- floating point
- basis functions
- feed forward
- dynamic programming
- kalman filtering
- back propagation
- arrival rate
- artificial neural networks
- neural nets
- hidden layer
- probability density function
- network architecture
- linear combination
- learning rate
- euclidean space
- hyperplane
- radial basis function
- nearest neighbor
- bayesian networks
- neural network model
- training data