GELU Activation Function in Deep Learning: A Comprehensive Mathematical Analysis and Performance.
Minhyeok LeePublished in: CoRR (2023)
Keyphrases
- mathematical analysis
- deep learning
- activation function
- neural network
- hidden layer
- feed forward
- artificial neural networks
- back propagation
- unsupervised learning
- multilayer perceptron
- network architecture
- machine learning
- neural nets
- radial basis function
- learning rate
- fuzzy neural network
- basis functions
- weakly supervised
- training phase
- bayesian networks
- learning strategies
- image processing
- decision making
- multi layer perceptron
- learning algorithm
- data mining