How important are activation functions in regression and classification? A survey, performance comparison, and future directions.
Ameya D. JagtapGeorge Em KarniadakisPublished in: CoRR (2022)
Keyphrases
- future directions
- activation function
- lessons learned
- support vector
- model selection
- current challenges
- pattern recognition
- machine learning
- feature vectors
- feature extraction
- neural network
- classification accuracy
- supervised learning
- support vector machine svm
- regression model
- neural architecture
- training phase
- radial basis function
- text classification
- support vector machine
- artificial neural networks
- feature space
- high dimensional
- classification algorithm
- feature set
- fuzzy logic
- decision trees
- hidden layer
- multi layer perceptron
- feature selection
- current status
- training set