ReLU soothes the NTK condition number and accelerates optimization for wide neural networks.

Chaoyue Liu Like Hui

Published in: CoRR (2023)

Keyphrases

neural network
condition number
condition numbers
pattern recognition
back propagation
machine learning
artificial neural networks
linear algebra
multiscale