Neural Network Weights Do Not Converge to Stationary Points: An Invariant Measure Perspective.

Jingzhao Zhang Haochuan Li Suvrit Sra Ali Jadbabaie

Published in: ICML (2022)

Keyphrases

neural network
stationary points
similarity measure
fixed point
nonlinear programming
karush kuhn tucker
linear combination
mathematical programming
constrained optimization
convergence analysis
dynamic programming
sensitivity analysis