SGD with Large Step Sizes Learns Sparse Features.

Maksym Andriushchenko Aditya Vardhan Varre Loucas Pillaud-Vivien Nicolas Flammarion

Published in: ICML (2023)

Keyphrases

step size
feature vectors
feature extraction
feature space
faster convergence
neural network
image segmentation
image features
sparse representation