Login / Signup
Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be.
Frederik Kunstner
Jacques Chen
Jonathan Wilder Lavington
Mark Schmidt
Published in:
ICLR (2023)
Keyphrases
</>
noise reduction
missing data
random noise
input data
signal to noise ratio
gaussian noise
additive noise
stochastic gradient descent
neural network
learning algorithm
image processing
pairwise
image restoration
noisy data