Grokking as the transition from lazy to rich training dynamics.

Tanishq Kumar Blake Bordelon Samuel J. Gershman Cengiz Pehlevan

Published in: ICLR (2024)

Keyphrases

training set
training examples
training process
recurrent networks
training samples
dynamic model
training algorithm
data sets
reinforcement learning
online learning
feedforward neural networks