Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking.

Kaifeng Lyu Jikai Jin Zhiyuan Li Simon S. Du Jason D. Lee Wei Hu

Published in: CoRR (2023)

Keyphrases

computer vision
three dimensional
neural network
artificial intelligence
training phase
learning phase
preprocessing phase
genetic algorithm
information systems
objective function
relational databases
learning process
phase information
single phase
phase difference