Small-scale proxies for large-scale Transformer training instabilities.

Mitchell Wortsman Peter J. Liu Lechao Xiao Katie E. Everett Alexander A. Alemi Ben Adlam John D. Co-Reyes Izzeddin Gur Abhishek Kumar Roman Novak Jeffrey Pennington Jascha Sohl-Dickstein Kelvin Xu Jaehoon Lee Justin Gilmer Simon Kornblith

Published in: ICLR (2024)

Keyphrases