Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Yi Tay Mostafa Dehghani Samira Abnar Hyung Won Chung William Fedus Jinfeng Rao Sharan Narang Vinh Q. Tran Dani Yogatama Donald Metzler

Published in: EMNLP (Findings) (2023)

Keyphrases