Login / Signup

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Yi TayMostafa DehghaniSamira AbnarHyung Won ChungWilliam FedusJinfeng RaoSharan NarangVinh Q. TranDani YogatamaDonald Metzler
Published in: CoRR (2022)
Keyphrases
  • objective function
  • prior knowledge
  • e learning
  • knowledge base
  • decision trees
  • pairwise
  • probabilistic model
  • upper bound
  • high order
  • inductive bias