• search
    search
  • reviewers
    reviewers
  • feeds
    feeds
  • assignments
    assignments
  • settings
  • logout

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Yi TayMostafa DehghaniSamira AbnarHyung Won ChungWilliam FedusJinfeng RaoSharan NarangVinh Q. TranDani YogatamaDonald Metzler
Published in: CoRR (2022)
Keyphrases
  • objective function
  • prior knowledge
  • e learning
  • knowledge base
  • decision trees
  • pairwise
  • probabilistic model
  • upper bound
  • high order
  • inductive bias