Login / Signup

The Cost of Down-Scaling Language Models: Fact Recall Deteriorates before In-Context Learning.

Tian JinNolan ClementXin DongVaishnavh NagarajanMichael CarbinJonathan Ragan-KelleyGintare Karolina Dziugaite
Published in: CoRR (2023)
Keyphrases
  • language model
  • language modeling
  • probabilistic model
  • document retrieval
  • speech recognition
  • test collection
  • precision and recall
  • context sensitive