Login / Signup

GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length.

Hongye JinXiaotian HanJingfeng YangZhimeng JiangChia-Yuan ChangXia Hu
Published in: CoRR (2023)
Keyphrases
  • neural network
  • training process
  • databases
  • artificial intelligence
  • information systems
  • information technology
  • training set
  • training samples
  • training examples
  • test set
  • training phase
  • fixed length
  • total length