Login / Signup

Data-Juicer: A One-Stop Data Processing System for Large Language Models.

Daoyuan ChenYilun HuangZhijian MaHesen ChenXuchen PanCe GeDawei GaoYuexiang XieZhaoyang LiuJinyang GaoYaliang LiBolin DingJingren Zhou
Published in: CoRR (2023)
Keyphrases
  • data processing
  • language model
  • data analysis
  • knowledge discovery
  • data sources
  • n gram
  • information retrieval
  • training data
  • statistical language models