• search
    search
  • reviewers
    reviewers
  • feeds
    feeds
  • assignments
    assignments
  • settings
  • logout

Data-Juicer: A One-Stop Data Processing System for Large Language Models.

Daoyuan ChenYilun HuangZhijian MaHesen ChenXuchen PanCe GeDawei GaoYuexiang XieZhaoyang LiuJinyang GaoYaliang LiBolin DingJingren Zhou
Published in: CoRR (2023)
Keyphrases
  • data processing
  • language model
  • data analysis
  • knowledge discovery
  • data sources
  • n gram
  • information retrieval
  • training data
  • statistical language models