Login / Signup

How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese.

Takuro FujiiKoki ShibataAtsuki YamaguchiTerufumi MorishitaYasuhiro Sogawa
Published in: ACL (student) (2023)
Keyphrases
  • case study
  • relational databases
  • language independent
  • multiple tasks
  • cross lingual
  • databases
  • web services
  • decision trees
  • database systems
  • information retrieval systems
  • expressive power
  • test bed
  • computer programs