Joint Optimization of Tokenization and Downstream Model.

Tatsuya Hiraoka Sho Takase Kei Uchiumi Atsushi Keyaki Naoaki Okazaki

Published in: ACL/IJCNLP (Findings) (2021)

Keyphrases

joint optimization
formal model
high level
prior knowledge
probabilistic model
statistical model
experimental data
data sets
computational model
image classification
mathematical model
parameter estimation
em algorithm
language model
management system
objective function
feature extraction
social networks