Login / Signup
The Foundations of Tokenization: Statistical and Computational Concerns.
Juan Luis Gastaldi
John Terilla
Luca Malagutti
Brian DuSell
Tim Vieira
Ryan Cotterell
Published in:
CoRR (2024)
Keyphrases
</>
neural network
artificial intelligence
statistical analysis
information theoretic
statistical information
statistical methods
computational power
database
machine learning
learning algorithm
evolutionary algorithm
mathematical programming
statistical data