Greed is All You Need: An Evaluation of Tokenizer Inference Methods.

Omri Uzan Craig W. Schmidt Chris Tanner Yuval Pinter

Published in: CoRR (2024)

Keyphrases

database
real world
information systems
evaluation criteria
evaluation methods
data sets
genetic algorithm
computer vision
multimedia
website
multi agent
information technology
gold standard
evaluation model