A Formal Perspective on Byte-Pair Encoding.

Vilém Zouhar Clara Meister Juan Luis Gastaldi Li Du Tim Vieira Mrinmaya Sachan Ryan Cotterell

Published in: CoRR (2023)

Keyphrases

pairwise
viewpoint
genetic algorithm
formal model
formal specification
encoding scheme
real time
information retrieval
artificial intelligence
search algorithm
image compression