Two Counterexamples to Tokenization and the Noiseless Channel.

Marco Cognetta Vilém Zouhar Sangwhan Moon Naoaki Okazaki

Published in: LREC/COLING (2024)

Keyphrases

noisy data
multi channel
multiple access
named entities
biomedical text
biomedical information retrieval
video sequences
communication systems
channel capacity
communication channels
noisy channel