Wine is Not v i n. - On the Compatibility of Tokenizations Across Languages.

Antonis Maronikolakis Philipp Dufter Hinrich Schütze

Published in: CoRR (2021)

Keyphrases

multi lingual
language independent
cross lingual
language identification
natural language
artificial neural networks
database
real world
case study
digital libraries