Multi-word Tokenization for Sequence Compression.

Leonidas Gee Leonardo Rigutini Marco Ernandes Andrea Zugarini

Published in: EMNLP (Industry Track) (2023)

Keyphrases

multiword
context sensitive
proper nouns
text clustering
text segments
information retrieval
language model
named entities