Tokenization with Factorized Subword Encoding.

David Samuel Lilja Øvrelid

Published in: CoRR (2023)

Keyphrases

n gram
named entities
fractal image compression
biomedical information retrieval
broadcast news
neural network
data mining
matrix factorization
variable length
biomedical text
genetic algorithm
social networks
website
recommender systems
spoken document retrieval