ELLA-V: Stable Neural Codec Language Modeling with Alignment-guided Sequence Reordering.
Yakun SongZhuo ChenXiaofei WangZiyang MaXie ChenPublished in: CoRR (2024)
Keyphrases
- language modeling
- language model
- information retrieval
- retrieval model
- query expansion
- n gram
- probabilistic model
- text classification
- neural network
- improvements in retrieval effectiveness
- cross lingual
- statistical language models
- machine learning
- statistical language modeling
- information retrieval systems
- sentence retrieval
- dirichlet prior
- language modeling approaches
- document retrieval
- generative model
- word segmentation
- comparable corpora
- training set
- keywords
- search engine