Character-Level Language Modeling with Deeper Self-Attention.
Rami Al-RfouDokook ChoeNoah ConstantMandy GuoLlion JonesPublished in: AAAI (2019)
Keyphrases
- language modeling
- language model
- retrieval model
- query expansion
- information retrieval
- probabilistic model
- n gram
- cross lingual
- sentence retrieval
- statistical language models
- text classification
- improvements in retrieval effectiveness
- statistical language modeling
- word segmentation
- comparable corpora
- dirichlet prior
- test collection
- bayesian networks