The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives.
Elena VoitaRico SennrichIvan TitovPublished in: CoRR (2019)
Keyphrases
- machine translation
- language modeling
- cross lingual
- language model
- language independent
- finite state transducers
- sentence retrieval
- n gram
- query expansion
- cross language information retrieval
- natural language
- comparable corpora
- statistical machine translation
- information retrieval
- retrieval model
- natural language processing
- web search
- translation model
- word alignment
- information extraction
- probabilistic model