The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives.
Elena VoitaRico SennrichIvan TitovPublished in: EMNLP/IJCNLP (1) (2019)
Keyphrases
- machine translation
- language modeling
- cross lingual
- language model
- language independent
- retrieval model
- sentence retrieval
- finite state transducers
- n gram
- natural language processing
- statistical machine translation
- translation model
- target language
- query expansion
- text classification
- information retrieval systems
- information extraction
- artificial intelligence
- statistical translation models
- machine translation system
- news articles
- knowledge representation
- knowledge base