Shortformer: Better Language Modeling using Shorter Inputs.
Ofir PressNoah A. SmithMike LewisPublished in: CoRR (2020)
Keyphrases
- language modeling
- language model
- information retrieval
- retrieval model
- cross lingual
- probabilistic model
- query expansion
- n gram
- text classification
- document retrieval
- statistical language models
- language modeling approaches
- sentence retrieval
- term weighting schemes
- test collection
- tf idf
- relevance model
- trec collections
- retrieval effectiveness
- comparable corpora
- multimedia
- improvements in retrieval effectiveness
- machine learning