Shortformer: Better Language Modeling using Shorter Inputs.
Ofir PressNoah A. SmithMike LewisPublished in: ACL/IJCNLP (1) (2021)
Keyphrases
- language modeling
- language model
- information retrieval
- retrieval model
- query expansion
- cross lingual
- probabilistic model
- n gram
- statistical language models
- text classification
- test collection
- document retrieval
- mixture model
- information retrieval systems
- relevance model
- trec collections
- improvements in retrieval effectiveness
- comparable corpora
- term weighting schemes
- word segmentation
- vector space model
- high dimensional