The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models.
Ulme WennbergGustav Eje HenterPublished in: CoRR (2021)
Keyphrases
- language model
- translation invariant
- language modeling
- probabilistic model
- n gram
- document retrieval
- denoising
- language modelling
- multiscale
- mathematical morphology
- retrieval model
- statistical language models
- query expansion
- information retrieval
- object identification
- test collection
- relevance model
- smoothing methods
- wavelet transform
- language models for information retrieval
- wavelet packet
- image classification
- computer vision
- gray scale
- edge detection
- feature space