On the Computational Power of Decoder-Only Transformer Language Models.
Jesse RobertsPublished in: CoRR (2023)
Keyphrases
- computational power
- language model
- language modeling
- parallel processing
- computing power
- n gram
- document retrieval
- speech recognition
- probabilistic model
- information retrieval
- retrieval model
- low complexity
- context sensitive
- language modelling
- query terms
- query expansion
- test collection
- statistical language models
- smoothing methods
- memory requirements
- vector space model
- pseudo relevance feedback
- translation model
- distributed video coding
- document ranking
- motion estimation
- ad hoc information retrieval
- hardware architectures
- language model for information retrieval
- language models for information retrieval
- okapi bm
- multithreading
- recommender systems