The Fine-Grained Complexity of Gradient Computation for Training Large Language Models.
Josh AlmanZhao SongPublished in: CoRR (2024)
Keyphrases
- fine grained
- language model
- language modeling
- coarse grained
- document retrieval
- probabilistic model
- retrieval model
- n gram
- speech recognition
- language modelling
- statistical language models
- information retrieval
- query expansion
- test collection
- context sensitive
- access control
- smoothing methods
- relevance model
- spoken term detection
- vector space model
- recommender systems
- query terms
- translation model
- ad hoc retrieval
- text categorization
- text mining
- feature selection