From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference.
Siddharth SamsiDan ZhaoJoseph McDonaldBaolin LiAdam MichaleasMichael JonesWilliam BergeronJeremy KepnerDevesh TiwariVijay GadepallyPublished in: CoRR (2023)
Keyphrases
- language model
- n gram
- language modeling
- out of vocabulary
- translation model
- document representation
- multiword
- language modelling
- statistical language modeling
- speech recognition
- document retrieval
- retrieval model
- probabilistic model
- document level
- word error rate
- test collection
- query expansion
- ad hoc information retrieval
- query terms
- mixture model
- information retrieval
- bayesian inference
- statistical language models
- word segmentation
- vector space model
- context sensitive
- dependency structure
- smoothing methods
- relevance model
- bayesian networks
- part of speech
- query specific
- pseudo relevance feedback
- document length
- word recognition
- okapi bm
- probability distribution
- keywords
- language model for information retrieval