Unified Scaling Laws for Routed Language Models.
Aidan ClarkDiego de Las CasasAurelia GuyArthur MenschMichela PaganiniJordan HoffmannBogdan DamocBlake A. HechtmanTrevor CaiSebastian BorgeaudGeorge van den DriesscheEliza RutherfordTom HenniganMatthew JohnsonKatie MillicanAlbin CassirerChris JonesElena BuchatskayaDavid BuddenLaurent SifreSimon OsinderoOriol VinyalsJack W. RaeErich ElsenKoray KavukcuogluKaren SimonyanPublished in: CoRR (2022)
Keyphrases
- language model
- language modeling
- document retrieval
- n gram
- information retrieval
- probabilistic model
- language modelling
- speech recognition
- query expansion
- smoothing methods
- test collection
- retrieval model
- statistical language models
- context sensitive
- pseudo relevance feedback
- language models for information retrieval
- word error rate
- language model for information retrieval
- document ranking
- vector space model
- decision trees
- error rate
- okapi bm
- information extraction