Unified Scaling Laws for Routed Language Models.
Aidan ClarkDiego de Las CasasAurelia GuyArthur MenschMichela PaganiniJordan HoffmannBogdan DamocBlake A. HechtmanTrevor CaiSebastian BorgeaudGeorge van den DriesscheEliza RutherfordTom HenniganMatthew J. JohnsonAlbin CassirerChris JonesElena BuchatskayaDavid BuddenLaurent SifreSimon OsinderoOriol VinyalsMarc'Aurelio RanzatoJack W. RaeErich ElsenKoray KavukcuogluKaren SimonyanPublished in: ICML (2022)
Keyphrases
- language model
- language modeling
- n gram
- document retrieval
- information retrieval
- query expansion
- probabilistic model
- context sensitive
- retrieval model
- speech recognition
- test collection
- language modelling
- ad hoc information retrieval
- pseudo relevance feedback
- query specific
- language model for information retrieval
- query terms
- document ranking
- language models for information retrieval
- translation model
- document length
- word error rate
- pseudo feedback
- statistical language models
- machine learning