PaLM: Scaling Language Modeling with Pathways.
Aakanksha ChowdherySharan NarangJacob DevlinMaarten BosmaGaurav MishraAdam RobertsPaul BarhamHyung Won ChungCharles SuttonSebastian GehrmannParker SchuhKensen ShiSasha TsvyashchenkoJoshua MaynezAbhishek RaoParker BarnesYi TayNoam ShazeerVinodkumar PrabhakaranEmily ReifNan DuBen HutchinsonReiner PopeJames BradburyJacob AustinMichael IsardGuy Gur-AriPengcheng YinToju DukeAnselm LevskayaSanjay GhemawatSunipa DevHenryk MichalewskiXavier GarciaVedant MisraKevin RobinsonLiam FedusDenny ZhouDaphne IppolitoDavid LuanHyeontaek LimBarret ZophAlexander SpiridonovRyan SepassiDavid DohanShivani AgrawalMark OmernickAndrew M. DaiThanumalayan Sankaranarayana PillaiMarie PellatAitor LewkowyczErica MoreiraRewon ChildOleksandr PolozovKatherine LeeZongwei ZhouXuezhi WangBrennan SaetaMark DiazOrhan FiratMichele CatastaJason WeiKathy Meier-HellsternDouglas EckJeff DeanSlav PetrovNoah FiedelPublished in: J. Mach. Learn. Res. (2023)
Keyphrases
- language modeling
- language model
- retrieval model
- information retrieval
- query expansion
- probabilistic model
- n gram
- cross lingual
- sentence retrieval
- improvements in retrieval effectiveness
- text classification
- relevance model
- test collection
- language modeling approaches
- document retrieval
- high dimensional
- generative model
- document length
- statistical language models
- bayesian networks
- multimedia