Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.
Aarohi SrivastavaAbhinav RastogiAbhishek RaoAbu Awal Md ShoebAbubakar AbidAdam FischAdam R. BrownAdam SantoroAditya GuptaAdrià Garriga-AlonsoAgnieszka KluskaAitor LewkowyczAkshat AgarwalAlethea PowerAlex RayAlex WarstadtAlexander W. KocurekAli SafayaAli TazarvAlice XiangAlicia ParrishAllen NieAman HussainAmanda AskellAmanda DsouzaAmbrose SloneAmeet RahaneAnantharaman S. IyerAnders AndreassenAndrea MadottoAndrea SantilliAndreas StuhlmüllerAndrew M. DaiAndrew LaAndrew K. LampinenAndy ZouAngela JiangAngelica ChenAnh VuongAnimesh GuptaAnna GottardiAntonio NorelliAnu VenkateshArash GholamidavoodiArfa TabassumArul MenezesArun KirubarajanAsher MullokandovAshish SabharwalAustin HerrickAvia EfratAykut ErdemAyla KarakasB. Ryan RobertsBao Sheng LoeBarret ZophBartlomiej BojanowskiBatuhan ÖzyurtBehnam HedayatniaBehnam NeyshaburBenjamin IndenBenno SteinBerk EkmekciBill Yuchen LinBlake HowaldBryan OrinionCameron DiaoCameron DourCatherine StinsonCedrick ArguetaCèsar Ferri RamírezChandan SinghCharles RathkopfChenlin MengChitta BaralChiyu WuChris Callison-BurchChris WaitesChristian VoigtChristopher D. ManningChristopher PottsCindy RamirezClara E. RiveraClemencia SiroColin RaffelCourtney AshcraftCristina GarbaceaDamien SileoDan GarretteDan HendrycksDan KilmanDan RothDaniel FreemanDaniel KhashabiDaniel LevyDaniel Moseguí GonzálezDanielle PerszykDanny HernandezDanqi ChenDaphne IppolitoDar GilboaDavid DohanDavid DrakardDavid JurgensDebajyoti DattaDeep GanguliDenis EmelinDenis KleykoDeniz YuretDerek ChenDerek TamDieuwke HupkesDiganta MisraDilyar BuzanDimitri Coelho MolloDiyi YangDong-Ho LeeDylan SchraderEkaterina ShutovaEkin Dogus CubukElad SegalEleanor HagermanElizabeth BarnesElizabeth DonowayEllie PavlickEmanuele RodolàEmma LamEric ChuEric TangErkut ErdemErnie ChangEthan A. ChiEthan DyerEthan J. JerzakEthan KimEunice Engefu ManyasiEvgenii ZheltonozhskiiFanyue XiaFatemeh SiarFernando Martínez-PlumedFrancesca HappéFrançois CholletFrieda RongGaurav MishraGenta Indra WinataGerard de MeloGermán KruszewskiGiambattista ParascandoloGiorgio MarianiGloria WangGonzalo Jaimovitch-LópezGregor BetzGuy Gur-AriHana GalijasevicHannah KimHannah RashkinHannaneh HajishirziHarsh MehtaHayden BogarHenry ShevlinHinrich SchützeHiromu YakuraHongming ZhangHugh Mee WongIan NgIsaac NobleJaap JumeletJack GeissingerJackson KernionJacob HiltonJaehoon LeeJaime Fernández FisacJames B. SimonJames KoppelJames ZhengJames ZouJan KoconJana ThompsonJanelle WingfieldJared KaplanJarema RadomJascha Sohl-DicksteinJason PhangJason WeiJason YosinskiJekaterina NovikovaJelle BosscherJennifer MarshJeremy KimJeroen TaalJesse H. EngelJesujoba AlabiJiacheng XuJiaming SongJillian TangJoan WaweruJohn BurdenJohn MillerJohn U. BalisJonathan BatchelderJonathan BerantJörg FrohbergJos RozenJosé Hernández-OralloJoseph BoudemanJoseph GuerrJoseph JonesJoshua B. TenenbaumJoshua S. RuleJoyce ChuaKamil KanclerzKaren LivescuKarl KrauthKarthik GopalakrishnanKaterina IgnatyevaKatja MarkertKaustubh D. DholeKevin GimpelKevin OmondiKory MathewsonKristen ChiafulloKsenia ShkarutaKumar ShridharKyle McDonellKyle RichardsonLaria ReynoldsLeo GaoLi ZhangLiam DuganLianhui QinLidia Contreras OchandoLouis-Philippe MorencyLuca MoschellaLucas LamLucy NobleLudwig SchmidtLuheng HeLuis Oliveros ColónLuke MetzLütfi Kerem SenelMaarten BosmaMaarten SapMaartje ter HoeveMaheen FarooqiManaal FaruquiMantas MazeikaMarco BaturanMarco MarelliMarco MaruMaría José Ramírez-QuintanaMarie TolkiehnMario GiulianelliMartha LewisMartin PotthastMatthew L. LeavittMatthias HagenMátyás SchubertMedina BaitemirovaMelody ArnaudMelvin McElrathMichael A. YeeMichael CohenMichael GuMichael I. IvanitskiyMichael StarrittMichael StrubeMichal SwedrowskiMichele BevilacquaMichihiro YasunagaMihir KaleMike CainMimee XuMirac SuzgunMitch WalkerMo TiwariMohit BansalMoin AminnaseriMor GevaMozhdeh GheiniMukund Varma T.Nanyun PengNathan A. ChiNayeon LeeNeta Gur-Ari KrakoverNicholas CameronNicholas RobertsNick DoironNicole MartinezNikita NangiaNiklas DeckersNiklas MuennighoffNitish Shirish KeskarNiveditha IyerNoah ConstantNoah FiedelNuan WenOliver ZhangOmar AghaOmar ElbaghdadiOmer LevyOwain EvansPablo Antonio Moreno CasaresParth DoshiPascale FungPaul Pu LiangPaul VicolPegah AlipoormolabashiPeiyuan LiaoPercy LiangPeter ChangPeter EckersleyPhu Mon HtutPinyu HwangPiotr MilkowskiPiyush PatilPouya PezeshkpourPriti OliQiaozhu MeiQing LyuQinlang ChenRabin BanjadeRachel Etta RudolphRaefer GabrielRahel HabackerRamon RiscoRaphaël MillièreRhythm GargRichard BarnesRif A. SaurousRiku ArakawaRobbe RaymaekersRobert FrankRohan SikandRoman NovakRoman SitelewRonan LeBrasRosanne LiuRowan JacobsRui ZhangRuslan SalakhutdinovRyan ChiRyan LeeRyan StovallRyan TeehanRylan YangSahib SinghSaif M. MohammadSajant AnandSam DillavouSam ShleiferSam WisemanSamuel GruetterSamuel R. BowmanSamuel S. SchoenholzSanghyun HanSanjeev KwatraSarah A. RousSarik GhazarianSayan GhoshSean CaseySebastian BischoffSebastian GehrmannSebastian SchusterSepideh SadeghiShadi HamdanSharon ZhouShashank SrivastavaSherry ShiShikhar SinghShima AsaadiShixiang Shane GuShubh PachchigarShubham ToshniwalShyam UpadhyayShyamolima (Shammie) DebnathSiamak ShakeriSimon ThormeyerSimone MelziSiva ReddySneha Priscilla MakiniSoo-Hwan LeeSpencer ToreneSriharsha HatwarStanislas DehaeneStefan DivicStefano ErmonStella BidermanStephanie LinStephen PrasadSteven T. PiantadosiStuart M. ShieberSummer MisherghiSvetlana KiritchenkoSwaroop MishraTal LinzenTal SchusterTao LiTao YuTariq AliTatsu HashimotoTe-Lin WuThéo DesbordesTheodore RothschildThomas PhanTianle WangTiberius NkinyiliTimo SchickTimofei KornevTitus TundunyTobias GerstenbergTrenton ChangTrishala NeerajTushar KhotTyler ShultzUri ShahamVedant MisraVera DembergVictoria NyamaiVikas RaunakVinay V. RamaseshVinay Uday PrabhuVishakh PadmakumarVivek SrikumarWilliam FedusWilliam SaundersWilliam ZhangWout VossenXiang RenXiaoyu TongXinran ZhaoXinyi WuXudong ShenYadollah YaghoobzadehYair LakretzYangqiu SongYasaman BahriYejin ChoiYichi YangYiding HaoYifu ChenYonatan BelinkovYu HouYufang HouYuntao BaiZachary SeidZhuoye ZhaoZijian WangZijie J. WangZirui WangZiyi WuPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- language model
- language modeling
- n gram
- probabilistic model
- information retrieval
- speech recognition
- document retrieval
- retrieval model
- query expansion
- test collection
- language modelling
- vector space model
- smoothing methods
- statistical language models
- pseudo relevance feedback
- language models for information retrieval
- context sensitive
- translation model
- query terms
- ad hoc information retrieval
- document ranking
- language model for information retrieval
- spoken term detection
- word error rate
- cross lingual