Luke Zettlemoyer

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 338

Top Venues

CoRR

EMNLP

ACL (1)

ICLR

Publications

Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
OLMo: Accelerating the Science of Language Models. CoRR (2024)
Haoqiang Kang, Terra Blevins, Luke Zettlemoyer
Comparing Hallucination Detection Metrics for Multilingual Generation. CoRR (2024)
Jiacheng Liu, Sewon Min, Luke Zettlemoyer, Yejin Choi, Hannaneh Hajishirzi
Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens. CoRR (2024)
Michael Duan, Anshuman Suri, Niloofar Mireshghallah, Sewon Min, Weijia Shi, Luke Zettlemoyer, Yulia Tsvetkov, Yejin Choi, David Evans, Hannaneh Hajishirzi
Do Membership Inference Attacks Work on Large Language Models? CoRR (2024)
Terra Blevins, Tomasz Limisiewicz, Suchin Gururangan, Margaret Li, Hila Gonen, Noah A. Smith, Luke Zettlemoyer
Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models. CoRR (2024)
Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research. CoRR (2024)
Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, Hannaneh Hajishirzi
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation. EMNLP (2023)
Hu Xu, Saining Xie, Xiaoqing Ellen Tan, Po-Yao Huang, Russell Howes, Vasu Sharma, Shang-Wen Li, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
Demystifying CLIP Data. CoRR (2023)
Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy
LIMA: Less Is More for Alignment. CoRR (2023)
Yu Meng, Jitin Krishnan, Sinong Wang, Qifan Wang, Yuning Mao, Han Fang, Marjan Ghazvininejad, Jiawei Han, Luke Zettlemoyer
Representation Deficiency in Masked Language Modeling. CoRR (2023)
Hila Gonen, Srini Iyer, Terra Blevins, Noah A. Smith, Luke Zettlemoyer
Demystifying Prompts in Language Models via Perplexity Estimation. EMNLP (Findings) (2023)
Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Luke Zettlemoyer, Omer Levy, Jason Weston, Mike Lewis
Self-Alignment with Instruction Backtranslation. CoRR (2023)
Tim Dettmers, Luke Zettlemoyer
The case for 4-bit precision: k-bit Inference Scaling Laws. ICML (2023)
Chenglei Si, Weijia Shi, Chen Zhao, Luke Zettlemoyer, Jordan L. Boyd-Graber
Mixture of Prompt Experts for Generalizable and Interpretable Question Answering. CoRR (2023)
Boshi Wang, Sewon Min, Xiang Deng, Jiaming Shen, You Wu, Luke Zettlemoyer, Huan Sun
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters. ACL (1) (2023)
Xinyan Yu, Sewon Min, Luke Zettlemoyer, Hannaneh Hajishirzi
CREPE: Open-Domain Question Answering with False Presuppositions. ACL (1) (2023)
Mengzhou Xia, Mikel Artetxe, Chunting Zhou, Xi Victoria Lin, Ramakanth Pasunuru, Danqi Chen, Luke Zettlemoyer, Veselin Stoyanov
Training Trajectories of Language Models Across Scales. ACL (1) (2023)
Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Xi Victoria Lin, Noah A. Smith, Luke Zettlemoyer, Scott Yih, Mike Lewis
In-Context Pretraining: Language Modeling Beyond Document Boundaries. CoRR (2023)
Weijia Shi, Xiaochuang Han, Hila Gonen, Ari Holtzman, Yulia Tsvetkov, Luke Zettlemoyer
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too? EMNLP (Findings) (2023)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. IEEE ACM Trans. Audio Speech Lang. Process. 31 (2023)
Ari Holtzman, Peter West, Luke Zettlemoyer
Generative Models as a Complex Systems Science: How can we make sense of large language model behavior? CoRR (2023)
Terra Blevins, Hila Gonen, Luke Zettlemoyer
Prompting Language Models for Linguistic Structure. ACL (1) (2023)
Tianlu Wang, Ping Yu, Xiaoqing Ellen Tan, Sean O'Brien, Ramakanth Pasunuru, Jane Dwivedi-Yu, Olga Golovneva, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz
Shepherd: A Critic for Language Model Generation. CoRR (2023)
Olga Golovneva, Sean O'Brien, Ramakanth Pasunuru, Tianlu Wang, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz
PathFinder: Guided Search over Multi-Step Reasoning Paths. CoRR (2023)
Chenglei Si, Weijia Shi, Chen Zhao, Luke Zettlemoyer, Jordan L. Boyd-Graber
Getting MoRE out of Mixture of Language Model Reasoning Experts. EMNLP (Findings) (2023)
Suchin Gururangan, Margaret Li, Mike Lewis, Weijia Shi, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
Scaling Expert Language Models with Unsupervised Domain Discovery. CoRR (2023)
Hu Xu, Saining Xie, Po-Yao Huang, Licheng Yu, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
CiT: Curation in Training for Effective Vision-Language Data. ICCV (2023)
Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Michael Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages. CoRR (2023)
Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, Hannaneh Hajishirzi
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation. CoRR (2023)
Bhargavi Paranjape, Scott M. Lundberg, Sameer Singh, Hannaneh Hajishirzi, Luke Zettlemoyer, Marco Túlio Ribeiro
ART: Automatic multi-step reasoning and tool-use for large language models. CoRR (2023)
Sewon Min, Suchin Gururangan, Eric Wallace, Hannaneh Hajishirzi, Noah A. Smith, Luke Zettlemoyer
SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore. CoRR (2023)
Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
Scaling Laws for Generative Mixed-Modal Language Models. ICML (2023)
Suzanna Sia, Anton Belyy, Amjad Almahairi, Madian Khabsa, Luke Zettlemoyer, Lambert Mathias
Logical Satisfiability of Counterfactuals for Faithful Explanations in NLI. AAAI (2023)
Mitchell Wortsman, Tim Dettmers, Luke Zettlemoyer, Ari Morcos, Ali Farhadi, Ludwig Schmidt
Stable and low-precision training for large-scale vision-language models. CoRR (2023)
Hongjin Su, Weijia Shi, Jungo Kasai, Yizhong Wang, Yushi Hu, Mari Ostendorf, Wen-tau Yih, Noah A. Smith, Luke Zettlemoyer, Tao Yu
One Embedder, Any Task: Instruction-Finetuned Text Embeddings. ACL (Findings) (2023)
Mitchell Wortsman, Tim Dettmers, Luke Zettlemoyer, Ari Morcos, Ali Farhadi, Ludwig Schmidt
Stable and low-precision training for large-scale vision-language models. NeurIPS (2023)
Mikel Artetxe, Vedanuj Goswami, Shruti Bhosale, Angela Fan, Luke Zettlemoyer
Revisiting Machine Translation for Cross-lingual Classification. CoRR (2023)
Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, Thomas Scialom
Toolformer: Language Models Can Teach Themselves to Use Tools. CoRR (2023)
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. CoRR (2023)
Sewon Min, Weijia Shi, Mike Lewis, Xilun Chen, Wen-tau Yih, Hannaneh Hajishirzi, Luke Zettlemoyer
Nonparametric Masked Language Modeling. ACL (Findings) (2023)
Chunting Zhou, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy
LIMA: Less Is More for Alignment. NeurIPS (2023)
Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages. WMT (2023)
Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, Tao Yu
Binding Language Models in Symbolic Languages. ICLR (2023)
Marjan Ghazvininejad, Hila Gonen, Luke Zettlemoyer
Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation. CoRR (2023)
Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Rich James, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih
REPLUG: Retrieval-Augmented Black-Box Language Models. CoRR (2023)
Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models. EMNLP (2023)
Victor Zhong, Weijia Shi, Wen-tau Yih, Luke Zettlemoyer
RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering. EMNLP (Findings) (2023)
Yuhang Lai, Chengxi Li, Yiming Wang, Tianyi Zhang, Ruiqi Zhong, Luke Zettlemoyer, Wen-Tau Yih, Daniel Fried, Sida I. Wang, Tao Yu
DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation. ICML (2023)
Weijia Shi, Xiaochuang Han, Mike Lewis, Yulia Tsvetkov, Luke Zettlemoyer, Scott Wen-tau Yih
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding. CoRR (2023)
Michihiro Yasunaga, Armen Aghajanyan, Weijia Shi, Richard James, Jure Leskovec, Percy Liang, Mike Lewis, Luke Zettlemoyer, Wen-Tau Yih
Retrieval-Augmented Multimodal Language Modeling. ICML (2023)
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. NeurIPS (2023)
Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Eric Hambro, Luke Zettlemoyer, Nicola Cancedda, Thomas Scialom
Toolformer: Language Models Can Teach Themselves to Use Tools. NeurIPS (2023)
Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
Scaling Laws for Generative Mixed-Modal Language Models. CoRR (2023)
Weijia Shi, Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu, Terra Blevins, Danqi Chen, Luke Zettlemoyer
Detecting Pretraining Data from Large Language Models. CoRR (2023)
Bhargavi Paranjape, Pradeep Dasigi, Vivek Srikumar, Luke Zettlemoyer, Hannaneh Hajishirzi
AGRO: Adversarial discovery of error-prone Groups for Robust Optimization. ICLR (2023)
Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Scott Yih, Luke Zettlemoyer, Mike Lewis
InCoder: A Generative Model for Code Infilling and Synthesis. ICLR (2023)
Mikel Artetxe, Vedanuj Goswami, Shruti Bhosale, Angela Fan, Luke Zettlemoyer
Revisiting Machine Translation for Cross-lingual Classification. EMNLP (2023)
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke Zettlemoyer
QLoRA: Efficient Finetuning of Quantized LLMs. NeurIPS (2023)
Xiang Lisa Li, Ari Holtzman, Daniel Fried, Percy Liang, Jason Eisner, Tatsunori Hashimoto, Luke Zettlemoyer, Mike Lewis
Contrastive Decoding: Open-ended Text Generation as Optimization. ACL (1) (2023)
Haoqiang Kang, Terra Blevins, Luke Zettlemoyer
Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Models. CoRR (2023)
Hongjin Su, Jungo Kasai, Chen Henry Wu, Weijia Shi, Tianlu Wang, Jiayi Xin, Rui Zhang, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, Tao Yu
Selective Annotation Makes Language Models Better Few-Shot Learners. ICLR (2023)
Olga Golovneva, Moya Chen, Spencer Poff, Martin Corredor, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning. ICLR (2023)
Xi Victoria Lin, Xilun Chen, Mingda Chen, Weijia Shi, Maria Lomeli, Rich James, Pedro Rodriguez, Jacob Kahn, Gergely Szilvasy, Mike Lewis, Luke Zettlemoyer, Scott Yih
RA-DIT: Retrieval-Augmented Dual Instruction Tuning. CoRR (2023)
Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants. CoRR (2023)
Lili Yu, Bowen Shi, Ramakanth Pasunuru, Benjamin Muller, Olga Golovneva, Tianlu Wang, Arun Babu, Binh Tang, Brian Karrer, Shelly Sheynin, Candace Ross, Adam Polyak, Russell Howes, Vasu Sharma, Puxin Xu, Hovhannes Tamoyan, Oron Ashual, Uriel Singer, Shang-Wen Li, Susan Zhang, Richard James, Gargi Ghosh, Yaniv Taigman, Maryam Fazel-Zarandi, Asli Celikyilmaz, Luke Zettlemoyer, Armen Aghajanyan
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning. CoRR (2023)
Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models. CoRR (2023)
Hu Xu, Saining Xie, Po-Yao Huang, Licheng Yu, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
CiT: Curation in Training for Effective Vision-Language Data. CoRR (2023)
Joel Jang, Seungone Kim, Bill Yuchen Lin, Yizhong Wang, Jack Hessel, Luke Zettlemoyer, Hannaneh Hajishirzi, Yejin Choi, Prithviraj Ammanabrolu
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging. CoRR (2023)
Xuezhe Ma, Chunting Zhou, Xiang Kong, Junxian He, Liangke Gui, Graham Neubig, Jonathan May, Luke Zettlemoyer
Mega: Moving Average Equipped Gated Attention. ICLR (2023)
Sweta Agrawal, Chunting Zhou, Mike Lewis, Luke Zettlemoyer, Marjan Ghazvininejad
In-context Examples Selection for Machine Translation. ACL (Findings) (2023)
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke Zettlemoyer
QLoRA: Efficient Finetuning of Quantized LLMs. CoRR (2023)
Xinxi Lyu, Sewon Min, Iz Beltagy, Luke Zettlemoyer, Hannaneh Hajishirzi
Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations. ACL (1) (2023)
Xinyan Velocity Yu, Sewon Min, Luke Zettlemoyer, Hannaneh Hajishirzi
CREPE: Open-Domain Question Answering with False Presuppositions. CoRR (2022)
Suchin Gururangan, Dallas Card, Sarah K. Dreier, Emily K. Gade, Leroy Z. Wang, Zeyu Wang, Luke Zettlemoyer, Noah A. Smith
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection. CoRR (2022)
Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni
Multilingual Autoregressive Entity Linking. Trans. Assoc. Comput. Linguistics 10 (2022)
Terra Blevins, Luke Zettlemoyer
Language Contamination Explains the Cross-lingual Capabilities of English Pretrained Models. CoRR (2022)
Freda Shi, Daniel Fried, Marjan Ghazvininejad, Luke Zettlemoyer, Sida I. Wang
Natural Language to Code Translation with Execution. CoRR (2022)
Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, Tao Yu
Binding Language Models in Symbolic Languages. CoRR (2022)
Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? CoRR (2022)
Victor Zhong, Jesse Mu, Luke Zettlemoyer, Edward Grefenstette, Tim Rocktäschel
Improving Policy Learning via Language Dynamics Distillation. CoRR (2022)
Freda Shi, Daniel Fried, Marjan Ghazvininejad, Luke Zettlemoyer, Sida I. Wang
Natural Language to Code Translation with Execution. EMNLP (2022)
Weijia Shi, Julian Michael, Suchin Gururangan, Luke Zettlemoyer
Nearest Neighbor Zero-Shot Inference. EMNLP (2022)
Sewon Min, Weijia Shi, Mike Lewis, Xilun Chen, Wen-tau Yih, Hannaneh Hajishirzi, Luke Zettlemoyer
Nonparametric Masked Language Modeling. CoRR (2022)
Robin Jia, Mike Lewis, Luke Zettlemoyer
Question Answering Infused Pre-training of General-Purpose Contextualized Representations. ACL (Findings) (2022)
Tim Dettmers, Mike Lewis, Sam Shleifer, Luke Zettlemoyer
8-bit Optimizers via Block-wise Quantization. ICLR (2022)
Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
M2D2: A Massively Multi-domain Language Modeling Dataset. CoRR (2022)
Suzanna Sia, Anton Belyy, Amjad Almahairi, Madian Khabsa, Luke Zettlemoyer, Lambert Mathias
Logical Satisfiability of Counterfactuals for Faithful Explanations in NLI. CoRR (2022)
Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Ves Stoyanov
On the Role of Bidirectionality in Language Model Pre-Training. CoRR (2022)
Eleftheria Briakou, Sida I. Wang, Luke Zettlemoyer, Marjan Ghazvininejad
BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation. NAACL-HLT (Findings) (2022)
Margaret Li, Suchin Gururangan, Tim Dettmers, Mike Lewis, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models. CoRR (2022)
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Noisy Channel Language Model Prompting for Few-Shot Text Classification. ACL (1) (2022)
Tim Dettmers, Luke Zettlemoyer
The case for 4-bit precision: k-bit Inference Scaling Laws. CoRR (2022)
Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? EMNLP (2022)
Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng Wu, Ming Zhong, Pengcheng Yin, Sida I. Wang, Victor Zhong, Bailin Wang, Chengzu Li, Connor Boyle, Ansong Ni, Ziyu Yao, Dragomir Radev, Caiming Xiong, Lingpeng Kong, Rui Zhang, Noah A. Smith, Luke Zettlemoyer, Tao Yu
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models. EMNLP (2022)
Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giridharan Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeffrey Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Veselin Stoyanov
Efficient Large Scale Language Modeling with Mixtures of Experts. EMNLP (2022)
Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
M2D2: A Massively Multi-Domain Language Modeling Dataset. EMNLP (2022)
Mandar Joshi, Terra Blevins, Mike Lewis, Daniel S. Weld, Luke Zettlemoyer
Few-shot Mining of Naturally Occurring Inputs and Outputs. CoRR (2022)
Jungsoo Park, Sewon Min, Jaewoo Kang, Luke Zettlemoyer, Hannaneh Hajishirzi
FaVIQ: FAct Verification from Information-seeking Questions. ACL (1) (2022)
Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale. CoRR (2022)
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah Smith, Luke Zettlemoyer
DEMix Layers: Disentangling Domains for Modular Language Modeling. NAACL-HLT (2022)

Luke Zettlemoyer.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Luke Zettlemoyer