Mike Lewis

Publication Activity (10 Years)

Years Active: 2007-2024
Publications (10 Years): 135

Top Venues

CoRR

EMNLP

ICLR

NAACL-HLT

Publications

Zexuan Zhong, Mengzhou Xia, Danqi Chen, Mike Lewis
Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training. CoRR (2024)
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
Efficient Streaming Language Models with Attention Sinks. ICLR (2024)
Xi Victoria Lin, Xilun Chen, Mingda Chen, Weijia Shi, Maria Lomeli, Richard James, Pedro Rodriguez, Jacob Kahn, Gergely Szilvasy, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih
RA-DIT: Retrieval-Augmented Dual Instruction Tuning. ICLR (2024)
Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Xi Victoria Lin, Noah A. Smith, Luke Zettlemoyer, Wen-tau Yih, Mike Lewis
In-Context Pretraining: Language Modeling Beyond Document Boundaries. ICLR (2024)
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
Effective Long-Context Scaling of Foundation Models. NAACL-HLT (2024)
Xi Victoria Lin, Akshat Shrivastava, Liang Luo, Srinivasan Iyer, Mike Lewis, Gargi Ghosh, Luke Zettlemoyer, Armen Aghajanyan
MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts. CoRR (2024)
Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Omer Levy, Luke Zettlemoyer, Jason Weston, Mike Lewis
Self-Alignment with Instruction Backtranslation. ICLR (2024)
Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Richard James, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih
REPLUG: Retrieval-Augmented Black-Box Language Models. NAACL-HLT (2024)
Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, Hannaneh Hajishirzi
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation. EMNLP (2023)
Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Jimmy Ba, Amjad Almahairi
Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization. CoRR (2023)
Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy
LIMA: Less Is More for Alignment. CoRR (2023)
Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Luke Zettlemoyer, Omer Levy, Jason Weston, Mike Lewis
Self-Alignment with Instruction Backtranslation. CoRR (2023)
Devendra Singh Sachan, Mike Lewis, Dani Yogatama, Luke Zettlemoyer, Joelle Pineau, Manzil Zaheer
Questions Are All You Need to Train a Dense Passage Retriever. Trans. Assoc. Comput. Linguistics 11 (2023)
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
Effective Long-Context Scaling of Foundation Models. CoRR (2023)
Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Xi Victoria Lin, Noah A. Smith, Luke Zettlemoyer, Scott Yih, Mike Lewis
In-Context Pretraining: Language Modeling Beyond Document Boundaries. CoRR (2023)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. IEEE ACM Trans. Audio Speech Lang. Process. 31 (2023)
Suchin Gururangan, Margaret Li, Mike Lewis, Weijia Shi, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
Scaling Expert Language Models with Unsupervised Domain Discovery. CoRR (2023)
Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, Hannaneh Hajishirzi
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation. CoRR (2023)
Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Amjad Almahairi
Progressive Prompts: Continual Learning for Language Models. ICLR (2023)
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
Efficient Streaming Language Models with Attention Sinks. CoRR (2023)
Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Amjad Almahairi
Progressive Prompts: Continual Learning for Language Models. CoRR (2023)
Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A. Smith, Mike Lewis
Measuring and Narrowing the Compositionality Gap in Language Models. EMNLP (Findings) (2023)
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. CoRR (2023)
Sewon Min, Weijia Shi, Mike Lewis, Xilun Chen, Wen-tau Yih, Hannaneh Hajishirzi, Luke Zettlemoyer
Nonparametric Masked Language Modeling. ACL (Findings) (2023)
Chunting Zhou, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy
LIMA: Less Is More for Alignment. NeurIPS (2023)
Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Rich James, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih
REPLUG: Retrieval-Augmented Black-Box Language Models. CoRR (2023)
Weijia Shi, Xiaochuang Han, Mike Lewis, Yulia Tsvetkov, Luke Zettlemoyer, Scott Wen-tau Yih
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding. CoRR (2023)
Michihiro Yasunaga, Armen Aghajanyan, Weijia Shi, Richard James, Jure Leskovec, Percy Liang, Mike Lewis, Luke Zettlemoyer, Wen-Tau Yih
Retrieval-Augmented Multimodal Language Modeling. ICML (2023)
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. NeurIPS (2023)
Tianyi Zhang, Tao Yu, Tatsunori Hashimoto, Mike Lewis, Wen-Tau Yih, Daniel Fried, Sida Wang
Coder Reviewer Reranking for Code Generation. ICML (2023)
Sean O'Brien, Mike Lewis
Contrastive Decoding Improves Reasoning in Large Language Models. CoRR (2023)
Anastasia Razdaibiedina, Yuning Mao, Madian Khabsa, Mike Lewis, Rui Hou, Jimmy Ba, Amjad Almahairi
Residual Prompt Tuning: improving prompt tuning with residual reparameterization. ACL (Findings) (2023)
Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Scott Yih, Luke Zettlemoyer, Mike Lewis
InCoder: A Generative Model for Code Infilling and Synthesis. ICLR (2023)
Xiang Lisa Li, Ari Holtzman, Daniel Fried, Percy Liang, Jason Eisner, Tatsunori Hashimoto, Luke Zettlemoyer, Mike Lewis
Contrastive Decoding: Open-ended Text Generation as Optimization. ACL (1) (2023)
Weiyan Shi, Emily Dinan, Adi Renduchintala, Daniel Fried, Athul Paul Jacob, Zhou Yu, Mike Lewis
AutoReply: Detecting Nonsense in Dialogue with Discriminative Replies. EMNLP (Findings) (2023)
Xi Victoria Lin, Xilun Chen, Mingda Chen, Weijia Shi, Maria Lomeli, Rich James, Pedro Rodriguez, Jacob Kahn, Gergely Szilvasy, Mike Lewis, Luke Zettlemoyer, Scott Yih
RA-DIT: Retrieval-Augmented Dual Instruction Tuning. CoRR (2023)
Sweta Agrawal, Chunting Zhou, Mike Lewis, Luke Zettlemoyer, Marjan Ghazvininejad
In-context Examples Selection for Machine Translation. ACL (Findings) (2023)
Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A. Smith, Mike Lewis
Measuring and Narrowing the Compositionality Gap in Language Models. CoRR (2022)
Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? CoRR (2022)
Sewon Min, Weijia Shi, Mike Lewis, Xilun Chen, Wen-tau Yih, Hannaneh Hajishirzi, Luke Zettlemoyer
Nonparametric Masked Language Modeling. CoRR (2022)
Robin Jia, Mike Lewis, Luke Zettlemoyer
Question Answering Infused Pre-training of General-Purpose Contextualized Representations. ACL (Findings) (2022)
Tim Dettmers, Mike Lewis, Sam Shleifer, Luke Zettlemoyer
8-bit Optimizers via Block-wise Quantization. ICLR (2022)
Tianyi Zhang, Tao Yu, Tatsunori B. Hashimoto, Mike Lewis, Wen-tau Yih, Daniel Fried, Sida I. Wang
Coder Reviewer Reranking for Code Generation. CoRR (2022)
Andrew Lee, David Wu, Emily Dinan, Mike Lewis
Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Engines. CoRR (2022)
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models. NAACL-HLT (2022)
Margaret Li, Suchin Gururangan, Tim Dettmers, Mike Lewis, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models. CoRR (2022)
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Noisy Channel Language Model Prompting for Few-Shot Text Classification. ACL (1) (2022)
Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? EMNLP (2022)
Mandar Joshi, Terra Blevins, Mike Lewis, Daniel S. Weld, Luke Zettlemoyer
Few-shot Mining of Naturally Occurring Inputs and Outputs. CoRR (2022)
Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale. CoRR (2022)
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah Smith, Luke Zettlemoyer
DEMix Layers: Disentangling Domains for Modular Language Modeling. NAACL-HLT (2022)
Dheeru Dua, Shruti Bhosale, Vedanuj Goswami, James Cross, Mike Lewis, Angela Fan
Tricks for Training Sparse Translation Models. NAACL-HLT (2022)
Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer
CM3: A Causal Masked Multimodal Model of the Internet. CoRR (2022)
Devendra Singh Sachan, Mike Lewis, Mandar Joshi, Armen Aghajanyan, Wen-tau Yih, Joelle Pineau, Luke Zettlemoyer
Improving Passage Retrieval with Zero-Shot Question Generation. EMNLP (2022)
Ofir Press, Noah Smith, Mike Lewis
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation. ICLR (2022)
Armen Aghajanyan, Dmytro Okhonko, Mike Lewis, Mandar Joshi, Hu Xu, Gargi Ghosh, Luke Zettlemoyer
HTLM: Hyper-Text Pre-Training and Prompting of Language Models. ICLR (2022)
Sewon Min, Mike Lewis, Luke Zettlemoyer, Hannaneh Hajishirzi
MetaICL: Learning to Learn In Context. NAACL-HLT (2022)
Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Wen-tau Yih, Luke Zettlemoyer, Mike Lewis
InCoder: A Generative Model for Code Infilling and Synthesis. CoRR (2022)
Xiang Lisa Li, Ari Holtzman, Daniel Fried, Percy Liang, Jason Eisner, Tatsunori Hashimoto, Luke Zettlemoyer, Mike Lewis
Contrastive Decoding: Open-ended Text Generation as Optimization. CoRR (2022)
Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer
GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale. NeurIPS (2022)
Weiyan Shi, Emily Dinan, Adi Renduchintala, Daniel Fried, Athul Paul Jacob, Zhou Yu, Mike Lewis
AutoReply: Detecting Nonsense in Dialogue Introspectively with Discriminative Replies. CoRR (2022)
Devendra Singh Sachan, Mike Lewis, Mandar Joshi, Armen Aghajanyan, Wen-tau Yih, Joelle Pineau, Luke Zettlemoyer
Improving Passage Retrieval with Zero-Shot Question Generation. CoRR (2022)
Sweta Agrawal, Chunting Zhou, Mike Lewis, Luke Zettlemoyer, Marjan Ghazvininejad
In-context Examples Selection for Machine Translation. CoRR (2022)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. CoRR (2022)
Michihiro Yasunaga, Armen Aghajanyan, Weijia Shi, Rich James, Jure Leskovec, Percy Liang, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih
Retrieval-Augmented Multimodal Language Modeling. CoRR (2022)
Devendra Singh Sachan, Mike Lewis, Dani Yogatama, Luke Zettlemoyer, Joelle Pineau, Manzil Zaheer
Questions Are All You Need to Train a Dense Passage Retriever. CoRR (2022)
Sewon Min, Mike Lewis, Luke Zettlemoyer, Hannaneh Hajishirzi
MetaICL: Learning to Learn In Context. CoRR (2021)
Tim Dettmers, Mike Lewis, Sam Shleifer, Luke Zettlemoyer
8-bit Optimizers via Block-wise Quantization. CoRR (2021)
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer
BASE Layers: Simplifying Training of Large, Sparse Models. ICML (2021)
Athul Paul Jacob, Mike Lewis, Jacob Andreas
Multitasking Inhibits Semantic Drift. NAACL-HLT (2021)
Michael Sejr Schlichtkrull, Vladimir Karpukhin, Barlas Oguz, Mike Lewis, Wen-tau Yih, Sebastian Riedel
Joint Verification and Reranking for Open Fact Checking Over Tables. ACL/IJCNLP (1) (2021)
Ofir Press, Noah A. Smith, Mike Lewis
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation. CoRR (2021)
Robin Jia, Mike Lewis, Luke Zettlemoyer
Question Answering Infused Pre-training of General-Purpose Contextualized Representations. CoRR (2021)
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer
DEMix Layers: Disentangling Domains for Modular Language Modeling. CoRR (2021)
Armen Aghajanyan, Dmytro Okhonko, Mike Lewis, Mandar Joshi, Hu Xu, Gargi Ghosh, Luke Zettlemoyer
HTLM: Hyper-Text Pre-Training and Prompting of Language Models. CoRR (2021)
Athul Paul Jacob, Mike Lewis, Jacob Andreas
Multitasking Inhibits Semantic Drift. CoRR (2021)
Ofir Press, Noah A. Smith, Mike Lewis
Shortformer: Better Language Modeling using Shorter Inputs. ACL/IJCNLP (1) (2021)
Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis
Nearest Neighbor Machine Translation. ICLR (2021)
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer
BASE Layers: Simplifying Training of Large, Sparse Models. CoRR (2021)
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
Sparse Distillation: Speeding Up Text Classification by Using Bigger Models. CoRR (2021)
Dheeru Dua, Shruti Bhosale, Vedanuj Goswami, James Cross, Mike Lewis, Angela Fan
Tricks for Training Sparse Translation Models. CoRR (2021)
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer
Noisy Channel Language Model Prompting for Few-Shot Text Classification. CoRR (2021)
Ofir Press, Noah A. Smith, Mike Lewis
Shortformer: Better Language Modeling using Shorter Inputs. CoRR (2020)
Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. CoRR (2020)
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. ACL (2020)
Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. NeurIPS (2020)
Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis
Nearest Neighbor Machine Translation. CoRR (2020)
Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis
Generalization through Memorization: Nearest Neighbor Language Models. ICLR (2020)
Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida I. Wang, Luke Zettlemoyer
Pre-training via Paraphrasing. CoRR (2020)
Alex Wang, Kyunghyun Cho, Mike Lewis
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries. ACL (2020)
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
Multilingual Denoising Pre-training for Neural Machine Translation. CoRR (2020)
Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida I. Wang, Luke Zettlemoyer
Pre-training via Paraphrasing. NeurIPS (2020)
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
Multilingual Denoising Pre-training for Neural Machine Translation. Trans. Assoc. Comput. Linguistics 8 (2020)
Armen Aghajanyan, Jean Maillard, Akshat Shrivastava, Keith Diedrick, Mike Haeger, Haoran Li, Yashar Mehdad, Ves Stoyanov, Anuj Kumar, Mike Lewis, Sonal Gupta
Conversational Semantic Parsing. CoRR (2020)
Armen Aghajanyan, Jean Maillard, Akshat Shrivastava, Keith Diedrick, Michael Haeger, Haoran Li, Yashar Mehdad, Veselin Stoyanov, Anuj Kumar, Mike Lewis, Sonal Gupta
Conversational Semantic Parsing. EMNLP (1) (2020)
Alex Wang, Kyunghyun Cho, Mike Lewis
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries. CoRR (2020)
Michael Sejr Schlichtkrull, Vladimir Karpukhin, Barlas Oguz, Mike Lewis, Wen-tau Yih, Sebastian Riedel
Joint Verification and Reranking for Open Fact Checking Over Tables. CoRR (2020)
Victor Zhong, Mike Lewis, Sida I. Wang, Luke Zettlemoyer
Grounded Adaptation for Zero-shot Executable Semantic Parsing. CoRR (2020)
Victor Zhong, Mike Lewis, Sida I. Wang, Luke Zettlemoyer
Grounded Adaptation for Zero-shot Executable Semantic Parsing. EMNLP (1) (2020)
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. CoRR (2019)

Mike Lewis.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Mike Lewis