Shayne Longpre

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 55

Top Topics

Passage Retrieval

Question Answering

Top Venues

Publications

Rishi Bommasani, Kevin Klyman, Shayne Longpre, Betty Xiong, Sayash Kapoor, Nestor Maslej, Arvind Narayanan, Percy Liang
Foundation Model Transparency Reports. CoRR (2024)
Rishi Bommasani, Kevin Klyman, Sayash Kapoor, Shayne Longpre, Betty Xiong, Nestor Maslej, Percy Liang
The Foundation Model Transparency Index v1.1: May 2024. CoRR (2024)
Shayne Longpre, Robert Mahari, Ariel Lee, Campbell Lund, Hamidah Oderinwale, William Brannon, Nayan Saxena, Naana Obeng-Marnu, Tobin South, Cole Hunter, Kevin Klyman, Christopher Klamm, Hailey Schoelkopf, Nikhil Singh, Manuel Cherep, Ahmad Anis, An Dinh, Caroline Chitongo, Da Yin, Damien Sileo, Deividas Mataciunas, Diganta Misra, Emad A. Alghamdi, Enrico Shippole, Jianguo Zhang, Joanna Materzynska, Kun Qian, Kush Tiwary, Lester James V. Miranda, Manan Dey, Minnie Liang, Mohammed Hamdy, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Shrestha Mohanty, Vipul Gupta, Vivek Sharma, Vu Minh Chien, Xuhui Zhou, Yizhi Li, Caiming Xiong, Luis Villa, Stella Biderman, Hanlin Li, Daphne Ippolito, Sara Hooker, Jad Kabbara, Sandy Pentland
Consent in Crisis: The Rapid Decline of the AI Data Commons. CoRR (2024)
Riley Simmons-Edler, Ryan Badman, Shayne Longpre, Kanaka Rajan
AI-Powered Autonomous Weapons Risk Geopolitical Instability and Threaten AI Research. CoRR (2024)
Shayne Longpre, Robert Mahari, Naana Obeng-Marnu, William Brannon, Tobin South, Katy Ilonka Gero, Sandy Pentland, Jad Kabbara
Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them? CoRR (2024)
Ahmet Üstün, Viraat Aryabumi, Zheng Xin Yong, Wei-Yin Ko, Daniel D'souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model. CoRR (2024)
Seungone Kim, Juyoung Suk, Shayne Longpre, Bill Yuchen Lin, Jamin Shin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models. CoRR (2024)
Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang
A Survey on Data Selection for Language Models. CoRR (2024)
Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Choi, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models. CoRR (2024)
Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, Rumman Chowdhury, Alex Engler, Peter Henderson, Yacine Jernite, Seth Lazar, Stefano Maffulli, Alondra Nelson, Joelle Pineau, Aviya Skowron, Dawn Song, Victor Storchan, Daniel Zhang, Daniel E. Ho, Percy Liang, Arvind Narayanan
On the Societal Impact of Open Foundation Models. CoRR (2024)
Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. CoRR (2024)
Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity. NAACL-HLT (2024)
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models. ICLR (2024)
Shayne Longpre, Sayash Kapoor, Kevin Klyman, Ashwin Ramaswami, Rishi Bommasani, Borhane Blili-Hamelin, Yangsibo Huang, Aviya Skowron, Zheng Xin Yong, Suhas Kotha, Yi Zeng, Weiyan Shi, Xianjun Yang, Reid Southen, Alexander Robey, Patrick Chao, Diyi Yang, Ruoxi Jia, Daniel Kang, Sandy Pentland, Arvind Narayanan, Percy Liang, Peter Henderson
A Safe Harbor for AI Evaluation and Red Teaming. CoRR (2024)
Seungone Kim, Jamin Shin, Yejin Choi, Joel Jang, Shayne Longpre, Hwaran Lee, Sangdoo Yun, Seongjin Shin, Sungdong Kim, James Thorne, Minjoon Seo
Prometheus: Inducing Fine-Grained Evaluation Capability in Language Models. ICLR (2024)
Niklas Muennighoff, Qian Liu, Armel Randy Zebaze, Qinkai Zheng, Binyuan Hui, Terry Yue Zhuo, Swayam Singh, Xiangru Tang, Leandro von Werra, Shayne Longpre
OctoPack: Instruction Tuning Code Large Language Models. ICLR (2024)
Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang
A Survey on Data Selection for Language Models. Trans. Mach. Learn. Res. 2024 (2024)
Shayne Longpre, Robert Mahari, Anthony Chen, Naana Obeng-Marnu, Damien Sileo, William Brannon, Niklas Muennighoff, Nathan Khazam, Jad Kabbara, Kartik Perisetla, Xinyi Wu, Enrico Shippole, Kurt D. Bollacker, Tongshuang Wu, Luis Villa, Sandy Pentland, Deb Roy, Sara Hooker
The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI. CoRR (2023)
Seungone Kim, Jamin Shin, Yejin Cho, Joel Jang, Shayne Longpre, Hwaran Lee, Sangdoo Yun, Seongjin Shin, Sungdong Kim, James Thorne, Minjoon Seo
Prometheus: Inducing Fine-grained Evaluation Capability in Language Models. CoRR (2023)
Niklas Muennighoff, Qian Liu, Armel Zebaze, Qinkai Zheng, Binyuan Hui, Terry Yue Zhuo, Swayam Singh, Xiangru Tang, Leandro von Werra, Shayne Longpre
OctoPack: Instruction Tuning Code Large Language Models. CoRR (2023)
Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Sasko, Quentin Lhoest, Angelina McMillan-Major, Gérard Dupont, Stella Biderman, Anna Rogers, Loubna Ben Allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa, Paulo Villegas, Tristan Thrush, Shayne Longpre, Sebastian Nagel, Leon Weber, Manuel Muñoz, Jian Zhu, Daniel van Strien, Zaid Alyafeai, Khalid Almubarak, Minh Chien Vu, Itziar Gonzalez-Dios, Aitor Soroa, Kyle Lo, Manan Dey, Pedro Ortiz Suarez, Aaron Gokaslan, Shamik Bose, David Ifeoluwa Adelani, Long Phan, Hieu Tran, Ian Yu, Suhas Pai, Jenny Chim, Violette Lepercq, Suzana Ilic, Margaret Mitchell, Sasha Luccioni, Yacine Jernite
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset. CoRR (2023)
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. ICML (2023)
Rishi Bommasani, Kevin Klyman, Shayne Longpre, Sayash Kapoor, Nestor Maslej, Betty Xiong, Daniel Zhang, Percy Liang
The Foundation Model Transparency Index. CoRR (2023)
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts. CoRR (2023)
Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity. CoRR (2023)
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. CoRR (2023)
Akari Asai, Shayne Longpre, Jungo Kasai, Chia-Hsuan Lee, Rui Zhang, Junjie Hu, Ikuya Yamada, Jonathan H. Clark, Eunsol Choi
MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages. CoRR (2022)
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
Scaling Instruction-Finetuned Language Models. CoRR (2022)
Shayne Longpre, Julia Reisler, Edward Greg Huang, Yi Lu, Andrew J. Frank, Nikhil Ramesh, Chris DuBois
Active Learning Over Multiple Domains in Natural Language Tasks. CoRR (2022)
Rajiv Movva, Jinhao Lei, Shayne Longpre, Ajay Gupta, Chris DuBois
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks. COLING (2022)
Rajiv Movva, Jinhao Lei, Shayne Longpre, Ajay Gupta, Chris DuBois
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks. CoRR (2022)
Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Sasko, Quentin Lhoest, Angelina McMillan-Major, Gérard Dupont, Stella Biderman, Anna Rogers, Loubna Ben Allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa, Paulo Villegas, Tristan Thrush, Shayne Longpre, Sebastian Nagel, Leon Weber, Manuel Muñoz, Jian Zhu, Daniel van Strien, Zaid Alyafeai, Khalid Almubarak, Minh Chien Vu, Itziar Gonzalez-Dios, Aitor Soroa, Kyle Lo, Manan Dey, Pedro Ortiz Suarez, Aaron Gokaslan, Shamik Bose, David Ifeoluwa Adelani, Long Phan, Hieu Tran, Ian Yu, Suhas Pai, Jenny Chim, Violette Lepercq, Suzana Ilic, Margaret Mitchell, Alexandra Sasha Luccioni, Yacine Jernite
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset. NeurIPS (2022)
Anthony Chen, Pallavi Gudipati, Shayne Longpre, Xiao Ling, Sameer Singh
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP. ACL/IJCNLP (1) (2021)
Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre
Leveraging Query Resolution and Reading Comprehension for Conversational Passage Retrieval. CoRR (2021)
Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre
A Comparison of Question Rewriting Methods for Conversational Passage Retrieval. CoRR (2021)
Shayne Longpre, Yi Lu, Chris DuBois
On the Transferability of Minimal Prediction Preserving Inputs in Question Answering. NAACL-HLT (2021)
Shayne Longpre, Kartik Perisetla, Anthony Chen, Nikhil Ramesh, Chris DuBois, Sameer Singh
Entity-Based Knowledge Conflicts in Question Answering. CoRR (2021)
Shayne Longpre, Yi Lu, Joachim Daiber
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering. Trans. Assoc. Comput. Linguistics 9 (2021)
Anthony Chen, Pallavi Gudipati, Shayne Longpre, Xiao Ling, Sameer Singh
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP. CoRR (2021)
Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, Srinivas Chappidi
Open-Domain Question Answering Goes Conversational via Question Rewriting. NAACL-HLT (2021)
Shayne Longpre, Kartik Perisetla, Anthony Chen, Nikhil Ramesh, Chris DuBois, Sameer Singh
Entity-Based Knowledge Conflicts in Question Answering. EMNLP (1) (2021)
Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, Raviteja Anantha
Question Rewriting for Conversational Question Answering. WSDM (2021)
Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre
A Comparison of Question Rewriting Methods for Conversational Passage Retrieval. ECIR (2) (2021)
Shayne Longpre, Yi Lu, Christopher DuBois
On the Transferability of Minimal Prediction Preserving Inputs in Question Answering. CoRR (2020)
Ivan Montero, Shayne Longpre, Ni Lao, Andrew J. Frank, Christopher DuBois
Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval. CoRR (2020)
Shayne Longpre, Yu Wang, Christopher DuBois
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers? CoRR (2020)
Shayne Longpre, Yi Lu, Joachim Daiber
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering. CoRR (2020)
Shayne Longpre, Yu Wang, Chris DuBois
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers? EMNLP (Findings) (2020)
Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, Raviteja Anantha
A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answering. CoRR (2020)
Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, Srinivas Chappidi
Open-Domain Question Answering Goes Conversational via Question Rewriting. CoRR (2020)
Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, Raviteja Anantha
Question Rewriting for Conversational Question Answering. CoRR (2020)
Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre
Leveraging Query Resolution and Reading Comprehension for Conversational Passage Retrieval. TREC (2020)
Shayne Longpre, Yi Lu, Zhucheng Tu, Chris DuBois
An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering. CoRR (2019)
Shayne Longpre, Yi Lu, Zhucheng Tu, Chris DuBois
An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering. MRQA@EMNLP (2019)
Shayne Longpre, Sabeek Pradhan, Caiming Xiong, Richard Socher
A Way out of the Odyssey: Analyzing and Combining Recent Insights for LSTMs. CoRR (2016)