Suchin Gururangan

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 43

Top Topics

Top Venues

Publications

Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar
DataComp-LM: In search of the next generation of training sets for language models. CoRR (2024)
Mengzhou Xia, Sadhika Malladi, Suchin Gururangan, Sanjeev Arora, Danqi Chen
LESS: Selecting Influential Data for Targeted Instruction Tuning. CoRR (2024)
Li Lucy, Suchin Gururangan, Luca Soldaini, Emma Strubell, David Bamman, Lauren Klein, Jesse Dodge
AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters. CoRR (2024)
Kai Nylund, Suchin Gururangan, Noah A. Smith
Time is Encoded in the Weights of Finetuned Language Models. ACL (1) (2024)
Terra Blevins, Tomasz Limisiewicz, Suchin Gururangan, Margaret Li, Hila Gonen, Noah A. Smith, Luke Zettlemoyer
Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models. CoRR (2024)
Trishita Tiwari, Suchin Gururangan, Chuan Guo, Weizhe Hua, Sanjay Kariyappa, Udit Gupta, Wenjie Xiong, Kiwan Maeng, Hsien-Hsin S. Lee, G. Edward Suh
Information Flow Control in Machine Learning through Modular Model Architecture. USENIX Security Symposium (2024)
Li Lucy, Suchin Gururangan, Luca Soldaini, Emma Strubell, David Bamman, Lauren Klein, Jesse Dodge
AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters. ACL (1) (2024)
Sewon Min, Suchin Gururangan, Eric Wallace, Weijia Shi, Hannaneh Hajishirzi, Noah A. Smith, Luke Zettlemoyer
SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore. ICLR (2024)
Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Jenia Jitsev, Alexandros G. Dimakis, Gabriel Ilharco, Shuran Song, Thomas Kollar, Yair Carmon, Achal Dave, Reinhard Heckel, Niklas Muennighoff, Ludwig Schmidt
Language models scale reliably with over-training and on downstream tasks. CoRR (2024)
Suchin Gururangan, Margaret Li, Mike Lewis, Weijia Shi, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
Scaling Expert Language Models with Unsupervised Domain Discovery. CoRR (2023)
Mitchell Wortsman, Suchin Gururangan, Shen Li, Ali Farhadi, Ludwig Schmidt, Michael G. Rabbat, Ari S. Morcos
lo-fi: distributed fine-tuning without communication. Trans. Mach. Learn. Res. 2023 (2023)
Sewon Min, Suchin Gururangan, Eric Wallace, Hannaneh Hajishirzi, Noah A. Smith, Luke Zettlemoyer
SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore. CoRR (2023)
Trishita Tiwari, Suchin Gururangan, Chuan Guo, Weizhe Hua, Sanjay Kariyappa, Udit Gupta, Wenjie Xiong, Kiwan Maeng, Hsien-Hsin S. Lee, G. Edward Suh
Information Flow Control in Machine Learning through Modular Model Architecture. CoRR (2023)
Kai Nylund, Suchin Gururangan, Noah A. Smith
Time is Encoded in the Weights of Finetuned Language Models. CoRR (2023)
Suchin Gururangan, Dallas Card, Sarah K. Dreier, Emily K. Gade, Leroy Z. Wang, Zeyu Wang, Luke Zettlemoyer, Noah A. Smith
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection. CoRR (2022)
Weijia Shi, Julian Michael, Suchin Gururangan, Luke Zettlemoyer
Nearest Neighbor Zero-Shot Inference. EMNLP (2022)
Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
M2D2: A Massively Multi-domain Language Modeling Dataset. CoRR (2022)
Gabriel Ilharco, Marco Túlio Ribeiro, Mitchell Wortsman, Suchin Gururangan, Ludwig Schmidt, Hannaneh Hajishirzi, Ali Farhadi
Editing Models with Task Arithmetic. CoRR (2022)
Margaret Li, Suchin Gururangan, Tim Dettmers, Mike Lewis, Tim Althoff, Noah A. Smith, Luke Zettlemoyer
Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models. CoRR (2022)
Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
M2D2: A Massively Multi-Domain Language Modeling Dataset. EMNLP (2022)
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah Smith, Luke Zettlemoyer
DEMix Layers: Disentangling Domains for Modular Language Modeling. NAACL-HLT (2022)
Weijia Shi, Julian Michael, Suchin Gururangan, Luke Zettlemoyer
Nearest Neighbor Zero-Shot Inference. CoRR (2022)
Kelvin Luu, Daniel Khashabi, Suchin Gururangan, Karishma Mandyam, Noah A. Smith
Time Waits for No One! Analysis and Challenges of Temporal Misalignment. NAACL-HLT (2022)
Suchin Gururangan, Dallas Card, Sarah K. Dreier, Emily K. Gade, Leroy Z. Wang, Zeyu Wang, Luke Zettlemoyer, Noah A. Smith
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection. EMNLP (2022)
Mitchell Wortsman, Suchin Gururangan, Shen Li, Ali Farhadi, Ludwig Schmidt, Michael G. Rabbat, Ari S. Morcos
lo-fi: distributed fine-tuning without communication. CoRR (2022)
Kelvin Luu, Daniel Khashabi, Suchin Gururangan, Karishma Mandyam, Noah A. Smith
Time Waits for No One! Analysis and Challenges of Temporal Misalignment. CoRR (2021)
Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein
Detoxifying Language Models Risks Marginalizing Minority Voices. CoRR (2021)
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer
DEMix Layers: Disentangling Domains for Modular Language Modeling. CoRR (2021)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Expected Validation Performance and Estimation of a Random Variable's Maximum. CoRR (2021)
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith
All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text. ACL/IJCNLP (1) (2021)
Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein
Detoxifying Language Models Risks Marginalizing Minority Voices. NAACL-HLT (2021)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Expected Validation Performance and Estimation of a Random Variable's Maximum. EMNLP (Findings) (2021)
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith
All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text. CoRR (2021)
Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, Noah A. Smith
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models. CoRR (2020)
Suchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks. CoRR (2020)
Suchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks. ACL (2020)
Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, Noah A. Smith
RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models. EMNLP (Findings) (2020)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Show Your Work: Improved Reporting of Experimental Results. CoRR (2019)
Suchin Gururangan, Tam Dang, Dallas Card, Noah A. Smith
Variational Pretraining for Semi-supervised Text Classification. ACL (1) (2019)
Suchin Gururangan, Tam Dang, Dallas Card, Noah A. Smith
Variational Pretraining for Semi-supervised Text Classification. CoRR (2019)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Show Your Work: Improved Reporting of Experimental Results. EMNLP/IJCNLP (1) (2019)
Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith
Annotation Artifacts in Natural Language Inference Data. NAACL-HLT (2) (2018)
Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith
Annotation Artifacts in Natural Language Inference Data. CoRR (2018)