Gabriel Ilharco

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 48

Top Topics

Dynamic Time Warping

Visual Representations

Top Venues

Publications

Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. CoRR (2024)
Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar
DataComp-LM: In search of the next generation of training sets for language models. CoRR (2024)
Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Jenia Jitsev, Alexandros G. Dimakis, Gabriel Ilharco, Shuran Song, Thomas Kollar, Yair Carmon, Achal Dave, Reinhard Heckel, Niklas Muennighoff, Ludwig Schmidt
Language models scale reliably with over-training and on downstream tasks. CoRR (2024)
Thao Nguyen, Samir Yitzhak Gadre, Gabriel Ilharco, Sewoong Oh, Ludwig Schmidt
Improving Multimodal Datasets with Image Captioning. CoRR (2023)
Joongwon Kim, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi
TaskWeb: Selecting Better Source Tasks for Multi-task NLP. CoRR (2023)
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah M. Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti, Ranjay Krishna, Pang Wei Koh, Olga Saukh, Alexander Ratner, Shuran Song, Hannaneh Hajishirzi, Ali Farhadi, Romain Beaumont, Sewoong Oh, Alex Dimakis, Jenia Jitsev, Yair Carmon, Vaishaal Shankar, Ludwig Schmidt
DataComp: In search of the next generation of multimodal datasets. CoRR (2023)
Gabriel Ilharco, Marco Túlio Ribeiro, Mitchell Wortsman, Ludwig Schmidt, Hannaneh Hajishirzi, Ali Farhadi
Editing models with task arithmetic. ICLR (2023)
Mehdi Cherti, Romain Beaumont, Ross Wightman, Mitchell Wortsman, Gabriel Ilharco, Cade Gordon, Christoph Schuhmann, Ludwig Schmidt, Jenia Jitsev
Reproducible Scaling Laws for Contrastive Language-Image Learning. CVPR (2023)
Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Yitzhak Gadre, Shiori Sagawa, Jenia Jitsev, Simon Kornblith, Pang Wei Koh, Gabriel Ilharco, Mitchell Wortsman, Ludwig Schmidt
OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models. CoRR (2023)
Joongwon Kim, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi
TaskWeb: Selecting Better Source Tasks for Multi-task NLP. EMNLP (2023)
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah M. Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti, Ranjay Krishna, Pang Wei Koh, Olga Saukh, Alexander J. Ratner, Shuran Song, Hannaneh Hajishirzi, Ali Farhadi, Romain Beaumont, Sewoong Oh, Alex Dimakis, Jenia Jitsev, Yair Carmon, Vaishaal Shankar, Ludwig Schmidt
DataComp: In search of the next generation of multimodal datasets. NeurIPS (2023)
Samir Yitzhak Gadre, Mitchell Wortsman, Gabriel Ilharco, Ludwig Schmidt, Shuran Song
CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation. CVPR (2023)
Irena Gao, Gabriel Ilharco, Scott M. Lundberg, Marco Túlio Ribeiro
Adaptive Testing of Computer Vision Models. ICCV (2023)
Thao Nguyen, Samir Yitzhak Gadre, Gabriel Ilharco, Sewoong Oh, Ludwig Schmidt
Improving multimodal datasets with image captioning. NeurIPS (2023)
Samir Yitzhak Gadre, Mitchell Wortsman, Gabriel Ilharco, Ludwig Schmidt, Shuran Song
CLIP on Wheels: Zero-Shot Object Navigation as Object Localization and Exploration. CoRR (2022)
Thao Nguyen, Gabriel Ilharco, Mitchell Wortsman, Sewoong Oh, Ludwig Schmidt
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP. NeurIPS (2022)
Mitchell Wortsman, Gabriel Ilharco, Jong Wook Kim, Mike Li, Simon Kornblith, Rebecca Roelofs, Raphael Gontijo Lopes, Hannaneh Hajishirzi, Ali Farhadi, Hongseok Namkoong, Ludwig Schmidt
Robust fine-tuning of zero-shot models. CVPR (2022)
Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Rebecca Roelofs, Raphael Gontijo Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. ICML (2022)
Gabriel Ilharco, Marco Túlio Ribeiro, Mitchell Wortsman, Suchin Gururangan, Ludwig Schmidt, Hannaneh Hajishirzi, Ali Farhadi
Editing Models with Task Arithmetic. CoRR (2022)
Irena Gao, Gabriel Ilharco, Scott M. Lundberg, Marco Túlio Ribeiro
Adaptive Testing of Computer Vision Models. CoRR (2022)
Alex Fang, Gabriel Ilharco, Mitchell Wortsman, Yuhao Wan, Vaishaal Shankar, Achal Dave, Ludwig Schmidt
Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP). ICML (2022)
Mehdi Cherti, Romain Beaumont, Ross Wightman, Mitchell Wortsman, Gabriel Ilharco, Cade Gordon, Christoph Schuhmann, Ludwig Schmidt, Jenia Jitsev
Reproducible scaling laws for contrastive language-image learning. CoRR (2022)
Anas Awadalla, Mitchell Wortsman, Gabriel Ilharco, Sewon Min, Ian Magnusson, Hannaneh Hajishirzi, Ludwig Schmidt
Exploring The Landscape of Distributional Robustness for Question Answering Models. CoRR (2022)
Gabriel Ilharco, Mitchell Wortsman, Samir Yitzhak Gadre, Shuran Song, Hannaneh Hajishirzi, Simon Kornblith, Ali Farhadi, Ludwig Schmidt
Patching open-vocabulary models by interpolating weights. NeurIPS (2022)
Gabriel Ilharco, Mitchell Wortsman, Samir Yitzhak Gadre, Shuran Song, Hannaneh Hajishirzi, Simon Kornblith, Ali Farhadi, Ludwig Schmidt
Patching open-vocabulary models by interpolating weights. CoRR (2022)
Alex Fang, Gabriel Ilharco, Mitchell Wortsman, Yuhao Wan, Vaishaal Shankar, Achal Dave, Ludwig Schmidt
Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP). CoRR (2022)
Thao Nguyen, Gabriel Ilharco, Mitchell Wortsman, Sewoong Oh, Ludwig Schmidt
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP. CoRR (2022)
Anas Awadalla, Mitchell Wortsman, Gabriel Ilharco, Sewon Min, Ian Magnusson, Hannaneh Hajishirzi, Ludwig Schmidt
Exploring The Landscape of Distributional Robustness for Question Answering Models. EMNLP (Findings) (2022)
Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. CoRR (2022)
Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi
Probing Contextual Language Models for Common Ground with Visual Representations. NAACL-HLT (2021)
Mitchell Wortsman, Gabriel Ilharco, Mike Li, Jong Wook Kim, Hannaneh Hajishirzi, Ali Farhadi, Hongseok Namkoong, Ludwig Schmidt
Robust fine-tuning of zero-shot models. CoRR (2021)
Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell, Matt Gardner
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus. EMNLP (1) (2021)
Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav, Yizhong Wang, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi, Jonathan Berant
MultiModalQA: complex question answering over text, tables and images. ICLR (2021)
Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav, Yizhong Wang, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi, Jonathan Berant
MultiModalQA: Complex Question Answering over Text, Tables and Images. CoRR (2021)
Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
Contrasting Contrastive Self-Supervised Representation Learning Pipelines. ICCV (2021)
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith
Finetuning Pretrained Transformers into RNNs. EMNLP (1) (2021)
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith
Finetuning Pretrained Transformers into RNNs. CoRR (2021)
Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Matt Gardner
Documenting the English Colossal Clean Crawled Corpus. CoRR (2021)
Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
Contrasting Contrastive Self-Supervised Representation Learning Models. CoRR (2021)
Gabriel Ilharco, Cesar Ilharco, Iulia Turc, Tim Dettmers, Felipe Ferreira, Kenton Lee
High Performance Natural Language Processing. EMNLP (Tutorial Abstracts) (2020)
Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi
Probing Text Models for Common Ground with Visual Representations. CoRR (2020)
Jesse Dodge, Gabriel Ilharco, Roy Schwartz, Ali Farhadi, Hannaneh Hajishirzi, Noah A. Smith
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping. CoRR (2020)
Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hanna Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
Evaluating NLP Models via Contrast Sets. CoRR (2020)
Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
Evaluating Models' Local Decision Boundaries via Contrast Sets. EMNLP (Findings) (2020)
Gabriel Ilharco, Vihan Jain, Alexander Ku, Eugene Ie, Jason Baldridge
General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warping. ViGIL@NeurIPS (2019)
Gabriel Ilharco, Yuan Zhang, Jason Baldridge
Large-scale representation learning from visually grounded untranscribed speech. CoRR (2019)
Gabriel Ilharco, Yuan Zhang, Jason Baldridge
Large-Scale Representation Learning from Visually Grounded Untranscribed Speech. CoNLL (2019)
Gabriel Ilharco, Vihan Jain, Alexander Ku, Eugene Ie, Jason Baldridge
General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warping CoRR (2019)