Victor Sanh

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 34

Top Topics

Transfer Learning

Natural Language

Top Venues

Publications

Hugo Laurençon, Léo Tronchon, Matthieu Cord, Victor Sanh
What matters when building vision-language models? CoRR (2024)
Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. CoRR (2024)
Hugo Laurençon, Léo Tronchon, Victor Sanh
Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset. CoRR (2024)
Hendrik Strobelt, Albert Webson, Victor Sanh, Benjamin Hoover, Johanna Beyer, Hanspeter Pfister, Alexander M. Rush
Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models. IEEE Trans. Vis. Comput. Graph. 29 (1) (2023)
Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh
OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents. CoRR (2023)
Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh
OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents. NeurIPS (2023)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
What Language Model to Train if You Have One Million GPU Hours? CoRR (2022)
Victor Sanh, Albert Webson, Colin Raffel, Stephen Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Teven Le Scao, Stella Biderman, Leo Gao, Thomas Wolf, Alexander M. Rush
Multitask Prompted Training Enables Zero-Shot Task Generalization. ICLR (2022)
Stephen H. Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M. Saiful Bari, Thibault Févry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged Saeed AlShaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Mike Tian-Jian Jiang, Alexander M. Rush
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. CoRR (2022)
Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilic, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major, Iz Beltagy, Huu Nguyen, Lucile Saulnier, Samson Tan, Pedro Ortiz Suarez, Victor Sanh, Hugo Laurençon, Yacine Jernite, Julien Launay, Margaret Mitchell, Colin Raffel, Aaron Gokaslan, Adi Simhi, Aitor Soroa, Alham Fikri Aji, Amit Alfassy, Anna Rogers, Ariel Kreisberg Nitzav, Canwen Xu, Chenghao Mou, Chris Emezue, Christopher Klamm, Colin Leong, Daniel van Strien, David Ifeoluwa Adelani, et al.
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. CoRR (2022)
Stephen H. Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M. Saiful Bari, Thibault Févry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged Saeed AlShaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Dragomir R. Radev, Mike Tian-Jian Jiang, Alexander M. Rush
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. ACL (demo) (2022)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
What Language Model to Train if You Have One Million GPU Hours? EMNLP (Findings) (2022)
Hendrik Strobelt, Albert Webson, Victor Sanh, Benjamin Hoover, Johanna Beyer, Hanspeter Pfister, Alexander M. Rush
Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models. CoRR (2022)
Prasetya Ajie Utama, Nafise Sadat Moosavi, Victor Sanh, Iryna Gurevych
Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning. EMNLP (1) (2021)
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M. Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, Alexander M. Rush
Multitask Prompted Training Enables Zero-Shot Task Generalization. CoRR (2021)
Thierry Tambe, Coleman Hooper, Lillian Pentecost, Tianyu Jia, En-Yu Yang, Marco Donato, Victor Sanh, Paul N. Whatmough, Alexander M. Rush, David Brooks, Gu-Yeon Wei
EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference. MICRO (2021)
Victor Sanh, Alexander M. Rush
Low-Complexity Probing via Finding Subnetworks. NAACL-HLT (2021)
Steven Cao, Victor Sanh, Alexander M. Rush
Low-Complexity Probing via Finding Subnetworks. CoRR (2021)
François Lagunas, Ella Charlaix, Victor Sanh, Alexander M. Rush
Block Pruning For Faster Transformers. CoRR (2021)
Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, Abhishek Thakur, Patrick von Platen, Suraj Patil, Julien Chaumond, Mariama Drame, Julien Plu, Lewis Tunstall, Joe Davison, Mario Sasko, Gunjan Chhablani, Bhavitvya Malik, Simon Brandeis, Teven Le Scao, Victor Sanh, Canwen Xu, Nicolas Patry, Angelina McMillan-Major, Philipp Schmid, Sylvain Gugger, Clement Delangue, Théo Matussière, Lysandre Debut, Stas Bekman, Pierric Cistac, Thibault Goehringer, Victor Mustar, François Lagunas, Alexander M. Rush, Thomas Wolf
Datasets: A Community Library for Natural Language Processing. CoRR (2021)
Victor Sanh, Thomas Wolf, Yonatan Belinkov, Alexander M. Rush
Learning from others' mistakes: Avoiding dataset biases without modeling them. ICLR (2021)
Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, Abhishek Thakur, Patrick von Platen, Suraj Patil, Julien Chaumond, Mariama Drame, Julien Plu, Lewis Tunstall, Joe Davison, Mario Sasko, Gunjan Chhablani, Bhavitvya Malik, Simon Brandeis, Teven Le Scao, Victor Sanh, Canwen Xu, Nicolas Patry, Angelina McMillan-Major, Philipp Schmid, Sylvain Gugger, Clément Delangue, Théo Matussière, Lysandre Debut, Stas Bekman, Pierric Cistac, Thibault Goehringer, Victor Mustar, François Lagunas, Alexander M. Rush, Thomas Wolf
Datasets: A Community Library for Natural Language Processing. EMNLP (Demos) (2021)
Prasetya Ajie Utama, Nafise Sadat Moosavi, Victor Sanh, Iryna Gurevych
Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning. CoRR (2021)
François Lagunas, Ella Charlaix, Victor Sanh, Alexander M. Rush
Block Pruning For Faster Transformers. EMNLP (1) (2021)
Victor Sanh, Thomas Wolf, Alexander M. Rush
Movement Pruning: Adaptive Sparsity by Fine-Tuning. CoRR (2020)
Victor Sanh, Thomas Wolf, Alexander M. Rush
Movement Pruning: Adaptive Sparsity by Fine-Tuning. NeurIPS (2020)
Thierry Tambe, Coleman Hooper, Lillian Pentecost, En-Yu Yang, Marco Donato, Victor Sanh, Alexander M. Rush, David Brooks, Gu-Yeon Wei
EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP. CoRR (2020)
Victor Sanh, Thomas Wolf, Yonatan Belinkov, Alexander M. Rush
Learning from others' mistakes: Avoiding dataset biases without modeling them. CoRR (2020)
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander M. Rush
Transformers: State-of-the-Art Natural Language Processing. EMNLP (Demos) (2020)
Thomas Wolf, Victor Sanh, Julien Chaumond, Clement Delangue
TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents. CoRR (2019)
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Jamie Brew
HuggingFace's Transformers: State-of-the-art Natural Language Processing. CoRR (2019)
Victor Sanh, Lysandre Debut, Julien Chaumond, Thomas Wolf
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. CoRR (2019)
Victor Sanh, Thomas Wolf, Sebastian Ruder
A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks. AAAI (2019)
Victor Sanh, Thomas Wolf, Sebastian Ruder
A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks. CoRR (2018)