Jonathan Pilault

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 19

Top Topics

Transfer Learning

Language Modeling

Multidocument Summarization

Fewer Parameters

Top Venues

Publications

Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge
Zamba: A Compact 7B SSM Hybrid Model. CoRR (2024)
Mahan Fathi, Clement Gehring, Jonathan Pilault, David Kanaa, Pierre-Luc Bacon, Ross Goroshin
Course Correcting Koopman Representations. ICLR (2024)
Yury Tokpanov, Beren Millidge, Paolo Glorioso, Jonathan Pilault, Adam Ibrahim, James Whittington, Quentin Anthony
Zyda: A 1.3T Dataset for Open Language Modeling. CoRR (2024)
Jonathan Pilault, Can Liu, Mohit Bansal, Markus Dreyer
On Conditional and Compositional Language Model Differentiable Prompting. IJCAI (2023)
Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction. IJCNLP (1) (2023)
Jonathan Pilault, Mahan Fathi, Orhan Firat, Chris Pal, Pierre-Luc Bacon, Ross Goroshin
Block-State Transformers. NeurIPS (2023)
Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction. CoRR (2023)
Mahan Fathi, Clement Gehring, Jonathan Pilault, David Kanaa, Pierre-Luc Bacon, Ross Goroshin
Course Correcting Koopman Representations. CoRR (2023)
Mahan Fathi, Jonathan Pilault, Pierre-Luc Bacon, Christopher Pal, Orhan Firat, Ross Goroshin
Block-State Transformer. CoRR (2023)
Joo Hyung Lee, Wonpyo Park, Nicole Mitchell, Jonathan Pilault, Johan S. Obando-Ceron, Han-Byul Kim, Namhoon Lee, Elias Frantar, Yun Long, Amir Yazdanbakhsh, Shivani Agrawal, Suvinay Subramanian, Xin Wang, Sheng-Chun Kao, Xingyao Zhang, Trevor Gale, Aart Bik, Woohyun Han, Milen Ferev, Zhonglin Han, Hong-Seok Kim, Yann N. Dauphin, Karolina Dziugaite, Pablo Samuel Castro, Utku Evci
JaxPruner: A concise library for sparsity research. CoRR (2023)
Jonathan Pilault, Can Liu, Mohit Bansal, Markus Dreyer
On Conditional and Compositional Language Model Differentiable Prompting. CoRR (2023)
Jonathan Pilault, Michael Galkin, Bahare Fatemi, Perouz Taslakian, David Vasquez, Christopher Pal
Using Graph Algorithms to Pretrain Graph Completion Transformers. CoRR (2022)
Torsten Scholak, Jonathan Pilault, Joey Velez-Ginorio
Towards Neural Functional Program Evaluation. CoRR (2021)
Jonathan Pilault, Amine Elhattami, Christopher J. Pal
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data. ICLR (2021)
Jonathan Pilault, Jaehong Park, Christopher J. Pal
On the impressive performance of randomly weighted encoders in summarization tasks. CoRR (2020)
Jonathan Pilault, Amine Elhattami, Christopher J. Pal
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data. CoRR (2020)
Jaehong Park, Jonathan Pilault, Christopher Joseph Pal
Learning to Summarize Long Texts with Memory Compression and Transfer. CoRR (2020)
Jonathan Pilault, Raymond Li, Sandeep Subramanian, Chris Pal
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models. EMNLP (1) (2020)
Sandeep Subramanian, Raymond Li, Jonathan Pilault, Christopher J. Pal
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models. CoRR (2019)