Jean-Baptiste Alayrac

ORCID

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 63

Top Venues

École Normale Supérieure, Paris, France (PHD)

Education History

École Normale Supérieure, Paris, France

PHD

Publications

Tomás Soucek, Jean-Baptiste Alayrac, Antoine Miech, Ivan Laptev, Josef Sivic
Multi-Task Learning of Object States and State-Modifying Actions From Web Videos. IEEE Trans. Pattern Anal. Mach. Intell. 46 (7) (2024)
Khaled Saab, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, Tim Strother, Chunjong Park, Elahe Vedadi, Juanma Zambrano Chaves, Szu-Yeu Hu, Mike Schaekermann, Aishwarya Kamath, Yong Cheng, David G. T. Barrett, Cathy Cheung, Basil Mustafa, Anil Palepu, Daniel McDuff, Le Hou, Tomer Golany, Luyang Liu, Jean-Baptiste Alayrac, Neil Houlsby, Nenad Tomasev, Jan Freyberg, Charles Lau, Jonas Kemp, Jeremy Lai, Shekoofeh Azizi, Kimberly Kanada, SiWai Man, Kavita Kulkarni, Ruoxi Sun, Siamak Shakeri, Luheng He, Benjamin Caine, Albert Webson, Natasha Latysheva, Melvin Johnson, Philip Andrew Mansfield, Jian Lu, Ehud Rivlin, Jesper Anderson, Bradley Green, Renee Wong, Jonathan Krause, Jonathon Shlens, Ewa Dominowska, S. M. Ali Eslami, Katherine Chou, Claire Cui, Oriol Vinyals, Koray Kavukcuoglu, James Manyika, Jeff Dean, Demis Hassabis, Yossi Matias, Dale R. Webster, Joelle K. Barral, Greg Corrado, Christopher Semturs, S. Sara Mahdavi, Juraj Gottweis, Alan Karthikesalingam, Vivek Natarajan
Capabilities of Gemini Models in Medicine. CoRR (2024)
Machel Reid, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy P. Lillicrap, Jean-Baptiste Alayrac, Radu Soricut, Angeliki Lazaridou, Orhan Firat, Julian Schrittwieser, Ioannis Antonoglou, Rohan Anil, Sebastian Borgeaud, Andrew M. Dai, Katie Millican, Ethan Dyer, Mia Glaese, Thibault Sottiaux, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, James Molloy, Jilin Chen, Michael Isard, Paul Barham, Tom Hennigan, Ross McIlroy, Melvin Johnson, Johan Schalkwyk, Eli Collins, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, Clemens Meyer, Gregory Thornton, Zhen Yang, Henryk Michalewski, Zaheer Abbas, Nathan Schucher, Ankesh Anand, Richard Ives, James Keeling, Karel Lenc, Salem Haykal, Siamak Shakeri, Pranav Shyam, Aakanksha Chowdhery, Roman Ring, Stephen Spencer, Eren Sezener, et al.
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. CoRR (2024)
Relja Arandjelovic, Alex Andonian, Arthur Mensch, Olivier J. Hénaff, Jean-Baptiste Alayrac, Andrew Zisserman
Three ways to improve feature alignment for open vocabulary detection. CoRR (2023)
Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Slav Petrov, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy P. Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul Ronald Barham, Tom Hennigan, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, Ryan Doherty, Eli Collins, Clemens Meyer, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, George Tucker, Enrique Piqueras, Maxim Krikun, Iain Barr, Nikolay Savinov, Ivo Danihelka, Becca Roelofs, Anaïs White, Anders Andreassen, Tamara von Glehn, Lakshman Yagati, Mehran Kazemi, Lucas Gonzalez, Misha Khalman, Jakub Sygnowski, et al.
Gemini: A Family of Highly Capable Multimodal Models. CoRR (2023)
Chuhan Zhang, Antoine Miech, Jiajun Shen, Jean-Baptiste Alayrac, Pauline Luc
Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime. CoRR (2023)
Adrià Recasens, Jason Lin, João Carreira, Andrew Jaegle, Luyu Wang, Jean-Baptiste Alayrac, Pauline Luc, Antoine Miech, Lucas Smaira, Ross Hemsley, Andrew Zisserman
Zorro: the masked multimodal transformer. CoRR (2023)
Luyu Wang, Pauline Luc, Yan Wu, Adrià Recasens, Lucas Smaira, Andrew Brock, Andrew Jaegle, Jean-Baptiste Alayrac, Sander Dieleman, João Carreira, Aäron van den Oord
Towards Learning Universal Audio Representations. ICASSP (2022)
Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J. Hénaff, Matthew M. Botvinick, Andrew Zisserman, Oriol Vinyals, João Carreira
Perceiver IO: A General Architecture for Structured Inputs & Outputs. ICLR (2022)
Tomás Soucek, Jean-Baptiste Alayrac, Antoine Miech, Ivan Laptev, Josef Sivic
Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videos. CoRR (2022)
Tomás Soucek, Jean-Baptiste Alayrac, Antoine Miech, Ivan Laptev, Josef Sivic
Multi-Task Learning of Object State Changes from Uncurated Videos. CoRR (2022)
Tomás Soucek, Jean-Baptiste Alayrac, Antoine Miech, Ivan Laptev, Josef Sivic
Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videos. CVPR (2022)
Curtis Hawthorne, Andrew Jaegle, Catalina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour, Jean-Baptiste Alayrac, João Carreira, Jesse H. Engel
General-purpose, long-context autoregressive modeling with Perceiver AR. CoRR (2022)
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob Menick, Sebastian Borgeaud, Andrew Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, Karen Simonyan
Flamingo: a Visual Language Model for Few-Shot Learning. CoRR (2022)
Curtis Hawthorne, Andrew Jaegle, Catalina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew M. Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour, Jean-Baptiste Alayrac, João Carreira, Jesse H. Engel
General-purpose, long-context autoregressive modeling with Perceiver AR. ICML (2022)
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob L. Menick, Sebastian Borgeaud, Andy Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, Karén Simonyan
Flamingo: a Visual Language Model for Few-Shot Learning. NeurIPS (2022)
Olivier J. Hénaff, Skanda Koppula, Jean-Baptiste Alayrac, Aäron van den Oord, Oriol Vinyals, João Carreira
Efficient Visual Pretraining with Contrastive Detection. CoRR (2021)
Chrisantha Fernando, S. M. Ali Eslami, Jean-Baptiste Alayrac, Piotr Mirowski, Dylan Banarse, Simon Osindero
Generative Art Using Neural Visual Grammars and Dual Encoders. CoRR (2021)
Antoine Miech, Jean-Baptiste Alayrac, Ivan Laptev, Josef Sivic, Andrew Zisserman
Thinking Fast and Slow: Efficient Text-to-Visual Retrieval With Transformers. CVPR (2021)
Rémi Leblond, Jean-Baptiste Alayrac, Laurent Sifre, Miruna Pislar, Jean-Baptiste Lespiau, Ioannis Antonoglou, Karen Simonyan, Oriol Vinyals
Machine Translation Decoding beyond Beam Search. EMNLP (1) (2021)
Luyu Wang, Pauline Luc, Yan Wu, Adrià Recasens, Lucas Smaira, Andrew Brock, Andrew Jaegle, Jean-Baptiste Alayrac, Sander Dieleman, João Carreira, Aäron van den Oord
Towards Learning Universal Audio Representations. CoRR (2021)
Adrià Recasens, Pauline Luc, Jean-Baptiste Alayrac, Luyu Wang, Florian Strub, Corentin Tallec, Mateusz Malinowski, Viorica Patraaucean, Florent Altché, Michal Valko, Jean-Bastien Grill, Aäron van den Oord, Andrew Zisserman
Broaden Your Views for Self-Supervised Video Learning. ICCV (2021)
Rémi Leblond, Jean-Baptiste Alayrac, Laurent Sifre, Miruna Pislar, Jean-Baptiste Lespiau, Ioannis Antonoglou, Karen Simonyan, Oriol Vinyals
Machine Translation Decoding beyond Beam Search. CoRR (2021)
Antoine Miech, Jean-Baptiste Alayrac, Ivan Laptev, Josef Sivic, Andrew Zisserman
Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformers. CoRR (2021)
Luyu Wang, Pauline Luc, Adrià Recasens, Jean-Baptiste Alayrac, Aäron van den Oord
Multimodal Self-Supervised Learning of General Audio Representations. CoRR (2021)
Olivier J. Hénaff, Skanda Koppula, Jean-Baptiste Alayrac, Aäron van den Oord, Oriol Vinyals, João Carreira
Efficient Visual Pretraining with Contrastive Detection. ICCV (2021)
Lisa Anne Hendricks, John Mellor, Rosalia Schneider, Jean-Baptiste Alayrac, Aida Nematzadeh
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers. CoRR (2021)
Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J. Hénaff, Matthew M. Botvinick, Andrew Zisserman, Oriol Vinyals, João Carreira
Perceiver IO: A General Architecture for Structured Inputs & Outputs. CoRR (2021)
Adrià Recasens, Pauline Luc, Jean-Baptiste Alayrac, Luyu Wang, Florian Strub, Corentin Tallec, Mateusz Malinowski, Viorica Patraucean, Florent Altché, Michal Valko, Jean-Bastien Grill, Aäron van den Oord, Andrew Zisserman
Broaden Your Views for Self-Supervised Video Learning. CoRR (2021)
Lisa Anne Hendricks, John Mellor, Rosalia Schneider, Jean-Baptiste Alayrac, Aida Nematzadeh
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers. Trans. Assoc. Comput. Linguistics 9 (2021)
Gunnar A. Sigurdsson, Jean-Baptiste Alayrac, Aida Nematzadeh, Lucas Smaira, Mateusz Malinowski, João Carreira, Phil Blunsom, Andrew Zisserman
Visual Grounding in Video for Unsupervised Word Translation. CoRR (2020)
Antoine Miech, Jean-Baptiste Alayrac, Lucas Smaira, Ivan Laptev, Josef Sivic, Andrew Zisserman
End-to-End Learning of Visual Representations From Uncurated Instructional Videos. CVPR (2020)
Gunnar A. Sigurdsson, Jean-Baptiste Alayrac, Aida Nematzadeh, Lucas Smaira, Mateusz Malinowski, João Carreira, Phil Blunsom, Andrew Zisserman
Visual Grounding in Video for Unsupervised Word Translation. CVPR (2020)
Daniel Fried, Jean-Baptiste Alayrac, Phil Blunsom, Chris Dyer, Stephen Clark, Aida Nematzadeh
Learning to Segment Actions from Observation and Narration. CoRR (2020)
Dimitri Zhukov, Jean-Baptiste Alayrac, Ivan Laptev, Josef Sivic
Learning Actionness via Long-Range Temporal Order Verification. ECCV (29) (2020)
Antoine Miech, Jean-Baptiste Alayrac, Ivan Laptev, Josef Sivic, Andrew Zisserman
RareAct: A video dataset of unusual interactions. CoRR (2020)
Jean-Baptiste Alayrac, Adrià Recasens, Rosalia Schneider, Relja Arandjelovic, Jason Ramapuram, Jeffrey De Fauw, Lucas Smaira, Sander Dieleman, Andrew Zisserman
Self-Supervised MultiModal Versatile Networks. NeurIPS (2020)
Jean-Baptiste Alayrac, Adrià Recasens, Rosalia Schneider, Relja Arandjelovic, Jason Ramapuram, Jeffrey De Fauw, Lucas Smaira, Sander Dieleman, Andrew Zisserman
Self-Supervised MultiModal Versatile Networks. CoRR (2020)
Daniel Fried, Jean-Baptiste Alayrac, Phil Blunsom, Chris Dyer, Stephen Clark, Aida Nematzadeh
Learning to Segment Actions from Observation and Narration. ACL (2020)
Antoine Miech, Dimitri Zhukov, Jean-Baptiste Alayrac, Makarand Tapaswi, Ivan Laptev, Josef Sivic
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips. ICCV (2019)
Jean-Baptiste Alayrac, João Carreira, Relja Arandjelovic, Andrew Zisserman
Controllable Attention for Structured Layered Video Decomposition. CoRR (2019)
Jean-Baptiste Alayrac, Jonathan Uesato, Po-Sen Huang, Alhussein Fawzi, Robert Stanforth, Pushmeet Kohli
Are Labels Required for Improving Adversarial Robustness? NeurIPS (2019)
Jean-Baptiste Alayrac, João Carreira, Andrew Zisserman
The Visual Centrifuge: Model-Free Layered Video Representations. CVPR (2019)
Jonathan Uesato, Jean-Baptiste Alayrac, Po-Sen Huang, Robert Stanforth, Alhussein Fawzi, Pushmeet Kohli
Are Labels Required for Improving Adversarial Robustness? CoRR (2019)
Dimitri Zhukov, Jean-Baptiste Alayrac, Ramazan Gokberk Cinbis, David F. Fouhey, Ivan Laptev, Josef Sivic
Cross-task weakly supervised learning from instructional videos. CoRR (2019)
Jean-Baptiste Alayrac, João Carreira, Relja Arandjelovic, Andrew Zisserman
Controllable Attention for Structured Layered Video Decomposition. ICCV (2019)
Dimitri Zhukov, Jean-Baptiste Alayrac, Ramazan Gokberk Cinbis, David F. Fouhey, Ivan Laptev, Josef Sivic
Cross-Task Weakly Supervised Learning From Instructional Videos. CVPR (2019)
Antoine Miech, Dimitri Zhukov, Jean-Baptiste Alayrac, Makarand Tapaswi, Ivan Laptev, Josef Sivic
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips. CoRR (2019)
Antoine Miech, Jean-Baptiste Alayrac, Lucas Smaira, Ivan Laptev, Josef Sivic, Andrew Zisserman
End-to-End Learning of Visual Representations from Uncurated Instructional Videos. CoRR (2019)
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Josef Sivic, Ivan Laptev, Simon Lacoste-Julien
Learning from Narrated Instruction Videos. IEEE Trans. Pattern Anal. Mach. Intell. 40 (9) (2018)
Jean-Baptiste Alayrac, João Carreira, Andrew Zisserman
The Visual Centrifuge: Model-Free Layered Video Representations. CoRR (2018)
Guilhem Chéron, Jean-Baptiste Alayrac, Ivan Laptev, Cordelia Schmid
A flexible model for training action localization with varying levels of supervision. CoRR (2018)
Rémi Leblond, Jean-Baptiste Alayrac, Anton Osokin, Simon Lacoste-Julien
SEARNN: Training RNNs with global-local losses. ICLR (Poster) (2018)
Guilhem Chéron, Jean-Baptiste Alayrac, Ivan Laptev, Cordelia Schmid
A flexible model for training action localization with varying levels of supervision. NeurIPS (2018)
Meera Hahn, Nataniel Ruiz, Jean-Baptiste Alayrac, Ivan Laptev, James M. Rehg
Learning to Localize and Align Fine-Grained Actions to Sparse Instructions. CoRR (2018)
Antoine Miech, Jean-Baptiste Alayrac, Piotr Bojanowski, Ivan Laptev, Josef Sivic
Learning from Video and Text via Large-Scale Discriminative Clustering. ICCV (2017)
Antoine Miech, Jean-Baptiste Alayrac, Piotr Bojanowski, Ivan Laptev, Josef Sivic
Learning from Video and Text via Large-Scale Discriminative Clustering. CoRR (2017)
Jean-Baptiste Alayrac, Josef Sivic, Ivan Laptev, Simon Lacoste-Julien
Joint Discovery of Object States and Manipulation Actions. ICCV (2017)
Rémi Leblond, Jean-Baptiste Alayrac, Anton Osokin, Simon Lacoste-Julien
SEARNN: Training RNNs with Global-Local Losses. CoRR (2017)
Jean-Baptiste Alayrac, Josef Sivic, Ivan Laptev, Simon Lacoste-Julien
Joint Discovery of Object States and Manipulating Actions. CoRR (2017)
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Josef Sivic, Ivan Laptev, Simon Lacoste-Julien
Unsupervised Learning from Narrated Instruction Videos. CVPR (2016)
Anton Osokin, Jean-Baptiste Alayrac, Isabella Lukasewitz, Puneet Kumar Dokania, Simon Lacoste-Julien
Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs. CoRR (2016)
Anton Osokin, Jean-Baptiste Alayrac, Isabella Lukasewitz, Puneet Kumar Dokania, Simon Lacoste-Julien
Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs. ICML (2016)
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Josef Sivic, Ivan Laptev, Simon Lacoste-Julien
Learning from narrated instruction videos. CoRR (2015)

Jean-Baptiste Alayrac.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Jean-Baptiste Alayrac