Joan Puigcerver

Publication Activity (10 Years)

Years Active: 2014-2024
Publications (10 Years): 48

Top Topics

Handwritten Text

Convolutional Neural Networks

Top Venues

Publications

Tianlin Liu, Mathieu Blondel, Carlos Riquelme Ruiz, Joan Puigcerver
Routers in Vision Mixture of Experts: An Empirical Study. Trans. Mach. Learn. Res. 2024 (2024)
Lucas Beyer, Andreas Steiner, André Susano Pinto, Alexander Kolesnikov, Xiao Wang, Daniel Salz, Maxim Neumann, Ibrahim Alabdulmohsin, Michael Tschannen, Emanuele Bugliarello, Thomas Unterthiner, Daniel Keysers, Skanda Koppula, Fangyu Liu, Adam Grycner, Alexey A. Gritsenko, Neil Houlsby, Manoj Kumar, Keran Rong, Julian Eisenschlos, Rishabh Kabra, Matthias Bauer, Matko Bosnjak, Xi Chen, Matthias Minderer, Paul Voigtlaender, Ioana Bica, Ivana Balazevic, Joan Puigcerver, Pinelopi Papalampidi, Olivier J. Hénaff, Xi Xiong, Radu Soricut, Jeremiah Harmsen, Xiaohua Zhai
PaliGemma: A versatile 3B VLM for transfer. CoRR (2024)
Tianlin Liu, Mathieu Blondel, Carlos Riquelme, Joan Puigcerver
Routers in Vision Mixture of Experts: An Empirical Study. CoRR (2024)
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil Houlsby
From Sparse to Soft Mixtures of Experts. ICLR (2024)
Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim M. Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution. NeurIPS (2023)
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby
Scaling Vision Transformers to 22 Billion Parameters. CoRR (2023)
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. ICLR (2023)
Michael E. Sander, Joan Puigcerver, Josip Djolonga, Gabriel Peyré, Mathieu Blondel
Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective. CoRR (2023)
Xi Chen, Xiao Wang, Soravit Changpinyo, A. J. Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V. Thapliyal, James Bradbury, Weicheng Kuo
PaLI: A Jointly-Scaled Multilingual Language-Image Model. ICLR (2023)
Tianlin Liu, Joan Puigcerver, Mathieu Blondel
Sparsity-Constrained Optimal Transport. ICLR (2023)
Enrique Vidal, Alejandro H. Toselli, Joan Puigcerver
Lexicon-based probabilistic indexing of handwritten text images. Neural Comput. Appl. 35 (24) (2023)
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby
Scaling Vision Transformers to 22 Billion Parameters. ICML (2023)
Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution. CoRR (2023)
Michael Eli Sander, Joan Puigcerver, Josip Djolonga, Gabriel Peyré, Mathieu Blondel
Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective. ICML (2023)
Joan Puigcerver, Carlos Riquelme, Basil Mustafa, Neil Houlsby
From Sparse to Soft Mixtures of Experts. CoRR (2023)
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. CoRR (2022)
James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
Sparse MoEs meet Efficient Ensembles. Trans. Mach. Learn. Res. 2022 (2022)
Joan Puigcerver, Rodolphe Jenatton, Carlos Riquelme, Pranjal Awasthi, Srinadh Bhojanapalli
On the Adversarial Robustness of Mixture of Experts. CoRR (2022)
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts. CoRR (2022)
Tianlin Liu, Joan Puigcerver, Mathieu Blondel
Sparsity-Constrained Optimal Transport. CoRR (2022)
Xi Chen, Xiao Wang, Soravit Changpinyo, A. J. Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish Thapliyal, James Bradbury, Weicheng Kuo, Mojtaba Seyedhosseini, Chao Jia, Burcu Karagol Ayan, Carlos Riquelme, Andreas Steiner, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
PaLI: A Jointly-Scaled Multilingual Language-Image Model. CoRR (2022)
Joan Puigcerver, Rodolphe Jenatton, Carlos Riquelme, Pranjal Awasthi, Srinadh Bhojanapalli
On the Adversarial Robustness of Mixture of Experts. NeurIPS (2022)
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts. NeurIPS (2022)
Cédric Renggli, André Susano Pinto, Neil Houlsby, Basil Mustafa, Joan Puigcerver, Carlos Riquelme
Learning to Merge Tokens in Vision Transformers. CoRR (2022)
Cédric Renggli, André Susano Pinto, Luka Rimanic, Joan Puigcerver, Carlos Riquelme, Ce Zhang, Mario Lucic
Which Model to Transfer? Finding the Needle in the Growing Haystack. CVPR (2022)
Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby
Scaling Vision with Sparse Mixture of Experts. NeurIPS (2021)
Enrique Vidal, Alejandro H. Toselli, Joan Puigcerver
A Probabilistic Framework for Lexicon-based Keyword Spotting in Handwritten Text Images. CoRR (2021)
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Cédric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
Scalable Transfer Learning with Expert Models. ICLR (2021)
Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic
On Robustness and Transferability of Convolutional Neural Networks. CVPR (2021)
Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby
Scaling Vision with Sparse Mixture of Experts. CoRR (2021)
James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
Sparse MoEs meet Efficient Ensembles. CoRR (2021)
Cédric Renggli, André Susano Pinto, Luka Rimanic, Joan Puigcerver, Carlos Riquelme, Ce Zhang, Mario Lucic
Which Model to Transfer? Finding the Needle in the Growing Haystack. CoRR (2020)
Joan Puigcerver, Carlos Riquelme, Basil Mustafa, Cédric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
Scalable Transfer Learning with Expert Models. CoRR (2020)
Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic
On Robustness and Transferability of Convolutional Neural Networks. CoRR (2020)
Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby
Big Transfer (BiT): General Visual Representation Learning. ECCV (5) (2020)
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, André Susano Pinto, Daniel Keysers, Neil Houlsby
Deep Ensembles for Low-Data Transfer Learning. CoRR (2020)
Alejandro H. Toselli, Enrique Vidal, Joan Puigcerver, Ernesto Noya-García
Probabilistic multi-word spotting in handwritten text images. Pattern Anal. Appl. 22 (1) (2019)
Xiaohua Zhai, Joan Puigcerver, Alexander Kolesnikov, Pierre Ruyssen, Carlos Riquelme, Mario Lucic, Josip Djolonga, André Susano Pinto, Maxim Neumann, Alexey Dosovitskiy, Lucas Beyer, Olivier Bachem, Michael Tschannen, Marcin Michalski, Olivier Bousquet, Sylvain Gelly, Neil Houlsby
The Visual Task Adaptation Benchmark. CoRR (2019)
Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby
Large Scale Learning of General Visual Representations for Transfer. CoRR (2019)
Eva Lang, Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
Probabilistic Indexing and Search for Information Extraction on Handwritten German Parish Records. ICFHR (2018)
Dominique Stutzmann, Christopher Kermorvant, Enrique Vidal, Sukalpa Chanda, Sébastien Hamel, Joan Puigcerver, Lambert Schomaker, Alejandro H. Toselli
Handwritten Text Recognition, Keyword Indexing, and Plain Text Search in Medieval Manuscripts. DH (2018)
Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
Querying out-of-vocabulary words in lexicon-based keyword spotting. Neural Comput. Appl. 28 (9) (2017)
Joan Puigcerver
Are Multidimensional Recurrent Layers Really Necessary for Handwritten Text Recognition? ICDAR (2017)
Théodore Bluche, Sébastien Hamel, Christopher Kermorvant, Joan Puigcerver, Dominique Stutzmann, Alejandro H. Toselli, Enrique Vidal
Preparatory KWS Experiments for Large-Scale Indexing of a Vast Medieval Manuscript Collection in the HIMANIS Project. ICDAR (2017)
Mauricio Villegas, Joan Puigcerver, Alejandro H. Toselli, Joan-Andreu Sánchez, Enrique Vidal
Overview of the ImageCLEF 2016 Handwritten Scanned Document Retrieval Task. CLEF (Working Notes) (2016)
Mauricio Villegas, Henning Müller, Alba Garcia Seco de Herrera, Roger Schaer, Stefano Bromuri, Andrew Gilbert, Luca Piras, Josiah Wang, Fei Yan, Arnau Ramisa, Emmanuel Dellandréa, Robert J. Gaizauskas, Krystian Mikolajczyk, Joan Puigcerver, Alejandro H. Toselli, Joan-Andreu Sánchez, Enrique Vidal
General Overview of ImageCLEF at the CLEF 2016 Labs. CLEF (2016)
Ioannis Pratikakis, Konstantinos Zagoris, Basilis Gatos, Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
ICFHR2016 Handwritten Keyword Spotting Competition (H-KWS 2016). ICFHR (2016)
Alejandro Héctor Toselli Rossi, Joan Puigcerver, Enrique Vidal
Two Methods to Improve Confidence Scores for Lexicon-Free Word Spotting in Handwritten Text. ICFHR (2016)
Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
A New Smoothing Method for Lexicon-Based Handwritten Text Keyword Spotting. IbPRIA (2015)
Alejandro Héctor Toselli Rossi, Joan Puigcerver, Enrique Vidal
Context-aware lattice based filler approach for key word spotting in handwritten documents. ICDAR (2015)
Enrique Vidal, Alejandro H. Toselli, Joan Puigcerver
High performance Query-by-Example keyword spotting using Query-by-String techniques. ICDAR (2015)
Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
ICDAR2015 Competition on Keyword Spotting for Handwritten Documents. ICDAR (2015)
Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
Probabilistic interpretation and improvements to the HMM-filler for handwritten keyword spotting. ICDAR (2015)
Joan Puigcerver, Alejandro Héctor Toselli Rossi, Enrique Vidal
Word-Graph and Character-Lattice Combination for KWS in Handwritten Documents. ICFHR (2014)
Joan Puigcerver, Alejandro Héctor Toselli Rossi, Enrique Vidal
Word-Graph-Based Handwriting Keyword Spotting of Out-of-Vocabulary Queries. ICPR (2014)