Joan Puigcerver

55 papers A* 13A 6B 5Misc 1Journal 26Unranked 4

Year	Rank	Type	Title / Venue / Authors
2024	A*	`conf`	From Sparse to Soft Mixtures of Experts. ICLR Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil Houlsby
2024	J	`jnl`	PaliGemma: A versatile 3B VLM for transfer. CoRR Lucas Beyer, Andreas Steiner, André Susano Pinto, Alexander Kolesnikov, Xiao Wang, Daniel Salz, Maxim Neumann, Ibrahim Alabdulmohsin, Michael Tschannen, Emanuele Bugliarello, Thomas Unterthiner, Daniel Keysers, Skanda Koppula, Fangyu Liu, Adam Grycner, Alexey A. Gritsenko, Neil Houlsby, Manoj Kumar, Keran Rong, Julian Eisenschlos, Rishabh Kabra, Matthias Bauer, Matko Bosnjak, Xi Chen, Matthias Minderer, Paul Voigtlaender, Ioana Bica, Ivana Balazevic, Joan Puigcerver, Pinelopi Papalampidi, Olivier J. Hénaff, Xi Xiong, Radu Soricut, Jeremiah Harmsen, Xiaohua Zhai
2024	J	`jnl`	Routers in Vision Mixture of Experts: An Empirical Study. CoRR Tianlin Liu, Mathieu Blondel, Carlos Riquelme, Joan Puigcerver
2024	J	`jnl`	Routers in Vision Mixture of Experts: An Empirical Study. Trans. Mach. Learn. Res. Tianlin Liu, Mathieu Blondel, Carlos Riquelme Ruiz, Joan Puigcerver
2023	A*	`conf`	Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective. ICML Michael Eli Sander, Joan Puigcerver, Josip Djolonga, Gabriel Peyré, Mathieu Blondel
2023	J	`jnl`	Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective. CoRR Michael E. Sander, Joan Puigcerver, Josip Djolonga, Gabriel Peyré, Mathieu Blondel
2023	J	`jnl`	From Sparse to Soft Mixtures of Experts. CoRR Joan Puigcerver, Carlos Riquelme, Basil Mustafa, Neil Houlsby
2023	J	`jnl`	Lexicon-based probabilistic indexing of handwritten text images. Neural Comput. Appl. Enrique Vidal, Alejandro H. Toselli, Joan Puigcerver
2023	A*	`conf`	PaLI: A Jointly-Scaled Multilingual Language-Image Model. ICLR Xi Chen, Xiao Wang, Soravit Changpinyo, A. J. Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V. Thapliyal, James Bradbury, Weicheng Kuo
2023	A*	`conf`	Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution. NeurIPS Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim M. Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
2023	J	`jnl`	Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution. CoRR Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
2023	A*	`conf`	Scaling Vision Transformers to 22 Billion Parameters. ICML Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby
2023	J	`jnl`	Scaling Vision Transformers to 22 Billion Parameters. CoRR Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby
2023	A*	`conf`	Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. ICLR Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
2023	A*	`conf`	Sparsity-Constrained Optimal Transport. ICLR Tianlin Liu, Joan Puigcerver, Mathieu Blondel
2022	J	`jnl`	Learning to Merge Tokens in Vision Transformers. CoRR Cédric Renggli, André Susano Pinto, Neil Houlsby, Basil Mustafa, Joan Puigcerver, Carlos Riquelme
2022	A*	`conf`	Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts. NeurIPS Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
2022	J	`jnl`	Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts. CoRR Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
2022	A*	`conf`	On the Adversarial Robustness of Mixture of Experts. NeurIPS Joan Puigcerver, Rodolphe Jenatton, Carlos Riquelme, Pranjal Awasthi, Srinadh Bhojanapalli
2022	J	`jnl`	On the Adversarial Robustness of Mixture of Experts. CoRR Joan Puigcerver, Rodolphe Jenatton, Carlos Riquelme, Pranjal Awasthi, Srinadh Bhojanapalli
2022	J	`jnl`	PaLI: A Jointly-Scaled Multilingual Language-Image Model. CoRR Xi Chen, Xiao Wang, Soravit Changpinyo, A. J. Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V. Thapliyal, James Bradbury, Weicheng Kuo, Mojtaba Seyedhosseini, Chao Jia, Burcu Karagol Ayan, Carlos Riquelme, Andreas Steiner, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2022	J	`jnl`	Sparse MoEs meet Efficient Ensembles. Trans. Mach. Learn. Res. James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
2022	J	`jnl`	Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. CoRR Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
2022	J	`jnl`	Sparsity-Constrained Optimal Transport. CoRR Tianlin Liu, Joan Puigcerver, Mathieu Blondel
2022	A*	`conf`	Which Model to Transfer? Finding the Needle in the Growing Haystack. CVPR Cédric Renggli, André Susano Pinto, Luka Rimanic, Joan Puigcerver, Carlos Riquelme, Ce Zhang, Mario Lucic
2021	J	`jnl`	A Probabilistic Framework for Lexicon-based Keyword Spotting in Handwritten Text Images. CoRR Enrique Vidal, Alejandro H. Toselli, Joan Puigcerver
2021	A*	`conf`	On Robustness and Transferability of Convolutional Neural Networks. CVPR Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic
2021	A*	`conf`	Scalable Transfer Learning with Expert Models. ICLR Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Cédric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
2021	A*	`conf`	Scaling Vision with Sparse Mixture of Experts. NeurIPS Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby
2021	J	`jnl`	Scaling Vision with Sparse Mixture of Experts. CoRR Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby
2021	J	`jnl`	Sparse MoEs meet Efficient Ensembles. CoRR James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
2020	—	`conf`	Big Transfer (BiT): General Visual Representation Learning. ECCV (5) Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby
2020	J	`jnl`	Deep Ensembles for Low-Data Transfer Learning. CoRR Basil Mustafa, Carlos Riquelme, Joan Puigcerver, André Susano Pinto, Daniel Keysers, Neil Houlsby
2020	J	`jnl`	On Robustness and Transferability of Convolutional Neural Networks. CoRR Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic
2020	J	`jnl`	Scalable Transfer Learning with Expert Models. CoRR Joan Puigcerver, Carlos Riquelme, Basil Mustafa, Cédric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
2020	J	`jnl`	Which Model to Transfer? Finding the Needle in the Growing Haystack. CoRR Cédric Renggli, André Susano Pinto, Luka Rimanic, Joan Puigcerver, Carlos Riquelme, Ce Zhang, Mario Lucic
2019	J	`jnl`	Large Scale Learning of General Visual Representations for Transfer. CoRR Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby
2019	J	`jnl`	Probabilistic multi-word spotting in handwritten text images. Pattern Anal. Appl. Alejandro H. Toselli, Enrique Vidal, Joan Puigcerver, Ernesto Noya-García
2019	J	`jnl`	The Visual Task Adaptation Benchmark. CoRR Xiaohua Zhai, Joan Puigcerver, Alexander Kolesnikov, Pierre Ruyssen, Carlos Riquelme, Mario Lucic, Josip Djolonga, André Susano Pinto, Maxim Neumann, Alexey Dosovitskiy, Lucas Beyer, Olivier Bachem, Michael Tschannen, Marcin Michalski, Olivier Bousquet, Sylvain Gelly, Neil Houlsby
2018	—	`conf`	Handwritten Text Recognition, Keyword Indexing, and Plain Text Search in Medieval Manuscripts. DH Dominique Stutzmann, Christopher Kermorvant, Enrique Vidal, Sukalpa Chanda, Sébastien Hamel, Joan Puigcerver, Lambert Schomaker, Alejandro H. Toselli
2018	B	`conf`	Probabilistic Indexing and Search for Information Extraction on Handwritten German Parish Records. ICFHR Eva Lang, Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
2017	A	`conf`	Are Multidimensional Recurrent Layers Really Necessary for Handwritten Text Recognition? ICDAR Joan Puigcerver
2017	A	`conf`	Preparatory KWS Experiments for Large-Scale Indexing of a Vast Medieval Manuscript Collection in the HIMANIS Project. ICDAR Théodore Bluche, Sébastien Hamel, Christopher Kermorvant, Joan Puigcerver, Dominique Stutzmann, Alejandro H. Toselli, Enrique Vidal
2017	J	`jnl`	Querying out-of-vocabulary words in lexicon-based keyword spotting. Neural Comput. Appl. Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
2016	—	`conf`	General Overview of ImageCLEF at the CLEF 2016 Labs. CLEF Mauricio Villegas, Henning Müller, Alba Garcia Seco de Herrera, Roger Schaer, Stefano Bromuri, Andrew Gilbert, Luca Piras, Josiah Wang, Fei Yan, Arnau Ramisa, Emmanuel Dellandréa, Robert J. Gaizauskas, Krystian Mikolajczyk, Joan Puigcerver, Alejandro H. Toselli, Joan-Andreu Sánchez, Enrique Vidal
2016	B	`conf`	ICFHR2016 Handwritten Keyword Spotting Competition (H-KWS 2016). ICFHR Ioannis Pratikakis, Konstantinos Zagoris, Basilis Gatos, Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
2016	—	`conf`	Overview of the ImageCLEF 2016 Handwritten Scanned Document Retrieval Task. CLEF (Working Notes) Mauricio Villegas, Joan Puigcerver, Alejandro H. Toselli, Joan-Andreu Sánchez, Enrique Vidal
2016	B	`conf`	Two Methods to Improve Confidence Scores for Lexicon-Free Word Spotting in Handwritten Text. ICFHR Alejandro Héctor Toselli Rossi, Joan Puigcerver, Enrique Vidal
2015	Misc	`conf`	A New Smoothing Method for Lexicon-Based Handwritten Text Keyword Spotting. IbPRIA Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
2015	A	`conf`	Context-aware lattice based filler approach for key word spotting in handwritten documents. ICDAR Alejandro Héctor Toselli Rossi, Joan Puigcerver, Enrique Vidal
2015	A	`conf`	High performance Query-by-Example keyword spotting using Query-by-String techniques. ICDAR Enrique Vidal, Alejandro H. Toselli, Joan Puigcerver
2015	A	`conf`	ICDAR2015 Competition on Keyword Spotting for Handwritten Documents. ICDAR Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
2015	A	`conf`	Probabilistic interpretation and improvements to the HMM-filler for handwritten keyword spotting. ICDAR Joan Puigcerver, Alejandro H. Toselli, Enrique Vidal
2014	B	`conf`	Word-Graph and Character-Lattice Combination for KWS in Handwritten Documents. ICFHR Joan Puigcerver, Alejandro Héctor Toselli Rossi, Enrique Vidal
2014	B	`conf`	Word-Graph-Based Handwriting Keyword Spotting of Out-of-Vocabulary Queries. ICPR Joan Puigcerver, Alejandro Héctor Toselli Rossi, Enrique Vidal