Neil Houlsby

108 papers A* 32A 4C 1Journal 64Unranked 7
YearRankTypeTitle / Venue / Authors
2025 J jnl
Compression Scaling Laws:Unifying Sparsity and Quantization.
CoRR
Elias Frantar, Utku Evci, Wonpyo Park, Neil Houlsby, Dan Alistarh
2024 J jnl
Capabilities of Gemini Models in Medicine.
CoRR
Khaled Saab, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, Tim Strother, Chunjong Park, Elahe Vedadi, Juanma Zambrano Chaves, Szu-Yeu Hu, Mike Schaekermann, Aishwarya Kamath, Yong Cheng, David G. T. Barrett, Cathy Cheung, Basil Mustafa, Anil Palepu, Daniel McDuff, Le Hou, Tomer Golany, Luyang Liu, Jean-Baptiste Alayrac, Neil Houlsby, Nenad Tomasev, Jan Freyberg, Charles Lau, Jonas Kemp, Jeremy Lai, Shekoofeh Azizi, Kimberly Kanada, SiWai Man, Kavita Kulkarni, Ruoxi Sun, Siamak Shakeri, Luheng He, Benjamin Caine, Albert Webson, Natasha Latysheva, Melvin Johnson, Philip Andrew Mansfield, Jian Lu, Ehud Rivlin, Jesper Anderson, Bradley Green, Renee Wong, Jonathan Krause, Jonathon Shlens, Ewa Dominowska, S. M. Ali Eslami, Katherine Chou, Claire Cui, Oriol Vinyals, Koray Kavukcuoglu, James Manyika, Jeff Dean, Demis Hassabis, Yossi Matias, Dale R. Webster, Joelle K. Barral, Greg Corrado, Christopher Semturs, S. Sara Mahdavi, Juraj Gottweis, Alan Karthikesalingam, Vivek Natarajan
2024 A* conf
From Sparse to Soft Mixtures of Experts.
ICLR
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil Houlsby
2024 A* conf
Frozen Feature Augmentation for Few-Shot Image Classification.
CVPR
Andreas Bär, Neil Houlsby, Mostafa Dehghani, Manoj Kumar
2024 J jnl
Frozen Feature Augmentation for Few-Shot Image Classification.
CoRR
Andreas Bär, Neil Houlsby, Mostafa Dehghani, Manoj Kumar
2024 A conf
Location-Aware Self-Supervised Transformers for Semantic Segmentation.
WACV
Mathilde Caron, Neil Houlsby, Cordelia Schmid
2024 A* conf
On Scaling Up a Multilingual Vision and Language Model.
CVPR
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2024 J jnl
PaliGemma: A versatile 3B VLM for transfer.
CoRR
Lucas Beyer, Andreas Steiner, André Susano Pinto, Alexander Kolesnikov, Xiao Wang, Daniel Salz, Maxim Neumann, Ibrahim Alabdulmohsin, Michael Tschannen, Emanuele Bugliarello, Thomas Unterthiner, Daniel Keysers, Skanda Koppula, Fangyu Liu, Adam Grycner, Alexey A. Gritsenko, Neil Houlsby, Manoj Kumar, Keran Rong, Julian Eisenschlos, Rishabh Kabra, Matthias Bauer, Matko Bosnjak, Xi Chen, Matthias Minderer, Paul Voigtlaender, Ioana Bica, Ivana Balazevic, Joan Puigcerver, Pinelopi Papalampidi, Olivier J. Hénaff, Xi Xiong, Radu Soricut, Jeremiah Harmsen, Xiaohua Zhai
2024 A* conf
Scaling Laws for Sparsely-Connected Foundation Models.
ICLR
Elias Frantar, Carlos Riquelme Ruiz, Neil Houlsby, Dan Alistarh, Utku Evci
2024 A* conf
SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation.
NeurIPS
Jonathan Roberts, Kai Han, Neil Houlsby, Samuel Albanie
2024 J jnl
SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation.
CoRR
Jonathan Roberts, Kai Han, Neil Houlsby, Samuel Albanie
2024 J jnl
Semantica: An Adaptable Image-Conditioned Diffusion Model.
CoRR
Manoj Kumar, Neil Houlsby, Emiel Hoogeboom
2023 A* conf
Adaptive Computation with Elastic Input Sequence.
ICML
Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You
2023 J jnl
Adaptive Computation with Elastic Input Sequence.
CoRR
Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You
2023 A* conf
CLIPPO: Image-and-Language Understanding from Pixels Only.
CVPR
Michael Tschannen, Basil Mustafa, Neil Houlsby
2023 J jnl
Dual PatchNorm.
CoRR
Manoj Kumar, Mostafa Dehghani, Neil Houlsby
2023 J jnl
Dual PatchNorm.
Trans. Mach. Learn. Res.
Manoj Kumar, Mostafa Dehghani, Neil Houlsby
2023 J jnl
From Sparse to Soft Mixtures of Experts.
CoRR
Joan Puigcerver, Carlos Riquelme, Basil Mustafa, Neil Houlsby
2023 A* conf
Image Captioners Are Scalable Vision Learners Too.
NeurIPS
Michael Tschannen, Manoj Kumar, Andreas Steiner, Xiaohua Zhai, Neil Houlsby, Lucas Beyer
2023 J jnl
Image Captioners Are Scalable Vision Learners Too.
CoRR
Michael Tschannen, Manoj Kumar, Andreas Steiner, Xiaohua Zhai, Neil Houlsby, Lucas Beyer
2023 A* conf
Massively Scaling Heteroscedastic Classifiers.
ICLR
Mark Collier, Rodolphe Jenatton, Basil Mustafa, Neil Houlsby, Jesse Berent, Effrosyni Kokiopoulou
2023 J jnl
Massively Scaling Heteroscedastic Classifiers.
CoRR
Mark Collier, Rodolphe Jenatton, Basil Mustafa, Neil Houlsby, Jesse Berent, Effrosyni Kokiopoulou
2023 J jnl
PaLI-X: On Scaling up a Multilingual Vision and Language Model.
CoRR
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2023 A* conf
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution.
NeurIPS
Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim M. Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
2023 J jnl
Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution.
CoRR
Mostafa Dehghani, Basil Mustafa, Josip Djolonga, Jonathan Heek, Matthias Minderer, Mathilde Caron, Andreas Steiner, Joan Puigcerver, Robert Geirhos, Ibrahim Alabdulmohsin, Avital Oliver, Piotr Padlewski, Alexey A. Gritsenko, Mario Lucic, Neil Houlsby
2023 J jnl
Scaling Laws for Sparsely-Connected Foundation Models.
CoRR
Elias Frantar, Carlos Riquelme, Neil Houlsby, Dan Alistarh, Utku Evci
2023 A* conf
Scaling Open-Vocabulary Object Detection.
NeurIPS
Matthias Minderer, Alexey A. Gritsenko, Neil Houlsby
2023 J jnl
Scaling Open-Vocabulary Object Detection.
CoRR
Matthias Minderer, Alexey A. Gritsenko, Neil Houlsby
2023 A* conf
Scaling Vision Transformers to 22 Billion Parameters.
ICML
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby
2023 J jnl
Scaling Vision Transformers to 22 Billion Parameters.
CoRR
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby
2023 A* conf
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.
ICLR
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
2023 A* conf
Transcending Scaling Laws with 0.1% Extra Compute.
EMNLP
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani
2023 A* conf
UL2: Unifying Language Learning Paradigms.
ICLR
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler
2022 J jnl
Do better ImageNet classifiers assess perceptual similarity better?
Trans. Mach. Learn. Res.
Manoj Kumar, Neil Houlsby, Nal Kalchbrenner, Ekin Dogus Cubuk
2022 J jnl
Image-and-Language Understanding from Pixels Only.
CoRR
Michael Tschannen, Basil Mustafa, Neil Houlsby
2022 J jnl
Learning to Merge Tokens in Vision Transformers.
CoRR
Cédric Renggli, André Susano Pinto, Neil Houlsby, Basil Mustafa, Joan Puigcerver, Carlos Riquelme
2022 J jnl
Location-Aware Self-Supervised Transformers.
CoRR
Mathilde Caron, Neil Houlsby, Cordelia Schmid
2022 A* conf
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts.
NeurIPS
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
2022 J jnl
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts.
CoRR
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
2022 J jnl
On the surprising tradeoff between ImageNet accuracy and perceptual similarity.
CoRR
Manoj Kumar, Neil Houlsby, Nal Kalchbrenner, Ekin D. Cubuk
2022 J jnl
PaLI: A Jointly-Scaled Multilingual Language-Image Model.
CoRR
Xi Chen, Xiao Wang, Soravit Changpinyo, A. J. Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Nan Ding, Keran Rong, Hassan Akbari, Gaurav Mishra, Linting Xue, Ashish V. Thapliyal, James Bradbury, Weicheng Kuo, Mojtaba Seyedhosseini, Chao Jia, Burcu Karagol Ayan, Carlos Riquelme, Andreas Steiner, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2022 J jnl
Robust and Efficient Medical Imaging with Self-Supervision.
CoRR
Shekoofeh Azizi, Laura Culp, Jan Freyberg, Basil Mustafa, Sebastien Baur, Simon Kornblith, Ting Chen, Patricia MacWilliams, S. Sara Mahdavi, Ellery Wulczyn, Boris Babenko, Megan Wilson, Aaron Loh, Po-Hsuan Cameron Chen, Yuan Liu, Pinal Bavishi, Scott Mayer McKinney, Jim Winkens, Abhijit Guha Roy, Zachary Beaver, Fiona Ryan, Justin Krogue, Mozziyar Etemadi, Umesh Telang, Yun Liu, Lily Peng, Gregory S. Corrado, Dale R. Webster, David J. Fleet, Geoffrey E. Hinton, Neil Houlsby, Alan Karthikesalingam, Mohammad Norouzi, Vivek Natarajan
2022 A* conf
Scaling Vision Transformers.
CVPR
Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, Lucas Beyer
2022 J jnl
Simple Open-Vocabulary Object Detection with Vision Transformers.
CoRR
Matthias Minderer, Alexey A. Gritsenko, Austin Stone, Maxim Neumann, Dirk Weissenborn, Alexey Dosovitskiy, Aravindh Mahendran, Anurag Arnab, Mostafa Dehghani, Zhuoran Shen, Xiao Wang, Xiaohua Zhai, Thomas Kipf, Neil Houlsby
2022 — conf
Simple Open-Vocabulary Object Detection.
ECCV (10)
Matthias Minderer, Alexey A. Gritsenko, Austin Stone, Maxim Neumann, Dirk Weissenborn, Alexey Dosovitskiy, Aravindh Mahendran, Anurag Arnab, Mostafa Dehghani, Zhuoran Shen, Xiao Wang, Xiaohua Zhai, Thomas Kipf, Neil Houlsby
2022 J jnl
Sparse MoEs meet Efficient Ensembles.
Trans. Mach. Learn. Res.
James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
2022 J jnl
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.
CoRR
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
2022 J jnl
Transcending Scaling Laws with 0.1% Extra Compute.
CoRR
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani
2022 A* conf
UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes.
NeurIPS
Alexander Kolesnikov, André Susano Pinto, Lucas Beyer, Xiaohua Zhai, Jeremiah Harmsen, Neil Houlsby
2022 J jnl
UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes.
CoRR
Alexander Kolesnikov, André Susano Pinto, Lucas Beyer, Xiaohua Zhai, Jeremiah Harmsen, Neil Houlsby
2022 J jnl
Underspecification Presents Challenges for Credibility in Modern Machine Learning.
J. Mach. Learn. Res.
Alexander D'Amour, Katherine A. Heller, Dan Moldovan, Ben Adlam, Babak Alipanahi, Alex Beutel, Christina Chen, Jonathan Deaton, Jacob Eisenstein, Matthew D. Hoffman, Farhad Hormozdiari, Neil Houlsby, Shaobo Hou, Ghassen Jerfel, Alan Karthikesalingam, Mario Lucic, Yi-An Ma, Cory Y. McLean, Diana Mincu, Akinori Mitani, Andrea Montanari, Zachary Nado, Vivek Natarajan, Christopher Nielson, Thomas F. Osborne, Rajiv Raman, Kim Ramasamy, Rory Sayres, Jessica Schrouff, Martin Seneviratne, Shannon Sequeira, Harini Suresh, Victor Veitch, Max Vladymyrov, Xuezhi Wang, Kellie Webster, Steve Yadlowsky, Taedong Yun, Xiaohua Zhai, D. Sculley
2022 J jnl
Unifying Language Learning Paradigms.
CoRR
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, Donald Metzler
2021 — conf
A Unified Few-Shot Classification Benchmark to Compare Transfer and Meta Learning Approaches.
NeurIPS Datasets and Benchmarks
Vincent Dumoulin, Neil Houlsby, Utku Evci, Xiaohua Zhai, Ross Goroshin, Sylvain Gelly, Hugo Larochelle
2021 A* conf
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.
ICLR
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby
2021 J jnl
Comparing Transfer and Meta Learning Approaches on a Unified Few-Shot Classification Benchmark.
CoRR
Vincent Dumoulin, Neil Houlsby, Utku Evci, Xiaohua Zhai, Ross Goroshin, Sylvain Gelly, Hugo Larochelle
2021 J jnl
Guest Editorial: Automated Machine Learning.
IEEE Trans. Pattern Anal. Mach. Intell.
Hugo Jair Escalante, Quanming Yao, Wei-Wei Tu, Nelishia Pillay, Rong Qu, Yang Yu, Neil Houlsby
2021 A* conf
MLP-Mixer: An all-MLP Architecture for Vision.
NeurIPS
Ilya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, Mario Lucic, Alexey Dosovitskiy
2021 J jnl
MLP-Mixer: An all-MLP Architecture for Vision.
CoRR
Ilya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, Mario Lucic, Alexey Dosovitskiy
2021 A* conf
On Robustness and Transferability of Convolutional Neural Networks.
CVPR
Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic
2021 A conf
Representation learning from videos in-the-wild: An object-centric approach.
WACV
Rob Romijnders, Aravindh Mahendran, Michael Tschannen, Josip Djolonga, Marvin Ritter, Neil Houlsby, Mario Lucic
2021 A* conf
Revisiting the Calibration of Modern Neural Networks.
NeurIPS
Matthias Minderer, Josip Djolonga, Rob Romijnders, Frances Hubis, Xiaohua Zhai, Neil Houlsby, Dustin Tran, Mario Lucic
2021 J jnl
Revisiting the Calibration of Modern Neural Networks.
CoRR
Matthias Minderer, Josip Djolonga, Rob Romijnders, Frances Hubis, Xiaohua Zhai, Neil Houlsby, Dustin Tran, Mario Lucic
2021 J jnl
SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and size.
CoRR
Jessica Yung, Rob Romijnders, Alexander Kolesnikov, Lucas Beyer, Josip Djolonga, Neil Houlsby, Sylvain Gelly, Mario Lucic, Xiaohua Zhai
2021 A* conf
Scalable Transfer Learning with Expert Models.
ICLR
Joan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Cédric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
2021 J jnl
Scaling Vision Transformers.
CoRR
Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, Lucas Beyer
2021 A* conf
Scaling Vision with Sparse Mixture of Experts.
NeurIPS
Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby
2021 J jnl
Scaling Vision with Sparse Mixture of Experts.
CoRR
Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby
2021 J jnl
Sparse MoEs meet Efficient Ensembles.
CoRR
James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton
2021 J jnl
Supervised Transfer Learning at Scale for Medical Imaging.
CoRR
Basil Mustafa, Aaron Loh, Jan Freyberg, Patricia MacWilliams, Megan Wilson, Scott Mayer McKinney, Marcin Sieniek, Jim Winkens, Yuan Liu, Peggy Bui, Shruthi Prabhakara, Umesh Telang, Alan Karthikesalingam, Neil Houlsby, Vivek Natarajan
2021 J jnl
The Benchmark Lottery.
CoRR
Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko, Zhe Zhao, Neil Houlsby, Fernando Diaz, Donald Metzler, Oriol Vinyals
2020 J jnl
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.
CoRR
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby
2020 A* conf
Automatic Shortcut Removal for Self-Supervised Representation Learning.
ICML
Matthias Minderer, Olivier Bachem, Neil Houlsby, Michael Tschannen
2020 J jnl
Automatic Shortcut Removal for Self-Supervised Representation Learning.
CoRR
Matthias Minderer, Olivier Bachem, Neil Houlsby, Michael Tschannen
2020 — conf
Big Transfer (BiT): General Visual Representation Learning.
ECCV (5)
Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby
2020 J jnl
Deep Ensembles for Low-Data Transfer Learning.
CoRR
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, André Susano Pinto, Daniel Keysers, Neil Houlsby
2020 J jnl
On Robustness and Transferability of Convolutional Neural Networks.
CoRR
Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders, Lucas Beyer, Alexander Kolesnikov, Joan Puigcerver, Matthias Minderer, Alexander D'Amour, Dan Moldovan, Sylvain Gelly, Neil Houlsby, Xiaohua Zhai, Mario Lucic
2020 J jnl
Representation learning from videos in-the-wild: An object-centric approach.
CoRR
Rob Romijnders, Aravindh Mahendran, Michael Tschannen, Josip Djolonga, Marvin Ritter, Neil Houlsby, Mario Lucic
2020 J jnl
Scalable Transfer Learning with Expert Models.
CoRR
Joan Puigcerver, Carlos Riquelme, Basil Mustafa, Cédric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
2020 A* conf
Self-Supervised Learning of Video-Induced Visual Invariances.
CVPR
Michael Tschannen, Josip Djolonga, Marvin Ritter, Aravindh Mahendran, Neil Houlsby, Sylvain Gelly, Mario Lucic
2020 C conf
Training General Representations for Remote Sensing Using in-Domain Knowledge.
IGARSS
Maxim Neumann, André Susano Pinto, Xiaohua Zhai, Neil Houlsby
2020 J jnl
Training general representations for remote sensing using in-domain knowledge.
CoRR
Maxim Neumann, André Susano Pinto, Xiaohua Zhai, Neil Houlsby
2020 J jnl
Underspecification Presents Challenges for Credibility in Modern Machine Learning.
CoRR
Alexander D'Amour, Katherine A. Heller, Dan Moldovan, Ben Adlam, Babak Alipanahi, Alex Beutel, Christina Chen, Jonathan Deaton, Jacob Eisenstein, Matthew D. Hoffman, Farhad Hormozdiari, Neil Houlsby, Shaobo Hou, Ghassen Jerfel, Alan Karthikesalingam, Mario Lucic, Yi-An Ma, Cory Y. McLean, Diana Mincu, Akinori Mitani, Andrea Montanari, Zachary Nado, Vivek Natarajan, Christopher Nielson, Thomas F. Osborne, Rajiv Raman, Kim Ramasamy, Rory Sayres, Jessica Schrouff, Martin Seneviratne, Shannon Sequeira, Harini Suresh, Victor Veitch, Max Vladymyrov, Xuezhi Wang, Kellie Webster, Steve Yadlowsky, Taedong Yun, Xiaohua Zhai, D. Sculley
2019 J jnl
In-domain representation learning for remote sensing.
CoRR
Maxim Neumann, André Susano Pinto, Xiaohua Zhai, Neil Houlsby
2019 J jnl
Large Scale Learning of General Visual Representations for Transfer.
CoRR
Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, Neil Houlsby
2019 — conf
On Self Modulation for Generative Adversarial Networks.
ICLR (Poster)
Ting Chen, Mario Lucic, Neil Houlsby, Sylvain Gelly
2019 A* conf
Parameter-Efficient Transfer Learning for NLP.
ICML
Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin de Laroussilhe, Andrea Gesmundo, Mona Attariyan, Sylvain Gelly
2019 J jnl
Parameter-Efficient Transfer Learning for NLP.
CoRR
Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin de Laroussilhe, Andrea Gesmundo, Mona Attariyan, Sylvain Gelly
2019 A* conf
Self-Supervised GANs via Auxiliary Rotation Loss.
CVPR
Ting Chen, Xiaohua Zhai, Marvin Ritter, Mario Lucic, Neil Houlsby
2019 J jnl
Self-Supervised Learning of Video-Induced Visual Invariances.
CoRR
Michael Tschannen, Josip Djolonga, Marvin Ritter, Aravindh Mahendran, Neil Houlsby, Sylvain Gelly, Mario Lucic
2019 J jnl
The Visual Task Adaptation Benchmark.
CoRR
Xiaohua Zhai, Joan Puigcerver, Alexander Kolesnikov, Pierre Ruyssen, Carlos Riquelme, Mario Lucic, Josip Djolonga, André Susano Pinto, Maxim Neumann, Alexey Dosovitskiy, Lucas Beyer, Olivier Bachem, Michael Tschannen, Marcin Michalski, Olivier Bousquet, Sylvain Gelly, Neil Houlsby
2018 J jnl
Analyzing Language Learned by an Active Question Answering Agent.
CoRR
Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Wojciech Gajewski, Andrea Gesmundo, Neil Houlsby, Wei Wang
2018 — conf
Ask the Right Questions: Active Question Reformulation with Reinforcement Learning.
ICLR
Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Wojciech Gajewski, Andrea Gesmundo, Neil Houlsby, Wei Wang
2018 J jnl
Neural Architecture Search Over a Graph Search Space.
CoRR
Quentin de Laroussilhe, Stanislaw Jastrzebski, Neil Houlsby, Andrea Gesmundo
2018 J jnl
On Self Modulation for Generative Adversarial Networks.
CoRR
Ting Chen, Mario Lucic, Neil Houlsby, Sylvain Gelly
2018 J jnl
Self-Supervised GAN to Counter Forgetting.
CoRR
Ting Chen, Xiaohua Zhai, Neil Houlsby
2018 J jnl
Self-Supervised Generative Adversarial Networks.
CoRR
Ting Chen, Xiaohua Zhai, Marvin Ritter, Mario Lucic, Neil Houlsby
2018 J jnl
Transfer Automatic Machine Learning.
CoRR
Catherine Wong, Neil Houlsby, Yifeng Lu, Andrea Gesmundo
2018 A* conf
Transfer Learning with Neural AutoML.
NeurIPS
Catherine Wong, Neil Houlsby, Yifeng Lu, Andrea Gesmundo
2017 J jnl
Ask the Right Questions: Active Question Reformulation with Reinforcement Learning.
CoRR
Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Andrea Gesmundo, Neil Houlsby, Wojciech Gajewski, Wei Wang
2014 — conf
A Filtering Approach to Stochastic Variational Inference.
NIPS
Neil Houlsby, David M. Blei
2014 A conf
A Scalable Gibbs Sampler for Probabilistic Entity Linking.
ECIR
Neil Houlsby, Massimiliano Ciaramita
2014 A* conf
Cold-start Active Learning with Robust Ordinal Matrix Factorization.
ICML
Neil Houlsby, José Miguel Hernández-Lobato, Zoubin Ghahramani
2014 A* conf
Probabilistic Matrix Factorization with Non-random Missing Data.
ICML
José Miguel Hernández-Lobato, Neil Houlsby, Zoubin Ghahramani
2014 A* conf
Stochastic Inference for Scalable Probabilistic Modeling of Binary Matrices.
ICML
José Miguel Hernández-Lobato, Neil Houlsby, Zoubin Ghahramani
2013 A conf
Active Learning for Interactive Visualization.
AISTATS
Tomoharu Iwata, Neil Houlsby, Zoubin Ghahramani
2013 J jnl
Scalable Probabilistic Entity-Topic Modeling.
CoRR
Neil Houlsby, Massimiliano Ciaramita
2012 — conf
Collaborative Gaussian Processes for Preference Learning.
NIPS
Neil Houlsby, José Miguel Hernández-Lobato, Ferenc Huszar, Zoubin Ghahramani
2011 J jnl
Bayesian Active Learning for Classification and Preference Learning
CoRR
Neil Houlsby, Ferenc Huszar, Zoubin Ghahramani, Máté Lengyel