Aidan N. Gomez

33 papers A* 3Journal 24Unranked 6

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Tiny Aya: Bridging Scale and Multilingual Depth. CoRR Alejandro Salamanca, Diana Abagyan, Daniel D'souza, Ammar Khairi, David Mora, Saurabh Dash, Viraat Aryabumi, Sara Rajaee, Mehrnaz Mofakhami, Ananya Sahu, Thomas Euyang, Brittawnya Prince, Madeline Smith, Hangyu Lin, Acyr Locatelli, Sara Hooker, Tom Kocmi, Aidan N. Gomez, Ivan Zhang, Phil Blunsom, Nick Frosst, Joelle Pineau, Beyza Ermis, Ahmet Üstün, Julia Kreutzer, Marzieh Fadaee
2025	J	`jnl`	Aya Vision: Advancing the Frontier of Multilingual Multimodality. CoRR Saurabh Dash, Yiyang Nan, John Dang, Arash Ahmadian, Shivalika Singh, Madeline Smith, Bharat Venkitesh, Vlad Shmyhlo, Viraat Aryabumi, Walter Beller-Morales, Jeremy Pekmez, Jason Ozuzu, Pierre Richemond, Acyr Locatelli, Nick Frosst, Phil Blunsom, Aidan N. Gomez, Ivan Zhang, Marzieh Fadaee, Manoj Govindassamy, Sudip Roy, Matthias Gallé, Beyza Ermis, Ahmet Üstün, Sara Hooker
2024	J	`jnl`	Aya 23: Open Weight Releases to Further Multilingual Progress. CoRR Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Jon Ander Campos, Yi Chern Tan, Kelly Marchisio, Max Bartolo, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Aidan N. Gomez, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, Sara Hooker
2024	J	`jnl`	Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier. CoRR John Dang, Shivalika Singh, Daniel D'souza, Arash Ahmadian, Alejandro Salamanca, Madeline Smith, Aidan Peppin, Sungjin Hong, Manoj Govindassamy, Terrence Zhao, Sandra Kublik, Meor Amer, Viraat Aryabumi, Jon Ander Campos, Yi Chern Tan, Tom Kocmi, Florian Strub, Nathan Grinsztajn, Yannis Flet-Berliac, Acyr Locatelli, Hangyu Lin, Dwarak Talupuru, Bharat Venkitesh, David Cairuz, Bowen Yang, Tim Chung, Wei-Yin Ko, Sylvie Shang Shi, Amir Shukayev, Sammie Bae, Aleksandra Piktus, Roman Castagné, Felipe Cruz-Salinas, Eddie Kim, Lucas Crawhall-Stein, Adrien Morisot, Sudip Roy, Phil Blunsom, Ivan Zhang, Aidan N. Gomez, Nick Frosst, Marzieh Fadaee, Beyza Ermis, Ahmet Üstün, Sara Hooker
2022	J	`jnl`	Exploring Low Rank Training of Deep Neural Networks. CoRR Siddhartha Rao Kamalakara, Acyr Locatelli, Bharat Venkitesh, Jimmy Ba, Yarin Gal, Aidan N. Gomez
2022	J	`jnl`	Interlocking Backpropagation: Improving depthwise model-parallelism. J. Mach. Learn. Res. Aidan N. Gomez, Oscar Key, Kuba Perlin, Stephen Gou, Nick Frosst, Jeff Dean, Yarin Gal
2022	J	`jnl`	Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt. CoRR Sören Mindermann, Jan Markus Brauner, Muhammed Razzak, Mrinank Sharma, Andreas Kirsch, Winnie Xu, Benedikt Höltgen, Aidan N. Gomez, Adrien Morisot, Sebastian Farquhar, Yarin Gal
2022	A*	`conf`	Prioritized Training on Points that are Learnable, Worth Learning, and not yet Learnt. ICML Sören Mindermann, Jan Markus Brauner, Muhammed Razzak, Mrinank Sharma, Andreas Kirsch, Winnie Xu, Benedikt Höltgen, Aidan N. Gomez, Adrien Morisot, Sebastian Farquhar, Yarin Gal
2022	A*	`conf`	Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-time Retrieval. ICML Pascal Notin, Mafalda Dias, Jonathan Frazer, Javier Marchena-Hurtado, Aidan N. Gomez, Debora S. Marks, Yarin Gal
2022	J	`jnl`	Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval. CoRR Pascal Notin, Mafalda Dias, Jonathan Frazer, Javier Marchena-Hurtado, Aidan N. Gomez, Debora S. Marks, Yarin Gal
2021	J	`jnl`	Prioritized training on points that are learnable, worth learning, and not yet learned. CoRR Sören Mindermann, Muhammed Razzak, Winnie Xu, Andreas Kirsch, Mrinank Sharma, Adrien Morisot, Aidan N. Gomez, Sebastian Farquhar, Jan Markus Brauner, Yarin Gal
2021	J	`jnl`	Robustness to Pruning Predicts Generalization in Deep Neural Networks. CoRR Lorenz Kuhn, Clare Lyle, Aidan N. Gomez, Jonas Rothfuss, Yarin Gal
2021	A*	`conf`	Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning. NeurIPS Jannik Kossen, Neil Band, Clare Lyle, Aidan N. Gomez, Thomas Rainforth, Yarin Gal
2021	J	`jnl`	Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning. CoRR Jannik Kossen, Neil Band, Clare Lyle, Aidan N. Gomez, Tom Rainforth, Yarin Gal
2020	J	`jnl`	Interlocking Backpropagation: Improving depthwise model-parallelism. CoRR Aidan N. Gomez, Oscar Key, Stephen Gou, Nick Frosst, Jeff Dean, Yarin Gal
2020	—	`conf`	Predicting Twitter Engagement With Deep Language Models. RecSys Challenge Maksims Volkovs, Zhaoyue Cheng, Mathieu Ravaut, Hojin Yang, Kevin Shen, Jin Peng Zhou, Anson Wong, Saba Zuberi, Ivan Zhang, Nick Frosst, Helen Ngo, Carol Chen, Bharat Venkitesh, Stephen Gou, Aidan N. Gomez
2020	J	`jnl`	SliceOut: Training Transformers and CNNs faster while using less memory. CoRR Pascal Notin, Aidan N. Gomez, Joanna Yoo, Yarin Gal
2020	J	`jnl`	Wat zei je? Detecting Out-of-Distribution Translations with Variational Transformers. CoRR Tim Z. Xiao, Aidan N. Gomez, Yarin Gal
2019	J	`jnl`	A Systematic Comparison of Bayesian Deep Learning Robustness in Diabetic Retinopathy Tasks. CoRR Angelos Filos, Sebastian Farquhar, Aidan N. Gomez, Tim G. J. Rudner, Zachary Kenton, Lewis Smith, Milad Alizadeh, Arnoud de Kroon, Yarin Gal
2019	J	`jnl`	Learning Sparse Networks Using Targeted Dropout. CoRR Aidan N. Gomez, Ivan Zhang, Kevin Swersky, Yarin Gal, Geoffrey E. Hinton
2019	J	`jnl`	RL: Generic reinforcement learning codebase in TensorFlow. J. Open Source Softw. Bryan M. Li, Alexander I. Cowen-Rivers, Piotr Kozakowski, David Tao, Siddhartha Kamalakara, Nitarshan Rajkumar, Hariharan Sezhiyan, Sicong Huang, Aidan N. Gomez
2019	J	`jnl`	The Difficulty of Training Sparse Neural Networks. CoRR Utku Evci, Fabian Pedregosa, Aidan N. Gomez, Erich Elsen
2018	—	`conf`	Depthwise Separable Convolutions for Neural Machine Translation. ICLR (Poster) Lukasz Kaiser, Aidan N. Gomez, François Chollet
2018	—	`conf`	Tensor2Tensor for Neural Machine Translation. AMTA (1) Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
2018	J	`jnl`	Tensor2Tensor for Neural Machine Translation. CoRR Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
2018	—	`conf`	Unsupervised Cipher Cracking Using Discrete GANs. ICLR (Poster) Aidan N. Gomez, Sicong Huang, Ivan Zhang, Bryan M. Li, Muhammad Osama, Lukasz Kaiser
2018	J	`jnl`	Unsupervised Cipher Cracking Using Discrete GANs. CoRR Aidan N. Gomez, Sicong Huang, Ivan Zhang, Bryan M. Li, Muhammad Osama, Lukasz Kaiser
2017	J	`jnl`	Attention Is All You Need. CoRR Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
2017	—	`conf`	Attention is All you Need. NIPS Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
2017	J	`jnl`	Depthwise Separable Convolutions for Neural Machine Translation. CoRR Lukasz Kaiser, Aidan N. Gomez, François Chollet
2017	J	`jnl`	One Model To Learn Them All. CoRR Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, Jakob Uszkoreit
2017	—	`conf`	The Reversible Residual Network: Backpropagation Without Storing Activations. NIPS Aidan N. Gomez, Mengye Ren, Raquel Urtasun, Roger B. Grosse
2017	J	`jnl`	The Reversible Residual Network: Backpropagation Without Storing Activations. CoRR Aidan N. Gomez, Mengye Ren, Raquel Urtasun, Roger B. Grosse