Ashish Vaswani

58 papers A* 13A 1B 2Journal 26Unranked 16

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	Essential-Web v1.0: 24T tokens of organized web data. CoRR Andrew Hojel, Michael Pust, Tim Romanski, Yash Vanjani, Ritvik Kapila, Mohit Parmar, Adarsh Chaluvaraju, Alok Tripathy, Anil Thomas, Ashish Tanwer, Darsh J. Shah, Ishaan Shah, Karl Stratos, Khoi Nguyen, Kurt Smith, Michael Callahan, Peter Rushton, Philip Monk, Platon Mazarakis, Saad Jamal, Saurabh Srivastava, Somanshu Singla, Ashish Vaswani
2025	J	`jnl`	Practical Efficiency of Muon for Pretraining. CoRR Ishaan Shah, Anthony M. Polloreno, Karl Stratos, Philip Monk, Adarsh Chaluvaraju, Andrew Hojel, Andrew Ma, Anil Thomas, Ashish Tanwer, Darsh J. Shah, Khoi Nguyen, Kurt Smith, Michael Callahan, Michael Pust, Mohit Parmar, Peter Rushton, Platon Mazarakis, Ritvik Kapila, Saurabh Srivastava, Somanshu Singla, Tim Romanski, Yash Vanjani, Ashish Vaswani
2025	J	`jnl`	Rethinking Reflection in Pre-Training. CoRR Darsh J. Shah, Peter Rushton, Somanshu Singla, Mohit Parmar, Kurt Smith, Yash Vanjani, Ashish Vaswani, Adarsh Chaluvaraju, Andrew Hojel, Andrew Ma, Anil Thomas, Anthony M. Polloreno, Ashish Tanwer, Burhan Drak Sibai, Divya S. Mansingka, Divya Shivaprasad, Ishaan Shah, Karl Stratos, Khoi Nguyen, Michael Callahan, Michael Pust, Mrinal Iyer, Philip Monk, Platon Mazarakis, Ritvik Kapila, Saurabh Srivastava, Tim Romanski
2023	J	`jnl`	Guest Editorial Introduction to the Special Section on Transformer Models in Vision. IEEE Trans. Pattern Anal. Mach. Intell. Salman H. Khan, Fahad Shahbaz Khan, Ashish Vaswani, Niki Parmar, Ming-Hsuan Yang, Mubarak Shah
2022	A*	`conf`	Scale Efficiently: Insights from Pretraining and Finetuning Transformers. ICLR Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
2022	A*	`conf`	The Efficiency Misnomer. ICLR Mostafa Dehghani, Yi Tay, Anurag Arnab, Lucas Beyer, Ashish Vaswani
2021	A*	`conf`	Bottleneck Transformers for Visual Recognition. CVPR Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani
2021	J	`jnl`	Bottleneck Transformers for Visual Recognition. CoRR Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani
2021	J	`jnl`	Efficient Content-Based Sparse Attention with Routing Transformers. Trans. Assoc. Comput. Linguistics Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
2021	J	`jnl`	Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers. CoRR Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
2021	A*	`conf`	Scaling Local Self-Attention for Parameter Efficient Visual Backbones. CVPR Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens
2021	J	`jnl`	Scaling Local Self-Attention for Parameter Efficient Visual Backbones. CoRR Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens
2021	J	`jnl`	Simple and Efficient ways to Improve REALM. CoRR Vidhisha Balachandran, Ashish Vaswani, Yulia Tsvetkov, Niki Parmar
2021	J	`jnl`	The Efficiency Misnomer. CoRR Mostafa Dehghani, Anurag Arnab, Lucas Beyer, Ashish Vaswani, Yi Tay
2020	J	`jnl`	Efficient Content-Based Sparse Attention with Routing Transformers. CoRR Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
2019	A*	`conf`	Attention Augmented Convolutional Networks. ICCV Irwan Bello, Barret Zoph, Quoc Le, Ashish Vaswani, Jonathon Shlens
2019	J	`jnl`	Attention Augmented Convolutional Networks. CoRR Irwan Bello, Barret Zoph, Ashish Vaswani, Jonathon Shlens, Quoc V. Le
2019	—	`conf`	Music Transformer: Generating Music with Long-Term Structure. ICLR (Poster) Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Ian Simon, Curtis Hawthorne, Noam Shazeer, Andrew M. Dai, Matthew D. Hoffman, Monica Dinculescu, Douglas Eck
2019	A*	`conf`	Stand-Alone Self-Attention in Vision Models. NeurIPS Niki Parmar, Prajit Ramachandran, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens
2019	J	`jnl`	Stand-Alone Self-Attention in Vision Models. CoRR Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens
2019	—	`conf`	Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation. ACL (1) Vihan Jain, Gabriel Magalhães, Alexander Ku, Ashish Vaswani, Eugene Ie, Jason Baldridge
2019	J	`jnl`	Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation. CoRR Vihan Jain, Gabriel Magalhães, Alexander Ku, Ashish Vaswani, Eugene Ie, Jason Baldridge
2018	J	`jnl`	An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation. CoRR Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Curtis Hawthorne, Andrew M. Dai, Matthew D. Hoffman, Douglas Eck
2018	A*	`conf`	Fast Decoding in Sequence Models Using Discrete Latent Variables. ICML Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer
2018	J	`jnl`	Fast Decoding in Sequence Models using Discrete Latent Variables. CoRR Lukasz Kaiser, Aurko Roy, Ashish Vaswani, Niki Parmar, Samy Bengio, Jakob Uszkoreit, Noam Shazeer
2018	A*	`conf`	Image Transformer. ICML Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran
2018	J	`jnl`	Image Transformer. CoRR Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku
2018	A*	`conf`	Mesh-TensorFlow: Deep Learning for Supercomputers. NeurIPS Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
2018	J	`jnl`	Mesh-TensorFlow: Deep Learning for Supercomputers. CoRR Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
2018	J	`jnl`	Relational inductive biases, deep learning, and graph networks. CoRR Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinícius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Çaglar Gülçehre, H. Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew M. Botvinick, Oriol Vinyals, Yujia Li, Razvan Pascanu
2018	—	`conf`	Self-Attention with Relative Position Representations. NAACL-HLT (2) Peter Shaw, Jakob Uszkoreit, Ashish Vaswani
2018	J	`jnl`	Self-Attention with Relative Position Representations. CoRR Peter Shaw, Jakob Uszkoreit, Ashish Vaswani
2018	—	`conf`	Tensor2Tensor for Neural Machine Translation. AMTA (1) Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
2018	J	`jnl`	Tensor2Tensor for Neural Machine Translation. CoRR Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
2018	—	`conf`	The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. ACL (1) Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes
2018	J	`jnl`	Theory and Experiments on Vector Quantized Autoencoders. CoRR Aurko Roy, Ashish Vaswani, Arvind Neelakantan, Niki Parmar
2017	J	`jnl`	Attention Is All You Need. CoRR Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
2017	—	`conf`	Attention is All you Need. NIPS Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
2017	J	`jnl`	One Model To Learn Them All. CoRR Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, Jakob Uszkoreit
2016	J	`jnl`	Efficient Structured Inference for Transition-Based Parsing with Neural Networks and Error States. Trans. Assoc. Comput. Linguistics Ashish Vaswani, Kenji Sagae
2016	—	`conf`	Name Tagging for Low-resource Incident Languages based on Expectation-driven Learning. HLT-NAACL Boliang Zhang, Xiaoman Pan, Tianlu Wang, Ashish Vaswani, Heng Ji, Kevin Knight, Daniel Marcu
2016	—	`conf`	Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies. HLT-NAACL Barret Zoph, Ashish Vaswani, Jonathan May, Kevin Knight
2016	—	`conf`	Supertagging With LSTMs. HLT-NAACL Ashish Vaswani, Yonatan Bisk, Kenji Sagae, Ryan Musa
2016	—	`conf`	Unsupervised Neural Hidden Markov Models. SPNLP@EMNLP Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu, Kevin Knight
2016	J	`jnl`	Unsupervised Neural Hidden Markov Models. CoRR Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu, Kevin Knight
2015	—	`conf`	Model Invertibility Regularization: Sequence Alignment With or Without Parallel Data. HLT-NAACL Tomer Levinboim, Ashish Vaswani, David Chiang
2015	—	`conf`	Unifying Bayesian Inference and Vector Space Models for Improved Decipherment. ACL (1) Qing Dou, Ashish Vaswani, Kevin Knight, Chris Dyer
2014	A*	`conf`	Aligning context-based statistical models of language with brain activity during reading. EMNLP Leila Wehbe, Ashish Vaswani, Kevin Knight, Tom M. Mitchell
2014	A*	`conf`	Beyond Parallel Data: Joint Word Alignment and Decipherment Improves Machine Translation. EMNLP Qing Dou, Ashish Vaswani, Kevin Knight
2013	A*	`conf`	Decoding with Large-Scale Neural Language Models Improves Translation. EMNLP Ashish Vaswani, Yinggong Zhao, Victoria Fossum, David Chiang
2013	—	`conf`	Learning Whom to Trust with MACE. HLT-NAACL Dirk Hovy, Taylor Berg-Kirkpatrick, Ashish Vaswani, Eduard H. Hovy
2012	—	`conf`	Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0-norm. ACL (1) Ashish Vaswani, Liang Huang, David Chiang
2011	—	`conf`	Models and Training for Unsupervised Preposition Sense Disambiguation. ACL (2) Dirk Hovy, Ashish Vaswani, Stephen Tratz, David Chiang, Eduard H. Hovy
2011	A*	`conf`	Rule Markov Models for Fast Tree-to-String Translation. ACL Ashish Vaswani, Haitao Mi, Liang Huang, David Chiang
2010	—	`conf`	Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging. ACL (2) Ashish Vaswani, Adam Pauls, David Chiang
2010	B	`conf`	Fast, Greedy Model Minimization for Unsupervised Tagging. COLING Sujith Ravi, Ashish Vaswani, Kevin Knight, David Chiang
2007	B	`conf`	Hassan: A Virtual Human for Tactical Questioning. SIGdial David R. Traum, Antonio Roque, Anton Leuski, Panayiotis G. Georgiou, Jillian Gerten, Bilyana Martinovski, Shrikanth Narayanan, Susan Robinson, Ashish Vaswani
2006	A	`conf`	Radiobot-CFF: a spoken dialogue system for military training. INTERSPEECH Antonio Roque, Anton Leuski, Vivek Kumar Rangarajan Sridhar, Susan Robinson, Ashish Vaswani, Shrikanth S. Narayanan, David R. Traum