Tao Lei

65 papers A* 16A 1Misc 1Journal 32Unranked 14
YearRankTypeTitle / Venue / Authors
2026 J jnl
Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization.
CoRR
Chong Wang, Nan Du, Tom Gunter, Tao Lei, Kulin Seth, Senyu Tong, Jianyu Wang, Guoli Yin, Xiyou Zhou, Kelvin Zou, Ruoming Pang
2026 J jnl
SPLA: Block Sparse Plus Linear Attention for Long Context Modeling.
CoRR
Bailin Wang, Dan Friedman, Tao Lei, Chong Wang
2025 J jnl
AXLearn: Modular Large Model Training on Heterogeneous Infrastructure.
CoRR
Mark Lee, Tom Gunter, Chang Lan, John Peebles, Hanzhi Zhou, Kelvin Zou, Sneha Bangalore, Chung-Cheng Chiu, Nan Du, Xianzhi Du, Philipp Dufter, Ruixuan Hou, Haoshuo Huang, Dongseong Hwang, Xiang Kong, Jinhao Lei, Tao Lei, Meng Li, Li Li, Jiarui Lu, Zhiyun Lu, Yiping Ma, David Qiu, Vivek Rathod, Senyu Tong, Zhucheng Tu, Jianyu Wang, Yongqiang Wang, Zirui Wang, Floris Weers, Sam Wiseman, Guoli Yin, Bowen Zhang, Xiyou Zhou, Danyang Zhuo, Cheng Leong, Ruoming Pang
2025 A* conf
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing.
ICLR
Haotian Sun, Tao Lei, Bowen Zhang, Yanghao Li, Haoshuo Huang, Ruoming Pang, Bo Dai, Nan Du
2025 J jnl
IDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining.
CoRR
Yixiao Li, Xianzhi Du, Ajay Jaiswal, Tao Lei, Tuo Zhao, Chong Wang, Jianyu Wang
2025 A* conf
Instruction-Following Pruning for Large Language Models.
ICML
Bairu Hou, Qibin Chen, Jianyu Wang, Guoli Yin, Chong Wang, Nan Du, Ruoming Pang, Shiyu Chang, Tao Lei
2025 J jnl
Instruction-Following Pruning for Large Language Models.
CoRR
Bairu Hou, Qibin Chen, Jianyu Wang, Guoli Yin, Chong Wang, Nan Du, Ruoming Pang, Shiyu Chang, Tao Lei
2024 J jnl
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing.
CoRR
Haotian Sun, Tao Lei, Bowen Zhang, Yanghao Li, Haoshuo Huang, Ruoming Pang, Bo Dai, Nan Du
2024 J jnl
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training.
CoRR
Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Ankur Jain, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Guoli Yin, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang
2024 — conf
MM1: Methods, Analysis and Insights from Multimodal LLM Pre-training.
ECCV (29)
Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang
2023 A* conf
CoLT5: Faster Long-Range Transformers with Conditional Computation.
EMNLP
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
2023 J jnl
CoLT5: Faster Long-Range Transformers with Conditional Computation.
CoRR
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
2023 A* conf
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference.
NeurIPS
Tao Lei, Junwen Bai, Siddhartha Brahma, Joshua Ainslie, Kenton Lee, Yanqi Zhou, Nan Du, Vincent Y. Zhao, Yuexin Wu, Bo Li, Yu Zhang, Ming-Wei Chang
2023 J jnl
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference.
CoRR
Tao Lei, Junwen Bai, Siddhartha Brahma, Joshua Ainslie, Kenton Lee, Yanqi Zhou, Nan Du, Vincent Y. Zhao, Yuexin Wu, Bo Li, Yu Zhang, Ming-Wei Chang
2023 J jnl
Learning to Skip for Language Modeling.
CoRR
Dewen Zeng, Nan Du, Tao Wang, Yuanzhong Xu, Tao Lei, Zhifeng Chen, Claire Cui
2023 A* conf
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval.
NeurIPS
Jinhyuk Lee, Zhuyun Dai, Sai Meher Karthik Duddu, Tao Lei, Iftekhar Naim, Ming-Wei Chang, Vincent Y. Zhao
2023 J jnl
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval.
CoRR
Jinhyuk Lee, Zhuyun Dai, Sai Meher Karthik Duddu, Tao Lei, Iftekhar Naim, Ming-Wei Chang, Vincent Y. Zhao
2022 A* conf
Mixture-of-Experts with Expert Choice Routing.
NeurIPS
Yanqi Zhou, Tao Lei, Hanxiao Liu, Nan Du, Yanping Huang, Vincent Y. Zhao, Andrew M. Dai, Zhifeng Chen, Quoc V. Le, James Laudon
2022 J jnl
Mixture-of-Experts with Expert Choice Routing.
CoRR
Yanqi Zhou, Tao Lei, Hanxiao Liu, Nan Du, Yanping Huang, Vincent Y. Zhao, Andrew M. Dai, Zhifeng Chen, Quoc Le, James Laudon
2022 J jnl
Multi-Vector Retrieval as Sparse Alignment.
CoRR
Yujie Qian, Jinhyuk Lee, Sai Meher Karthik Duddu, Zhuyun Dai, Siddhartha Brahma, Iftekhar Naim, Tao Lei, Vincent Y. Zhao
2022 Misc conf
SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition.
ICASSP
Jing Pan, Tao Lei, Kwangyoun Kim, Kyu Jeong Han, Shinji Watanabe
2021 — conf
Nutri-bullets Hybrid: Consensual Multi-document Summarization.
NAACL-HLT
Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay
2021 A* conf
Nutri-bullets: Summarizing Health Studies by Composing Segments.
AAAI
Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay
2021 J jnl
Nutri-bullets: Summarizing Health Studies by Composing Segments.
CoRR
Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay
2021 J jnl
Nutribullets Hybrid: Multi-document Health Summarization.
CoRR
Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay
2021 J jnl
SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition.
CoRR
Jing Pan, Tao Lei, Kwangyoun Kim, Kyu Jeong Han, Shinji Watanabe
2020 A conf
ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition.
INTERSPEECH
Jing Pan, Joshua Shapiro, Jeremy Wohlwend, Kyu Jeong Han, Tao Lei, Tao Ma
2020 J jnl
ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition.
CoRR
Jing Pan, Joshua Shapiro, Jeremy Wohlwend, Kyu Jeong Han, Tao Lei, Tao Ma
2020 — conf
Autoregressive Knowledge Distillation through Imitation Learning.
EMNLP (1)
Alexander Lin, Jeremy Wohlwend, Howard Chen, Tao Lei
2020 J jnl
Autoregressive Knowledge Distillation through Imitation Learning.
CoRR
Alexander Lin, Jeremy Wohlwend, Howard Chen, Tao Lei
2020 A* conf
Interactive Classification by Asking Informative Questions.
ACL
Lili Yu, Howard Chen, Sida I. Wang, Tao Lei, Yoav Artzi
2020 A* conf
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport.
ACL
Kyle Swanson, Lili Yu, Tao Lei
2020 J jnl
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport.
CoRR
Kyle Swanson, Lili Yu, Tao Lei
2020 — conf
Structured Pruning of Large Language Models.
EMNLP (1)
Ziheng Wang, Jeremy Wohlwend, Tao Lei
2019 J jnl
Building a Production Model for Retrieval-Based Chatbots.
CoRR
Kyle Swanson, Lili Yu, Christopher Fox, Jeremy Wohlwend, Tao Lei
2019 J jnl
Interactive Classification by Asking Informative Questions.
CoRR
Lili Yu, Howard Chen, Sida Wang, Yoav Artzi, Tao Lei
2019 — conf
Metric Learning for Dynamic Text Classification.
DeepLo@EMNLP-IJCNLP
Jeremy Wohlwend, Ethan R. Elenberg, Sam Altschul, Shawn Henry, Tao Lei
2019 J jnl
Metric Learning for Dynamic Text Classification.
CoRR
Jeremy Wohlwend, Ethan R. Elenberg, Samuel Altschul, Shawn Henry, Tao Lei
2019 J jnl
Structured Pruning of Large Language Models.
CoRR
Ziheng Wang, Jeremy Wohlwend, Tao Lei
2018 A* conf
Adversarial Domain Adaptation for Duplicate Question Detection.
EMNLP
Darsh J. Shah, Tao Lei, Alessandro Moschitti, Salvatore Romeo, Preslav Nakov
2018 J jnl
Adversarial Domain Adaptation for Duplicate Question Detection.
CoRR
Darsh J. Shah, Tao Lei, Alessandro Moschitti, Salvatore Romeo, Preslav Nakov
2018 A* conf
Simple Recurrent Units for Highly Parallelizable Recurrence.
EMNLP
Tao Lei, Yu Zhang, Sida I. Wang, Hui Dai, Yoav Artzi
2017 A* conf
Deriving Neural Architectures from Sequence and Graph Kernels.
ICML
Tao Lei, Wengong Jin, Regina Barzilay, Tommi S. Jaakkola
2017 J jnl
Deriving Neural Architectures from Sequence and Graph Kernels.
CoRR
Tao Lei, Wengong Jin, Regina Barzilay, Tommi S. Jaakkola
2017 — —
Interpretable neural models for natural language processing.
Tao Lei
2017 — conf
Style Transfer from Non-Parallel Text by Cross-Alignment.
NIPS
Tianxiao Shen, Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2017 J jnl
Style Transfer from Non-Parallel Text by Cross-Alignment.
CoRR
Tianxiao Shen, Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2017 J jnl
Training RNNs as Fast as CNNs.
CoRR
Tao Lei, Yu Zhang, Yoav Artzi
2016 A* conf
Learning to refine text based recommendations.
EMNLP
Youyang Gu, Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2016 — conf
Making Dependency Labeling Simple, Fast and Accurate.
HLT-NAACL
Tianxiao Shen, Tao Lei, Regina Barzilay
2016 A* conf
Rationalizing Neural Predictions.
EMNLP
Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2016 J jnl
Rationalizing Neural Predictions.
CoRR
Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2016 — conf
SLS at SemEval-2016 Task 3: Neural-based Approaches for Ranking in Community Question Answering.
SemEval@NAACL-HLT
Mitra Mohtarami, Yonatan Belinkov, Wei-Ning Hsu, Yu Zhang, Tao Lei, Kfir Bar, Scott Cyphers, James R. Glass
2016 — conf
Semi-supervised Question Retrieval with Gated Convolutions.
HLT-NAACL
Tao Lei, Hrishikesh Joshi, Regina Barzilay, Tommi S. Jaakkola, Kateryna Tymoshenko, Alessandro Moschitti, Lluís Màrquez
2015 J jnl
Denoising Bodies to Titles: Retrieving Similar Questions with Recurrent Convolutional Models.
CoRR
Tao Lei, Hrishikesh Joshi, Regina Barzilay, Tommi S. Jaakkola, Kateryna Tymoshenko, Alessandro Moschitti, Lluís Màrquez i Villodre
2015 J jnl
Erratum: "Exploring Compositional Architectures and Word Vector Representations for Prepositional Phrase Attachment".
Trans. Assoc. Comput. Linguistics
Yonatan Belinkov, Tao Lei, Regina Barzilay, Amir Globerson
2015 — conf
High-Order Low-Rank Tensors for Semantic Role Labeling.
HLT-NAACL
Tao Lei, Yuan Zhang, Lluís Màrquez i Villodre, Alessandro Moschitti, Regina Barzilay
2015 A* conf
Molding CNNs for text: non-linear, non-consecutive convolutions.
EMNLP
Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2015 J jnl
Molding CNNs for text: non-linear, non-consecutive convolutions.
CoRR
Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2014 J jnl
Exploring Compositional Architectures and Word Vector Representations for Prepositional Phrase Attachment.
Trans. Assoc. Comput. Linguistics
Yonatan Belinkov, Tao Lei, Regina Barzilay, Amir Globerson
2014 A* conf
Greed is Good if Randomized: New Inference for Dependency Parsing.
EMNLP
Yuan Zhang, Tao Lei, Regina Barzilay, Tommi S. Jaakkola
2014 — conf
Low-Rank Tensors for Scoring Dependency Structures.
ACL (1)
Tao Lei, Yu Xin, Yuan Zhang, Regina Barzilay, Tommi S. Jaakkola
2014 — conf
Steps to Excellence: Simple Inference with Refined Scoring of Dependency Trees.
ACL (1)
Yuan Zhang, Tao Lei, Regina Barzilay, Tommi S. Jaakkola, Amir Globerson
2013 — conf
From Natural Language Specifications to Program Input Parsers.
ACL (1)
Tao Lei, Fan Long, Regina Barzilay, Martin C. Rinard
2012 — conf
Learning High-Level Planning from Text.
ACL (1)
S. R. K. Branavan, Nate Kushman, Tao Lei, Regina Barzilay