Lianmin Zheng

49 papers A* 17B 1Journal 25Unranked 5
YearRankTypeTitle / Venue / Authors
2026 — conf
BlendServe: Optimizing Offline Inference with Resource-Aware Batching.
ASPLOS (2)
Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yifan Qiao, Yang Zhou, Jiarong Xing, Ion Stoica
2024 J jnl
BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching.
CoRR
Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yang Zhou, Jiarong Xing, Ion Stoica
2024 A* conf
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference.
ICML
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, Ion Stoica
2024 J jnl
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference.
CoRR
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael I. Jordan, Joseph E. Gonzalez, Ion Stoica
2024 A* conf
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.
ICLR
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
2024 J jnl
Post-Training Sparse Attention with Double Sparsity.
CoRR
Shuo Yang, Ying Sheng, Joseph E. Gonzalez, Ion Stoica, Lianmin Zheng
2024 A* conf
SGLang: Efficient Execution of Structured Language Model Programs.
NeurIPS
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark W. Barrett, Ying Sheng
2024 — conf
SLoRA: Scalable Serving of Thousands of LoRA Adapters.
MLSys
Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph Gonzalez, Ion Stoica
2024 — —
Scalable and Efficient Systems for Large Deep Learning Models
Lianmin Zheng
2023 A* conf
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving.
OSDI
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving.
CoRR
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 A* conf
Efficient Memory Management for Large Language Model Serving with PagedAttention.
SOSP
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, Ion Stoica
2023 J jnl
Efficient Memory Management for Large Language Model Serving with PagedAttention.
CoRR
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, Ion Stoica
2023 J jnl
Efficiently Programming Large Language Models using SGLang.
CoRR
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Jeff Huang, Chuyue Sun, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark W. Barrett, Ying Sheng
2023 A* conf
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU.
ICML
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
2023 J jnl
H
CoRR
Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen
2023 A* conf
H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
NeurIPS
Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen
2023 J jnl
High-throughput Generative Inference of Large Language Models with a Single GPU.
CoRR
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark W. Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
2023 A* conf
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.
NeurIPS
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
Judging LLM-as-a-judge with MT-Bench and Chatbot Arena.
CoRR
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.
CoRR
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
2023 J jnl
On Optimal Caching and Model Multiplexing for Large Model Inference.
CoRR
Banghua Zhu, Ying Sheng, Lianmin Zheng, Clark W. Barrett, Michael I. Jordan, Jiantao Jiao
2023 — conf
On Optimizing the Communication of Model Parallelism.
MLSys
Yonghao Zhuang, Lianmin Zheng, Zhuohan Li, Eric P. Xing, Qirong Ho, Joseph Gonzalez, Ion Stoica, Hao Zhang, Hexu Zhao
2023 J jnl
Rethinking Benchmark and Contamination for Language Models with Rephrased Samples.
CoRR
Shuo Yang, Wei-Lin Chiang, Lianmin Zheng, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
S-LoRA: Serving Thousands of Concurrent LoRA Adapters.
CoRR
Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph E. Gonzalez, Ion Stoica
2023 — conf
TensorIR: An Abstraction for Automatic Tensorized Program Optimization.
ASPLOS (2)
Siyuan Feng, Bohan Hou, Hongyi Jin, Wuwei Lin, Junru Shao, Ruihang Lai, Zihao Ye, Lianmin Zheng, Cody Hao Yu, Yong Yu, Tianqi Chen
2023 A* conf
Towards Optimal Caching and Model Selection for Large Model Inference.
NeurIPS
Banghua Zhu, Ying Sheng, Lianmin Zheng, Clark W. Barrett, Michael I. Jordan, Jiantao Jiao
2022 A* conf
Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning.
OSDI
Lianmin Zheng, Zhuohan Li, Hao Zhang, Yonghao Zhuang, Zhifeng Chen, Yanping Huang, Yida Wang, Yuanzhong Xu, Danyang Zhuo, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica
2022 J jnl
Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning.
CoRR
Lianmin Zheng, Zhuohan Li, Hao Zhang, Yonghao Zhuang, Zhifeng Chen, Yanping Huang, Yida Wang, Yuanzhong Xu, Danyang Zhuo, Joseph E. Gonzalez, Ion Stoica
2022 J jnl
GACT: Activation Compressed Training for General Architectures.
CoRR
Xiaoxuan Liu, Lianmin Zheng, Dequan Wang, Yukuo Cen, Weize Chen, Xu Han, Jianfei Chen, Zhiyuan Liu, Jie Tang, Joey Gonzalez, Michael W. Mahoney, Alvin Cheung
2022 A* conf
GACT: Activation Compressed Training for Generic Network Architectures.
ICML
Xiaoxuan Liu, Lianmin Zheng, Dequan Wang, Yukuo Cen, Weize Chen, Xu Han, Jianfei Chen, Zhiyuan Liu, Jie Tang, Joey Gonzalez, Michael W. Mahoney, Alvin Cheung
2022 J jnl
NumS: Scalable Array Programming for the Cloud.
CoRR
Melih Elibol, Vinamra Benara, Samyu Yagati, Lianmin Zheng, Alvin Cheung, Michael I. Jordan, Ion Stoica
2022 J jnl
On Optimizing the Communication of Model Parallelism.
CoRR
Yonghao Zhuang, Hexu Zhao, Lianmin Zheng, Zhuohan Li, Eric P. Xing, Qirong Ho, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
2022 J jnl
TensorIR: An Abstraction for Automatic Tensorized Program Optimization.
CoRR
Siyuan Feng, Bohan Hou, Hongyi Jin, Wuwei Lin, Junru Shao, Ruihang Lai, Zihao Ye, Lianmin Zheng, Cody Hao Yu, Yong Yu, Tianqi Chen
2021 A* conf
ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training.
ICML
Jianfei Chen, Lianmin Zheng, Zhewei Yao, Dequan Wang, Ion Stoica, Michael W. Mahoney, Joseph Gonzalez
2021 J jnl
ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training.
CoRR
Jianfei Chen, Lianmin Zheng, Zhewei Yao, Dequan Wang, Ion Stoica, Michael W. Mahoney, Joseph E. Gonzalez
2021 A* conf
Simple and Automatic Distributed Machine Learning on Ray.
KDD
Hao Zhang, Zhuohan Li, Lianmin Zheng, Ion Stoica
2021 — conf
TenSet: A Large-scale Program Performance Dataset for Learned Tensor Compilers.
NeurIPS Datasets and Benchmarks
Lianmin Zheng, Ruochen Liu, Junru Shao, Tianqi Chen, Joseph Gonzalez, Ion Stoica, Ameer Haj-Ali
2020 J jnl
Ansor : Generating High-Performance Tensor Programs for Deep Learning.
CoRR
Lianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu, Cody Hao Yu, Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, Joseph E. Gonzalez, Ion Stoica
2020 A* conf
Ansor: Generating High-Performance Tensor Programs for Deep Learning.
OSDI
Lianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu, Cody Hao Yu, Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, Joseph E. Gonzalez, Ion Stoica
2019 J jnl
A Hardware-Software Blueprint for Flexible Deep Learning Specialization.
IEEE Micro
Thierry Moreau, Tianqi Chen, Luis Vega, Jared Roesch, Eddie Q. Yan, Lianmin Zheng, Josh Fromm, Ziheng Jiang, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy
2019 B conf
A Unified Optimization Approach for CNN Model Inference on Integrated GPUs.
ICPP
Leyuan Wang, Zhi Chen, Yizhi Liu, Yao Wang, Lianmin Zheng, Mu Li, Yida Wang
2019 J jnl
A Unified Optimization Approach for CNN Model Inference on Integrated GPUs.
CoRR
Leyuan Wang, Zhi Chen, Yizhi Liu, Yao Wang, Lianmin Zheng, Mu Li, Yida Wang
2018 A* conf
Learning to Optimize Tensor Programs.
NeurIPS
Tianqi Chen, Lianmin Zheng, Eddie Q. Yan, Ziheng Jiang, Thierry Moreau, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy
2018 J jnl
Learning to Optimize Tensor Programs.
CoRR
Tianqi Chen, Lianmin Zheng, Eddie Q. Yan, Ziheng Jiang, Thierry Moreau, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy
2018 A* conf
MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligence.
AAAI
Lianmin Zheng, Jiacheng Yang, Han Cai, Ming Zhou, Weinan Zhang, Jun Wang, Yong Yu
2018 J jnl
Size-to-depth: A New Perspective for Single Image Depth Estimation.
CoRR
Yiran Wu, Sihao Ying, Lianmin Zheng
2018 A* conf
TVM: An Automated End-to-End Optimizing Compiler for Deep Learning.
OSDI
Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Q. Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy
2017 J jnl
MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligence.
CoRR
Lianmin Zheng, Jiacheng Yang, Han Cai, Weinan Zhang, Jun Wang, Yong Yu