Ying Sheng

49 papers A* 12A 2Journal 28Unranked 7
YearRankTypeTitle / Venue / Authors
2025 — conf
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution.
MLSys
Zhiqiang Xie, Hao Kang, Ying Sheng, Tushar Krishna, Kayvon Fatahalian, Christos Kozyrakis
2025 J jnl
DafnyBench: A Benchmark for Formal Software Verification.
Trans. Mach. Learn. Res.
Chloe Loughridge, Qinyi Sun, Seth Ahrenbach, Federico Cassano, Chuyue Sun, Ying Sheng, Anish Mudide, Md Rakib Hossain Misu, Nada Amin, Max Tegmark
2025 J jnl
Locality-aware Fair Scheduling in LLM Serving.
CoRR
Shiyi Cao, Yichuan Wang, Ziming Mao, Pin-Lun Hsu, Liangsheng Yin, Tian Xia, Dacheng Li, Shu Liu, Yineng Zhang, Yang Zhou, Ying Sheng, Joseph Gonzalez, Ion Stoica
2025 — conf
MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs.
ASPLOS (1)
Shiyi Cao, Shu Liu, Tyler Griggs, Peter Schafhalter, Xiaoxuan Liu, Ying Sheng, Joseph E. Gonzalez, Matei Zaharia, Ion Stoica
2025 J jnl
Prism: Unleashing GPU Sharing for Cost-Efficient Multi-LLM Serving.
CoRR
Shan Yu, Jiarong Xing, Yifan Qiao, Mingyuan Ma, Yangmin Li, Yang Wang, Shuo Yang, Zhiqiang Xie, Shiyi Cao, Ke Bao, Ion Stoica, Harry Xu, Ying Sheng
2025 A* conf
SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal.
ICLR
Tinghao Xie, Xiangyu Qi, Yi Zeng, Yangsibo Huang, Udari Madhushani Sehwag, Kaixuan Huang, Luxi He, Boyi Wei, Dacheng Li, Ying Sheng, Ruoxi Jia, Bo Li, Kai Li, Danqi Chen, Peter Henderson, Prateek Mittal
2024 J jnl
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution.
CoRR
Zhiqiang Xie, Hao Kang, Ying Sheng, Tushar Krishna, Kayvon Fatahalian, Christos Kozyrakis
2024 A* conf
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference.
ICML
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, Ion Stoica
2024 J jnl
Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference.
CoRR
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael I. Jordan, Joseph E. Gonzalez, Ion Stoica
2024 — conf
Clover: Closed-Loop Verifiable Code Generation.
SAIV
Chuyue Sun, Ying Sheng, Oded Padon, Clark W. Barrett
2024 J jnl
DafnyBench: A Benchmark for Formal Software Verification.
CoRR
Chloe Loughridge, Qinyi Sun, Seth Ahrenbach, Federico Cassano, Chuyue Sun, Ying Sheng, Anish Mudide, Md Rakib Hossain Misu, Nada Amin, Max Tegmark
2024 A* conf
Fairness in Serving Large Language Models.
OSDI
Ying Sheng, Shiyi Cao, Dacheng Li, Banghua Zhu, Zhuohan Li, Danyang Zhuo, Joseph E. Gonzalez, Ion Stoica
2024 J jnl
Fairness in Serving Large Language Models.
CoRR
Ying Sheng, Shiyi Cao, Dacheng Li, Banghua Zhu, Zhuohan Li, Danyang Zhuo, Joseph E. Gonzalez, Ion Stoica
2024 — conf
Inference-Friendly Models With MixAttention.
ENLSP
Shashank Rajput, Ying Sheng, Sean Owen, Vitaliy Chiley
2024 J jnl
Inference-Friendly Models With MixAttention.
CoRR
Shashank Rajput, Ying Sheng, Sean Owen, Vitaliy Chiley
2024 A* conf
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.
ICLR
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
2024 J jnl
MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs.
CoRR
Shiyi Cao, Shu Liu, Tyler Griggs, Peter Schafhalter, Xiaoxuan Liu, Ying Sheng, Joseph E. Gonzalez, Matei Zaharia, Ion Stoica
2024 J jnl
Post-Training Sparse Attention with Double Sparsity.
CoRR
Shuo Yang, Ying Sheng, Joseph E. Gonzalez, Ion Stoica, Lianmin Zheng
2024 A* conf
SGLang: Efficient Execution of Structured Language Model Programs.
NeurIPS
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark W. Barrett, Ying Sheng
2024 — conf
SLoRA: Scalable Serving of Thousands of LoRA Adapters.
MLSys
Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph Gonzalez, Ion Stoica
2024 J jnl
SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal Behaviors.
CoRR
Tinghao Xie, Xiangyu Qi, Yi Zeng, Yangsibo Huang, Udari Madhushani Sehwag, Kaixuan Huang, Luxi He, Boyi Wei, Dacheng Li, Ying Sheng, Ruoxi Jia, Bo Li, Kai Li, Danqi Chen, Peter Henderson, Prateek Mittal
2023 A* conf
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving.
OSDI
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving.
CoRR
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
Clover: Closed-Loop Verifiable Code Generation.
CoRR
Chuyue Sun, Ying Sheng, Oded Padon, Clark W. Barrett
2023 J jnl
Combining Stable Infiniteness and (Strong) Politeness.
J. Autom. Reason.
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Andrew Reynolds, Clark W. Barrett, Cesare Tinelli
2023 A* conf
Efficient Memory Management for Large Language Model Serving with PagedAttention.
SOSP
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, Ion Stoica
2023 J jnl
Efficient Memory Management for Large Language Model Serving with PagedAttention.
CoRR
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, Ion Stoica
2023 J jnl
Efficiently Programming Large Language Models using SGLang.
CoRR
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Jeff Huang, Chuyue Sun, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark W. Barrett, Ying Sheng
2023 A* conf
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU.
ICML
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
2023 J jnl
H
CoRR
Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen
2023 A* conf
H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
NeurIPS
Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen
2023 J jnl
High-throughput Generative Inference of Large Language Models with a Single GPU.
CoRR
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark W. Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
2023 A* conf
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.
NeurIPS
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
Judging LLM-as-a-judge with MT-Bench and Chatbot Arena.
CoRR
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
2023 J jnl
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.
CoRR
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
2023 J jnl
On Optimal Caching and Model Multiplexing for Large Model Inference.
CoRR
Banghua Zhu, Ying Sheng, Lianmin Zheng, Clark W. Barrett, Michael I. Jordan, Jiantao Jiao
2023 J jnl
Reasoning About Vectors: Satisfiability Modulo a Theory of Sequences.
J. Autom. Reason.
Ying Sheng, Andres Nötzli, Andrew Reynolds, Yoni Zohar, David L. Dill, Wolfgang Grieskamp, Junkil Park, Shaz Qadeer, Clark W. Barrett, Cesare Tinelli
2023 J jnl
S-LoRA: Serving Thousands of Concurrent LoRA Adapters.
CoRR
Ying Sheng, Shiyi Cao, Dacheng Li, Coleman Hooper, Nicholas Lee, Shuo Yang, Christopher Chou, Banghua Zhu, Lianmin Zheng, Kurt Keutzer, Joseph E. Gonzalez, Ion Stoica
2023 A* conf
Towards Optimal Caching and Model Selection for Large Model Inference.
NeurIPS
Banghua Zhu, Ying Sheng, Lianmin Zheng, Clark W. Barrett, Michael I. Jordan, Jiantao Jiao
2022 J jnl
Polite Combination of Algebraic Datatypes.
J. Autom. Reason.
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Jane Lange, Pascal Fontaine, Clark W. Barrett
2022 J jnl
Read-once refutations in Horn constraint systems: an algorithmic approach.
J. Log. Comput.
K. Subramani, Piotr Wojciechowski, Ying Sheng
2022 A conf
Reasoning About Vectors Using an SMT Theory of Sequences.
IJCAR
Ying Sheng, Andres Nötzli, Andrew Reynolds, Yoni Zohar, David L. Dill, Wolfgang Grieskamp, Junkil Park, Shaz Qadeer, Clark W. Barrett, Cesare Tinelli
2022 J jnl
Reasoning About Vectors using an SMT Theory of Sequences.
CoRR
Ying Sheng, Andres Nötzli, Andrew Reynolds, Yoni Zohar, David L. Dill, Wolfgang Grieskamp, Junkil Park, Shaz Qadeer, Clark W. Barrett, Cesare Tinelli
2022 — conf
cvc5: A Versatile and Industrial-Strength SMT Solver.
TACAS (1)
Haniel Barbosa, Clark W. Barrett, Martin Brain, Gereon Kremer, Hanna Lachnitt, Makai Mann, Abdalrhman Mohamed, Mudathir Mohamed, Aina Niemetz, Andres Nötzli, Alex Ozdemir, Mathias Preiner, Andrew Reynolds, Ying Sheng, Cesare Tinelli, Yoni Zohar
2021 A conf
Politeness and Stable Infiniteness: Stronger Together.
CADE
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Andrew Reynolds, Clark W. Barrett, Cesare Tinelli
2021 J jnl
Politeness and Stable Infiniteness: Stronger Together.
CoRR
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Andrew Reynolds, Clark W. Barrett, Cesare Tinelli
2021 A* conf
Politeness for the Theory of Algebraic Datatypes (Extended Abstract).
IJCAI
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Jane Lange, Pascal Fontaine, Clark W. Barrett
2020 — conf
Politeness for the Theory of Algebraic Datatypes.
IJCAR (1)
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Jane Lange, Pascal Fontaine, Clark W. Barrett
2020 J jnl
Politeness for the Theory of Algebraic Datatypes.
CoRR
Ying Sheng, Yoni Zohar, Christophe Ringeissen, Jane Lange, Pascal Fontaine, Clark W. Barrett