Kan Zhu - RankMe

17 papers A* 4Journal 10Unranked 3

Year	Rank	Type	Title / Venue / Authors
2026	—	`conf`	BlendServe: Optimizing Offline Inference with Resource-Aware Batching. ASPLOS (2) Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yifan Qiao, Yang Zhou, Jiarong Xing, Ion Stoica
2025	J	`jnl`	Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding. CoRR Yilong Zhao, Jiaming Tang, Kan Zhu, Zihao Ye, Chi-Chih Chang, Chaofan Lin, Jongseok Park, Guangxuan Xiao, Mohamed S. Abdelfattah, Mingyu Gao, Baris Kasikci, Song Han, Ion Stoica
2025	A*	`conf`	Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models. ICLR Keisuke Kamahori, Tian Tang, Yile Gu, Kan Zhu, Baris Kasikci
2025	A*	`conf`	From Optimal to Practical: Efficient Micro-op Cache Replacement Policies for Data Center Applications. HPCA Kan Zhu, Yilong Zhao, Yufei Gao, Peter Braun, Tanvir Ahmed Khan, Heiner Litz, Baris Kasikci, Shuwen Deng
2025	A*	`conf`	NanoFlow: Towards Optimal Large Language Model Serving Throughput. OSDI Kan Zhu, Yufei Gao, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Ziren Wang, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci
2025	J	`jnl`	PolyServe: Efficient Multi-SLO Serving at Scale. CoRR Kan Zhu, Haiyang Shi, Le Xu, Jiaxin Shan, Arvind Krishnamurthy, Baris Kasikci, Liguang Xie
2025	J	`jnl`	Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs. CoRR Kan Zhu, Tian Tang, Qinyu Xu, Yile Gu, Zhichen Zeng, Rohan Kadekodi, Liangyu Zhao, Ang Li, Arvind Krishnamurthy, Baris Kasikci
2025	J	`jnl`	TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval. CoRR Chien-Yu Lin, Keisuke Kamahori, Yiyu Liu, Xiaoxiang Shi, Madhav Mahesh Kashyap, Yile Gu, Rulin Shao, Zihao Ye, Kan Zhu, Stephanie Wang, Arvind Krishnamurthy, Rohan Kadekodi, Luis Ceze, Baris Kasikci
2024	—	`conf`	Atom: Low-Bit Quantization for Efficient and Accurate LLM Serving. MLSys Yilong Zhao, Chien-Yu Lin, Kan Zhu, Zihao Ye, Lequn Chen, Size Zheng, Luis Ceze, Arvind Krishnamurthy, Tianqi Chen, Baris Kasikci
2024	J	`jnl`	BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching. CoRR Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yang Zhou, Jiarong Xing, Ion Stoica
2024	—	`conf`	Can Storage Devices be Power Adaptive? HotStorage Dedong Xie, Theano Stavrinos, Kan Zhu, Simon Peter, Baris Kasikci, Thomas E. Anderson
2024	J	`jnl`	Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models. CoRR Keisuke Kamahori, Yile Gu, Kan Zhu, Baris Kasikci
2024	J	`jnl`	NanoFlow: Towards Optimal Large Language Model Serving Throughput. CoRR Kan Zhu, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Yufei Gao, Qinyu Xu, Tian Tang, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci
2024	A*	`conf`	QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference. ICML Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, Song Han
2024	J	`jnl`	Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference. CoRR Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, Song Han
2023	J	`jnl`	Atom: Low-bit Quantization for Efficient and Accurate LLM Serving. CoRR Yilong Zhao, Chien-Yu Lin, Kan Zhu, Zihao Ye, Lequn Chen, Size Zheng, Luis Ceze, Arvind Krishnamurthy, Tianqi Chen, Baris Kasikci
2016	J	`jnl`	Practical Algorithms for Learning Near-Isometric Linear Embeddings. CoRR Jerry Luo, Kayla Shapiro, Hao-Jun Michael Shi, Qi Yang, Kan Zhu