Yuhan Liu - RankMe

25 papers A* 2A 1Misc 1Journal 19Unranked 2

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism. CoRR Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu
2026	J	`jnl`	Keeper: Automated Testing and Fixing of Machine Learning Software - RCR Report. ACM Trans. Softw. Eng. Methodol. Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Michael Maire, Henry Hoffmann, Shan Lu
2026	J	`jnl`	The 1/W Law: An Analytical Study of Context-Length Routing Topology and GPU Generation Gains for LLM Inference Energy Efficiency. CoRR Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu
2026	J	`jnl`	The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project. CoRR Huamin Chen, Xunzhuo Liu, Bowei He, Fuyuan Lyu, Yankai Chen, Xue Liu, Yuhan Liu, Junchen Jiang
2026	J	`jnl`	inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference. CoRR Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu
2025	J	`jnl`	AdaptCache: KV Cache Native Storage Hierarchy for Low-Delay and High-Quality Language Model Serving. CoRR Shaoting Feng, Hanchen Li, Kuntai Du, Zhuohan Gu, Yuhan Liu, Jiayi Yao, Siddhant Ray, Samuel Shen, Yihua Cheng, Ganesh Ananthanarayanan, Junchen Jiang
2025	A	`conf`	CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion. EuroSys Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang
2025	J	`jnl`	EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving. CoRR Shaoting Feng, Yuhan Liu, Hanchen Li, Xiaokun Chen, Samuel Shen, Kuntai Du, Zhuohan Gu, Rui Zhang, Yuyang Huang, Yihua Cheng, Jiayi Yao, Qizheng Zhang, Ganesh Ananthanarayanan, Junchen Jiang
2025	J	`jnl`	LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference. CoRR Yihua Cheng, Yuhan Liu, Jiayi Yao, Yuwei An, Xiaokun Chen, Shaoting Feng, Yuyang Huang, Samuel Shen, Kuntai Du, Junchen Jiang
2025	J	`jnl`	ShadowServe: Interference-Free KV Cache Fetching for Distributed Prefix Caching. CoRR Xingyu Xiang, Raj Joshi, Yuhan Liu, Jiayi Yao, Chenxingyu Zhao, Junchen Jiang, Yang Zhou, Eddie Kohler, Minlan Yu
2025	J	`jnl`	Towards More Economical Context-Augmented LLM Generation by Reusing Stored KV Cache. CoRR Hanchen Li, Yuhan Liu, Yihua Cheng, Kuntai Du, Junchen Jiang
2025	J	`jnl`	When to Reason: Semantic Router for vLLM. CoRR Chen Wang, Xunzhuo Liu, Yuhan Liu, Yue Zhu, Xiangxi Mo, Junchen Jiang, Huamin Chen
2024	J	`jnl`	CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion. CoRR Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang
2024	A*	`conf`	CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving. SIGCOMM Yuhan Liu, Hanchen Li, Yihua Cheng, Siddhant Ray, Yuyang Huang, Qizheng Zhang, Kuntai Du, Jiayi Yao, Shan Lu, Ganesh Ananthanarayanan, Michael Maire, Henry Hoffmann, Ari Holtzman, Junchen Jiang
2024	A*	`conf`	ChameleonAPI: Automatic and Efficient Customization of Neural Networks for ML Applications. OSDI Yuhan Liu, Chengcheng Wan, Kuntai Du, Henry Hoffmann, Junchen Jiang, Shan Lu, Michael Maire
2024	J	`jnl`	Chatterbox: Robust Transport for LLM Token Streaming under Unstable Network. CoRR Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang
2024	J	`jnl`	DroidSpeak: Enhancing Cross-LLM Communication. CoRR Yuhan Liu, Esha Choukse, Shan Lu, Junchen Jiang, Madan Musuvathi
2024	—	`conf`	Eloquent: A More Robust Transmission Scheme for LLM Token Streaming. NAIC Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang
2024	Misc	`conf`	GRACE: Loss-Resilient Real-Time Video through Neural Codecs. NSDI Yihua Cheng, Ziyi Zhang, Hanchen Li, Anton Arapin, Yue Zhang, Qizheng Zhang, Yuhan Liu, Kuntai Du, Xu Zhang, Francis Y. Yan, Amrita Mazumdar, Nick Feamster, Junchen Jiang
2024	J	`jnl`	Keeper: Automated Testing and Fixing of Machine Learning Software. ACM Trans. Softw. Eng. Methodol. Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Henry Hoffmann, Michael Maire, Shan Lu
2023	J	`jnl`	Automatic and Efficient Customization of Neural Networks for ML Applications. CoRR Yuhan Liu, Chengcheng Wan, Kuntai Du, Henry Hoffmann, Junchen Jiang, Shan Lu, Michael Maire
2023	J	`jnl`	CacheGen: Fast Context Loading for Language Model Applications. CoRR Yuhan Liu, Hanchen Li, Kuntai Du, Jiayi Yao, Yihua Cheng, Yuyang Huang, Shan Lu, Michael Maire, Henry Hoffmann, Ari Holtzman, Ganesh Ananthanarayanan, Junchen Jiang
2023	—	`conf`	OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation. SoCC Kuntai Du, Yuhan Liu, Yitian Hao, Qizheng Zhang, Haodong Wang, Yuyang Huang, Ganesh Ananthanarayanan, Junchen Jiang
2023	J	`jnl`	OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation. CoRR Kuntai Du, Yuhan Liu, Yitian Hao, Qizheng Zhang, Haodong Wang, Yuyang Huang, Ganesh Ananthanarayanan, Junchen Jiang
2023	J	`jnl`	Run-Time Prevention of Software Integration Failures of Machine Learning APIs. Proc. ACM Program. Lang. Chengcheng Wan, Yuhan Liu, Kuntai Du, Henry Hoffmann, Junchen Jiang, Michael Maire, Shan Lu