Luohe Shi

12 papers A* 3Journal 7Unranked 2
YearRankTypeTitle / Venue / Authors
2026 A* conf
Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios.
AAAI
Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao
2025 J jnl
Faster MoE LLM Inference for Extremely Large Models.
CoRR
Haoqi Yang, Luohe Shi, Qiwei Li, Zuchao Li, Ping Wang, Bo Du, Mengjia Shen, Hai Zhao
2025 A* conf
From Parameters to Performance: A Data-Driven Study on LLM Structure and Development.
EMNLP
Suqing Wang, Zuchao Li, Luohe Shi, Bo Du, Hai Zhao, Yun Li, Qianren Wang
2025 J jnl
From Parameters to Performance: A Data-Driven Study on LLM Structure and Development.
CoRR
Suqing Wang, Zuchao Li, Luohe Shi, Bo Du, Hai Zhao, Yun Li, Qianren Wang
2025 — conf
KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding.
ACL (1)
Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao
2025 J jnl
KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding.
CoRR
Luohe Shi, Zuchao Li, Lefei Zhang, Guoming Liu, Baoyuan Qi, Hai Zhao
2025 J jnl
Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios.
CoRR
Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao
2025 — conf
SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers.
ACL (1)
Zicong Tang, Luohe Shi, Zuchao Li, Baoyuan Qi, Guoming Liu, Lefei Zhang, Ping Wang
2025 J jnl
SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers.
CoRR
Zicong Tang, Luohe Shi, Zuchao Li, Baoyuan Qi, Guoming Liu, Lefei Zhang, Ping Wang
2024 J jnl
Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumption.
CoRR
Luohe Shi, Hongyi Zhang, Yao Yao, Zuchao Li, Hai Zhao
2024 A* conf
Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models.
NeurIPS
Luohe Shi, Yao Yao, Zuchao Li, Lefei Zhang, Hai Zhao
2024 J jnl
Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models.
CoRR
Luohe Shi, Yao Yao, Zuchao Li, Lefei Zhang, Hai Zhao