Shenggan Cheng

28 papers A* 3A 1B 4C 1Journal 16Unranked 3

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	DiT-HC: Enabling Efficient Training of Visual Generation Model DiT on HPC-oriented CPU Cluster. CoRR Jinxiao Zhang, Yunpu Xu, Xiyong Wu, Runmin Dong, Shenggan Cheng, Yi Zhao, Mengxuan Chen, Qinrui Zheng, Jianting Liu, Haohuan Fu
2026	B	`conf`	HelixPipe: Efficient Distributed Training of Long Sequence Transformers with Attention Parallel Pipeline Parallelism. PPoPP Geng Zhang, Shenggan Cheng, Xuanlei Zhao, Ziming Liu, Yang You
2025	—	`conf`	Concerto: Automatic Communication Optimization and Scheduling for Large-Scale Deep Learning. ASPLOS (1) Shenggan Cheng, Shengjie Lin, Lansong Diao, Hao Wu, Siyu Wang, Chang Si, Ziming Liu, Xuanlei Zhao, Jiangsu Du, Wei Lin, Yang You
2025	A*	`conf`	DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers. ICML Xuanlei Zhao, Shenggan Cheng, Chang Chen, Zangwei Zheng, Ziming Liu, Zheming Yang, Yang You
2025	J	`jnl`	ElasticMM: Efficient Multimodal LLMs Serving with Elastic Multimodal Parallelism. CoRR Zedong Liu, Shenggan Cheng, Guangming Tan, Yang You, Dingwen Tao
2025	J	`jnl`	Expert-as-a-Service: Towards Efficient, Scalable, and Robust Large-scale MoE Serving. CoRR Ziming Liu, Boyu Tian, Guoteng Wang, Zhen Jiang, Peng Sun, Zhenhua Han, Tian Tang, Xiaohe Hu, Yanmin Jia, Yan Zhang, He Liu, Mingjun Zhang, Yiqi Zhang, Qiaoling Chen, Shenggan Cheng, Mingyu Gao, Yang You, Siyuan Feng
2025	J	`jnl`	HelixPipe: Efficient Distributed Training of Long Sequence Transformers with Attention Parallel Pipeline Parallelism. CoRR Geng Zhang, Shenggan Cheng, Xuanlei Zhao, Ziming Liu, Yang You
2025	J	`jnl`	MixCache: Mixture-of-Cache for Video Diffusion Transformer Acceleration. CoRR Yuanxin Wei, Lansong Diao, Bujiao Chen, Shenggan Cheng, Zhengping Qian, Wenyuan Yu, Nong Xiao, Wei Lin, Jiangsu Du
2025	J	`jnl`	SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation. CoRR Shenggan Cheng, Yuanxin Wei, Lansong Diao, Yong Liu, Bujiao Chen, Lianghua Huang, Yu Liu, Wenyuan Yu, Jiangsu Du, Wei Lin, Yang You
2025	A*	`conf`	SeedLoRA: A Fusion Approach to Efficient LLM Fine-Tuning. ICML Yong Liu, Di Fu, Shenggan Cheng, Zirui Zhu, Yang Luo, Minhao Cheng, Cho-Jui Hsieh, Yang You
2024	A*	`conf`	AutoChunk: Automated Activation Chunk for Memory-Efficient Deep Learning Inference. ICLR Xuanlei Zhao, Shenggan Cheng, Guangyang Lu, Haotian Zhou, Bin Jia, Yang You
2024	J	`jnl`	AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference. CoRR Xuanlei Zhao, Shenggan Cheng, Guangyang Lu, Jiarui Fang, Haotian Zhou, Bin Jia, Ziming Liu, Yang You
2024	J	`jnl`	DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers. CoRR Xuanlei Zhao, Shenggan Cheng, Zangwei Zheng, Zheming Yang, Ziming Liu, Yang You
2024	B	`conf`	FastFold: Optimizing AlphaFold Training and Inference on GPU Clusters. PPoPP Shenggan Cheng, Xuanlei Zhao, Guangyang Lu, Jiarui Fang, Tian Zheng, Ruidong Wu, Xiwen Zhang, Jian Peng, Yang You
2024	—	`conf`	HeteGen: Efficient Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices. MLSys Xuanlei Zhao, Bin Jia, Haotian Zhou, Ziming Liu, Shenggan Cheng, Yang You
2024	J	`jnl`	HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices. CoRR Xuanlei Zhao, Bin Jia, Haotian Zhou, Ziming Liu, Shenggan Cheng, Yang You
2024	B	`conf`	Liger: Interleaving Intra- and Inter-Operator Parallelism for Distributed Large Model Inference. PPoPP Jiangsu Du, Jinhui Wei, Jiazhi Jiang, Shenggan Cheng, Dan Huang, Zhiguang Chen, Yutong Lu
2024	J	`jnl`	WallFacer: Guiding Transformer Model Training Out of the Long-Context Dark Forest with N-body Problem. CoRR Ziming Liu, Shaoyu Wang, Shenggan Cheng, Zhongkai Zhao, Xuanlei Zhao, James Demmel, Yang You
2023	J	`jnl`	ATP: Adaptive Tensor Parallelism for Foundation Models. CoRR Shenggan Cheng, Ziming Liu, Jiangsu Du, Yang You
2023	A	`conf`	Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency. SC Ziming Liu, Shenggan Cheng, Haotian Zhou, Yang You
2023	J	`jnl`	Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency. CoRR Ziming Liu, Shenggan Cheng, Haotian Zhou, Yang You
2022	J	`jnl`	FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours. CoRR Shenggan Cheng, Ruidong Wu, Zhongming Yu, Bin-Rui Li, Xiwen Zhang, Jian Peng, Yang You
2021	C	`conf`	tcFFT: A Fast Half-Precision FFT Library for NVIDIA Tensor Cores. CLUSTER Bin-Rui Li, Shenggan Cheng, James Lin
2021	J	`jnl`	tcFFT: Accelerating Half-Precision FFT through Tensor Cores. CoRR Bin-Rui Li, Shenggan Cheng, James Lin
2020	B	`conf`	CUBE - Towards an Optimal Scaling of Cosmological N-body Simulations. CCGRID Shenggan Cheng, Hao-Ran Yu, Derek Inman, Qiucheng Liao, Qiaoya Wu, James Lin
2020	J	`jnl`	CUBE - Towards an Optimal Scaling of Cosmological N-body Simulations. CoRR Shenggan Cheng, Hao-Ran Yu, Derek Inman, Qiucheng Liao, Qiaoya Wu, James Lin
2020	—	`conf`	FTL: A Universal Framework for Training Low-Bit DNNs via Feature Transfer. ECCV (25) Kunyuan Du, Ya Zhang, Haibing Guan, Qi Tian, Yanfeng Wang, Shenggan Cheng, James Lin
2020	J	`jnl`	HMS-Net: Hierarchical Multi-Scale Sparsity-Invariant Network for Sparse Depth Completion. IEEE Trans. Image Process. Zixuan Huang, Junming Fan, Shenggan Cheng, Shuai Yi, Xiaogang Wang, Hongsheng Li