Yanghua Peng - RankMe

51 papers A* 9A 8B 1C 1Misc 3Journal 25Unranked 4

Year	Rank	Type	Title / Venue / Authors
2026	A	`conf`	Laminar: A Scalable Asynchronous RL Post-Training Framework. EuroSys Guangming Sheng, Yuxuan Tong, Borui Wan, Wang Zhang, Chaobo Jia, Xibin Wu, Yuqi Wu, Xiang Li, Chi Zhang, Yanghua Peng, Haibin Lin, Xin Liu, Chuan Wu
2026	A	`conf`	MegaScale-Data: Scaling DataLoader for Multisource Large Foundation Model Training. EuroSys Juntao Zhao, Qi Lu, Wei Jia, Borui Wan, Lei Zuo, Junda Feng, Jianyu Jiang, Yangrui Chen, Shuaishuai Cao, Jialing He, Kaihua Jiang, Yuanzhe Hu, Shibiao Nong, Yanghua Peng, Haibin Lin, Chuan Wu
2026	A	`conf`	MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production. EuroSys Chao Jin, Ziheng Jiang, Zhihao Bai, Zheng Zhong, Juncai Liu, Xiang Li, Ningxin Zheng, Xi Wang, Cong Xie, Qi Huang, Wen Heng, Yiyuan Ma, Wenlei Bao, Size Zheng, Xuegui Zheng, Yanghua Peng, Haibin Lin, Xuanzhe Liu, Xin Jin, Xin Liu
2026	A	`conf`	MegaScale-Omni: A Hyper-Scale, Workload-Resilient System for MultiModal LLM Training in Production. EuroSys Chunyu Xue, Yangrui Chen, Jianyu Jiang, Ningxin Zheng, Junda Feng, Jingji Chen, Shixiong Zhao, Shen Yan, Yi Lin, Lei Shi, Zanbo Wang, Lishu Luo, Faming Wu, Haibin Lin, Yanghua Peng, Xin Liu, Quan Chen
2026	A*	`conf`	OmniScale: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo. AAAI Qianli Ma, Yaowei Zheng, Zhelun Shi, Zhongkai Zhao, Bin Jia, Ziyue Huang, Zhiqi Lin, Youjie Li, Jiacheng Yang, Yanghua Peng, Zhi Zhang, Xin Liu
2026	J	`jnl`	veScale-FSDP: Flexible and High-Performance FSDP at Scale. CoRR Zezhou Wang, Youjie Li, Zhiqi Lin, Jiacheng Yang, Cong Xie, Guanyu Feng, Zheng Zhong, Ziyue Huang, Hongyu Zhu, Zhi Zhang, Yanghua Peng, Xin Liu
2025	Misc	`conf`	ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model Development. NSDI Borui Wan, Mingji Han, Yiyao Sheng, Yanghua Peng, Haibin Lin, Mofan Zhang, Zhichao Lai, Menghan Yu, Junda Zhang, Zuquan Song, Xin Liu, Chuan Wu
2025	A*	`conf`	Goku: Flow Based Video Generative Foundation Models. CVPR Shoufa Chen, Chongjian Ge, Yuqi Zhang, Yida Zhang, Fengda Zhu, Hao Yang, Hongxiang Hao, Hui Wu, Zhichao Lai, Yifei Hu, Ting-Che Lin, Shilong Zhang, Fu Li, Chuan Li, Xing Wang, Yanghua Peng, Peize Sun, Ping Luo, Yi Jiang, Zehuan Yuan, Bingyue Peng, Xiaobing Liu
2025	J	`jnl`	Goku: Flow Based Video Generative Foundation Models. CoRR Shoufa Chen, Chongjian Ge, Yuqi Zhang, Yida Zhang, Fengda Zhu, Hao Yang, Hongxiang Hao, Hui Wu, Zhichao Lai, Yifei Hu, Ting-Che Lin, Shilong Zhang, Fu Li, Chuan Li, Xing Wang, Yanghua Peng, Peize Sun, Ping Luo, Yi Jiang, Zehuan Yuan, Bingyue Peng, Xiaobing Liu
2025	A	`conf`	HybridFlow: A Flexible and Efficient RLHF Framework. EuroSys Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu, Wang Zhang, Ru Zhang, Yanghua Peng, Haibin Lin, Chuan Wu
2025	J	`jnl`	Laminar: A Scalable Asynchronous RL Post-Training Framework. CoRR Guangming Sheng, Yuxuan Tong, Borui Wan, Wang Zhang, Chaobo Jia, Xibin Wu, Yuqi Wu, Xiang Li, Chi Zhang, Yanghua Peng, Haibin Lin, Xin Liu, Chuan Wu
2025	J	`jnl`	MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production. CoRR Chao Jin, Ziheng Jiang, Zhihao Bai, Zheng Zhong, Juncai Liu, Xiang Li, Ningxin Zheng, Xi Wang, Cong Xie, Qi Huang, Wen Heng, Yiyuan Ma, Wenlei Bao, Size Zheng, Yanghua Peng, Haibin Lin, Xuanzhe Liu, Xin Jin, Xin Liu
2025	J	`jnl`	Mesh-Attention: A New Communication-Efficient Distributed Attention with Improved Data Locality. CoRR Sirui Chen, Jingji Chen, Siqi Zhu, Ziheng Jiang, Yanghua Peng, Xuehai Qian
2025	J	`jnl`	OVERLORD: Ultimate Scaling of DataLoader for Multi-Source Large Foundation Model Training. CoRR Juntao Zhao, Qi Lu, Wei Jia, Borui Wan, Lei Zuo, Junda Feng, Jianyu Jiang, Yangrui Chen, Shuaishuai Cao, Jialing He, Kaihua Jiang, Yuanzhe Hu, Yanghua Peng, Haibin Lin, Xin Liu, Chuan Wu
2025	—	`conf`	Optimus: Accelerating Large-Scale Multi-Modal LLM Training by Bubble Exploitation. USENIX ATC Weiqi Feng, Yangrui Chen, Shaoyu Wang, Yanghua Peng, Haibin Lin, Minlan Yu
2025	A*	`conf`	Robust LLM Training Infrastructure at ByteDance. SOSP Borui Wan, Gaohong Liu, Zuquan Song, Jun Wang, Yun Zhang, Guangming Sheng, Shuguang Wang, Houmin Wei, Chenyuan Wang, Weiqiang Lou, Xi Yang, Mofan Zhang, Kaihua Jiang, Cheng Ren, Xiaoyun Zhi, Menghan Yu, Zhe Nan, Zhuolin Zheng, Baoquan Zhong, Qinlong Wang, Huan Yu, Jinxin Chi, Wang Zhang, Yuhan Li, Zixian Du, Sida Zhao, Yongqiang Zhang, Jingzhe Tang, Zherui Liu, Chuan Wu, Yanghua Peng, Haibin Lin, Wencong Xiao, Xin Liu, Liang Xiang
2025	J	`jnl`	Robust LLM Training Infrastructure at ByteDance. CoRR Borui Wan, Gaohong Liu, Zuquan Song, Jun Wang, Yun Zhang, Guangming Sheng, Shuguang Wang, Houmin Wei, Chenyuan Wang, Weiqiang Lou, Xi Yang, Mofan Zhang, Kaihua Jiang, Cheng Ren, Xiaoyun Zhi, Menghan Yu, Zhe Nan, Zhuolin Zheng, Baoquan Zhong, Qinlong Wang, Huan Yu, Jinxin Chi, Wang Zhang, Yuhan Li, Zixian Du, Sida Zhao, Yongqiang Zhang, Jingzhe Tang, Zherui Liu, Chuan Wu, Yanghua Peng, Haibin Lin, Wencong Xiao, Xin Liu, Liang Xiang
2025	C	`conf`	SplitQuant: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and Adaptive Quantization. CLUSTER Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Chuan Wu
2025	J	`jnl`	VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo. CoRR Qianli Ma, Yaowei Zheng, Zhelun Shi, Zhongkai Zhao, Bin Jia, Ziyue Huang, Zhiqi Lin, Youjie Li, Jiacheng Yang, Yanghua Peng, Zhi Zhang, Xin Liu
2025	J	`jnl`	veScale: Consistent and Efficient Tensor Programming with Eager-Mode SPMD. CoRR Youjie Li, Cheng Wan, Zhiqi Lin, Hongyu Zhu, Jiacheng Yang, Ziang Song, Xinyi Di, Jiawei Wu, Huiyao Shu, Wenlei Bao, Yanghua Peng, Haibin Lin, Li-Wen Chang
2024	J	`jnl`	ByteCheckpoint: A Unified Checkpointing System for LLM Development. CoRR Borui Wan, Mingji Han, Yiyao Sheng, Zhichao Lai, Mofan Zhang, Junda Zhang, Yanghua Peng, Haibin Lin, Xin Liu, Chuan Wu
2024	A	`conf`	CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs. EuroSys Hanpeng Hu, Junwei Su, Juntao Zhao, Yanghua Peng, Yibo Zhu, Haibin Lin, Chuan Wu
2024	J	`jnl`	HybridFlow: A Flexible and Efficient RLHF Framework. CoRR Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu, Wang Zhang, Ru Zhang, Yanghua Peng, Haibin Lin, Chuan Wu
2024	J	`jnl`	LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization. CoRR Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Chuan Wu
2024	Misc	`conf`	MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. NSDI Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu
2024	J	`jnl`	MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. CoRR Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu
2024	J	`jnl`	Optimus: Accelerating Large-Scale Multi-Modal LLM Training by Bubble Exploitation. CoRR Weiqi Feng, Yangrui Chen, Shaoyu Wang, Yanghua Peng, Haibin Lin, Minlan Yu
2024	B	`conf`	POSTER: LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization. PPoPP Juntao Zhao, Borui Wan, Chuan Wu, Yanghua Peng, Haibin Lin
2024	A	`conf`	QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices. IPDPS Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Yibo Zhu, Chuan Wu
2024	J	`jnl`	QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices. CoRR Juntao Zhao, Borui Wan, Yanghua Peng, Haibin Lin, Yibo Zhu, Chuan Wu
2023	Misc	`conf`	BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing. NSDI Tianfeng Liu, Yangrui Chen, Dan Li, Chuan Wu, Yibo Zhu, Jun He, Yanghua Peng, Hongzheng Chen, Hongzhi Chen, Chuanxiong Guo
2023	J	`jnl`	CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs. CoRR Hanpeng Hu, Junwei Su, Juntao Zhao, Yanghua Peng, Yibo Zhu, Haibin Lin, Chuan Wu
2023	J	`jnl`	Deep Learning-Based Job Placement in Distributed Machine Learning Clusters With Heterogeneous Workloads. IEEE/ACM Trans. Netw. Yixin Bao, Yanghua Peng, Chuan Wu
2023	J	`jnl`	SP-GNN: Learning structure and position information from graphs. Neural Networks Yangrui Chen, Jiaxuan You, Jun He, Yuan Lin, Yanghua Peng, Chuan Wu, Yibo Zhu
2022	A*	`conf`	Multi-resource interleaving for deep learning training. SIGCOMM Yihao Zhao, Yuanqiang Liu, Yanghua Peng, Yibo Zhu, Xuanzhe Liu, Xin Jin
2022	A*	`conf`	SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training. NeurIPS Yangrui Chen, Cong Xie, Meng Ma, Juncheng Gu, Yanghua Peng, Haibin Lin, Chuan Wu, Yibo Zhu
2022	—	`conf`	dPRO: A Generic Performance Diagnosis and Optimization Toolkit for Expediting Distributed DNN Training. MLSys Hanpeng Hu, Chenyu Jiang, Yuchen Zhong, Yanghua Peng, Chuan Wu, Yibo Zhu, Haibin Lin, Chuanxiong Guo
2022	J	`jnl`	dPRO: A Generic Profiling and Optimization System for Expediting Distributed DNN Training. CoRR Hanpeng Hu, Chenyu Jiang, Yuchen Zhong, Yanghua Peng, Chuan Wu, Yibo Zhu, Haibin Lin, Chuanxiong Guo
2021	J	`jnl`	BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing. CoRR Tianfeng Liu, Yangrui Chen, Dan Li, Chuan Wu, Yibo Zhu, Jun He, Yanghua Peng, Hongzheng Chen, Hongzhi Chen, Chuanxiong Guo
2021	J	`jnl`	DL2: A Deep Learning-Driven Scheduler for Deep Learning Clusters. IEEE Trans. Parallel Distributed Syst. Yanghua Peng, Yixin Bao, Yangrui Chen, Chuan Wu, Chen Meng, Wei Lin
2020	—	`conf`	Elastic parameter server load distribution in deep learning clusters. SoCC Yangrui Chen, Yanghua Peng, Yixin Bao, Chuan Wu, Yibo Zhu, Chuanxiong Guo
2020	A*	`conf`	Preemptive All-reduce Scheduling for Expediting Distributed DNN Training. INFOCOM Yixin Bao, Yanghua Peng, Yangrui Chen, Chuan Wu
2019	A*	`conf`	A generic communication scheduler for distributed DNN training acceleration. SOSP Yanghua Peng, Yibo Zhu, Yangrui Chen, Yixin Bao, Bairen Yi, Chang Lan, Chuan Wu, Chuanxiong Guo
2019	J	`jnl`	DL2: A Deep Learning-driven Scheduler for Deep Learning Clusters. CoRR Yanghua Peng, Yixin Bao, Yangrui Chen, Chuan Wu, Chen Meng, Wei Lin
2019	A*	`conf`	Deep Learning-based Job Placement in Distributed Machine Learning Clusters. INFOCOM Yixin Bao, Yanghua Peng, Chuan Wu
2018	A*	`conf`	Online Job Scheduling in Distributed Machine Learning Clusters. INFOCOM Yixin Bao, Yanghua Peng, Chuan Wu, Zongpeng Li
2018	J	`jnl`	Online Job Scheduling in Distributed Machine Learning Clusters. CoRR Yixin Bao, Yanghua Peng, Chuan Wu, Zongpeng Li
2018	A	`conf`	Optimus: an efficient dynamic resource scheduler for deep learning clusters. EuroSys Yanghua Peng, Yixin Bao, Yangrui Chen, Chuan Wu, Chuanxiong Guo
2017	J	`jnl`	Dynamic Scaling of Virtualized, Distributed Service Chains: A Case Study of IMS. CoRR Jingpu Duan, Chuan Wu, Franck Le, Alex X. Liu, Yanghua Peng
2017	J	`jnl`	Dynamic Scaling of Virtualized, Distributed Service Chains: A Case Study of IMS. IEEE J. Sel. Areas Commun. Jingpu Duan, Chuan Wu, Franck Le, Alex X. Liu, Yanghua Peng
2017	—	`conf`	deTector: a Topology-aware Monitoring System for Data Center Networks. USENIX ATC Yanghua Peng, Ji Yang, Chuan Wu, Chuanxiong Guo, Chengchen Hu, Zongpeng Li