Wencong Xiao - RankMe

46 papers A* 11A 3Misc 2Journal 22Unranked 8

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	BootSeer: Analyzing and Mitigating Initialization Bottlenecks in Large-Scale LLM Training. CoRR Rui Li, Xiaoyun Zhi, Jinxin Chi, Menghan Yu, Lixin Huang, Jia Zhu, Weilun Zhang, Xing Ma, Wenjia Liu, Zhicheng Zhu, Daowen Luo, Zuquan Song, Xin Yin, Chao Xiang, Shuguang Wang, Wencong Xiao, Gene Cooperman
2025	J	`jnl`	Efficient Pre-Training of LLMs via Topology-Aware Communication Alignment on More Than 9600 GPUs. CoRR Guoliang He, Youhe Jiang, Wencong Xiao, Kaihua Jiang, Shuguang Wang, Jun Wang, Zixian Du, Zhuo Jiang, Xinlei Zhang, Binhang Yuan, Eiko Yoneki
2025	A*	`conf`	Enhancing Large-Scale AI Training Efficiency: The C4 Solution for Real-Time Anomaly Detection and Communication Optimization. HPCA Jianbo Dong, Bin Luo, Jun Zhang, Pengcheng Zhang, Fei Feng, Yikai Zhu, Ang Liu, Zian Chen, Yi Shi, Hairong Jiao, Gang Lu, Yu Guan, Ennan Zhai, Wencong Xiao, Hanyu Zhao, Man Yuan, Siran Yang, Xiang Li, Jiamang Wang, Rui Men, Jianwei Zhang, Chang Zhou, Dennis Cai, Yuan Xie, Binzhang Fu
2025	J	`jnl`	Fast LLM Post-training via Decoupled and Fastest-of-N Speculation. CoRR Rongxin Cheng, Kai Zhou, Xingda Wei, Siyuan Liu, Mingcong Han, Mingjing Ai, Yeju Zhou, Baoquan Zhong, Wencong Xiao, Rong Chen, Haibo Chen
2025	J	`jnl`	Fine-Grained Structured Sparse Computing for FPGA-Based AI Inference. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. Chen Zhang, Shijie Cao, Guohao Dai, Chenbo Geng, Zhuliang Yao, Wencong Xiao, Yunxin Liu, Ming Wu, Lintao Zhang, Guangyu Sun, Zhigang Ji, Runsheng Wang, Ru Huang
2025	A*	`conf`	Mycroft: Tracing Dependencies in Collective Communication Towards Reliable LLM Training. SOSP Yangtao Deng, Lei Zhang, Qinlong Wang, Xiaoyun Zhi, Xinlei Zhang, Zhuo Jiang, Haohan Xu, Lei Wang, Zuquan Song, Gaohong Liu, Yang Bai, Shuguang Wang, Wencong Xiao, Jianxi Ye, Minlan Yu, Hong Xu
2025	J	`jnl`	Mycroft: Tracing Dependencies in Collective Communication Towards Reliable LLM Training. CoRR Yangtao Deng, Lei Zhang, Qinlong Wang, Xiaoyun Zhi, Xinlei Zhang, Zhuo Jiang, Haohan Xu, Lei Wang, Zuquan Song, Gaohong Liu, Yang Bai, Shuguang Wang, Wencong Xiao, Jianxi Ye, Minlan Yu, Hong Xu
2025	A*	`conf`	Robust LLM Training Infrastructure at ByteDance. SOSP Borui Wan, Gaohong Liu, Zuquan Song, Jun Wang, Yun Zhang, Guangming Sheng, Shuguang Wang, Houmin Wei, Chenyuan Wang, Weiqiang Lou, Xi Yang, Mofan Zhang, Kaihua Jiang, Cheng Ren, Xiaoyun Zhi, Menghan Yu, Zhe Nan, Zhuolin Zheng, Baoquan Zhong, Qinlong Wang, Huan Yu, Jinxin Chi, Wang Zhang, Yuhan Li, Zixian Du, Sida Zhao, Yongqiang Zhang, Jingzhe Tang, Zherui Liu, Chuan Wu, Yanghua Peng, Haibin Lin, Wencong Xiao, Xin Liu, Liang Xiang
2025	J	`jnl`	Robust LLM Training Infrastructure at ByteDance. CoRR Borui Wan, Gaohong Liu, Zuquan Song, Jun Wang, Yun Zhang, Guangming Sheng, Shuguang Wang, Houmin Wei, Chenyuan Wang, Weiqiang Lou, Xi Yang, Mofan Zhang, Kaihua Jiang, Cheng Ren, Xiaoyun Zhi, Menghan Yu, Zhe Nan, Zhuolin Zheng, Baoquan Zhong, Qinlong Wang, Huan Yu, Jinxin Chi, Wang Zhang, Yuhan Li, Zixian Du, Sida Zhao, Yongqiang Zhang, Jingzhe Tang, Zherui Liu, Chuan Wu, Yanghua Peng, Haibin Lin, Wencong Xiao, Xin Liu, Liang Xiang
2025	—	`conf`	Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling. MLSys Xinyi Zhang, Hanyu Zhao, Wencong Xiao, Xianyan Jia, Fei Xu, Yong Li, Wei Lin, Fangming Liu
2025	J	`jnl`	Subdivision load identification of ball mill based on multi-domain feature extraction and UMAP-BOXGBoost. Signal Image Video Process. Gaipin Cai, Wencong Xiao, Huazhi Xu, Junliang Wan
2025	—	`conf`	Voyager: Input-Adaptive Algebraic Transformations for High-Performance Graph Neural Networks. ASPLOS (3) Yangjie Zhou, Wenting Shen, Jingwen Leng, Shuwen Lu, Zihan Liu, Weihao Cui, Zhendong Zhang, Wencong Xiao, Baole Ai, Yong Li, Wei Lin, Deze Zeng, Yun Liang, Quan Chen, Ning Liu, Minyi Guo
2024	J	`jnl`	Boosting Large-scale Parallel Training Efficiency with C4: A Communication-Driven Approach. CoRR Jianbo Dong, Bin Luo, Jun Zhang, Pengcheng Zhang, Fei Feng, Yikai Zhu, Ang Liu, Zian Chen, Yi Shi, Hairong Jiao, Gang Lu, Yu Guan, Ennan Zhai, Wencong Xiao, Hanyu Zhao, Man Yuan, Siran Yang, Xiang Li, Jiamang Wang, Rui Men, Jianwei Zhang, Huang Zhong, Dennis Cai, Yuan Xie, Binzhang Fu
2024	A*	`conf`	Crux: GPU-Efficient Communication Scheduling for Deep Learning Training. SIGCOMM Jiamin Cao, Yu Guan, Kun Qian, Jiaqi Gao, Wencong Xiao, Jianbo Dong, Binzhang Fu, Dennis Cai, Ennan Zhai
2024	J	`jnl`	ElasticBatch: A Learning-Augmented Elastic Scheduling System for Batch Inference on MIG. IEEE Trans. Parallel Distributed Syst. Jiaxing Qi, Wencong Xiao, Mingzhen Li, Chaojie Yang, Yong Li, Wei Lin, Hailong Yang, Zhongzhi Luan, Depei Qian
2024	J	`jnl`	Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache. CoRR Bin Lin, Tao Peng, Chen Zhang, Minmin Sun, Lanbo Li, Hanyu Zhao, Wencong Xiao, Qi Xu, Xiafei Qiu, Shen Li, Zhigang Ji, Yong Li, Wei Lin
2024	A*	`conf`	Llumnix: Dynamic Scheduling for Large Language Model Serving. OSDI Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang, Yong Li, Wei Lin
2024	J	`jnl`	Llumnix: Dynamic Scheduling for Large Language Model Serving. CoRR Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang, Yong Li, Wei Lin
2024	J	`jnl`	Multi-residual unit fusion and Wasserstein distance-based deep transfer learning for mill load recognition. Signal Image Video Process. Huazhi Xu, Xiaoyan Luo, Wencong Xiao
2024	J	`jnl`	Rubick: Exploiting Job Reconfigurability for Deep Learning Cluster Scheduling. CoRR Xinyi Zhang, Hanyu Zhao, Wencong Xiao, Xianyan Jia, Fei Xu, Yong Li, Wei Lin, Fangming Liu
2023	A	`conf`	EasyScale: Elastic Training with Consistent Accuracy and Improved Utilization on GPUs. SC Mingzhen Li, Wencong Xiao, Hailong Yang, Biao Sun, Hanyu Zhao, Shiru Ren, Zhongzhi Luan, Xianyan Jia, Yi Liu, Yong Li, Wei Lin, Depei Qian
2023	J	`jnl`	FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving. CoRR Tengju Ye, Wei Jing, Chunyong Hu, Shikun Huang, Lingping Gao, Fangzhen Li, Jingke Wang, Ke Guo, Wencong Xiao, Weibo Mao, Hang Zheng, Kun Li, Junbo Chen, Kaicheng Yu
2023	J	`jnl`	GoldMiner: Elastic Scaling of Training Data Pre-Processing Pipelines for Deep Learning. Proc. ACM Manag. Data Hanyu Zhao, Zhi Yang, Yu Cheng, Chao Tian, Shiru Ren, Wencong Xiao, Man Yuan, Langshi Chen, Kaibo Liu, Yang Zhang, Yong Li, Wei Lin
2023	J	`jnl`	MIGPerf: A Comprehensive Benchmark for Deep Learning Training and Inference Workloads on Multi-Instance GPUs. CoRR Huaizheng Zhang, Yuanming Li, Wencong Xiao, Yizheng Huang, Xing Di, Jianxiong Yin, Simon See, Yong Luo, Chiew Tong Lau, Yang You
2022	A	`conf`	CoGNN: Efficient Scheduling for Concurrent GNN Training on GPUs. SC Qingxiao Sun, Yi Liu, Hailong Yang, Ruizhe Zhang, Ming Dun, Mingzhen Li, Xiaoyan Liu, Wencong Xiao, Yong Li, Zhongzhi Luan, Depei Qian
2022	J	`jnl`	EasyScale: Accuracy-consistent Elastic Training for Deep Learning. CoRR Mingzhen Li, Wencong Xiao, Biao Sun, Hanyu Zhao, Hailong Yang, Shiru Ren, Zhongzhi Luan, Xianyan Jia, Yi Liu, Yong Li, Depei Qian, Wei Lin
2022	Misc	`conf`	MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters. NSDI Qizhen Weng, Wencong Xiao, Yinghao Yu, Wei Wang, Cheng Wang, Jian He, Yong Li, Liping Zhang, Wei Lin, Yu Ding
2022	—	`conf`	Whale: Efficient Giant Model Training over Heterogeneous GPUs. USENIX ATC Xianyan Jia, Le Jiang, Ang Wang, Wencong Xiao, Ziji Shi, Jie Zhang, Xinyuan Li, Langshi Chen, Yong Li, Zhen Zheng, Xiaoyong Liu, Wei Lin
2021	—	`conf`	Zico: Efficient GPU Memory Sharing for Concurrent DNN Training. USENIX ATC Gangmuk Lim, Jeongseob Ahn, Wencong Xiao, Youngjin Kwon, Myeongjae Jeon
2020	A*	`conf`	An empirical study on program failures of deep learning jobs. ICSE Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
2020	A*	`conf`	AntMan: Dynamic Scaling on GPU Clusters for Deep Learning. OSDI Wencong Xiao, Shiru Ren, Yong Li, Yang Zhang, Pengyang Hou, Zhi Li, Yihui Feng, Wei Lin, Yangqing Jia
2020	J	`jnl`	Distributed Graph Computation Meets Machine Learning. IEEE Trans. Parallel Distributed Syst. Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou
2020	J	`jnl`	Focusing More on Conflicts with Mis-Predictions Helps Language Pre-Training. CoRR Chen Xing, Wencong Xiao, Yong Li, Wei Lin
2019	—	`conf`	Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads. USENIX ATC Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
2019	J	`jnl`	Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads. CoRR Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
2019	A*	`conf`	Balanced Sparsity for Efficient DNN Inference on GPU. AAAI Zhuliang Yao, Shijie Cao, Wencong Xiao, Chen Zhang, Lanshun Nie
2019	J	`jnl`	BeamRaster: A Practical Fast Massive MU-MIMO System With Pre-Computed Precoders. IEEE Trans. Mob. Comput. Meng Meng, Wencong Xiao, Tong He, Yuechen Tao, Kun Tan, Jiansong Zhang, Wenjie Wang
2019	A	`conf`	Efficient and Effective Sparse LSTM on FPGA with Bank-Balanced Sparsity. FPGA Shijie Cao, Chen Zhang, Zhuliang Yao, Wencong Xiao, Lanshun Nie, De-chen Zhan, Yunxin Liu, Ming Wu, Lintao Zhang
2019	A*	`conf`	SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization. CVPR Shijie Cao, Lingxiao Ma, Wencong Xiao, Chen Zhang, Yunxin Liu, Lintao Zhang, Lanshun Nie, Zhi Yang
2018	J	`jnl`	Balanced Sparsity for Efficient DNN Inference on GPU. CoRR Zhuliang Yao, Shijie Cao, Wencong Xiao, Chen Zhang, Lanshun Nie
2018	A*	`conf`	Gandiva: Introspective Cluster Scheduling for Deep Learning. OSDI Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou
2018	—	`conf`	Scheduling CPU for GPU-based Deep Learning Jobs. SoCC Wencong Xiao, Zhenhua Han, Hanyu Zhao, Xuan Peng, Quanlu Zhang, Fan Yang, Lidong Zhou
2017	A*	`conf`	KV-Direct: High-Performance In-Memory Key-Value Store with Programmable NIC. SOSP Bojie Li, Zhenyuan Ruan, Wencong Xiao, Yuanwei Lu, Yongqiang Xiong, Andrew Putnam, Enhong Chen, Lintao Zhang
2017	—	`conf`	Memory Efficient Loss Recovery for Hardware-based Transport in Datacenter. APNet Yuanwei Lu, Guo Chen, Zhenyuan Ruan, Wencong Xiao, Bojie Li, Jiansong Zhang, Yongqiang Xiong, Peng Cheng, Enhong Chen
2017	Misc	`conf`	Tux NSDI Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou
2015	—	`conf`	GraM: scaling graph computation to the trillions. SoCC Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou