Shigang Li - RankMe

83 papers A* 2A 14B 12C 1Misc 2Journal 45Unranked 7

Year	Rank	Type	Title / Venue / Authors
2025	A	`conf`	CoLa: Towards Communication-efficient Distributed Sparse Matrix-Matrix Multiplication on GPUs. ICS Lixing Zhang, Yingxia Shao, Shigang Li
2025	B	`conf`	FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores. PPoPP Jinliang Shi, Shigang Li, Youxuan Xu, Rongtian Fu, Xueying Wang, Tong Wu
2025	A	`conf`	Hypertron: Efficiently Scaling Large Models by Exploring High-Dimensional Parallelization Space. SC Shigang Li, Jingkun Dong, Jihao Chen, Zhi Ma, Zhongzhe Hu
2025	J	`jnl`	Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication. CoRR Jinliang Shi, Shigang Li, Youxuan Xu, Xueying Wang, Rongtian Fu, Zhi Ma, Tong Wu
2025	J	`jnl`	OptiFX: Automatic Optimization for Convolutional Neural Networks with Aggressive Operator Fusion on GPUs. ACM Trans. Archit. Code Optim. Xueying Wang, Shigang Li, Hao Qian, Fan Luo, Zhaoyang Hao, Tong Wu, Ruiyuan Xu, Huimin Cui, Xiaobing Feng, Guangli Li, Jingling Xue
2025	A*	`conf`	ParGNN: A Scalable Graph Neural Network Training Framework on multi-GPUs. DAC Junyu Gu, Shunde Li, Rongqiang Cao, Jue Wang, Zijian Wang, Zhiqiang Liang, Fang Liu, Shigang Li, Chunbao Zhou, Yangang Wang, Xuebin Chi
2025	J	`jnl`	SparkAttention: High-Performance Multi-Head Attention for Large Models on Volta GPU Architecture. CoRR Youxuan Xu, Tong Wu, Shigang Li, Xueying Wang, Jingjing Wang
2025	J	`jnl`	SparkAttention: high-performance multi-head attention for large models on Volta GPU architecture. CCF Trans. High Perform. Comput. Youxuan Xu, Tong Wu, Shigang Li, Xueying Wang, Jingjing Wang
2024	Misc	`conf`	A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network. NSDI Nils Blach, Maciej Besta, Daniele De Sensi, Jens Domke, Hussein Harake, Shigang Li, Patrick Iff, Marek Konieczny, Kartik Lakhotia, Ales Kubicek, Marcel Ferrari, Fabrizio Petrini, Torsten Hoefler
2024	J	`jnl`	AutoDDL: Automatic Distributed Deep Learning With Near-Optimal Bandwidth Cost. IEEE Trans. Parallel Distributed Syst. Jinfan Chen, Shigang Li, Ran Guo, Jinhui Yuan, Torsten Hoefler
2024	J	`jnl`	FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores. CoRR Jinliang Shi, Shigang Li, Youxuan Xu, Rongtian Fu, Xueying Wang, Tong Wu
2024	B	`conf`	HE-ASR-IT: Hybrid Excitation and Adaptive Style Recombination for Unpaired Image-to-Image Translation. IJCNN Ziyi Wu, Juanjuan Luo, Mingxin Du, Shigang Li, Wenbin Yao, Zhibin Huang
2024	J	`jnl`	HammingMesh: A Network Topology for Large-Scale Deep Learning. Commun. ACM Torsten Hoefler, Tommaso Bonoto, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Deepak Goel, Miguel Castro, Steve Scott
2024	B	`conf`	POSTER: ParGNN: Efficient Training for Large-Scale Graph Neural Network on GPU Clusters. PPoPP Shunde Li, Junyu Gu, Jue Wang, Tiechui Yao, Zhiqiang Liang, Yumeng Shi, Shigang Li, Weiting Xi, Shushen Li, Chunbao Zhou, Yangang Wang, Xuebin Chi
2024	J	`jnl`	RDRM: Real-Time Dynamic Replica Management With Joint Optimization for Edge Computing. IEEE Trans. Serv. Comput. Xikang Zhu, Wenbin Yao, Yingying Hou, Shigang Li, Juanjuan Luo, Zhibin Huang, Shengdong Fu
2023	J	`jnl`	A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network. CoRR Nils Blach, Maciej Besta, Daniele De Sensi, Jens Domke, Hussein Harake, Shigang Li, Patrick Iff, Marek Konieczny, Kartik Lakhotia, Ales Kubicek, Marcel Ferrari, Fabrizio Petrini, Torsten Hoefler
2023	B	`conf`	A Scalable Hybrid Total FETI Method for Massively Parallel FEM Simulations. PPoPP Kehao Lin, Chunbao Zhou, Yan Zeng, Ningming Nie, Jue Wang, Shigang Li, Yangde Feng, Yangang Wang, Kehan Yao, Tiechui Yao, Jilin Zhang, Jian Wan
2023	J	`jnl`	AGCM-3DLF: Accelerating Atmospheric General Circulation Model via 3-D Parallelization and Leap-Format. IEEE Trans. Parallel Distributed Syst. Hang Cao, Liang Yuan, He Zhang, Yunquan Zhang, Baodong Wu, Kun Li, Shigang Li, Minghua Zhang, Pengqi Lu, Junmin Xiao
2023	A	`conf`	ANT-MOC: Scalable Neutral Particle Transport Using 3D Method of Characteristics on Multi-GPU Systems. SC Shunde Li, Zongguo Wang, Lingkun Bu, Jue Wang, Zhikuang Xin, Shigang Li, Yangang Wang, Yangde Feng, Peng Shi, Yun Hu, Xuebin Chi
2023	J	`jnl`	ASDL: A Unified Interface for Gradient Preconditioning in PyTorch. CoRR Kazuki Osawa, Satoki Ishikawa, Rio Yokota, Shigang Li, Torsten Hoefler
2023	A	`conf`	Asynch-SGBDT: Train Stochastic Gradient Boosting Decision Trees in an Asynchronous Parallel Manner. IPDPS Daning Cheng, Shigang Li, Yunquan Zhang
2023	J	`jnl`	AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication. CoRR Jinfan Chen, Shigang Li, Ran Guo, Jinhui Yuan, Torsten Hoefler
2023	A	`conf`	Co-design Hardware and Algorithm for Vector Search. SC Wenqi Jiang, Shigang Li, Yu Zhu, Johannes de Fine Licht, Zhenhao He, Runbin Shi, Cédric Renggli, Shuai Zhang, Theodoros Rekatsinas, Torsten Hoefler, Gustavo Alonso
2023	J	`jnl`	Co-design Hardware and Algorithm for Vector Search. CoRR Wenqi Jiang, Shigang Li, Yu Zhu, Johannes de Fine Licht, Zhenhao He, Runbin Shi, Cédric Renggli, Shuai Zhang, Theodoros Rekatsinas, Torsten Hoefler, Gustavo Alonso
2023	A	`conf`	Large-Scale Simulation of Structural Dynamics Computing on GPU Clusters. SC Yumeng Shi, Ningming Nie, Jue Wang, Kehao Lin, Chunbao Zhou, Shigang Li, Kehan Yao, Shunde Li, Yangde Feng, Yan Zeng, Fang Liu, Yangang Wang, Yue Gao
2023	—	`conf`	PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices. MLSys Kazuki Osawa, Shigang Li, Torsten Hoefler
2022	A	`conf`	A data-centric optimization framework for machine learning. ICS Oliver Rausch, Tal Ben-Nun, Nikoli Dryden, Andrei Ivanov, Shigang Li, Torsten Hoefler
2022	A	`conf`	Efficient Quantized Sparse Matrix Operations on Tensor Cores. SC Shigang Li, Kazuki Osawa, Torsten Hoefler
2022	J	`jnl`	Efficient Quantized Sparse Matrix Operations on Tensor Cores. CoRR Shigang Li, Kazuki Osawa, Torsten Hoefler
2022	A	`conf`	HammingMesh: A Network Topology for Large-Scale Deep Learning. SC Torsten Hoefler, Tommaso Bonato, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Jon Belk, Deepak Goel, Miguel Castro, Steve Scott
2022	J	`jnl`	HammingMesh: A Network Topology for Large-Scale Deep Learning. CoRR Torsten Hoefler, Tommaso Bonato, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Jon Belk, Deepak Goel, Miguel Castro, Steve Scott
2022	J	`jnl`	Near-Optimal Sparse Allreduce for Distributed Deep Learning. CoRR Shigang Li, Torsten Hoefler
2022	B	`conf`	Near-optimal sparse allreduce for distributed deep learning. PPoPP Shigang Li, Torsten Hoefler
2022	J	`jnl`	PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices. CoRR Kazuki Osawa, Shigang Li, Torsten Hoefler
2022	J	`jnl`	VenusAI: An artificial intelligence platform for scientific discovery on supercomputers. J. Syst. Archit. Tiechui Yao, Jue Wang, Meng Wan, Zhikuang Xin, Yangang Wang, Rongqiang Cao, Shigang Li, Xuebin Chi
2021	J	`jnl`	A Data-Centric Optimization Framework for Machine Learning. CoRR Oliver Rausch, Tal Ben-Nun, Nikoli Dryden, Andrei Ivanov, Shigang Li, Torsten Hoefler
2021	A*	`conf`	Asynchronous Decentralized SGD with Quantized and Local Updates. NeurIPS Giorgi Nadiradze, Amirmojtaba Sabour, Peter Davies, Shigang Li, Dan Alistarh
2021	J	`jnl`	Breaking (Global) Barriers in Parallel Stochastic Optimization With Wait-Avoiding Group Averaging. IEEE Trans. Parallel Distributed Syst. Shigang Li, Tal Ben-Nun, Giorgi Nadiradze, Salvatore Di Girolamo, Nikoli Dryden, Dan Alistarh, Torsten Hoefler
2021	J	`jnl`	Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines. CoRR Shigang Li, Torsten Höfler
2021	A	`conf`	Chimera: efficiently training large-scale neural networks with bidirectional pipelines. SC Shigang Li, Torsten Hoefler
2021	—	`conf`	Data Movement Is All You Need: A Case Study on Optimizing Transformers. MLSys Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Shigang Li, Torsten Hoefler
2021	J	`jnl`	Flare: Flexible In-Network Allreduce. CoRR Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler
2021	A	`conf`	Flare: flexible in-network allreduce. SC Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler
2021	J	`jnl`	Why Dataset Properties Bound the Scalability of Parallel Machine Learning Training Algorithms. IEEE Trans. Parallel Distributed Syst. Daning Cheng, Shigang Li, Hanping Zhang, Fen Xia, Yunquan Zhang
2020	A	`conf`	A Highly Efficient Dynamical Core of Atmospheric General Circulation Model based on Leap-Format. IPDPS Hang Cao, Liang Yuan, He Zhang, Baodong Wu, Shigang Li, Pengqi Lu, Yunquan Zhang, Yongjun Xu, Minghua Zhang
2020	J	`jnl`	Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging. CoRR Shigang Li, Tal Ben-Nun, Dan Alistarh, Salvatore Di Girolamo, Nikoli Dryden, Torsten Hoefler
2020	J	`jnl`	Data Movement Is All You Need: A Case Study on Optimizing Transformers. CoRR Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Shigang Li, Torsten Hoefler
2020	J	`jnl`	Deep Learning for Post-Processing Ensemble Weather Forecasts. CoRR Peter Grönquist, Chengyuan Yao, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Shigang Li, Torsten Hoefler
2020	J	`jnl`	FastNBL: fast neighbor lists establishment for molecular dynamics simulation based on bitwise operations. J. Supercomput. Kun Li, Shigang Li, Shan Huang, Yifeng Chen, Yunquan Zhang
2020	B	`conf`	Taming unbalanced training workloads in deep learning with partial collective operations. PPoPP Shigang Li, Tal Ben-Nun, Salvatore Di Girolamo, Dan Alistarh, Torsten Hoefler
2020	J	`jnl`	The static parallel distribution algorithms for hybrid density-functional calculations in HONPAS package. Int. J. High Perform. Comput. Appl. Xinming Qin, Honghui Shang, Lei Xu, Wei Hu, Jinlong Yang, Shigang Li, Yunquan Zhang
2020	J	`jnl`	WP-SGD: Weighted parallel SGD for distributed unbalanced-workload training system. J. Parallel Distributed Comput. Daning Cheng, Shigang Li, Yunquan Zhang
2019	J	`jnl`	Correction to: FastNBL: fast neighbor lists establishment for molecular dynamics simulation based on bitwise operations. J. Supercomput. Kun Li, Shigang Li, Shan Huang, Yifeng Chen, Yunquan Zhang
2019	J	`jnl`	Efficient parallel optimizations of a high-performance SIFT on GPUs. J. Parallel Distributed Comput. Zhihao Li, Haipeng Jia, Yunquan Zhang, Shice Liu, Shigang Li, Xiao Wang, Hao Zhang
2019	A	`conf`	OpenKMC: a KMC design for hundred-billion-atom simulation using millions of cores on Sunway Taihulight. SC Kun Li, Honghui Shang, Yunquan Zhang, Shigang Li, Baodong Wu, Dong Wang, Libo Zhang, Fang Li, Dexun Chen, Zhiqiang Wei
2019	J	`jnl`	Predicting Weather Uncertainty with Deep Convnets. CoRR Peter Grönquist, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Luca Lavarini, Shigang Li, Torsten Hoefler
2019	J	`jnl`	Taming Unbalanced Training Workloads in Deep Learning with Partial Collective Operations. CoRR Shigang Li, Tal Ben-Nun, Salvatore Di Girolamo, Dan Alistarh, Torsten Hoefler
2019	J	`jnl`	The Scalability for Parallel Machine Learning Training Algorithm: Dataset Matters. CoRR Daning Cheng, Hanping Zhang, Fen Xia, Shigang Li, Yunquan Zhang
2019	B	`conf`	Using Gradient Based Multikernel Gaussian Process and Meta-Acquisition Function to Accelerate SMBO. ICTAI Daning Cheng, Hanping Zhang, Fen Xia, Shigang Li, Yunquan Zhang
2019	—	`conf`	swMD: Performance Optimizations for Molecular Dynamics Simulation on Sunway Taihulight. ISPA/BDCloud/SocialCom/SustainCom Kun Li, Shigang Li, Bei Wang, Yifeng Chen, Yunquan Zhang
2018	B	`conf`	AGCM3D: A Highly Scalable Finite-Difference Dynamical Core of Atmospheric General Circulation Model Based on 3D Decomposition. ICPADS Baodong Wu, Shigang Li, Hang Cao, Yunquan Zhang, He Zhang, Junmin Xiao, Minghua Zhang
2018	J	`jnl`	Asynchronous Parallel Sampling Gradient Boosting Decision Tree. CoRR Daning Cheng, Fen Xia, Shigang Li, Yunquan Zhang
2018	J	`jnl`	Cache-Oblivious MPI All-to-All Communications Based on Morton Order. IEEE Trans. Parallel Distributed Syst. Shigang Li, Yunquan Zhang, Torsten Hoefler
2018	B	`conf`	Communication-Avoiding for Dynamical Core of Atmospheric General Circulation Model. ICPP Junmin Xiao, Shigang Li, Baodong Wu, He Zhang, Kun Li, Erlin Yao, Yunquan Zhang, Guangming Tan
2018	B	`conf`	Massively Scaling the Metal Microscopic Damage Simulation on Sunway TaihuLight Supercomputer. ICPP Shigang Li, Baodong Wu, Yunquan Zhang, Xianmeng Wang, Jianjiang Li, Changjun Hu, Jue Wang, Yangde Feng, Ningming Nie
2018	J	`jnl`	Using Known Information to Accelerate HyperParameters Optimization Based on SMBO. CoRR Daning Cheng, Hanping Zhang, Fen Xia, Shigang Li, Yunquan Zhang
2017	J	`jnl`	Asynchronous COMID: the theoretic basis for transmitted data sparsification tricks on Parameter Server. CoRR Daning Cheng, Shigang Li, Yunquan Zhang
2017	J	`jnl`	Hybrid-optimization strategy for the communication of large-scale Kinetic Monte Carlo simulation. Comput. Phys. Commun. Baodong Wu, Shigang Li, Yunquan Zhang, Ningming Nie
2017	J	`jnl`	Kernel optimization for short-range molecular dynamics. Comput. Phys. Commun. Changjun Hu, Xianmeng Wang, Jianjiang Li, Xinfu He, Shigang Li, Yangde Feng, Shaofeng Yang, He Bai
2017	B	`conf`	POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures. PPoPP Shigang Li, Yunquan Zhang, Torsten Hoefler
2017	J	`jnl`	Weighted parallel SGD for distributed unbalanced-workload training system. CoRR Daning Cheng, Shigang Li, Yunquan Zhang
2016	J	`jnl`	A Cross-Platform SpMV Framework on Many-Core Architectures. ACM Trans. Archit. Code Optim. Yunquan Zhang, Shigang Li, Shengen Yan, Huiyang Zhou
2016	J	`jnl`	Parallel Processing Systems for Big Data: A Survey. Proc. IEEE Yunquan Zhang, Ting Cao, Shigang Li, Xinhui Tian, Liang Yuan, Haipeng Jia, Athanasios V. Vasilakos
2015	B	`conf`	Analyzing MPI-3.0 Process-Level Shared Memory: A Case Study with Stencil Computations. CCGRID Xiaomin Zhu, Junchao Zhang, Kazutomo Yoshii, Shigang Li, Yunquan Zhang, Pavan Balaji
2015	J	`jnl`	Automatic tuning of sparse matrix-vector multiplication on multicore clusters. Sci. China Inf. Sci. Shigang Li, Changjun Hu, Junchao Zhang, Yunquan Zhang
2015	—	`conf`	Fast Convolution Operations on Many-Core Architectures. HPCC/CSS/ICESS Shigang Li, Yunquan Zhang, Chunyang Xiang, Lei Shi
2014	J	`jnl`	Improved MPI collectives for MPI processes in shared address spaces. Clust. Comput. Shigang Li, Torsten Hoefler, Chungjin Hu, Marc Snir
2013	C	`conf`	Asynchronous Work Stealing on Distributed Memory Systems. PDP Shigang Li, Jingyuan Hu, Xin Cheng, Chongchong Zhao
2013	A	`conf`	NUMA-aware shared-memory collective communication for MPI. HPDC Shigang Li, Torsten Hoefler, Marc Snir
2011	—	`conf`	Extending Synchronization Constructs in OpenMP to Exploit Pipeline Parallelism on Heterogeneous Multi-core. ICA3PP (2) Shigang Li, Shucai Yao, Haohu He, Lili Sun, Yi Chen, Yunfeng Peng
2011	Misc	`conf`	Management of Non-functional Attributes of Parallel Components. ICCS Yunfeng Peng, Changjun Hu, Chongchong Zhao, Shigang Li, Shucai Yao
2011	—	`conf`	Scheduling Multi-paradigm and Multi-grain Parallel Components on Heterogeneous Platforms. ChinaGrid Yunfeng Peng, Chongchong Zhao, Shucai Yao, Shigang Li, Yi Chen
2010	—	`conf`	Support for OpenMP Tasks on Cell Architecture. ICA3PP (2) Qian Cao, Changjun Hu, Haohu He, Xiang Huang, Shigang Li