Shengwei Li

36 papers A* 2A 1B 2C 11Misc 1Journal 17Unranked 2
YearRankTypeTitle / Venue / Authors
2026 A conf
AdaCheck: An Adaptive Checkpointing System for Efficient LLM Training with Redundancy Utilization.
FAST
Weijie Liu, Shengwei Li, Zhiquan Lai, Keshi Ge, Qiaoling Chen, Peng Sun, Dongsheng Li, Kai Lu
2026 J jnl
Pro-Prophet: A Systematic Load Balancing Method for Efficient Parallel Training of Large-Scale MoE Models.
IEEE Trans. Parallel Distributed Syst.
Wei Wang, Zhiquan Lai, Dongsheng Li, Shengwei Li, Weijie Liu, Keshi Ge, Ao Shen, Huayou Su
2025 J jnl
An Efficient Sequential Decentralized Federated Progressive Channel Pruning Strategy for Smart Grid Electricity Theft Detection.
IEEE Trans. Ind. Informatics
Fanghong Guo, Shengwei Li, Hao Yang, Chen Dong, Yifang Chen, Guoqi Li
2025 J jnl
AutoPipe-H: A Heterogeneity-Aware Data-Paralleled Pipeline Approach on Commodity GPU Servers.
IEEE Trans. Computers
Weijie Liu, Kai Lu, Zhiquan Lai, Shengwei Li, Keshi Ge, Dongsheng Li, Xicheng Lu
2025 C conf
Capricorn: Efficient In-Memory Checkpointing for MoE Model Training with Dynamicity Awareness.
CLUSTER
Wenqian Xie, Zhiquan Lai, Shengwei Li, Weijie Liu, Wei Wang, Yanqi Hao, Dongsheng Li
2025 J jnl
Efficient deep neural network training via decreasing precision with layer capacity.
Frontiers Comput. Sci.
Ao Shen, Zhiquan Lai, Tao Sun, Shengwei Li, Keshi Ge, Weijie Liu, Dongsheng Li
2025 J jnl
H2:Towards Efficient Large-Scale LLM Training on Hyper-Heterogeneous Cluster over 1,000 Chips.
CoRR
Ding Tang, Jiecheng Zhou, Jiakai Hu, Shengwei Li, Huihuang Zheng, Zhilin Pei, Hui Wang, Xingcheng Zhang
2025 J jnl
Internal Short-Circuit Fault Diagnosis for Batteries of Energy Storage Stations Based on Multivariate Multiscale Sample Entropy.
IEEE Trans. Ind. Electron.
Chao Li, Kaidi Zeng, Bin Li, Guanzheng Li, He Yang, Shengwei Li
2025 J jnl
Oases: Efficient Large-Scale Model Training on Commodity Servers via Overlapped and Automated Tensor Model Parallelism.
IEEE Trans. Parallel Distributed Syst.
Shengwei Li, Zhiquan Lai, Dongsheng Li, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Kai Lu
2025 J jnl
Real-Time Modeling Method for Large-Scale Photovoltaic Power Stations Using Nested Fast and Simultaneous Solution.
IEEE Trans. Ind. Electron.
Shiwei Xia, Jianzhong Xu, Linhong Guo, Shengwei Li, Haiping Guo
2025 J jnl
Toward Understanding the Generalizability of Delayed Stochastic Gradient Descent.
IEEE Trans. Pattern Anal. Mach. Intell.
Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao
2024 J jnl
A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training.
IEEE Trans. Parallel Distributed Syst.
Dongsheng Li, Shengwei Li, Zhiquan Lai, Yongquan Fu, Xiangyu Ye, Lei Cai, Linbo Qiao
2024 J jnl
A Multidimensional Communication Scheduling Method for Hybrid Parallel DNN Training.
IEEE Trans. Parallel Distributed Syst.
Shengwei Li, Kai Lu, Zhiquan Lai, Weijie Liu, Keshi Ge, Dong Sheng Li
2024 — conf
Coordinated Multi-regional Logistics Path Planning: A Broad Reinforcement Learning Framework.
ICA3PP (2)
Shengwei Li, Congcong Zhu, Zeping Tong
2024 C conf
End-To-End Control of a Quadrotor Using Gaussian Ensemble Model-Based Reinforcement Learning.
ICIS
Qiwen Zheng, Qingyuan Xia, Haonan Luo, Bohai Deng, Shengwei Li
2024 C conf
HSDP: Accelerating Large-scale Model Training via Efficient Sharded Data Parallelism.
ISPA
Yanqi Hao, Zhiquan Lai, Wei Wang, Shengwei Li, Weijie Liu, Keshi Ge, Dongsheng Li
2024 J jnl
Pro-Prophet: A Systematic Load Balancing Method for Efficient Parallel Training of Large-scale MoE Models.
CoRR
Wei Wang, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Ao Shen, Huayou Su, Dong Sheng Li
2024 A* conf
Stability and Generalization of Asynchronous SGD: Sharper Bounds Beyond Lipschitz and Smoothness.
NeurIPS
Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li, Xicheng Lu
2023 J jnl
Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training.
CoRR
Shengwei Li, Zhiquan Lai, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Dongsheng Li, Kai Lu
2023 — conf
Communication Analysis for Multidimensional Parallel Training of Large-scale DNN Models.
HPCC/DSS/SmartCity/DependSys
Zhiquan Lai, Yanqi Hao, Shengwei Li, Dongsheng Li
2023 C conf
Improved Accuracy of XCO2 Retrieval Based on OCO-2 Rtretrieval Framework Model.
IGARSS
Tao Yuan, Yong Xue, Liang Zhao, Chunlin Jin, Shengwei Li, Pei Li
2023 C conf
Keyword Spotting Based on CTC and Similarity Matching for Chinese Speech.
ICIS
Shengwei Li, Huajun Zhang
2023 J jnl
Merak: An Efficient Distributed DNN Training Framework With Automated 3D Parallelism for Giant Foundation Models.
IEEE Trans. Parallel Distributed Syst.
Zhiquan Lai, Shengwei Li, Xudong Tang, Keshi Ge, Weijie Liu, Yabo Duan, Linbo Qiao, Dongsheng Li
2023 C conf
Monitoring of Xch4 Changes and Anomaly in Hebei Province, China Based on Tropomi.
IGARSS
Botao He, Yong Xue, Xi Lu, Chunlin Jin, Shengwei Li, Wenhao Liu, Peng Wang, Xiangkai Wang, Pei Li
2023 C conf
Observing Anthropogenic CO2 Emissions with TanSat in Northeast China.
IGARSS
Chunlin Jin, Yong Xue, Tao Yuan, Shengwei Li, Botao He, Liang Zhao
2023 C conf
Prophet: Fine-grained Load Balancing for Parallel Training of Large-scale MoE Models.
CLUSTER
Wei Wang, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Yujie Liu, Ao Shen, Dongsheng Li
2023 A* conf
Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD.
AAAI
Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li
2023 J jnl
Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent.
CoRR
Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao
2022 C conf
AutoPipe: A Fast Pipeline Parallelism Approach with Balanced Partitioning and Micro-batch Slicing.
CLUSTER
Weijie Liu, Zhiquan Lai, Shengwei Li, Yabo Duan, Keshi Ge, Dongsheng Li
2022 B conf
EmbRace: Accelerating Sparse Communication for Distributed Training of Deep Neural Networks.
ICPP
Shengwei Li, Zhiquan Lai, Dongsheng Li, Yiming Zhang, Xiangyu Ye, Yabo Duan
2022 C conf
HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training.
CLUSTER
Yabo Duan, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Peng Liang, Dongsheng Li
2022 J jnl
Merak: An Efficient Distributed DNN Training Framework with Automated 3D Parallelism for Giant Foundation Models.
CoRR
Zhiquan Lai, Shengwei Li, Xudong Tang, Keshi Ge, Weijie Liu, Yabo Duan, Linbo Qiao, Dongsheng Li
2021 C conf
2PGraph: Accelerating GNN Training over Large Graphs on GPU Clusters.
CLUSTER
Lizhi Zhang, Zhiquan Lai, Shengwei Li, Yu Tang, Feng Liu, Dongsheng Li
2021 J jnl
EmbRace: Accelerating Sparse Communication for Distributed Training of NLP Neural Networks.
CoRR
Shengwei Li, Zhiquan Lai, Dongsheng Li, Xiangyu Ye, Yabo Duan
2021 B conf
Hippie: A Data-Paralleled Pipeline Approach to Improve Memory-Efficiency and Scalability for Large DNN Training.
ICPP
Xiangyu Ye, Zhiquan Lai, Shengwei Li, Lei Cai, Ding Sun, Linbo Qiao, Dongsheng Li
2009 Misc conf
Mining closed frequent itemset based on FP-Tree.
GrC
Shengwei Li, Lingsheng Li, Chong Han