Xiaoge Deng

25 papers A* 3A 1C 1Misc 2Journal 17Unranked 1
YearRankTypeTitle / Venue / Authors
2025 J jnl
BHerd: Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients.
IEEE Trans. Computers
Ping Luo, Xiaoge Deng, Ziqing Wen, Tao Sun, Dongsheng Li
2025 J jnl
Breaking Memory Limits: Gradient Wavelet Transform Enhances LLMs Training.
CoRR
Ziqing Wen, Ping Luo, Jiahuan Wang, Xiaoge Deng, Jinping Zou, Kun Yuan, Tao Sun, Dongsheng Li
2025 J jnl
Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient.
IEEE Trans. Big Data
Xiaoge Deng, Dongsheng Li, Tao Sun, Xicheng Lu
2025 J jnl
Oases: Efficient Large-Scale Model Training on Commodity Servers via Overlapped and Automated Tensor Model Parallelism.
IEEE Trans. Parallel Distributed Syst.
Shengwei Li, Zhiquan Lai, Dongsheng Li, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Kai Lu
2025 Misc conf
Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks.
ICASSP
Jinping Zou, Xiaoge Deng, Tao Sun
2025 J jnl
Toward Understanding the Generalizability of Delayed Stochastic Gradient Descent.
IEEE Trans. Pattern Anal. Mach. Intell.
Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao
2024 J jnl
Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients.
CoRR
Ping Luo, Xiaoge Deng, Ziqing Wen, Tao Sun, Dongsheng Li
2024 J jnl
Decentralized stochastic sharpness-aware minimization algorithm.
Neural Networks
Simiao Chen, Xiaoge Deng, Dongpo Xu, Tao Sun, Dongsheng Li
2024 A* conf
Exploring the Inefficiency of Heavy Ball as Momentum Parameter Approaches 1.
IJCAI
Xiaoge Deng, Tao Sun, Dongsheng Li, Xicheng Lu
2024 J jnl
Federated Prediction-Powered Inference from Decentralized Data.
CoRR
Ping Luo, Xiaoge Deng, Ziqing Wen, Tao Sun, Dongsheng Li
2024 J jnl
Score-based Generative Models with Adaptive Momentum.
CoRR
Ziqing Wen, Xiaoge Deng, Ping Luo, Tao Sun, Dongsheng Li
2024 J jnl
Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks.
CoRR
Jinping Zou, Xiaoge Deng, Tao Sun
2024 A* conf
Stability and Generalization of Asynchronous SGD: Sharper Bounds Beyond Lipschitz and Smoothness.
NeurIPS
Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li, Xicheng Lu
2023 J jnl
Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training.
CoRR
Shengwei Li, Zhiquan Lai, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Dongsheng Li, Kai Lu
2023 J jnl
Compressed Collective Sparse-Sketch for Distributed Data-Parallel Training of Deep Learning Models.
IEEE J. Sel. Areas Commun.
Keshi Ge, Kai Lu, Yongquan Fu, Xiaoge Deng, Zhiquan Lai, Dongsheng Li
2023 A conf
Normalized Stochastic Heavy Ball with Adaptive Momentum.
ECAI
Ziqing Wen, Xiaoge Deng, Tao Sun, Dongsheng Li
2023 A* conf
Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD.
AAAI
Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li
2023 J jnl
Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent.
CoRR
Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao
2022 Misc conf
S2 Reducer: High-Performance Sparse Communication to Accelerate Distributed Deep Learning.
ICASSP
Keshi Ge, Yongquan Fu, Yiming Zhang, Zhiquan Lai, Xiaoge Deng, Dongsheng Li
2021 C conf
CASQ: Accelerate Distributed Deep Learning with Sketch-Based Gradient Quantization.
CLUSTER
Keshi Ge, Yiming Zhang, Yongquan Fu, Zhiquan Lai, Xiaoge Deng, Dongsheng Li
2021 J jnl
S2 Reducer: High-Performance Sparse Communication to Accelerate Distributed Deep Learning.
CoRR
Keshi Ge, Yongquan Fu, Zhiquan Lai, Xiaoge Deng, Dongsheng Li
2021 J jnl
SASG: Sparsification with Adaptive Stochastic Gradients for Communication-efficient Distributed Learning.
CoRR
Xiaoge Deng, Tao Sun, Dongsheng Li
2020 J jnl
A Nonconvex Implementation of Sparse Subspace Clustering: Algorithm and Convergence Analysis.
IEEE Access
Xiaoge Deng, Tao Sun, Peibing Du, Dongsheng Li
2020 J jnl
Linear Convergence Rate of Splitting Algorithms for Multi-Block Constrained Convex Minimizations.
IEEE Access
Xiaoge Deng, Feng Liu, Feng Huang
2020 — conf
PRIAG: Proximal Reweighted Incremental Aggregated Gradient Algorithm for Distributed Optimizations.
ICA3PP (1)
Xiaoge Deng, Tao Sun, Feng Liu, Feng Huang