Huan Li

34 papers A* 2C 2Journal 27Unranked 1
YearRankTypeTitle / Venue / Authors
2026 J jnl
Convergence Rate Analysis of the AdamW-Style Shampoo: Unifying One-sided and Two-Sided Preconditioning.
CoRR
Huan Li, Yiming Dong, Zhouchen Lin
2025 J jnl
Conda: Column-Normalized Adam for Training Large Language Models Faster.
CoRR
Junjie Wang, Pan Zhou, Yiming Dong, Huan Li, Jia Li, Xun Zhou, Qicheng Lao, Cong Fang, Zhouchen Lin
2025 J jnl
On the O(\frac{√d}}{K
CoRR
Huan Li, Yiming Dong, Zhouchen Lin
2025 J jnl
On the O(sqrt(d)/T^(1/4)) Convergence Rate of RMSProp and Its Momentum Extension Measured by l_1 Norm.
J. Mach. Learn. Res.
Huan Li, Yiming Dong, Zhouchen Lin
2024 J jnl
Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization.
J. Mach. Learn. Res.
Huan Li, Zhouchen Lin
2024 J jnl
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models.
IEEE Trans. Pattern Anal. Mach. Intell.
Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan
2024 J jnl
Convergence Rate Analysis of LION.
CoRR
Yiming Dong, Huan Li, Zhouchen Lin
2024 J jnl
On the O(×d/T
CoRR
Huan Li, Zhouchen Lin
2023 J jnl
Optimization-inspired manual architecture design and neural architecture search.
Sci. China Inf. Sci.
Yibo Yang, Zhengyang Shen, Huan Li, Zhouchen Lin
2023 J jnl
Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the in the O(epsilon^(-7/4)) Complexity.
J. Mach. Learn. Res.
Huan Li, Zhouchen Lin
2022 J jnl
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models.
CoRR
Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan
2022 — book
Alternating Direction Method of Multipliers for Machine Learning
Zhouchen Lin, Huan Li, Cong Fang
2022 A* conf
Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the O(ε
ICML
Huan Li, Zhouchen Lin
2022 J jnl
Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the O(ε
CoRR
Huan Li, Zhouchen Lin
2022 J jnl
Variance Reduced EXTRA and DIGing and Their Optimal Acceleration for Strongly Convex Decentralized Optimization.
J. Mach. Learn. Res.
Huan Li, Zhouchen Lin, Yongchun Fang
2021 J jnl
Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization.
CoRR
Huan Li, Zhouchen Lin
2020 J jnl
Accelerated First-Order Optimization Algorithms for Machine Learning.
Proc. IEEE
Huan Li, Cong Fang, Zhouchen Lin
2020 — book
Accelerated Optimization for Machine Learning - First-Order Algorithms
Zhouchen Lin, Huan Li, Cong Fang
2020 J jnl
Decentralized Accelerated Gradient Methods With Increasing Penalty Parameters.
IEEE Trans. Signal Process.
Huan Li, Cong Fang, Wotao Yin, Zhouchen Lin
2020 J jnl
On the Complexity Analysis of the Primal Solutions for the Accelerated Randomized Dual Coordinate Ascent.
J. Mach. Learn. Res.
Huan Li, Zhouchen Lin
2020 J jnl
Optimal Accelerated Variance Reduced EXTRA and DIGing for Strongly Convex and Smooth Decentralized Optimization.
CoRR
Huan Li, Zhouchen Lin, Yongchun Fang
2020 J jnl
Provable accelerated gradient method for nonconvex low rank optimization.
Mach. Learn.
Huan Li, Zhouchen Lin
2020 J jnl
Revisiting EXTRA for Smooth Distributed Optimization.
CoRR
Huan Li, Zhouchen Lin
2020 J jnl
Revisiting EXTRA for Smooth Distributed Optimization.
SIAM J. Optim.
Huan Li, Zhouchen Lin
2019 J jnl
Accelerated Alternating Direction Method of Multipliers: An Optimal O(1 / K) Nonergodic Analysis.
J. Sci. Comput.
Huan Li, Zhouchen Lin
2018 C conf
Construction of Incoherent Dictionaries via Direct Babel Function Minimization.
ACML
Huan Li, Zhouchen Lin
2018 C conf
Optimization Algorithm Inspired Deep Neural Network Structure Design.
ACML
Huan Li, Yibo Yang, Dongmin Chen, Zhouchen Lin
2018 J jnl
Optimization Algorithm Inspired Deep Neural Network Structure Design.
CoRR
Huan Li, Yibo Yang, Dongmin Chen, Zhouchen Lin
2018 J jnl
Optimized projections for compressed sensing via direct mutual coherence minimization.
Signal Process.
Canyi Lu, Huan Li, Zhouchen Lin
2016 A* conf
Fast Proximal Linearized Alternating Direction Method of Multiplier with Parallel Splitting.
AAAI
Canyi Lu, Huan Li, Zhouchen Lin, Shuicheng Yan
2015 — conf
Accelerated Proximal Gradient Methods for Nonconvex Programming.
NIPS
Huan Li, Zhouchen Lin
2015 J jnl
Fast Proximal Linearized Alternating Direction Method of Multiplier with Parallel Splitting.
CoRR
Canyi Lu, Huan Li, Zhouchen Lin, Shuicheng Yan
2015 J jnl
Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning.
Mach. Learn.
Zhouchen Lin, Risheng Liu, Huan Li
2015 J jnl
Optimized Projections for Compressed Sensing via Direct Mutual Coherence Minimization.
CoRR
Zhouchen Lin, Canyi Lu, Huan Li