Yichuan Deng

25 papers A* 2B 3Journal 19Unranked 1
YearRankTypeTitle / Venue / Authors
2025 A* conf
Discrepancy Minimization in Input-Sparsity Time.
ICML
Yichuan Deng, Xiaoyu Li, Zhao Song, Omri Weinstein
2025 J jnl
OpenThoughts: Data Recipes for Reasoning Models.
CoRR
Etash Kumar Guha, Ryan Marten, Sedrick Keh, Negin Raoof, Georgios Smyrnis, Hritik Bansal, Marianna Nezhurina, Jean Mercat, Trung Vu, Zayne Sprague, Ashima Suvarna, Benjamin Feuer, Liangyu Chen, Zaid Khan, Eric Frankel, Sachin Grover, Caroline Choi, Niklas Muennighoff, Shiye Su, Wanjia Zhao, John Yang, Shreyas Pimpalgaonkar, Kartik Sharma, Charlie Cheng-Jie Ji, Yichuan Deng, Sarah M. Pratt, Vivek Ramanujan, Jon Saad-Falcon, Jeffrey Li, Achal Dave, Alon Albalak, Kushal Arora, Blake Wulfe, Chinmay Hegde, Greg Durrett, Sewoong Oh, Mohit Bansal, Saadia Gabriel, Aditya Grover, Kai-Wei Chang, Vaishaal Shankar, Aaron Gokaslan, Mike A. Merrill, Tatsunori Hashimoto, Yejin Choi, Jenia Jitsev, Reinhard Heckel, Maheswaran Sathiamoorthy, Alexandros G. Dimakis, Ludwig Schmidt
2025 — conf
Streaming Kernel PCA Algorithm With Small Space.
CPAL
Yichuan Deng, Jiangxuan Long, Zhao Song, Zifan Wang, Han Zhang
2025 B conf
Why Softmax Attention Outperforms Linear Attention.
IEEE Big Data
Yichuan Deng, Zhao Song, Kaijun Yuan, Tianyi Zhou
2024 J jnl
Attention is Naturally Sparse with Gaussian Distributed Input.
CoRR
Yichuan Deng, Zhao Song, Chiwun Yang
2024 J jnl
Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence.
CoRR
Yichuan Deng, Zhao Song, Chiwun Yang
2024 B conf
Zero-th Order Algorithm for Softmax Attention Optimization.
IEEE Big Data
Yichuan Deng, Zhihang Li, Sridhar Mahadevan, Zhao Song
2023 J jnl
An Improved Sample Complexity for Rank-1 Matrix Sensing.
CoRR
Yichuan Deng, Zhihang Li, Zhao Song
2023 J jnl
Attention Scheme Inspired Softmax Regression.
CoRR
Yichuan Deng, Zhihang Li, Zhao Song
2023 J jnl
Clustered Linear Contextual Bandits with Knapsacks.
CoRR
Yichuan Deng, Michalis Mamakos, Zhao Song
2023 J jnl
Convergence of Two-Layer Regression with Nonlinear Units.
CoRR
Yichuan Deng, Zhao Song, Shenghao Xie
2023 J jnl
Efficient Algorithm for Solving Hyperbolic Programs.
CoRR
Yichuan Deng, Zhao Song, Lichen Zhang, Ruizhe Zhang
2023 J jnl
Faster Robust Tensor Power Method for Arbitrary Order.
CoRR
Yichuan Deng, Zhao Song, Junze Yin
2023 J jnl
Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension.
CoRR
Yichuan Deng, Sridhar Mahadevan, Zhao Song
2023 B conf
Solving Tensor Low Cycle Rank Approximation.
IEEE Big Data
Yichuan Deng, Yeqi Gao, Zhao Song
2023 J jnl
Solving Tensor Low Cycle Rank Approximation.
CoRR
Yichuan Deng, Yeqi Gao, Zhao Song
2023 J jnl
Streaming Kernel PCA Algorithm With Small Space.
CoRR
Yichuan Deng, Zhao Song, Zifan Wang, Han Zhang
2023 J jnl
Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention.
CoRR
Yichuan Deng, Zhao Song, Tianyi Zhou
2023 J jnl
Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights.
CoRR
Yichuan Deng, Zhao Song, Shenghao Xie, Chiwun Yang
2023 J jnl
Zero-th Order Algorithm for Softmax Attention Optimization.
CoRR
Yichuan Deng, Zhihang Li, Sridhar Mahadevan, Zhao Song
2022 J jnl
A Nearly Optimal Size Coreset Algorithm with Nearly Linear Time.
CoRR
Yichuan Deng, Zhao Song, Yitan Wang, Yuanyuan Yang
2022 J jnl
Discrepancy Minimization in Input-Sparsity Time.
CoRR
Yichuan Deng, Zhao Song, Omri Weinstein
2022 J jnl
Dynamic Kernel Sparsifiers.
CoRR
Yichuan Deng, Wenyu Jin, Zhao Song, Xiaorui Sun, Omri Weinstein
2022 A* conf
Fast Distance Oracles for Any Symmetric Norm.
NeurIPS
Yichuan Deng, Zhao Song, Omri Weinstein, Ruizhe Zhang
2022 J jnl
Fast Distance Oracles for Any Symmetric Norm.
CoRR
Yichuan Deng, Zhao Song, Omri Weinstein, Ruizhe Zhang