Zhenyu Zhang - RankMe

70 papers A* 29Misc 1Journal 35Unranked 5

Year	Rank	Type	Title / Venue / Authors
2025	—	`conf`	APOLLO: SGD-like Memory, AdamW-level Performance. MLSys Hanqing Zhu, Zhenyu Zhang, Wenyan Cong, Xi Liu, Sem Park, Vikas Chandra, Bo Long, David Z. Pan, Zhangyang Wang, Jinwon Lee
2025	J	`jnl`	Fantastic Reasoning Behaviors and Where to Find Them: Unsupervised Discovery of the Reasoning Process. CoRR Zhenyu Zhang, Shujian Zhang, John Lambert, Wenxuan Zhou, Zhangyang Wang, Mingqing Chen, Andrew Hard, Rajiv Mathews, Lun Wang
2025	J	`jnl`	LLMs Can Get "Brain Rot"! CoRR Shuo Xing, Junyuan Hong, Yifan Wang, Runjin Chen, Zhenyu Zhang, Ananth Grama, Zhengzhong Tu, Zhangyang Wang
2025	A*	`conf`	Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More. ICML Xialie Zhuang, Zhikai Jia, Jianjin Li, Zhenyu Zhang, Li Shen, Zheng Cao, Shiwei Liu
2025	J	`jnl`	Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More. CoRR Xialie Zhuang, Zhikai Jia, Jianjin Li, Zhenyu Zhang, Li Shen, Zheng Cao, Shiwei Liu
2025	A*	`conf`	On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving. ICML Yeonju Ro, Zhenyu Zhang, Souvik Kundu, Zhangyang Wang, Aditya Akella
2025	J	`jnl`	On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention. CoRR Yeonju Ro, Zhenyu Zhang, Souvik Kundu, Zhangyang Wang, Aditya Akella
2025	—	`conf`	Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients. CPAL Zhenyu Zhang, Ajay Kumar Jaiswal, Lu Yin, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
2025	A*	`conf`	R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference. ICLR Zhenyu Zhang, Zechun Liu, Yuandong Tian, Harshit Khaitan, Zhangyang Wang, Steven Li
2025	J	`jnl`	R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference. CoRR Zhenyu Zhang, Zechun Liu, Yuandong Tian, Harshit Khaitan, Zhangyang Wang, Steven Li
2025	J	`jnl`	SEAL: Steerable Reasoning Calibration of Large Language Models for Free. CoRR Runjin Chen, Zhenyu Zhang, Junyuan Hong, Souvik Kundu, Zhangyang Wang
2025	J	`jnl`	Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam. CoRR Tianjin Huang, Haotian Hu, Zhenyu Zhang, Gaojie Jin, Xiang Li, Li Shen, Tianlong Chen, Lu Liu, Qingsong Wen, Zhangyang Wang, Shiwei Liu
2025	J	`jnl`	The Path Not Taken: RLVR Provably Learns Off the Principals. CoRR Hanqing Zhu, Zhenyu Zhang, Hanxian Huang, DiJia Su, Zechun Liu, Jiawei Zhao, Igor Fedorov, Hamed Pirsiavash, Zhizhou Sha, Jinwon Lee, David Z. Pan, Zhangyang Wang, Yuandong Tian, Kai Sheng Tai
2024	J	`jnl`	APOLLO: SGD-like Memory, AdamW-level Performance. CoRR Hanqing Zhu, Zhenyu Zhang, Wenyan Cong, Xi Liu, Sem Park, Vikas Chandra, Bo Long, David Z. Pan, Zhangyang Wang, Jinwon Lee
2024	A*	`conf`	CaM: Cache Merging for Memory-efficient LLMs Inference. ICML Yuxin Zhang, Yuxuan Du, Gen Luo, Yunshan Zhong, Zhenyu Zhang, Shiwei Liu, Rongrong Ji
2024	A*	`conf`	Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding. NeurIPS Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang
2024	J	`jnl`	Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding. CoRR Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang
2024	J	`jnl`	From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. CoRR Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
2024	A*	`conf`	GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection. ICML Jiawei Zhao, Zhenyu Zhang, Beidi Chen, Zhangyang Wang, Anima Anandkumar, Yuandong Tian
2024	J	`jnl`	GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection. CoRR Jiawei Zhao, Zhenyu Zhang, Beidi Chen, Zhangyang Wang, Anima Anandkumar, Yuandong Tian
2024	A*	`conf`	Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference. ICML Harry Dong, Xinyu Yang, Zhenyu Zhang, Zhangyang Wang, Yuejie Chi, Beidi Chen
2024	J	`jnl`	Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference. CoRR Harry Dong, Xinyu Yang, Zhenyu Zhang, Zhangyang Wang, Yuejie Chi, Beidi Chen
2024	A*	`conf`	JoMA: Demystifying Multilayer Transformers via Joint Dynamics of MLP and Attention. ICLR Yuandong Tian, Yiping Wang, Zhenyu Zhang, Beidi Chen, Simon Shaolei Du
2024	A*	`conf`	Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy. ICLR Pingzhi Li, Zhenyu Zhang, Prateek Yadav, Yi-Lin Sung, Yu Cheng, Mohit Bansal, Tianlong Chen
2024	A*	`conf`	Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity. ICML Lu Yin, You Wu, Zhenyu Zhang, Cheng-Yu Hsieh, Yaqing Wang, Yiling Jia, Gen Li, Ajay Kumar Jaiswal, Mykola Pechenizkiy, Yi Liang, Michael Bendersky, Zhangyang Wang, Shiwei Liu
2024	J	`jnl`	Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients. CoRR Zhenyu Zhang, Ajay Jaiswal, Lu Yin, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
2024	—	`conf`	Q-Hitter: A Better Token Oracle for Efficient LLM Inference via Sparse-Quantized KV Cache. MLSys Zhenyu Zhang, Shiwei Liu, Runjin Chen, Bhavya Kailkhura, Beidi Chen, Atlas Wang
2024	J	`jnl`	QuantumSEA: In-Time Sparse Exploration for Noise Adaptive Quantum Circuits. CoRR Tianlong Chen, Zhenyu Zhang, Hanrui Wang, Jiaqi Gu, Zirui Li, David Z. Pan, Frederic T. Chong, Song Han, Zhangyang Wang
2024	A*	`conf`	Sparse Cocktail: Every Sparse Pattern Every Sparse Ratio All At Once. ICML Zhangheng Li, Shiwei Liu, Tianlong Chen, Ajay Kumar Jaiswal, Zhenyu Zhang, Dilin Wang, Raghuraman Krishnamoorthi, Shiyu Chang, Zhangyang Wang
2024	A*	`conf`	Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention. AAAI Zhen Tan, Tianlong Chen, Zhenyu Zhang, Huan Liu
2023	—	`conf`	Accelerable Lottery Tickets with the Mixed-Precision Quantization. CVPR Workshops Zhangheng Li, Yu Gong, Zhenyu Zhang, Xingyun Xue, Tianlong Chen, Yi Liang, Bo Yuan, Zhangyang Wang
2023	A*	`conf`	Are Large Kernels Better Teachers than Transformers for ConvNets? ICML Tianjin Huang, Lu Yin, Zhenyu Zhang, Li Shen, Meng Fang, Mykola Pechenizkiy, Zhangyang Wang, Shiwei Liu
2023	J	`jnl`	Are Large Kernels Better Teachers than Transformers for ConvNets? CoRR Tianjin Huang, Lu Yin, Zhenyu Zhang, Li Shen, Meng Fang, Mykola Pechenizkiy, Zhangyang Wang, Shiwei Liu
2023	J	`jnl`	H CoRR Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen
2023	A*	`conf`	H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models. NeurIPS Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen
2023	J	`jnl`	JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention. CoRR Yuandong Tian, Yiping Wang, Zhenyu Zhang, Beidi Chen, Simon S. Du
2023	J	`jnl`	Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy. CoRR Pingzhi Li, Zhenyu Zhang, Prateek Yadav, Yi-Lin Sung, Yu Cheng, Mohit Bansal, Tianlong Chen
2023	J	`jnl`	Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity. CoRR Lu Yin, You Wu, Zhenyu Zhang, Cheng-Yu Hsieh, Yaqing Wang, Yiling Jia, Mykola Pechenizkiy, Yi Liang, Zhangyang Wang, Shiwei Liu
2023	Misc	`conf`	QuantumSEA: In-Time Sparse Exploration for Noise Adaptive Quantum Circuits. QCE Tianlong Chen, Zhenyu Zhang, Hanrui Wang, Jiaqi Gu, Zirui Li, David Z. Pan, Frederic T. Chong, Song Han, Zhangyang Wang
2023	A*	`conf`	Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights? ICML Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
2023	J	`jnl`	Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights? CoRR Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
2023	A*	`conf`	Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers. ICLR Tianlong Chen, Zhenyu Zhang, Ajay Kumar Jaiswal, Shiwei Liu, Zhangyang Wang
2023	J	`jnl`	Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers. CoRR Tianlong Chen, Zhenyu Zhang, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang
2023	A*	`conf`	Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! ICLR Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, Ajay Kumar Jaiswal, Zhangyang Wang
2023	J	`jnl`	Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! CoRR Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, Ajay Jaiswal, Zhangyang Wang
2023	J	`jnl`	Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention. CoRR Zhen Tan, Tianlong Chen, Zhenyu Zhang, Huan Liu
2022	J	`jnl`	Can You Win Everything with A Lottery Ticket? Trans. Mach. Learn. Res. Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangyang Wang
2022	A*	`conf`	Data-Efficient Double-Win Lottery Tickets from Robust Pre-training. ICML Tianlong Chen, Zhenyu Zhang, Sijia Liu, Yang Zhang, Shiyu Chang, Zhangyang Wang
2022	J	`jnl`	Data-Efficient Double-Win Lottery Tickets from Robust Pre-training. CoRR Tianlong Chen, Zhenyu Zhang, Sijia Liu, Yang Zhang, Shiyu Chang, Zhangyang Wang
2022	A*	`conf`	Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness. ICML Tianlong Chen, Huan Zhang, Zhenyu Zhang, Shiyu Chang, Sijia Liu, Pin-Yu Chen, Zhangyang Wang
2022	J	`jnl`	Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness. CoRR Tianlong Chen, Huan Zhang, Zhenyu Zhang, Shiyu Chang, Sijia Liu, Pin-Yu Chen, Zhangyang Wang
2022	J	`jnl`	QuanGCN: Noise-Adaptive Training for Robust Quantum Graph Convolutional Networks. CoRR Kaixiong Zhou, Zhenyu Zhang, Shengyuan Chen, Tianlong Chen, Xiao Huang, Zhangyang Wang, Xia Hu
2022	A*	`conf`	Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free. CVPR Tianlong Chen, Zhenyu Zhang, Yihua Zhang, Shiyu Chang, Sijia Liu, Zhangyang Wang
2022	J	`jnl`	Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free. CoRR Tianlong Chen, Zhenyu Zhang, Yihua Zhang, Shiyu Chang, Sijia Liu, Zhangyang Wang
2022	A*	`conf`	Randomized Channel Shuffling: Minimal-Overhead Backdoor Attack Detection without Clean Datasets. NeurIPS Ruisi Cai, Zhenyu Zhang, Tianlong Chen, Xiaohan Chen, Zhangyang Wang
2022	A*	`conf`	Sparse Winning Tickets are Data-Efficient Image Recognizers. NeurIPS Mukund Varma T., Xuxi Chen, Zhenyu Zhang, Tianlong Chen, Subhashini Venugopalan, Zhangyang Wang
2022	A*	`conf`	Sparsity Winning Twice: Better Robust Generalization from More Efficient Training. ICLR Tianlong Chen, Zhenyu Zhang, Pengjun Wang, Santosh Balachandra, Haoyu Ma, Zehao Wang, Zhangyang Wang
2022	J	`jnl`	Sparsity Winning Twice: Better Robust Generalization from More Efficient Training. CoRR Tianlong Chen, Zhenyu Zhang, Pengjun Wang, Santosh Balachandra, Haoyu Ma, Zehao Wang, Zhangyang Wang
2022	A*	`conf`	The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy. CVPR Tianlong Chen, Zhenyu Zhang, Yu Cheng, Ahmed Awadallah, Zhangyang Wang
2022	J	`jnl`	The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy. CoRR Tianlong Chen, Zhenyu Zhang, Yu Cheng, Ahmed Awadallah, Zhangyang Wang
2021	—	`conf`	"BNN - BN = ?": Training Binary Neural Networks Without Batch Normalization. CVPR Workshops Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
2021	J	`jnl`	"BNN - BN = ?": Training Binary Neural Networks without Batch Normalization. CoRR Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
2021	A*	`conf`	Efficient Lottery Ticket Finding: Less Data is More. ICML Zhenyu Zhang, Xuxi Chen, Tianlong Chen, Zhangyang Wang
2021	J	`jnl`	Efficient Lottery Ticket Finding: Less Data is More. CoRR Zhenyu Zhang, Xuxi Chen, Tianlong Chen, Zhangyang Wang
2021	A*	`conf`	GANs Can Play Lottery Tickets Too. ICLR Xuxi Chen, Zhenyu Zhang, Yongduo Sui, Tianlong Chen
2021	J	`jnl`	GANs Can Play Lottery Tickets Too. CoRR Xuxi Chen, Zhenyu Zhang, Yongduo Sui, Tianlong Chen
2021	A*	`conf`	Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning. ICLR Tianlong Chen, Zhenyu Zhang, Sijia Liu, Shiyu Chang, Zhangyang Wang
2021	A*	`conf`	Robust Overfitting may be mitigated by properly learned smoothening. ICLR Tianlong Chen, Zhenyu Zhang, Sijia Liu, Shiyu Chang, Zhangyang Wang
2021	A*	`conf`	You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership. NeurIPS Xuxi Chen, Tianlong Chen, Zhenyu Zhang, Zhangyang Wang
2021	J	`jnl`	You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership. CoRR Xuxi Chen, Tianlong Chen, Zhenyu Zhang, Zhangyang Wang