Druv Pai

29 papers A* 7Journal 20Unranked 2
YearRankTypeTitle / Venue / Authors
2025 A* conf
Attention-Only Transformers via Unrolled Subspace Denoising.
ICML
Peng Wang, Yifu Lu, Yaodong Yu, Druv Pai, Qing Qu, Yi Ma
2025 J jnl
Attention-Only Transformers via Unrolled Subspace Denoising.
CoRR
Peng Wang, Yifu Lu, Yaodong Yu, Druv Pai, Qing Qu, Yi Ma
2025 J jnl
Independent and Decentralized Learning in Markov Potential Games.
IEEE Trans. Autom. Control.
Chinmay Maheshwari, Manxi Wu, Druv Pai, Shankar Sastry
2025 J jnl
On the Edge of Memorization in Diffusion Models.
CoRR
Sam Buchanan, Druv Pai, Yi Ma, Valentin De Bortoli
2025 A* conf
Simplifying DINO via Coding Rate Regularization.
ICML
Ziyang Wu, Jingyuan Zhang, Druv Pai, Xudong Wang, Chandan Singh, Jianwei Yang, Jianfeng Gao, Yi Ma
2025 J jnl
Simplifying DINO via Coding Rate Regularization.
CoRR
Ziyang Wu, Jingyuan Zhang, Druv Pai, Xudong Wang, Chandan Singh, Jianwei Yang, Jianfeng Gao, Yi Ma
2025 A* conf
Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction.
ICLR
Ziyang Wu, Tianjiao Ding, Yifu Lu, Druv Pai, Jingyuan Zhang, Weida Wang, Yaodong Yu, Yi Ma, Benjamin David Haeffele
2024 A* conf
A Global Geometric Analysis of Maximal Coding Rate Reduction.
ICML
Peng Wang, Huikang Liu, Druv Pai, Yaodong Yu, Zhihui Zhu, Qing Qu, Yi Ma
2024 J jnl
A Global Geometric Analysis of Maximal Coding Rate Reduction.
CoRR
Peng Wang, Huikang Liu, Druv Pai, Yaodong Yu, Zhihui Zhu, Qing Qu, Yi Ma
2024 J jnl
Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs.
CoRR
Tianyu Guo, Druv Pai, Yu Bai, Jiantao Jiao, Michael I. Jordan, Song Mei
2024 — conf
Closed-Loop Transcription via Convolutional Sparse Coding.
CPAL
Xili Dai, Ke Chen, Shengbang Tong, Jingyuan Zhang, Xingjian Gao, Mingyang Li, Druv Pai, Yuexiang Zhai, Xiaojun Yuan, Heung-Yeung Shum, Lionel M. Ni, Yi Ma
2024 J jnl
Congestion Pricing for Efficiency and Equity: Theory and Applications to the San Francisco Bay Area.
CoRR
Chinmay Maheshwari, Kshitij Kulkarni, Druv Pai, Jiarui Yang, Manxi Wu, Shankar Sastry
2024 — conf
Emergence of Segmentation with Minimalistic White-Box Transformers.
CPAL
Yaodong Yu, Tianzhe Chu, Shengbang Tong, Ziyang Wu, Druv Pai, Sam Buchanan, Yi Ma
2024 A* conf
Masked Completion via Structured Diffusion with White-Box Transformers.
ICLR
Druv Pai, Sam Buchanan, Ziyang Wu, Yaodong Yu, Yi Ma
2024 J jnl
Masked Completion via Structured Diffusion with White-Box Transformers.
CoRR
Druv Pai, Ziyang Wu, Sam Buchanan, Yaodong Yu, Yi Ma
2024 J jnl
Representation Learning via Manifold Flattening and Reconstruction.
J. Mach. Learn. Res.
Michael Psenka, Druv Pai, Vishal Raman, Shankar Sastry, Yi Ma
2024 A* conf
Scaling White-Box Transformers for Vision.
NeurIPS
Jinrui Yang, Xianhang Li, Druv Pai, Yuyin Zhou, Yi Ma, Yaodong Yu, Cihang Xie
2024 J jnl
Scaling White-Box Transformers for Vision.
CoRR
Jinrui Yang, Xianhang Li, Druv Pai, Yuyin Zhou, Yi Ma, Yaodong Yu, Cihang Xie
2024 J jnl
Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction.
CoRR
Ziyang Wu, Tianjiao Ding, Yifu Lu, Druv Pai, Jingyuan Zhang, Weida Wang, Yaodong Yu, Yi Ma, Benjamin D. Haeffele
2024 J jnl
White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
J. Mach. Learn. Res.
Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Hao Bai, Yuexiang Zhai, Benjamin D. Haeffele, Yi Ma
2023 J jnl
Closed-Loop Transcription via Convolutional Sparse Coding.
CoRR
Xili Dai, Ke Chen, Shengbang Tong, Jingyuan Zhang, Xingjian Gao, Mingyang Li, Druv Pai, Yuexiang Zhai, Xiaojun Yuan, Heung-Yeung Shum, Lionel M. Ni, Yi Ma
2023 J jnl
Emergence of Segmentation with Minimalistic White-Box Transformers.
CoRR
Yaodong Yu, Tianzhe Chu, Shengbang Tong, Ziyang Wu, Druv Pai, Sam Buchanan, Yi Ma
2023 J jnl
Pursuit of a discriminative representation for multiple subspaces via sequential games.
J. Frankl. Inst.
Druv Pai, Michael Psenka, Chih-Yuan Chiu, Manxi Wu, Edgar Dobriban, Yi Ma
2023 J jnl
Representation Learning via Manifold Flattening and Reconstruction.
CoRR
Michael Psenka, Druv Pai, Vishal Raman, Shankar Sastry, Yi Ma
2023 A* conf
White-Box Transformers via Sparse Rate Reduction.
NeurIPS
Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Benjamin D. Haeffele, Yi Ma
2023 J jnl
White-Box Transformers via Sparse Rate Reduction.
CoRR
Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Benjamin D. Haeffele, Yi Ma
2023 J jnl
White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
CoRR
Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Hao Bai, Yuexiang Zhai, Benjamin D. Haeffele, Yi Ma
2022 J jnl
Independent and Decentralized Learning in Markov Potential Games.
CoRR
Chinmay Maheshwari, Manxi Wu, Druv Pai, Shankar Sastry
2022 J jnl
Pursuit of a Discriminative Representation for Multiple Subspaces via Sequential Games.
CoRR
Druv Pai, Michael Psenka, Chih-Yuan Chiu, Manxi Wu, Edgar Dobriban, Yi Ma