Sai Surya Duvvuri

14 papers A* 5Misc 1Journal 8
YearRankTypeTitle / Venue / Authors
2026 J jnl
Interleaved Head Attention.
CoRR
Sai Surya Duvvuri, Chanakya Ekbote, Rachit Bansal, Rishabh Tiwari, Devvrit Khatri, David Brandfonbrener, Paul Pu Liang, Inderjit S. Dhillon, Manzil Zaheer
2026 J jnl
LUCID: Attention with Preconditioned Representations.
CoRR
Sai Surya Duvvuri, Nirmal Patel, Nilesh Gupta, Inderjit S. Dhillon
2025 J jnl
Fast and Simplex: 2-Simplicial Attention in Triton.
CoRR
Aurko Roy, Timothy Chou, Sai Surya Duvvuri, Sijia Chen, Jiecao Yu, Xiaodong Wang, Manzil Zaheer, Rohan Anil
2025 A* conf
LASER: Attention with Exponential Transformation.
ICML
Sai Surya Duvvuri, Inderjit S. Dhillon
2025 J jnl
Let's (not) just put things in Context: Test-Time Training for Long-Context LLMs.
CoRR
Rachit Bansal, Aston Zhang, Rishabh Tiwari, Lovish Madaan, Sai Surya Duvvuri, Devvrit Khatri, David Brandfonbrener, David Alvarez-Melis, Prajjwal Bhargava, Mihir Sanjay Kale, Samy Jelassi
2025 A* conf
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization.
ICLR
Jui-Nan Yen, Si Si, Zhao Meng, Felix X. Yu, Sai Surya Duvvuri, Inderjit S. Dhillon, Cho-Jui Hsieh, Sanjiv Kumar
2025 J jnl
The Art of Scaling Reinforcement Learning Compute for LLMs.
CoRR
Devvrit Khatri, Lovish Madaan, Rishabh Tiwari, Rachit Bansal, Sai Surya Duvvuri, Manzil Zaheer, Inderjit S. Dhillon, David Brandfonbrener, Rishabh Agarwal
2024 A* conf
Combining Axes Preconditioners through Kronecker Approximation for Deep Learning.
ICLR
Sai Surya Duvvuri, Devvrit, Rohan Anil, Cho-Jui Hsieh, Inderjit S. Dhillon
2024 J jnl
LASER: Attention with Exponential Transformation.
CoRR
Sai Surya Duvvuri, Inderjit S. Dhillon
2024 J jnl
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization.
CoRR
Jui-Nan Yen, Si Si, Zhao Meng, Felix X. Yu, Sai Surya Duvvuri, Inderjit S. Dhillon, Cho-Jui Hsieh, Sanjiv Kumar
2023 A* conf
A Computationally Efficient Sparsified Online Newton Method.
NeurIPS
Devvrit, Sai Surya Duvvuri, Rohan Anil, Vineet Gupta, Cho-Jui Hsieh, Inderjit S. Dhillon
2023 J jnl
A Computationally Efficient Sparsified Online Newton Method.
CoRR
Devvrit, Sai Surya Duvvuri, Rohan Anil, Vineet Gupta, Cho-Jui Hsieh, Inderjit S. Dhillon
2023 A* conf
Block Low-Rank Preconditioner with Shared Basis for Stochastic Optimization.
NeurIPS
Jui-Nan Yen, Sai Surya Duvvuri, Inderjit S. Dhillon, Cho-Jui Hsieh
2020 Misc conf
iBox: Internet in a Box.
HotNets
Sachin Ashok, Sai Surya Duvvuri, Nagarajan Natarajan, Venkata N. Padmanabhan, Sundararajan Sellamanickam, Johannes Gehrke