Depen Morwani - RankMe

27 papers A* 8B 1Journal 18

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging. CoRR Alexandru Meterez, Pranav Ajit Nair, Depen Morwani, Cengiz Pehlevan, Sham M. Kakade
2026	J	`jnl`	GenAI for Systems: Recurring Challenges and Design Principles from Software to Silicon. CoRR Arya Tschand, Chenyu Wang, Zishen Wan, Andrew Cheng, Ioana Cristescu, Kevin He, Howard Huang, Alexander Ingare, Akseli Kangaslahti, Sara Kangaslahti, Theo Lebryk, Hongjin Lin, Jeffrey Jian Ma, Alexandru Meterez, Clara Mohri, Depen Morwani, Sunny Qin, Roy Rinberg, Paula Rodriguez Diaz, Alyssa Mia Taliotis, Pernille Undrum Fathi, Rosie Zhao, Todd Zhou, Vijay Janapa Reddi
2025	A*	`conf`	A New Perspective on Shampoo's Preconditioner. ICLR Depen Morwani, Itai Shapira, Nikhil Vyas, Eran Malach, Sham M. Kakade, Lucas Janson
2025	J	`jnl`	A Simplified Analysis of SGD for Linear Regression with Weight Averaging. CoRR Alexandru Meterez, Depen Morwani, Costin-Andrei Oncescu, Jingfeng Wu, Cengiz Pehlevan, Sham M. Kakade
2025	J	`jnl`	Adam or Gauss-Newton? A Comparative Study In Terms of Basis Alignment and SGD Noise. CoRR Bingbin Liu, Rachit Bansal, Depen Morwani, Nikhil Vyas, David Alvarez-Melis, Sham M. Kakade
2025	J	`jnl`	Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants. CoRR Depen Morwani, Nikhil Vyas, Hanlin Zhang, Sham M. Kakade
2025	A*	`conf`	Deconstructing What Makes a Good Optimizer for Autoregressive Language Models. ICLR Rosie Zhao, Depen Morwani, David Brandfonbrener, Nikhil Vyas, Sham M. Kakade
2025	A*	`conf`	How Does Critical Batch Size Scale in Pre-training? ICLR Hanlin Zhang, Depen Morwani, Nikhil Vyas, Jingfeng Wu, Difan Zou, Udaya Ghai, Dean P. Foster, Sham M. Kakade
2025	J	`jnl`	LOTION: Smoothing the Optimization Landscape for Quantized Training. CoRR Mujin Kwun, Depen Morwani, Chloe Huangyuan Su, Stephanie Gil, Nikhil Anand, Sham M. Kakade
2025	A*	`conf`	SOAP: Improving and Stabilizing Shampoo using Adam for Language Modeling. ICLR Nikhil Vyas, Depen Morwani, Rosie Zhao, Itai Shapira, David Brandfonbrener, Lucas Janson, Sham M. Kakade
2025	J	`jnl`	Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling. CoRR Alexandru Meterez, Depen Morwani, Jingfeng Wu, Costin-Andrei Oncescu, Cengiz Pehlevan, Sham M. Kakade
2025	J	`jnl`	The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton. CoRR Natalie Abreu, Nikhil Vyas, Sham M. Kakade, Depen Morwani
2024	J	`jnl`	A New Perspective on Shampoo's Preconditioner. CoRR Depen Morwani, Itai Shapira, Nikhil Vyas, Eran Malach, Sham M. Kakade, Lucas Janson
2024	A*	`conf`	Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning. ICML Nikhil Vyas, Depen Morwani, Rosie Zhao, Gal Kaplun, Sham M. Kakade, Boaz Barak
2024	J	`jnl`	Deconstructing What Makes a Good Optimizer for Language Models. CoRR Rosie Zhao, Depen Morwani, David Brandfonbrener, Nikhil Vyas, Sham M. Kakade
2024	A*	`conf`	Feature emergence via margin maximization: case studies in algebraic tasks. ICLR Depen Morwani, Benjamin L. Edelman, Costin-Andrei Oncescu, Rosie Zhao, Sham M. Kakade
2024	J	`jnl`	How Does Critical Batch Size Scale in Pre-training? CoRR Hanlin Zhang, Depen Morwani, Nikhil Vyas, Jingfeng Wu, Difan Zou, Udaya Ghai, Dean P. Foster, Sham M. Kakade
2024	J	`jnl`	SOAP: Improving and Stabilizing Shampoo using Adam. CoRR Nikhil Vyas, Depen Morwani, Rosie Zhao, Itai Shapira, David Brandfonbrener, Lucas Janson, Sham M. Kakade
2023	J	`jnl`	Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning. CoRR Nikhil Vyas, Depen Morwani, Rosie Zhao, Gal Kaplun, Sham M. Kakade, Boaz Barak
2023	J	`jnl`	Feature emergence via margin maximization: case studies in algebraic tasks. CoRR Depen Morwani, Benjamin L. Edelman, Costin-Andrei Oncescu, Rosie Zhao, Sham M. Kakade
2023	A*	`conf`	Feature-Learning Networks Are Consistent Across Widths At Realistic Scales. NeurIPS Nikhil Vyas, Alexander B. Atanasov, Blake Bordelon, Depen Morwani, Sabarish Sainathan, Cengiz Pehlevan
2023	J	`jnl`	Feature-Learning Networks Are Consistent Across Widths At Realistic Scales. CoRR Nikhil Vyas, Alexander B. Atanasov, Blake Bordelon, Depen Morwani, Sabarish Sainathan, Cengiz Pehlevan
2023	A*	`conf`	Simplicity Bias in 1-Hidden Layer Neural Networks. NeurIPS Depen Morwani, Jatin Batra, Prateek Jain, Praneeth Netrapalli
2023	J	`jnl`	Simplicity Bias in 1-Hidden Layer Neural Networks. CoRR Depen Morwani, Jatin Batra, Prateek Jain, Praneeth Netrapalli
2022	B	`conf`	Inductive Bias of Gradient Descent for Weight Normalized Smooth Homogeneous Neural Nets. ALT Depen Morwani, Harish G. Ramaswamy
2020	J	`jnl`	Inductive Bias of Gradient Descent for Exponentially Weight Normalized Smooth Homogeneous Neural Nets. CoRR Depen Morwani, Harish G. Ramaswamy
2020	J	`jnl`	Using noise resilience for ranking generalization of deep neural networks. CoRR Depen Morwani, Rahul Vashisht, Harish G. Ramaswamy