Maissam Barkeshli

12 papers A* 4Journal 8
YearRankTypeTitle / Venue / Authors
2026 J jnl
On the origin of neural scaling laws: from random graphs to natural language.
CoRR
Maissam Barkeshli, Alberto Alfarano, Andrey Gromov
2025 A* conf
(How) Can Transformers Predict Pseudo-Random Numbers?
ICML
Tao Tao, Darshil Doshi, Dayal Singh Kalra, Tianyu He, Maissam Barkeshli
2025 J jnl
(How) Can Transformers Predict Pseudo-Random Numbers?
CoRR
Tao Tao, Darshil Doshi, Dayal Singh Kalra, Tianyu He, Maissam Barkeshli
2025 J jnl
Learning Pseudorandom Numbers with Transformers: Permuted Congruential Generators, Curricula, and Interpretability.
CoRR
Tao Tao, Maissam Barkeshli
2025 A* conf
Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos.
ICLR
Dayal Singh Kalra, Tianyu He, Maissam Barkeshli
2025 J jnl
When Can You Get Away with Low Memory Adam?
CoRR
Dayal Singh Kalra, John Kirchenbauer, Maissam Barkeshli, Tom Goldstein
2024 A* conf
Why Warmup the Learning Rate? Underlying Mechanisms and Improvements.
NeurIPS
Dayal Singh Kalra, Maissam Barkeshli
2024 J jnl
Why Warmup the Learning Rate? Underlying Mechanisms and Improvements.
CoRR
Dayal Singh Kalra, Maissam Barkeshli
2023 A* conf
Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width.
NeurIPS
Dayal Singh Kalra, Maissam Barkeshli
2023 J jnl
Phase diagram of training dynamics in deep neural networks: effect of learning rate, depth, and width.
CoRR
Dayal Singh Kalra, Maissam Barkeshli
2023 J jnl
Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos.
CoRR
Dayal Singh Kalra, Tianyu He, Maissam Barkeshli
2019 J jnl
Universal logical gates with constant overhead: instantaneous Dehn twists for hyperbolic quantum codes.
Quantum
Ali Lavasani, Guanyu Zhu, Maissam Barkeshli