Nolan Dey - RankMe

11 papers A* 1Journal 10

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	Don't be lazy: CompleteP enables compute-efficient deep transformers. CoRR Nolan Dey, Bin Claire Zhang, Lorenzo Noci, Mufan Bill Li, Blake Bordelon, Shane Bergsma, Cengiz Pehlevan, Boris Hanin, Joel Hestness
2025	J	`jnl`	Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training. CoRR Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness
2025	J	`jnl`	Predicting Training Re-evaluation Curves Enables Effective Data Curriculums for LLMs. CoRR Shane Bergsma, Nolan Dey, Joel Hestness
2025	J	`jnl`	Scaling with Collapse: Efficient and Predictable Training of LLM Families. CoRR Shane Bergsma, Bin Claire Zhang, Nolan Dey, Shaheer Muhammad, Gurpreet Gosal, Joel Hestness
2025	J	`jnl`	Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs. CoRR Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness
2024	A*	`conf`	Sparse maximal update parameterization: A holistic approach to sparse training dynamics. NeurIPS Nolan Dey, Shane Bergsma, Joel Hestness
2024	J	`jnl`	Sparse maximal update parameterization: A holistic approach to sparse training dynamics. CoRR Nolan Dey, Shane Bergsma, Joel Hestness
2023	J	`jnl`	BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model. CoRR Nolan Dey, Daria Soboleva, Faisal Al-Khateeb, Bowen Yang, Ribhu Pathria, Hemant Khachane, Shaheer Muhammad, Zhiming Chen, Robert Myers, Jacob Robert Steeves, Natalia Vassilieva, Marvin Tom, Joel Hestness
2023	J	`jnl`	Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster. CoRR Nolan Dey, Gurpreet Gosal, Zhiming Chen, Hemant Khachane, William Marshall, Ribhu Pathria, Marvin Tom, Joel Hestness
2023	J	`jnl`	Position Interpolation Improves ALiBi Extrapolation. CoRR Faisal Al-Khateeb, Nolan Dey, Daria Soboleva, Joel Hestness
2020	J	`jnl`	37, 000 Human-Planned Robotic Grasps With Six Degrees of Freedom. IEEE Robotics Autom. Lett. Victor Reyes Osorio, Rajan Iyengar, Xueyang Yao, Presish Bhattachan, Adrian Ragobar, Nolan Dey, Bryan P. Tripp