Daria Soboleva

12 papers A* 1Misc 1Journal 8Unranked 2
YearRankTypeTitle / Venue / Authors
2025 — conf
Batch Tiling on Attention: Efficient Mixture of Experts Training on Wafer-Scale Processors.
SC Workshops
Daria Soboleva, Étienne Goffinet, Hui Zeng, Sangamesh Ragate, Elif Albuz, Natalia Vassilieva
2025 — conf
MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models.
SC Workshops
Krishna Teja Chitty-Venkata, Sylvia Howland, Golara Azar, Daria Soboleva, Natalia Vassilieva, Siddhisanket Raskar, Murali Emani, Venkatram Vishwanath
2025 J jnl
MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models.
CoRR
Krishna Teja Chitty-Venkata, Sylvia Howland, Golara Azar, Daria Soboleva, Natalia Vassilieva, Siddhisanket Raskar, Murali Emani, Venkatram Vishwanath
2025 J jnl
Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training.
CoRR
Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness
2025 A* conf
Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs.
ICLR
Shane Bergsma, Nolan Simran Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness
2025 J jnl
Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs.
CoRR
Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness
2024 J jnl
Agent-Based Insight into Eco-Choices: Simulating the Fast Fashion Shift.
CoRR
Daria Soboleva, Angel Sánchez
2023 J jnl
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model.
CoRR
Nolan Dey, Daria Soboleva, Faisal Al-Khateeb, Bowen Yang, Ribhu Pathria, Hemant Khachane, Shaheer Muhammad, Zhiming Chen, Robert Myers, Jacob Robert Steeves, Natalia Vassilieva, Marvin Tom, Joel Hestness
2023 J jnl
Position Interpolation Improves ALiBi Extrapolation.
CoRR
Faisal Al-Khateeb, Nolan Dey, Daria Soboleva, Joel Hestness
2023 J jnl
SlimPajama-DC: Understanding Data Combinations for LLM Training.
CoRR
Zhiqiang Shen, Tianhua Tao, Liqun Ma, Willie Neiswanger, Zhengzhong Liu, Hongyi Wang, Bowen Tan, Joel Hestness, Natalia Vassilieva, Daria Soboleva, Eric P. Xing
2021 Misc conf
Replacing Human Audio with Synthetic Audio for on-Device Unspoken Punctuation Prediction.
ICASSP
Daria Soboleva, Ondrej Skopek, Márius Sajgalík, Victor Carbune, Felix Weissenberger, Julia Proskurnia, Bogdan Prisacari, Daniel Valcarce, Justin Lu, Rohit Prabhavalkar, Balint Miklos
2020 J jnl
Replacing Human Audio with Synthetic Audio for On-device Unspoken Punctuation Prediction.
CoRR
Daria Soboleva, Ondrej Skopek, Márius Sajgalík, Victor Carbune, Felix Weissenberger, Julia Proskurnia, Bogdan Prisacari, Daniel Valcarce, Justin Lu, Rohit Prabhavalkar, Balint Miklos