Srinivas Sridharan

40 papers A* 4A 5B 3C 2Misc 3Journal 20Unranked 3

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	COSMIC: Enabling Full-Stack Co-Design and Optimization of Distributed Machine Learning Systems. CoRR Aditi Raju, Jared Ni, William Won, Changhai Man, Srivatsan Krishnan, Srinivas Sridharan, Amir Yazdanbakhsh, Tushar Krishna, Vijay Janapa Reddi
2025	J	`jnl`	STAGE: A Symbolic Tensor grAph GEnerator for distributed AI system co-design. CoRR Changhai Man, Joongun Park, Hanjiang Wu, Huan Xu, Srinivas Sridharan, Tushar Krishna
2025	J	`jnl`	Toward a Standardized Representation for Deep Learning Collective Algorithms. IEEE Micro Jinsun Yoo, William Won, Meghan Cowan, Nan Jiang, Benjamin Klenk, Srinivas Sridharan, Tushar Krishna
2024	J	`jnl`	LayerDAG: A Layerwise Autoregressive Diffusion Model for Directed Acyclic Graph Generation. CoRR Mufei Li, Viraj Shitole, Eli Chien, Changhai Man, Zhaodong Wang, Srinivas Sridharan, Ying Zhang, Tushar Krishna, Pan Li
2024	Misc	`conf`	Towards a Standardized Representation for Deep Learning Collective Algorithms. HOTI Jinsun Yoo, William Won, Meghan Cowan, Nan Jiang, Benjamin Klenk, Srinivas Sridharan, Tushar Krishna
2024	J	`jnl`	Towards a Standardized Representation for Deep Learning Collective Algorithms. CoRR Jinsun Yoo, William Won, Meghan Cowan, Nan Jiang, Benjamin Klenk, Srinivas Sridharan, Tushar Krishna
2023	B	`conf`	ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale. ISPASS William Won, Taekyung Heo, Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Tushar Krishna
2023	J	`jnl`	ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale. CoRR William Won, Taekyung Heo, Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Tushar Krishna
2023	Misc	`conf`	Better Together: Jointly Optimizing ML Collective Scheduling and Execution Planning using SYNDICATE. NSDI Kshiteej Mahajan, Ching-Hsiang Chu, Srinivas Sridharan, Aditya Akella
2023	J	`jnl`	Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces. CoRR Srinivas Sridharan, Taekyung Heo, Louis Feng, Zhaodong Wang, Matt Bergeron, Wenyin Fu, Shengbao Zheng, Brian Coutinho, Saeed Rashidi, Changhai Man, Tushar Krishna
2023	J	`jnl`	Mystique: Accurate and Scalable Production AI Benchmarks Generation. CoRR Mingyu Liang, Wenyin Fu, Louis Feng, Zhongyi Lin, Pavani Panakanti, Srinivas Sridharan, Christina Delimitrou
2023	A*	`conf`	Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks. ISCA Mingyu Liang, Wenyin Fu, Louis Feng, Zhongyi Lin, Pavani Panakanti, Shengbao Zheng, Srinivas Sridharan, Christina Delimitrou
2022	Misc	`conf`	Impact of RoCE Congestion Control Policies on Distributed Training of DNNs. HOTI Tarannum Khan, Saeed Rashidi, Srinivas Sridharan, Pallavi Shurpali, Aditya Akella, Tushar Krishna
2022	J	`jnl`	Impact of RoCE Congestion Control Policies on Distributed Training of DNNs. CoRR Tarannum Khan, Saeed Rashidi, Srinivas Sridharan, Pallavi Shurpali, Aditya Akella, Tushar Krishna
2022	A*	`conf`	Software-hardware co-design for fast and scalable training of deep learning recommendation models. ISCA Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang, Zhihao Jia, Andrew Tulloch, Srinivas Sridharan, Xing Liu, Mustafa Ozdal, Jade Nie, Jongsoo Park, Liang Luo, Jie Amy Yang, Leon Gao, Dmytro Ivchenko, Aarti Basant, Yuxi Hu, Jiyan Yang, Ehsan K. Ardestani, Xiaodong Wang, Rakesh Komuravelli, Ching-Hsiang Chu, Serhat Yilmaz, Huayu Li, Jiyuan Qian, Zhuobo Feng, Yinbin Ma, Junjie Yang, Ellie Wen, Hong Li, Lin Yang, Chonglin Sun, Whitney Zhao, Dimitry Melts, Krishna Dhulipala, K. R. Kishore, Tyler Graf, Assaf Eisenman, Kiran Kumar Matam, Adi Gangidi, Guoqiang Jerry Chen, Manoj Krishnan, Avinash Nayak, Krishnakumar Nair, Bharath Muthiah, Mahmoud khorashadi, Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Ajit Mathews, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, Vijay Rao
2022	A*	`conf`	Themis: a network bandwidth-aware collective scheduling policy for distributed training of DL models. ISCA Saeed Rashidi, William Won, Sudarshan Srinivasan, Srinivas Sridharan, Tushar Krishna
2021	A*	`conf`	Enabling Compute-Communication Overlap in Distributed Deep Learning Training Platforms. ISCA Saeed Rashidi, Matthew Denton, Srinivas Sridharan, Sudarshan Srinivasan, Amoghavarsha Suresh, Jade Nie, Tushar Krishna
2021	J	`jnl`	High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models. CoRR Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang, Andrew Tulloch, Srinivas Sridharan, Xing Liu, Mustafa Ozdal, Jade Nie, Jongsoo Park, Liang Luo, Jie Amy Yang, Leon Gao, Dmytro Ivchenko, Aarti Basant, Yuxi Hu, Jiyan Yang, Ehsan K. Ardestani, Xiaodong Wang, Rakesh Komuravelli, Ching-Hsiang Chu, Serhat Yilmaz, Huayu Li, Jiyuan Qian, Zhuobo Feng, Yinbin Ma, Junjie Yang, Ellie Wen, Hong Li, Lin Yang, Chonglin Sun, Whitney Zhao, Dimitry Melts, Krishna Dhulipala, K. R. Kishore, Tyler Graf, Assaf Eisenman, Kiran Kumar Matam, Adi Gangidi, Guoqiang Jerry Chen, Manoj Krishnan, Avinash Nayak, Krishnakumar Nair, Bharath Muthiah, Mahmoud khorashadi, Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, Vijay Rao
2021	J	`jnl`	Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models. CoRR Saeed Rashidi, William Won, Sudarshan Srinivasan, Srinivas Sridharan, Tushar Krishna
2020	B	`conf`	ASTRA-SIM: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms. ISPASS Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Tushar Krishna
2020	J	`jnl`	Deep Learning Training in Facebook Data Centers: Design of Scale-up and Scale-out Systems. CoRR Maxim Naumov, John Kim, Dheevatsa Mudigere, Srinivas Sridharan, Xiaodong Wang, Whitney Zhao, Serhat Yilmaz, Changkyu Kim, Hector Yuen, Mustafa Ozdal, Krishnakumar Nair, Isabel Gao, Bor-Yiing Su, Jiyan Yang, Mikhail Smelyanskiy
2020	J	`jnl`	Efficient Communication Acceleration for Next-Gen Scale-up Deep Learning Training Platforms. CoRR Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Matthew Denton, Tushar Krishna
2020	—	`conf`	Scalable Distributed Training of Recommendation Models: An ASTRA-SIM + NS3 case-study with TCP/IP transport. Hot Interconnects Saeed Rashidi, Pallavi Shurpali, Srinivas Sridharan, Naader Hassani, Dheevatsa Mudigere, Krishnakumar Nair, Misha Smelyanskiy, Tushar Krishna
2019	J	`jnl`	Automatic Model Parallelism for Deep Neural Networks with Compiler and Hardware Support. CoRR Sanket Tavarageri, Srinivas Sridharan, Bharat Kaul
2019	J	`jnl`	Planning for performance: Enhancing achievable performance for MPI through persistent collective operations. Parallel Comput. Daniel J. Holmes, Bradley Morgan, Anthony Skjellum, Purushotham V. Bangalore, Srinivas Sridharan
2019	J	`jnl`	TensorFlow at Scale: Performance and productivity analysis of distributed training with Horovod, MLSL, and Cray PE ML. Concurr. Comput. Pract. Exp. Thorsten Kurth, Mikhail Smorkalov, Peter Mendygral, Srinivas Sridharan, Amrita Mathuriya
2019	C	`conf`	Training Google Neural Machine Translation on an Intel CPU Cluster. CLUSTER Dhiraj D. Kalamkar, Kunal Banerjee, Sudarshan Srinivasan, Srinivas Sridharan, Evangelos Georganas, Mikhail E. Smorkalov, Cong Xu, Alexander Heinecke
2018	—	`conf`	Mixed Precision Training of Convolutional Neural Networks using Integer Operations. ICLR (Poster) Dipankar Das, Naveen Mellempudi, Dheevatsa Mudigere, Dhiraj D. Kalamkar, Sasikanth Avancha, Kunal Banerjee, Srinivas Sridharan, Karthik Vaidyanathan, Bharat Kaul, Evangelos Georganas, Alexander Heinecke, Pradeep Dubey, Jesús Corbal, Nikita Shustrov, Roman Dubtsov, Evarist Fomenko, Vadim O. Pirogov
2018	J	`jnl`	Mixed Precision Training of Convolutional Neural Networks using Integer Operations. CoRR Dipankar Das, Naveen Mellempudi, Dheevatsa Mudigere, Dhiraj D. Kalamkar, Sasikanth Avancha, Kunal Banerjee, Srinivas Sridharan, Karthik Vaidyanathan, Bharat Kaul, Evangelos Georganas, Alexander Heinecke, Pradeep Dubey, Jesús Corbal, Nikita Shustrov, Roman Dubtsov, Evarist Fomenko, Vadim O. Pirogov
2018	J	`jnl`	On Scale-out Deep Learning Training for Cloud and HPC. CoRR Srinivas Sridharan, Karthikeyan Vaidyanathan, Dhiraj D. Kalamkar, Dipankar Das, Mikhail E. Smorkalov, Mikhail Shiryaev, Dheevatsa Mudigere, Naveen Mellempudi, Sasikanth Avancha, Bharat Kaul, Pradeep Dubey
2017	J	`jnl`	Deep Learning at 15PF: Supervised and Semi-Supervised Classification for Scientific Data. CoRR Thorsten Kurth, Jian Zhang, Nadathur Satish, Ioannis Mitliagkas, Evan Racah, Md. Mostofa Ali Patwary, Tareq M. Malas, Narayanan Sundaram, Wahid Bhimji, Mikhail Smorkalov, Jack Deslippe, Mikhail Shiryaev, Srinivas Sridharan, Prabhat, Pradeep Dubey
2017	A	`conf`	Deep learning at 15PF: supervised and semi-supervised classification for scientific data. SC Thorsten Kurth, Jian Zhang, Nadathur Satish, Evan Racah, Ioannis Mitliagkas, Md. Mostofa Ali Patwary, Tareq M. Malas, Narayanan Sundaram, Wahid Bhimji, Mikhail Smorkalov, Jack Deslippe, Mikhail Shiryaev, Srinivas Sridharan, Prabhat, Pradeep Dubey
2017	—	`conf`	Planning for performance: persistent collective operations for MPI. EuroMPI/USA Bradley Morgan, Daniel J. Holmes, Anthony Skjellum, Purushotham V. Bangalore, Srinivas Sridharan
2016	C	`conf`	Comparing Runtime Systems with Exascale Ambitions Using the Parallel Research Kernels. ISC Rob F. Van der Wijngaart, Abdullah Kayi, Jeff R. Hammond, Gabriele Jost, Tom St. John, Srinivas Sridharan, Timothy G. Mattson, John Abercrombie, Jacob Nelson
2016	J	`jnl`	Distributed Deep Learning Using Synchronous Stochastic Gradient Descent. CoRR Dipankar Das, Sasikanth Avancha, Dheevatsa Mudigere, Karthikeyan Vaidyanathan, Srinivas Sridharan, Dhiraj D. Kalamkar, Bharat Kaul, Pradeep Dubey
2015	A	`conf`	Exploring Shared-Memory Optimizations for an Unstructured Mesh CFD Application on Modern Parallel Systems. IPDPS Dheevatsa Mudigere, Srinivas Sridharan, Anand M. Deshpande, Jongsoo Park, Alexander Heinecke, Mikhail Smelyanskiy, Bharat Kaul, Pradeep Dubey, Dinesh K. Kaushik, David E. Keyes
2014	A	`conf`	Enabling Efficient Multithreaded MPI Communication through a Library-Based Implementation of MPI Endpoints. SC Srinivas Sridharan, James Dinan, Dhiraj D. Kalamkar
2012	A	`conf`	Extending the BT NAS parallel benchmark to exascale computing. SC Rob F. Van der Wijngaart, Srinivas Sridharan, Victor W. Lee
2012	A	`conf`	High Performance Non-uniform FFT on Modern X86-based Multi-core Systems. IPDPS Dhiraj D. Kalamkar, Joshua D. Trzasko, Srinivas Sridharan, Mikhail Smelyanskiy, Daehyun Kim, Armando Manduca, Yunhong Shu, Matt A. Bernstein, Bharat Kaul, Pradeep Dubey
2007	B	`conf`	Evaluating synchronization techniques for light-weight multithreaded/multicore architectures. SPAA Srinivas Sridharan, Arun Rodrigues, Peter M. Kogge