Zachary DeVito

29 papers A* 5A 1B 2Journal 16Unranked 5
YearRankTypeTitle / Venue / Authors
2025 J jnl
PRISM: Probabilistic Runtime Insights and Scalable Performance Modeling for Large-Scale Distributed Training.
CoRR
Alicia Golden, Michael Kuchnik, Samuel Hsia, Zachary DeVito, Gu-Yeon Wei, David Brooks, Carole-Jean Wu
2025 A* conf
Revisiting Reliability in Large-Scale Machine Learning Research Clusters.
HPCA
Apostolos Kokolis, Michael Kuchnik, John Hoffman, Adithya Kumar, Parth Malani, Faye Ma, Zachary DeVito, Shubho Sengupta, Kalyan Saladi, Carole-Jean Wu
2024 B conf
Generative AI Beyond LLMs: System Implications of Multi-Modal Generation.
ISPASS
Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu
2024 J jnl
Is Flash Attention Stable?
CoRR
Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu
2024 A* conf
MAD-Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems.
ISCA
Samuel Hsia, Alicia Golden, Bilge Acun, Newsha Ardalani, Zachary DeVito, Gu-Yeon Wei, David Brooks, Carole-Jean Wu
2024 — conf
PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph Compilation.
ASPLOS (2)
Jason Ansel, Edward Z. Yang, Horace He, Natalia Gimelshein, Animesh Jain, Michael Voznesensky, Bin Bao, Peter Bell, David Berard, Evgeni Burovski, Geeta Chauhan, Anjali Chourdia, Will Constable, Alban Desmaison, Zachary DeVito, Elias Ellison, Will Feng, Jiong Gong, Michael Gschwind, Brian Hirsh, Sherlock Huang, Kshiteej Kalambarkar, Laurent Kirsch, Michael Lazos, Mario Lezcano, Yanbo Liang, Jason Liang, Yinghai Lu, C. K. Luk, Bert Maher, Yunjie Pan, Christian Puhrsch, Matthias Reso, Mark Saroufim, Marcos Yukio Siraichi, Helen Suk, Shunting Zhang, Michael Suo, Phil Tillet, Xu Zhao, Eikan Wang, Keren Zhou, Richard Zou, Xiaodong Wang, Ajit Mathews, William Wen, Gregory Chanan, Peng Wu, Soumith Chintala
2024 J jnl
Revisiting Reliability in Large-Scale Machine Learning Research Clusters.
CoRR
Apostolos Kokolis, Michael Kuchnik, John Hoffman, Adithya Kumar, Parth Malani, Faye Ma, Zachary DeVito, Shubho Sengupta, Kalyan Saladi, Carole-Jean Wu
2023 J jnl
A Theory on Adam Instability in Large-Scale Machine Learning.
CoRR
Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang
2023 J jnl
Generative AI Beyond LLMs: System Implications of Multi-Modal Generation.
CoRR
Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu
2023 J jnl
MAD Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems.
CoRR
Samuel Hsia, Alicia Golden, Bilge Acun, Newsha Ardalani, Zachary DeVito, Gu-Yeon Wei, David Brooks, Carole-Jean Wu
2023 — conf
PyTorch RPC: Distributed Deep Learning Built on Tensor-Optimized Remote Procedure Calls.
MLSys
Shen Li, Pritam Damania, Luca Wehrstedt, Rohan Varma, Omkar Salpekar, Pavel Belevich, Howard Huang, Yanli Zhao, Lucas Hosseini, Wanchao Liang, Hongyi Jia, Shihao Xu, Satendra Gera, Alisson G. Azzolini, Guoqiang Jerry Chen, Zachary DeVito, Chaoyang He, Amir Ziashahabi, Alban Desmaison, Edward Z. Yang, Gregory Chanan, Brian Vaughan, Manoj Krishnan, Joseph S. Spisak, Salman Avestimehr, Soumith Chintala
2022 — conf
torch.fx: Practical Program Capture and Transformation for Deep Learning in Python.
MLSys
James K. Reed, Zachary DeVito, Horace He, Ansley Ussery, Jason Ansel
2021 J jnl
Using Python for Model Inference in Deep Learning.
CoRR
Zachary DeVito, Jason Ansel, Will Constable, Michael Suo, Ailing Zhang, Kim M. Hazelwood
2021 J jnl
torch.fx: Practical Program Capture and Transformation for Deep Learning in Python.
CoRR
James K. Reed, Zachary DeVito, Horace He, Ansley Ussery, Jason Ansel
2020 J jnl
The Next 700 Accelerated Layers: From Mathematical Expressions of Network Computation Graphs to Accelerated GPU Kernels, Automatically.
ACM Trans. Archit. Code Optim.
Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen
2019 A* conf
PyTorch: An Imperative Style, High-Performance Deep Learning Library.
NeurIPS
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Z. Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, Soumith Chintala
2018 J jnl
Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions.
CoRR
Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, Albert Cohen
2017 J jnl
Opt: A Domain Specific Language for Non-Linear Least Squares Optimization in Graphics and Imaging.
ACM Trans. Graph.
Zachary DeVito, Michael Mara, Michael Zollhöfer, Gilbert Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, Matthias Nießner
2016 J jnl
Ebb: A DSL for Physical Simulation on CPUs and GPUs.
ACM Trans. Graph.
Gilbert Louis Bernstein, Chinmayee Shah, Crystal Lemire, Zachary DeVito, Matthew Fisher, Philip Alexander Levis, Pat Hanrahan
2016 J jnl
Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging.
CoRR
Zachary DeVito, Michael Mara, Michael Zollhöfer, Gilbert Louis Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, Matthias Nießner
2016 J jnl
Rigel: flexible multi-rate image processing hardware.
ACM Trans. Graph.
James Hegarty, Ross G. Daly, Zachary DeVito, Mark Horowitz, Pat Hanrahan, Jonathan Ragan-Kelley
2015 J jnl
Ebb: A DSL for Physical Simluation on CPUs and GPUs.
CoRR
Gilbert Louis Bernstein, Chinmayee Shah, Crystal Lemire, Zachary DeVito, Matthew Fisher, Philip Alexander Levis, Pat Hanrahan
2015 — conf
The Design of Terra: Harnessing the Best Features of High-Level and Low-Level Languages.
SNAPL
Zachary DeVito, Pat Hanrahan
2014 J jnl
Darkroom: compiling high-level image processing code into hardware pipelines.
ACM Trans. Graph.
James Hegarty, John S. Brunhaver, Zachary DeVito, Jonathan Ragan-Kelley, Noy Cohen, Steven Bell, Artem Vasilyev, Mark Horowitz, Pat Hanrahan
2014 A* conf
First-class runtime generation of high-performance types using exotypes.
PLDI
Zachary DeVito, Daniel Ritchie, Matthew Fisher, Alex Aiken, Pat Hanrahan
2014 — conf
Just-in-time Length Specialization of Dynamic Vector Code.
ARRAY@PLDI
Justin Talbot, Zachary DeVito, Pat Hanrahan
2013 A conf
Exploring Traditional and Emerging Parallel Programming Models Using a Proxy Application.
IPDPS
Ian Karlin, Abhinav Bhatele, Jeff Keasler, Bradford L. Chamberlain, Jonathan D. Cohen, Zachary DeVito, Riyaz Haque, Dan Laney, Edward Luke, Felix Wang, David F. Richards, Martin Schulz, Charles H. Still
2013 A* conf
Terra: a multi-stage language for high-performance computing.
PLDI
Zachary DeVito, James Hegarty, Alex Aiken, Pat Hanrahan, Jan Vitek
2012 B conf
Riposte: a trace-driven compiler and parallel VM for vector code in R.
PACT
Justin Talbot, Zachary DeVito, Pat Hanrahan