Blake A. Hechtman

21 papers A* 6B 2Journal 12

Year	Rank	Type	Title / Venue / Authors
2022	A*	`conf`	Unified Scaling Laws for Routed Language Models. ICML Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc'Aurelio Ranzato, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
2022	J	`jnl`	Unified Scaling Laws for Routed Language Models. CoRR Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Katie Millican, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
2021	B	`conf`	A Flexible Approach to Autotuning Multi-Pass Machine Learning Compilers. PACT Phitchaya Mangpo Phothilimthana, Amit Sabne, Nikhil Sarda, Karthik Srinivasa Murthy, Yanqi Zhou, Christof Angermueller, Mike Burrows, Sudip Roy, Ketan Mandke, Rezsa Farahani, Yu Emma Wang, Berkin Ilbeyi, Blake A. Hechtman, Bjarke Roune, Shen Wang, Yuanzhong Xu, Samuel J. Kaufman
2021	J	`jnl`	GSPMD: General and Scalable Parallelization for ML Computation Graphs. CoRR Yuanzhong Xu, HyoukJoong Lee, Dehao Chen, Blake A. Hechtman, Yanping Huang, Rahul Joshi, Maxim Krikun, Dmitry Lepikhin, Andy Ly, Marcello Maggioni, Ruoming Pang, Noam Shazeer, Shibo Wang, Tao Wang, Yonghui Wu, Zhifeng Chen
2021	J	`jnl`	Large-Scale Discrete Fourier Transform on TPUs. IEEE Access Tianjian Lu, Yi-Fan Chen, Blake A. Hechtman, Tao Wang, John R. Anderson
2021	J	`jnl`	Scaling Language Models: Methods, Analysis & Insights from Training Gopher. CoRR Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew J. Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving
2021	A*	`conf`	Scaling Local Self-Attention for Parameter Efficient Visual Backbones. CVPR Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens
2021	J	`jnl`	Scaling Local Self-Attention for Parameter Efficient Visual Backbones. CoRR Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens
2020	J	`jnl`	Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training. CoRR Yuanzhong Xu, HyoukJoong Lee, Dehao Chen, Hongjun Choi, Blake A. Hechtman, Shibo Wang
2020	J	`jnl`	Exploring the limits of Concurrency in ML Training on Google TPUs. CoRR Sameer Kumar, James Bradbury, Cliff Young, Yu Emma Wang, Anselm Levskaya, Blake A. Hechtman, Dehao Chen, HyoukJoong Lee, Mehmet Deveci, Naveen Kumar, Pankaj Kanwar, Shibo Wang, Skye Wanderman-Milne, Steve Lacy, Tao Wang, Tayo Oguntebi, Yazhou Zu, Yuanzhong Xu, Andy Swing
2020	J	`jnl`	Large-Scale Discrete Fourier Transform on TPUs. CoRR Tianjian Lu, Yi-Fan Chen, Blake A. Hechtman, Tao Wang, John R. Anderson
2019	J	`jnl`	Scale MLPerf-0.6 models on Google TPU-v3 Pods. CoRR Sameer Kumar, Victor Bitorff, Dehao Chen, Chiachen Chou, Blake A. Hechtman, HyoukJoong Lee, Naveen Kumar, Peter Mattson, Shibo Wang, Tao Wang, Yuanzhong Xu, Zongwei Zhou
2018	A*	`conf`	Mesh-TensorFlow: Deep Learning for Supercomputers. NeurIPS Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
2018	J	`jnl`	Mesh-TensorFlow: Deep Learning for Supercomputers. CoRR Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
2016	J	`jnl`	TREES: A CPU/GPU Task-Parallel Runtime with Explicit Epoch Synchronization. CoRR Blake A. Hechtman, Andrew D. Hilton, Daniel J. Sorin
2014	—	`—`	Exploiting Parallelism in GPUs. Blake A. Hechtman
2014	A*	`conf`	Heterogeneous-race-free memory models. ASPLOS Derek R. Hower, Blake A. Hechtman, Bradford M. Beckmann, Benedict R. Gaster, Mark D. Hill, Steven K. Reinhardt, David A. Wood
2014	A*	`conf`	QuickRelease: A throughput-oriented approach to release consistency on GPUs. HPCA Blake A. Hechtman, Shuai Che, Derek R. Hower, Yingying Tian, Bradford M. Beckmann, Mark D. Hill, Steven K. Reinhardt, David A. Wood
2013	J	`jnl`	Evaluating Cache Coherent Shared Virtual Memory for Heterogeneous Multicore Chips. CoRR Blake A. Hechtman, Daniel J. Sorin
2013	B	`conf`	Evaluating cache coherent shared virtual memory for heterogeneous multicore chips. ISPASS Blake A. Hechtman, Daniel J. Sorin
2013	A*	`conf`	Exploring memory consistency for massively-threaded throughput-oriented processors. ISCA Blake A. Hechtman, Daniel J. Sorin