Erich Elsen

54 papers A* 16A 3Journal 30Unranked 5
YearRankTypeTitle / Venue / Authors
2026 J jnl
OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoning.
CoRR
Krista Opsahl-Ong, Arnav Singhvi, Jasmine Collins, Ivan Zhou, Cindy Wang, Ashutosh Baheti, Owen Oertell, Jacob Portes, Sam Havens, Erich Elsen, Michael Bendersky, Matei Zaharia, Xing Chen
2022 A* conf
An empirical analysis of compute-optimal large language model training.
NeurIPS
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katherine Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Oriol Vinyals, Jack W. Rae, Laurent Sifre
2022 A* conf
Improving Language Models by Retrieving from Trillions of Tokens.
ICML
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre
2022 A* conf
Step-unrolled Denoising Autoencoders for Text Generation.
ICLR
Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aäron van den Oord
2022 A* conf
The State of Sparse Training in Deep Reinforcement Learning.
ICML
Laura Graesser, Utku Evci, Erich Elsen, Pablo Samuel Castro
2022 J jnl
The State of Sparse Training in Deep Reinforcement Learning.
CoRR
Laura Graesser, Utku Evci, Erich Elsen, Pablo Samuel Castro
2022 J jnl
Training Compute-Optimal Large Language Models.
CoRR
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Jack W. Rae, Oriol Vinyals, Laurent Sifre
2022 A* conf
Unified Scaling Laws for Routed Language Models.
ICML
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc'Aurelio Ranzato, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
2022 J jnl
Unified Scaling Laws for Routed Language Models.
CoRR
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Katie Millican, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
2021 A* conf
End-to-end Adversarial Text-to-Speech.
ICLR
Jeff Donahue, Sander Dieleman, Mikolaj Binkowski, Erich Elsen, Karen Simonyan
2021 J jnl
Improving language models by retrieving from trillions of tokens.
CoRR
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre
2021 A* conf
Practical Real Time Recurrent Learning with a Sparse Approximation.
ICLR
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
2021 J jnl
Scaling Language Models: Methods, Analysis & Insights from Training Gopher.
CoRR
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew J. Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving
2021 J jnl
Step-unrolled Denoising Autoencoders for Text Generation.
CoRR
Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aäron van den Oord
2021 J jnl
Top-KAST: Top-K Always Sparse Training.
CoRR
Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen
2020 J jnl
A Practical Sparse Approximation for Real Time Recurrent Learning.
CoRR
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
2020 J jnl
AlgebraNets.
CoRR
Jordan Hoffmann, Simon Schmitt, Simon Osindero, Karen Simonyan, Erich Elsen
2020 J jnl
End-to-End Adversarial Text-to-Speech.
CoRR
Jeff Donahue, Sander Dieleman, Mikolaj Binkowski, Erich Elsen, Karen Simonyan
2020 A* conf
Fast Sparse ConvNets.
CVPR
Erich Elsen, Marat Dukhan, Trevor Gale, Karen Simonyan
2020 A* conf
High Fidelity Speech Synthesis with Adversarial Networks.
ICLR
Mikolaj Binkowski, Jeff Donahue, Sander Dieleman, Aidan Clark, Erich Elsen, Norman Casagrande, Luis C. Cobo, Karen Simonyan
2020 A* conf
On the Generalization Benefit of Noise in Stochastic Gradient Descent.
ICML
Samuel L. Smith, Erich Elsen, Soham De
2020 J jnl
On the Generalization Benefit of Noise in Stochastic Gradient Descent.
CoRR
Samuel L. Smith, Erich Elsen, Soham De
2020 A* conf
Rigging the Lottery: Making All Tickets Winners.
ICML
Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, Erich Elsen
2020 J jnl
Sparse GPU Kernels for Deep Learning.
CoRR
Trevor Gale, Matei Zaharia, Cliff Young, Erich Elsen
2020 A conf
Sparse GPU kernels for deep learning.
SC
Trevor Gale, Matei Zaharia, Cliff Young, Erich Elsen
2020 A* conf
Top-KAST: Top-K Always Sparse Training.
NeurIPS
Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen
2019 — conf
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset.
ICLR
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse H. Engel, Douglas Eck
2019 J jnl
Fast Sparse ConvNets.
CoRR
Erich Elsen, Marat Dukhan, Trevor Gale, Karen Simonyan
2019 J jnl
High Fidelity Speech Synthesis with Adversarial Networks.
CoRR
Mikolaj Binkowski, Jeff Donahue, Sander Dieleman, Aidan Clark, Erich Elsen, Norman Casagrande, Luis C. Cobo, Karen Simonyan
2019 J jnl
Non-Differentiable Supervised Learning with Evolution Strategies and Hybrid Methods.
CoRR
Karel Lenc, Erich Elsen, Tom Schaul, Karen Simonyan
2019 J jnl
Rigging the Lottery: Making All Tickets Winners.
CoRR
Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, Erich Elsen
2019 J jnl
The Difficulty of Training Sparse Neural Networks.
CoRR
Utku Evci, Fabian Pedregosa, Aidan N. Gomez, Erich Elsen
2019 J jnl
The State of Sparsity in Deep Neural Networks.
CoRR
Trevor Gale, Erich Elsen, Sara Hooker
2018 A* conf
Efficient Neural Audio Synthesis.
ICML
Nal Kalchbrenner, Erich Elsen, Karen Simonyan, Seb Noury, Norman Casagrande, Edward Lockhart, Florian Stimberg, Aäron van den Oord, Sander Dieleman, Koray Kavukcuoglu
2018 J jnl
Efficient Neural Audio Synthesis.
CoRR
Nal Kalchbrenner, Erich Elsen, Karen Simonyan, Seb Noury, Norman Casagrande, Edward Lockhart, Florian Stimberg, Aäron van den Oord, Sander Dieleman, Koray Kavukcuoglu
2018 J jnl
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset.
CoRR
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse H. Engel, Douglas Eck
2018 — conf
Mixed Precision Training.
ICLR (Poster)
Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory F. Diamos, Erich Elsen, David García, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, Hao Wu
2018 — conf
Onsets and Frames: Dual-Objective Piano Transcription.
ISMIR
Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse H. Engel, Sageev Oore, Douglas Eck
2018 A* conf
Parallel WaveNet: Fast High-Fidelity Speech Synthesis.
ICML
Aäron van den Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, Koray Kavukcuoglu, George van den Driessche, Edward Lockhart, Luis C. Cobo, Florian Stimberg, Norman Casagrande, Dominik Grewe, Seb Noury, Sander Dieleman, Erich Elsen, Nal Kalchbrenner, Heiga Zen, Alex Graves, Helen King, Tom Walters, Dan Belov, Demis Hassabis
2017 — conf
DSD: Dense-Sparse-Dense Training for Deep Neural Networks.
ICLR (Poster)
Song Han, Jeff Pool, Sharan Narang, Huizi Mao, Enhao Gong, Shijian Tang, Erich Elsen, Peter Vajda, Manohar Paluri, John Tran, Bryan Catanzaro, William J. Dally
2017 — conf
Exploring Sparsity in Recurrent Neural Networks.
ICLR (Poster)
Sharan Narang, Greg Diamos, Shubho Sengupta, Erich Elsen
2017 J jnl
Exploring Sparsity in Recurrent Neural Networks.
CoRR
Sharan Narang, Gregory F. Diamos, Shubho Sengupta, Erich Elsen
2017 J jnl
Mixed Precision Training.
CoRR
Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory F. Diamos, Erich Elsen, David García, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, Hao Wu
2017 J jnl
Onsets and Frames: Dual-Objective Piano Transcription.
CoRR
Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse H. Engel, Sageev Oore, Douglas Eck
2017 J jnl
Parallel WaveNet: Fast High-Fidelity Speech Synthesis.
CoRR
Aäron van den Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, Koray Kavukcuoglu, George van den Driessche, Edward Lockhart, Luis C. Cobo, Florian Stimberg, Norman Casagrande, Dominik Grewe, Seb Noury, Sander Dieleman, Erich Elsen, Nal Kalchbrenner, Heiga Zen, Alex Graves, Helen King, Tom Walters, Dan Belov, Demis Hassabis
2016 J jnl
DSD: Regularizing Deep Neural Networks with Dense-Sparse-Dense Training Flow.
CoRR
Song Han, Jeff Pool, Sharan Narang, Huizi Mao, Shijian Tang, Erich Elsen, Bryan Catanzaro, John Tran, William J. Dally
2016 A* conf
Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin.
ICML
Dario Amodei, Sundaram Ananthanarayanan, Rishita Anubhai, Jingliang Bai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Awni Y. Hannun, Billy Jun, Tony Han, Patrick LeGresley, Xiangang Li, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Sheng Qian, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Chong Wang, Yi Wang, Zhiqian Wang, Bo Xiao, Yan Xie, Dani Yogatama, Jun Zhan, Zhenyao Zhu
2016 A* conf
Persistent RNNs: Stashing Recurrent Weights On-Chip.
ICML
Greg Diamos, Shubho Sengupta, Bryan Catanzaro, Mike Chrzanowski, Adam Coates, Erich Elsen, Jesse H. Engel, Awni Y. Hannun, Sanjeev Satheesh
2015 J jnl
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin.
CoRR
Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Tony Han, Awni Y. Hannun, Billy Jun, Patrick LeGresley, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Yi Wang, Zhiqian Wang, Chong Wang, Bo Xiao, Dani Yogatama, Jun Zhan, Zhenyao Zhu
2014 J jnl
Deep Speech: Scaling up end-to-end speech recognition.
CoRR
Awni Y. Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, Andrew Y. Ng
2011 A conf
Liszt: a domain specific language for building portable mesh-based PDE solvers.
SC
Zach DeVito, Niels Joubert, Francisco Palacios, Stephen Oakley, Montserrat Medina, Mike Barrientos, Erich Elsen, Frank Ham, Alex Aiken, Karthik Duraisamy, Eric Darve, Juan J. Alonso, Pat Hanrahan
2008 J jnl
Large calculation of the flow over a hypersonic vehicle using a GPU.
J. Comput. Phys.
Erich Elsen, Patrick LeGresley, Eric Darve
2007 J jnl
N-Body Simulations on GPUs
CoRR
Erich Elsen, Vaidyanathan Vishal, Mike Houston, Vijay S. Pande, Pat Hanrahan, Eric Darve
2006 A conf
Poster reception - N-Body simulation on GPUs.
SC
Erich Elsen, Mike Houston, Vaidyanathan Vishal, Eric Darve, Pat Hanrahan, Vijay S. Pande