Jared Casper

25 papers A* 6A 4B 1Misc 2Journal 9Unranked 2
YearRankTypeTitle / Venue / Authors
2024 J jnl
An Empirical Study of Mamba-based Language Models.
CoRR
Roger Waleffe, Wonmin Byeon, Duncan Riach, Brandon Norick, Vijay Korthikanti, Tri Dao, Albert Gu, Ali Hatamizadeh, Sudhakar Singh, Deepak Narayanan, Garvit Kulshreshtha, Vartika Singh, Jared Casper, Jan Kautz, Mohammad Shoeybi, Bryan Catanzaro
2024 J jnl
Nemotron-4 15B Technical Report.
CoRR
Jupinder Parmar, Shrimai Prabhumoye, Joseph Jennings, Mostofa Patwary, Sandeep Subramanian, Dan Su, Chen Zhu, Deepak Narayanan, Aastha Jhunjhunwala, Ayush Dattagupta, Vibhu Jawa, Jiwei Liu, Ameya Mahabaleshwarkar, Osvald Nitski, Annika Brundyn, James Maki, Miguel Martinez, Jiaxuan You, John Kamalu, Patrick LeGresley, Denys Fridman, Jared Casper, Ashwath Aithal, Oleksii Kuchaiev, Mohammad Shoeybi, Jonathan M. Cohen, Bryan Catanzaro
2023 — conf
Reducing Activation Recomputation in Large Transformer Models.
MLSys
Vijay Anand Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro
2022 J jnl
Reducing Activation Recomputation in Large Transformer Models.
CoRR
Vijay Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro
2022 J jnl
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.
CoRR
Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro
2021 J jnl
Efficient Large-Scale Language Model Training on GPU Clusters.
CoRR
Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia
2021 A conf
Efficient large-scale language model training on GPU clusters using megatron-LM.
SC
Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia
2019 J jnl
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.
CoRR
Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro
2016 A* conf
Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin.
ICML
Dario Amodei, Sundaram Ananthanarayanan, Rishita Anubhai, Jingliang Bai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Awni Y. Hannun, Billy Jun, Tony Han, Patrick LeGresley, Xiangang Li, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Sheng Qian, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Chong Wang, Yi Wang, Zhiqian Wang, Bo Xiao, Yan Xie, Dani Yogatama, Jun Zhan, Zhenyao Zhu
2015 J jnl
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin.
CoRR
Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Tony Han, Awni Y. Hannun, Billy Jun, Patrick LeGresley, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Yi Wang, Zhiqian Wang, Chong Wang, Bo Xiao, Dani Yogatama, Jun Zhan, Zhenyao Zhu
2015 — —
Domain specific hardware acceleration.
Jared Casper
2014 J jnl
Deep Speech: Scaling up end-to-end speech recognition.
CoRR
Awni Y. Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, Andrew Y. Ng
2014 A conf
Hardware acceleration of database operations.
FPGA
Jared Casper, Kunle Olukotun
2012 Misc conf
A case of system-level hardware/software co-design and co-verification of a commodity multi-processor system with custom hardware.
CODES+ISSS
Sungpack Hong, Tayo Oguntebi, Jared Casper, Nathan Grasso Bronson, Christos Kozyrakis, Kunle Olukotun
2011 A* conf
Hardware acceleration of transactional memory on commodity systems.
ASPLOS
Jared Casper, Tayo Oguntebi, Sungpack Hong, Nathan Grasso Bronson, Christos Kozyrakis, Kunle Olukotun
2010 B conf
A practical concurrent binary search tree.
PPoPP
Nathan Grasso Bronson, Jared Casper, Hassan Chafi, Kunle Olukotun
2010 — conf
Eigenbench: A simple exploration tool for orthogonal TM characteristics.
IISWC
Sungpack Hong, Tayo Oguntebi, Jared Casper, Nathan Grasso Bronson, Christos Kozyrakis, Kunle Olukotun
2010 Misc conf
FARM: A Prototyping Environment for Tightly-Coupled, Heterogeneous Architectures.
FCCM
Tayo Oguntebi, Sungpack Hong, Jared Casper, Nathan Grasso Bronson, Christos Kozyrakis, Kunle Olukotun
2010 A* conf
Transactional predication: high-performance concurrent sets and maps for STM.
PODC
Nathan Grasso Bronson, Jared Casper, Hassan Chafi, Kunle Olukotun
2007 A* conf
A Scalable, Non-blocking Approach to Transactional Memory.
HPCA
Hassan Chafi, Jared Casper, Brian D. Carlstrom, Austen McDonald, Chi Cao Minh, Woongki Baek, Christos Kozyrakis, Kunle Olukotun
2007 A conf
A practical FPGA-based framework for novel CMP research.
FPGA
Sewook Wee, Jared Casper, Njuguna Njoroge, Yuriy Teslyar, Daxia Ge, Christos Kozyrakis, Kunle Olukotun
2007 A conf
ATLAS: a chip-multiprocessor with transactional memory support.
DATE
Njuguna Njoroge, Jared Casper, Sewook Wee, Yuriy Teslyar, Daxia Ge, Christos Kozyrakis, Kunle Olukotun
2007 A* conf
An effective hybrid transactional memory system with strong isolation guarantees.
ISCA
Chi Cao Minh, Martin Trautmann, JaeWoong Chung, Austen McDonald, Nathan Grasso Bronson, Jared Casper, Christos Kozyrakis, Kunle Olukotun
2004 A* conf
The Vector-Thread Architecture.
ISCA
Ronny Krashinsky, Christopher Batten, Mark Hampton, Steve Gerding, Brian Pharris, Jared Casper, Krste Asanovic
2004 J jnl
The Vector-Thread Architecture.
IEEE Micro
Ronny Krashinsky, Christopher Batten, Mark Hampton, Steve Gerding, Brian Pharris, Jared Casper, Krste Asanovic