Sheng Li

41 papers A* 12A 7B 1Journal 16Unranked 5
YearRankTypeTitle / Venue / Authors
2024 — conf
FLIQS: One-Shot Mixed-Precision Floating-Point and Integer Quantization Search.
AutoML
Jordan Dotzel, Gang Wu, Andrew Li, Muhammad Umar, Yun Ni, Mohamed S. Abdelfattah, Zhiru Zhang, Liqun Cheng, Martin G. Dixon, Norman P. Jouppi, Quoc V. Le, Sheng Li
2024 A* conf
Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs.
ICML
Jordan Dotzel, Yuzong Chen, Bahaa Kotb, Sushma Prasad, Gang Wu, Sheng Li, Mohamed S. Abdelfattah, Zhiru Zhang
2024 J jnl
Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs.
CoRR
Jordan Dotzel, Yuzong Chen, Bahaa Kotb, Sushma Prasad, Gang Wu, Sheng Li, Mohamed S. Abdelfattah, Zhiru Zhang
2024 — conf
Reconfigurable Lightwave Fabrics for ML Supercomputers.
OFC
Hong Liu, Ryohei Urata, Kevin Yasumura, Xiang Zhou, Roy Bannon, Jill Berger, Pedram Dashti, Norm Jouppi, Cedric F. Lam, Sheng Li, Erji Mao, Daniel Nelson, George Papen, Muhammad Mukarram Bin Tariq, Amin Vahdat
2023 J jnl
Experts Weights Averaging: A New General Training Scheme for Vision Transformers.
CoRR
Yongqi Huang, Peng Ye, Xiaoshui Huang, Sheng Li, Tao Chen, Tong He, Wanli Ouyang
2023 J jnl
FLIQS: One-Shot Mixed-Precision Floating-Point and Integer Quantization Search.
CoRR
Jordan Dotzel, Gang Wu, Andrew Li, Muhammad Umar, Yun Ni, Mohamed S. Abdelfattah, Zhiru Zhang, Liqun Cheng, Martin G. Dixon, Norman P. Jouppi, Quoc V. Le, Sheng Li
2023 — conf
Hyperscale Hardware Optimized Neural Architecture Search.
ASPLOS (3)
Sheng Li, Garrett Andersen, Tao Chen, Liqun Cheng, Julian Grady, Da Huang, Quoc V. Le, Andrew Li, Xin Li, Yang Li, Chen Liang, Yifeng Lu, Yun Ni, Ruoming Pang, Mingxing Tan, Martin Wicke, Gang Wu, Shengqi Zhu, Parthasarathy Ranganathan, Norman P. Jouppi
2023 A* conf
Lightwave Fabrics: At-Scale Optical Circuit Switching for Datacenter and Machine Learning Systems.
SIGCOMM
Hong Liu, Ryohei Urata, Kevin Yasumura, Xiang Zhou, Roy Bannon, Jill Berger, Pedram Dashti, Norm Jouppi, Cedric F. Lam, Sheng Li, Erji Mao, Daniel Nelson, George Papen, Muhammad Mukarram Bin Tariq, Amin Vahdat
2023 A* conf
TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings.
ISCA
Norman P. Jouppi, George Kurian, Sheng Li, Peter C. Ma, Rahul Nagarajan, Lifeng Nai, Nishant Patil, Suvinay Subramanian, Andy Swing, Brian Towles, Cliff Young, Xiang Zhou, Zongwei Zhou, David A. Patterson
2023 J jnl
TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings.
CoRR
Norman P. Jouppi, George Kurian, Sheng Li, Peter C. Ma, Rahul Nagarajan, Lifeng Nai, Nishant Patil, Suvinay Subramanian, Andy Swing, Brian Towles, Cliff Young, Xiang Zhou, Zongwei Zhou, David A. Patterson
2023 A* conf
TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching.
ICCV
Cheng Fu, Hanxian Huang, Zixuan Jiang, Yun Ni, Lifeng Nai, Gang Wu, Liqun Cheng, Yanqi Zhou, Sheng Li, Andrew Li, Jishen Zhao
2021 A* conf
NeuroMeter: An Integrated Power, Area, and Timing Modeling Framework for Machine Learning Accelerators Industry Track Paper.
HPCA
Tianqi Tang, Sheng Li, Lifeng Nai, Norman P. Jouppi, Yuan Xie
2021 A* conf
Searching for Fast Model Families on Datacenter Accelerators.
CVPR
Sheng Li, Mingxing Tan, Ruoming Pang, Andrew Li, Liqun Cheng, Quoc V. Le, Norman P. Jouppi
2021 J jnl
Searching for Fast Model Families on Datacenter Accelerators.
CoRR
Sheng Li, Mingxing Tan, Ruoming Pang, Andrew Li, Liqun Cheng, Quoc V. Le, Norman P. Jouppi
2021 A* conf
Ten Lessons From Three Generations Shaped Google's TPUv4i : Industrial Product.
ISCA
Norman P. Jouppi, Doe Hyun Yoon, Matthew Ashcraft, Mark Gottscho, Thomas B. Jablin, George Kurian, James Laudon, Sheng Li, Peter C. Ma, Xiaoyu Ma, Thomas Norrie, Nishant Patil, Sushma Prasad, Cliff Young, Zongwei Zhou, David A. Patterson
2021 J jnl
The Design Process for Google's Training Chips: TPUv2 and TPUv3.
IEEE Micro
Thomas Norrie, Nishant Patil, Doe Hyun Yoon, George Kurian, Sheng Li, James Laudon, Cliff Young, Norman P. Jouppi, David A. Patterson
2020 J jnl
A domain-specific supercomputer for training deep neural networks.
Commun. ACM
Norman P. Jouppi, Doe Hyun Yoon, George Kurian, Sheng Li, Nishant Patil, James Laudon, Cliff Young, David A. Patterson
2020 — conf
Google's Training Chips Revealed: TPUv2 and TPUv3.
Hot Chips Symposium
Thomas Norrie, Nishant Patil, Doe Hyun Yoon, George Kurian, Sheng Li, James Laudon, Cliff Young, Norman P. Jouppi, David A. Patterson
2019 J jnl
Parallelizing Word2Vec in Shared and Distributed Memory.
IEEE Trans. Parallel Distributed Syst.
Shihao Ji, Nadathur Satish, Sheng Li, Pradeep Dubey
2017 — conf
Work as a team or individual: Characterizing the system-level impacts of main memory partitioning.
IISWC
Eojin Lee, Jongwook Chung, Daejin Jung, Sukhan Lee, Sheng Li, Jung Ho Ahn
2016 J jnl
Achieving One Billion Key-Value Requests per Second on a Single Server.
IEEE Micro
Sheng Li, Hyeontaek Lim, Victor W. Lee, Jung Ho Ahn, Anuj Kalia, Michael Kaminsky, David G. Andersen, Seongil O, Sukhan Lee, Pradeep Dubey
2016 J jnl
Full-Stack Architecting to Achieve a Billion-Requests-Per-Second Throughput on a Single Key-Value Store Server Platform.
ACM Trans. Comput. Syst.
Sheng Li, Hyeontaek Lim, Victor W. Lee, Jung Ho Ahn, Anuj Kalia, Michael Kaminsky, David G. Andersen, Seongil O, Sukhan Lee, Pradeep Dubey
2016 J jnl
Large Pages on Steroids: Small Ideas to Accelerate Big Memory Applications.
IEEE Comput. Archit. Lett.
Daejin Jung, Sheng Li, Jung Ho Ahn
2016 J jnl
Parallelizing Word2Vec in Multi-Core and Many-Core Architectures.
CoRR
Shihao Ji, Nadathur Satish, Sheng Li, Pradeep Dubey
2016 J jnl
Parallelizing Word2Vec in Shared and Distributed Memory.
CoRR
Shihao Ji, Nadathur Satish, Sheng Li, Pradeep Dubey
2015 A* conf
Architecting to achieve a billion requests per second throughput on a single key-value store server platform.
ISCA
Sheng Li, Hyeontaek Lim, Victor W. Lee, Jung Ho Ahn, Anuj Kalia, Michael Kaminsky, David G. Andersen, Seongil O, Sukhan Lee, Pradeep Dubey
2015 J jnl
Buri: Scaling Big-Memory Computing with Hardware-Based Memory Expansion.
ACM Trans. Archit. Code Optim.
Jishen Zhao, Sheng Li, Jichuan Chang, John L. Byrne, Laura L. Ramirez, Kevin T. Lim, Yuan Xie, Paolo Faraboschi
2015 A conf
History-Assisted Adaptive-Granularity Caches (HAAG$) for High Performance 3D DRAM Architectures.
ICS
Ke Chen, Sheng Li, Jung Ho Ahn, Naveen Muralimanohar, Jishen Zhao, Cong Xu, Seongil O, Yuan Xie, Jay B. Brockman, Norman P. Jouppi
2013 A* conf
Kiln: closing the performance gap between systems with and without persistence support.
MICRO
Jishen Zhao, Sheng Li, Doe Hyun Yoon, Yuan Xie, Norman P. Jouppi
2013 B conf
McSimA+: A manycore simulator with application-level+ simulation and detailed microarchitecture modeling.
ISPASS
Jung Ho Ahn, Sheng Li, Seongil O, Norman P. Jouppi
2013 J jnl
The McPAT Framework for Multicore and Manycore Architectures: Simultaneously Modeling Power, Area, and Timing.
ACM Trans. Archit. Code Optim.
Sheng Li, Jung Ho Ahn, Richard D. Strong, Jay B. Brockman, Dean M. Tullsen, Norman P. Jouppi
2012 A conf
CACTI-3DD: Architecture-level modeling for 3D die-stacked DRAM main memory.
DATE
Ke Chen, Sheng Li, Naveen Muralimanohar, Jung Ho Ahn, Jay B. Brockman, Norman P. Jouppi
2012 A conf
MAGE: adaptive granularity and ECC for resilient and power efficient memory systems.
SC
Sheng Li, Doe Hyun Yoon, Ke Chen, Jishen Zhao, Jung Ho Ahn, Jay B. Brockman, Yuan Xie, Norman P. Jouppi
2011 A conf
CACTI-P: Architecture-level modeling for SRAM-based structures with advanced leakage reduction techniques.
ICCAD
Sheng Li, Ke Chen, Jung Ho Ahn, Jay B. Brockman, Norman P. Jouppi
2011 J jnl
Lightweight Chip Multi-Threading (LCMT): Maximizing Fine-Grained Parallelism On-Chip.
IEEE Trans. Parallel Distributed Syst.
Sheng Li, Shannon K. Kuntz, Jay B. Brockman, Peter M. Kogge
2011 A conf
System implications of memory reliability in exascale computing.
SC
Sheng Li, Ke Chen, Ming-yu Hsieh, Naveen Muralimanohar, Chad D. Kersey, Jay B. Brockman, Arun F. Rodrigues, Norman P. Jouppi
2011 A* conf
System-level integrated server architectures for scale-out datacenters.
MICRO
Sheng Li, Kevin T. Lim, Paolo Faraboschi, Jichuan Chang, Parthasarathy Ranganathan, Norman P. Jouppi
2009 A* conf
McPAT: an integrated power, area, and timing modeling framework for multicore and manycore architectures.
MICRO
Sheng Li, Jung Ho Ahn, Richard D. Strong, Jay B. Brockman, Dean M. Tullsen, Norman P. Jouppi
2008 A* conf
Design of a mask-programmable memory/multiplier array using G4-FET technology.
DAC
Jay B. Brockman, Sheng Li, Peter M. Kogge, Amit Kashyap, Mohammad M. Mojarradi
2008 A conf
Memory model effects on application performance for a lightweight multithreaded architecture.
IPDPS
Sheng Li, Shannon K. Kuntz, Peter M. Kogge, Jay B. Brockman
2007 A conf
A Heterogeneous Lightweight Multithreaded Architecture.
IPDPS
Sheng Li, Amit Kashyap, Shannon K. Kuntz, Jay B. Brockman, Peter M. Kogge, Paul L. Springer, Gary Block