Shuaiwen Leon Song

124 papers A* 16A 26B 9C 2Journal 56Unranked 15

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention. CoRR Zhongzhu Zhou, Fengxiang Bie, Ziyan Chen, Zhenyu Zhang, Yibo Yang, Junxiong Wang, Ben Athiwaratkun, Xiaoxia Wu, Shuaiwen Leon Song
2026	J	`jnl`	When RL Meets Adaptive Speculative Training: A Unified Training-Serving System. CoRR Junxiong Wang, Fengxiang Bie, Jisen Li, Zhongzhu Zhou, Zelei Shao, Yubo Wang, Yinghui Liu, Qingyang Wu, Avner May, Sri Yanamandra, Yineng Zhang, Ce Zhang, Tri Dao, Percy Liang, Ben Athiwaratkun, Shuaiwen Leon Song, Chenfeng Xu, Xiaoxia Wu
2025	J	`jnl`	Data Diversification Methods In Alignment Enhance Math Performance In LLMs. CoRR Berkan Dokmeci, Qingyang Wu, Ben Athiwaratkun, Ce Zhang, Shuaiwen Leon Song, James Zou
2025	J	`jnl`	Disentangling Reasoning and Knowledge in Medical Large Language Models. CoRR Rahul Thapa, Qingyang Wu, Kevin Wu, Harrison Zhang, Angela Zhang, Eric Wu, Haotian Ye, Suhana Bedi, Nevin Aresh, Joseph Boen, Shriya Reddy, Ben Athiwaratkun, Shuaiwen Leon Song, James Zou
2025	J	`jnl`	How Well Can General Vision-Language Models Learn Medicine By Watching Public Educational Videos? CoRR Rahul Thapa, Andrew Li, Qingyang Wu, Bryan He, Yuki Sahashi, Christina Binder, Angela Zhang, Ben Athiwaratkun, Shuaiwen Leon Song, David Ouyang, James Zou
2025	J	`jnl`	Imitate Optimal Policy: Prevail and Induce Action Collapse in Policy Gradient. CoRR Zhongzhu Zhou, Yibo Yang, Ziyan Chen, Fengxiang Bie, Haojun Xia, Xiaoxia Wu, Robert Wu, Ben Athiwaratkun, Bernard Ghanem, Shuaiwen Leon Song
2025	J	`jnl`	Improving Model Alignment Through Collective Intelligence of Open-Source LLMS. CoRR Junlin Wang, Roy Xie, Shang Zhu, Jue Wang, Ben Athiwaratkun, Bhuwan Dhingra, Shuaiwen Leon Song, Ce Zhang, James Zou
2025	A*	`conf`	Improving Model Alignment Through Collective Intelligence of Open-Source Models. ICML Junlin Wang, Roy Xie, Shang Zhu, Jue Wang, Ben Athiwaratkun, Bhuwan Dhingra, Shuaiwen Leon Song, Ce Zhang, James Zou
2025	J	`jnl`	Kitty: Accurate and Efficient 2-bit KV Cache Quantization with Dynamic Channel-wise Precision Boost. CoRR Haojun Xia, Xiaoxia Wu, Jisen Li, Robert Wu, Junxiong Wang, Jue Wang, Chenxi Li, Aman Singhal, Alay Dilipbhai Shah, Alpay Ariyak, Donglin Zhuang, Zhongzhu Zhou, Ben Athiwaratkun, Zhen Zheng, Shuaiwen Leon Song
2025	A*	`conf`	Ladder-Residual: Parallelism-Aware Architecture for Accelerating Large Model Inference with Communication Overlapping. ICML Muru Zhang, Mayank Mishra, Zhongzhu Zhou, William Brandon, Jue Wang, Yoon Kim, Jonathan Ragan-Kelley, Shuaiwen Leon Song, Ben Athiwaratkun, Tri Dao
2025	J	`jnl`	Ladder-residual: parallelism-aware architecture for accelerating large model inference with communication overlapping. CoRR Muru Zhang, Mayank Mishra, Zhongzhu Zhou, William Brandon, Jue Wang, Yoon Kim, Jonathan Ragan-Kelley, Shuaiwen Leon Song, Ben Athiwaratkun, Tri Dao
2025	J	`jnl`	RenAIssance: A Survey Into AI Text-to-Image Generation in the Era of Large Model. IEEE Trans. Pattern Anal. Mach. Intell. Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Ameneh Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song
2025	J	`jnl`	Think Deep, Think Fast: Investigating Efficiency of Verifier-free Inference-time-scaling Methods. CoRR Junlin Wang, Shang Zhu, Jon Saad-Falcon, Ben Athiwaratkun, Qingyang Wu, Jue Wang, Shuaiwen Leon Song, Ce Zhang, Bhuwan Dhingra, James Zou
2025	J	`jnl`	Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time. CoRR Zhenyu Zhang, Xiaoxia Wu, Zhongzhu Zhou, Qingyang Wu, Yineng Zhang, Pragaash Ponnusamy, Harikaran Subbaraj, Jue Wang, Shuaiwen Leon Song, Ben Athiwaratkun
2024	J	`jnl`	CorDA: Context-Oriented Decomposition Adaptation of Large Language Models. CoRR Yibo Yang, Xiaojie Li, Zhongzhu Zhou, Shuaiwen Leon Song, Jianlong Wu, Liqiang Nie, Bernard Ghanem
2024	J	`jnl`	Dragonfly: Multi-Resolution Zoom Supercharges Large Visual-Language Model. CoRR Kezhen Chen, Rahul Thapa, Rahul Chalamala, Ben Athiwaratkun, Shuaiwen Leon Song, James Zou
2024	J	`jnl`	Efficient Radius Search for Adaptive Foveal Sizing Mechanism in Collaborative Foveated Rendering Framework. IEEE Trans. Mob. Comput. Yufei Yang, Chenhao Xie, Liansheng Liu, Philip H. W. Leong, Shuaiwen Leon Song
2024	J	`jnl`	FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design. CoRR Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song
2024	A*	`conf`	MonoNN: Enabling a New Monolithic Optimization Space for Neural Network Inference Tasks on Modern GPU-Centric Architectures. OSDI Donglin Zhuang, Zhen Zheng, Haojun Xia, Xiafei Qiu, Junjie Bai, Wei Lin, Shuaiwen Leon Song
2024	—	`conf`	Quant-LLM: Accelerating the Serving of Large Language Models via FP6-Centric Algorithm-System Co-Design on Modern GPUs. USENIX ATC Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song
2024	—	`conf`	System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. IPDPS (Workshops) Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Reza Yazdani Aminabadi, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He
2024	A*	`conf`	System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. PODC Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Reza Yazdani Aminadabi, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He
2024	J	`jnl`	TeGraph+: Scalable Temporal Graph Processing Enabling Flexible Edge Modifications. IEEE Trans. Parallel Distributed Syst. Chengying Huan, Yongchao Liu, Heng Zhang, Hang Liu, Shiyang Chen, Shuaiwen Leon Song, Yanjun Wu
2023	J	`jnl`	Chiplet Cloud: Building AI Supercomputers for Serving Large Generative Language Models. CoRR Huwan Peng, Scott Davidson, Richard Shi, Shuaiwen Leon Song, Michael B. Taylor
2023	J	`jnl`	Data Fusion in Infrastructure-Augmented Autonomous Driving System: Why? Where? and How? IEEE Internet Things J. Jianda Wang, Zhendong Wang, Bo Yu, Jie Tang, Shuaiwen Leon Song, Cong Liu, Yang Hu
2023	J	`jnl`	DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. CoRR Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He
2023	J	`jnl`	DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales. CoRR Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, Zhongzhu Zhou, Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He
2023	J	`jnl`	DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. CoRR Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan A. Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael W. Irvin, J. Gregory Pauloski, Logan T. Ward, Valérie Hayot-Sasson, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian T. Foster, James J. Davis, Michael E. Papka, Thomas S. Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi A. Hanson, Thomas E. Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton D. Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin M. Aji, Angela Dalton, Michael J. Schulte, Karl W. Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens
2023	J	`jnl`	Enabling High-Efficient ReRAM-Based CNN Training Via Exploiting Crossbar-Level Insignificant Writing Elimination. IEEE Trans. Computers Lening Wang, Qiyu Wan, Peixun Ma, Jing Wang, Mingsong Chen, Shuaiwen Leon Song, Xin Fu
2023	J	`jnl`	Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity. CoRR Haojun Xia, Zhen Zheng, Yuchao Li, Donglin Zhuang, Zhongzhu Zhou, Xiafei Qiu, Yong Li, Wei Lin, Shuaiwen Leon Song
2023	J	`jnl`	Flash-LLM: Enabling Low-Cost and Highly-Efficient Large Generative Model Inference With Unstructured Sparsity. Proc. VLDB Endow. Haojun Xia, Zhen Zheng, Yuchao Li, Donglin Zhuang, Zhongzhu Zhou, Xiafei Qiu, Yong Li, Wei Lin, Shuaiwen Leon Song
2023	B	`conf`	G-Sparse: Compiler-Driven Acceleration for Generalized Sparse Computation for Graph Neural Networks on Modern GPUs. PACT Yue Jin, Chengying Huan, Heng Zhang, Yongchao Liu, Shuaiwen Leon Song, Rui Zhao, Yao Zhang, Changhua He, Wenguang Chen
2023	A	`conf`	HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. ICS Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao
2023	J	`jnl`	HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. CoRR Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao
2023	A*	`conf`	NAS-SE: Designing A Highly-Efficient In-Situ Neural Architecture Search Engine for Large-Scale Deployment. MICRO Qiyu Wan, Lening Wang, Jing Wang, Shuaiwen Leon Song, Xin Fu
2023	A*	`conf`	Post0-VR: Enabling Universal Realistic Rendering for Modern VR via Exploiting Architectural Similarity and Data Sharing. HPCA Yu Wen, Chenhao Xie, Shuaiwen Leon Song, Xin Fu
2023	J	`jnl`	RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model. CoRR Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Ameneh Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song
2023	A	`conf`	TEA: A General-Purpose Temporal Graph Random Walk Engine. EuroSys Chengying Huan, Shuaiwen Leon Song, Santosh Pandey, Hang Liu, Yongchao Liu, Baptiste Lepers, Changhua He, Kang Chen, Jinlei Jiang, Yongwei Wu
2022	A*	`conf`	AStitch: enabling a new multi-dimensional optimization space for memory-intensive ML training and inference on modern SIMT architectures. ASPLOS Zhen Zheng, Xuanda Yang, Pengzhan Zhao, Guoping Long, Kai Zhu, Feiwen Zhu, Wenyi Zhao, Xiaoyong Liu, Jun Yang, Jidong Zhai, Shuaiwen Leon Song, Wei Lin
2022	A	`conf`	Brief Industry Paper: The Necessity of Adaptive Data Fusion in Infrastructure-Augmented Autonomous Driving System. RTAS Shaoshan Liu, Jianda Wang, Zhendong Wang, Bo Yu, Wei Hu, Yahui Liu, Jie Tang, Shuaiwen Leon Song, Cong Liu, Yang Hu
2022	J	`jnl`	Brief Industry Paper: The Necessity of Adaptive Data Fusion in Infrastructure-Augmented Autonomous Driving System. CoRR Shaoshan Liu, Jianda Wang, Zhendong Wang, Bo Yu, Wei Hu, Yahui Liu, Jie Tang, Shuaiwen Leon Song, Cong Liu, Yang Hu
2022	A	`conf`	Bring orders into uncertainty: enabling efficient uncertain graph processing via novel path sampling on multi-accelerator systems. ICS Heng Zhang, Lingda Li, Hang Liu, Donglin Zhuang, Rui Liu, Chengying Huan, Shuang Song, Dingwen Tao, Yongchao Liu, Charles He, Yanjun Wu, Shuaiwen Leon Song
2022	J	`jnl`	Detecting Performance Variance for Parallel Applications Without Source Code. IEEE Trans. Parallel Distributed Syst. Jidong Zhai, Liyan Zheng, Feng Zhang, Xiongchao Tang, Haojie Wang, Teng Yu, Yuyang Jin, Shuaiwen Leon Song, Wenguang Chen
2022	J	`jnl`	MSREP: A Fast yet Light Sparse Matrix Framework for Multi-GPU Systems. CoRR Jieyang Chen, Chenhao Xie, Jesun Sahariar Firoz, Jiajia Li, Shuaiwen Leon Song, Kevin J. Barker, Mark Raugas, Ang Li
2022	B	`conf`	T-GCN: A Sampling Based Streaming Graph Neural Network System with Hybrid Architecture. PACT Chengying Huan, Shuaiwen Leon Song, Yongchao Liu, Heng Zhang, Hang Liu, Charles He, Kang Chen, Jinlei Jiang, Yongwei Wu
2022	A*	`conf`	TeGraph: A Novel General-Purpose Temporal Graph Computing Engine. ICDE Chengying Huan, Hang Liu, Mengxing Liu, Yongchao Liu, Changhua He, Kang Chen, Jinlei Jiang, Yongwei Wu, Shuaiwen Leon Song
2022	J	`jnl`	Towards Efficient Architecture and Algorithms for Sensor Fusion. CoRR Zhendong Wang, Xiaoming Zeng, Shuaiwen Leon Song, Yang Hu
2022	B	`conf`	Vapro: performance variance detection and diagnosis for production-run parallel applications. PPoPP Liyan Zheng, Jidong Zhai, Xiongchao Tang, Haojie Wang, Teng Yu, Yuyang Jin, Shuaiwen Leon Song, Wenguang Chen
2021	B	`conf`	A novel memory-efficient deep learning training framework via error-bounded lossy compression. PPoPP Sian Jin, Guanpeng Li, Shuaiwen Leon Song, Dingwen Tao
2021	B	`conf`	An efficient uncertain graph processing framework for heterogeneous architectures. PPoPP Heng Zhang, Lingda Li, Donglin Zhuang, Rui Liu, Shuang Song, Dingwen Tao, Yanjun Wu, Shuaiwen Leon Song
2021	J	`jnl`	COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compression. CoRR Sian Jin, Chengming Zhang, Xintong Jiang, Yunhe Feng, Hui Guan, Guanpeng Li, Shuaiwen Leon Song, Dingwen Tao
2021	A	`conf`	ClickTrain: efficient and accurate end-to-end deep learning training via fine-grained architecture-preserving pruning. ICS Chengming Zhang, Geng Yuan, Wei Niu, Jiannan Tian, Sian Jin, Donglin Zhuang, Zhe Jiang, Yanzhi Wang, Bin Ren, Shuaiwen Leon Song, Dingwen Tao
2021	J	`jnl`	Dr. Top-k: Delegate-Centric Top-k on GPUs. CoRR Anil Gaihre, Da Zheng, Scott Weitze, Lingda Li, Shuaiwen Leon Song, Caiwen Ding, Xiaoye S. Li, Hang Liu
2021	A	`conf`	Dr. Top-k: delegate-centric Top-k on GPUs. SC Anil Gaihre, Da Zheng, Scott Weitze, Lingda Li, Shuaiwen Leon Song, Caiwen Ding, Xiaoye S. Li, Hang Liu
2021	J	`jnl`	Enabling Highly Efficient Capsule Networks Processing Through Software-Hardware Co-Design. IEEE Trans. Computers Xingyao Zhang, Xin Fu, Donglin Zhuang, Chenhao Xie, Shuaiwen Leon Song
2021	B	`conf`	Fast and Scalable Sparse Triangular Solver for Multi-GPU Based HPC Architectures. ICPP Chenhao Xie, Jieyang Chen, Jesun Firoz, Jiajia Li, Shuaiwen Leon Song, Kevin J. Barker, Mark Raugas, Ang Li
2021	J	`jnl`	MAPA: Multi-Accelerator Pattern Allocation Policy for Multi-Tenant GPU Servers. CoRR Kiran Ranganath, Joshua D. Suetterlein, Joseph B. Manzano, Shuaiwen Leon Song, Daniel Wong
2021	A	`conf`	MAPA: multi-accelerator pattern allocation policy for multi-tenant GPU servers. SC Kiran Ranganath, Joshua D. Suetterlein, Joseph B. Manzano, Shuaiwen Leon Song, Daniel Wong
2021	J	`jnl`	Q-VR: System-Level Design for Future Mobile Collaborative Virtual Reality. CoRR Chenhao Xie, Xie Li, Yang Hu, Huwan Peng, Michael B. Taylor, Shuaiwen Leon Song
2021	A*	`conf`	Q-VR: system-level design for future mobile collaborative virtual reality. ASPLOS Chenhao Xie, Xie Li, Yang Hu, Huwan Peng, Michael B. Taylor, Shuaiwen Leon Song
2021	J	`jnl`	Randomness In Neural Network Training: Characterizing The Impact of Tooling. CoRR Donglin Zhuang, Xingyao Zhang, Shuaiwen Leon Song, Sara Hooker
2021	A*	`conf`	Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving. MICRO Qiyu Wan, Haojun Xia, Xingyao Zhang, Lening Wang, Shuaiwen Leon Song, Xin Fu
2021	J	`jnl`	Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving. CoRR Qiyu Wan, Haojun Xia, Xingyao Zhang, Lening Wang, Shuaiwen Leon Song, Xin Fu
2021	J	`jnl`	TSM2X: High-performance tall-and-skinny matrix-matrix multiplication on GPUs. J. Parallel Distributed Comput. Cody Rivera, Jieyang Chen, Nan Xiong, Jing Zhang, Shuaiwen Leon Song, Dingwen Tao
2021	J	`jnl`	Toward Efficient Interactions between Python and Native Libraries. CoRR Jialiang Tan, Yu Chen, Zhenming Liu, Bin Ren, Shuaiwen Leon Song, Xipeng Shen, Xu Liu
2021	—	`conf`	Toward efficient interactions between Python and native libraries. ESEC/SIGSOFT FSE Jialiang Tan, Yu Chen, Zhenming Liu, Bin Ren, Shuaiwen Leon Song, Xipeng Shen, Xu Liu
2021	A*	`conf`	η-LSTM: Co-Designing Highly-Efficient Large LSTM Training via Exploiting Memory-Saving and Architectural Design Opportunities. ISCA Xingyao Zhang, Haojun Xia, Donglin Zhuang, Hao Sun, Xin Fu, Michael B. Taylor, Shuaiwen Leon Song
2020	J	`jnl`	A Novel Memory-Efficient Deep Learning Training Framework via Error-Bounded Lossy Compression. CoRR Sian Jin, Guanpeng Li, Shuaiwen Leon Song, Dingwen Tao
2020	J	`jnl`	An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning. CoRR Chengming Zhang, Geng Yuan, Wei Niu, Jiannan Tian, Sian Jin, Donglin Zhuang, Zhe Jiang, Yanzhi Wang, Bin Ren, Shuaiwen Leon Song, Dingwen Tao
2020	A*	`conf`	Enabling Highly Efficient Capsule Networks Processing Through A PIM-Based Architecture Design. HPCA Xingyao Zhang, Shuaiwen Leon Song, Chenhao Xie, Jing Wang, Weigong Zhang, Xin Fu
2020	J	`jnl`	Energy-Efficient GPU L2 Cache Design Using Instruction-Level Data Locality Similarity. ACM Trans. Design Autom. Electr. Syst. Jingweijia Tan, Kaige Yan, Shuaiwen Leon Song, Xin Fu
2020	J	`jnl`	Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect. IEEE Trans. Parallel Distributed Syst. Ang Li, Shuaiwen Leon Song, Jieyang Chen, Jiajia Li, Xu Liu, Nathan R. Tallent, Kevin J. Barker
2020	J	`jnl`	Fast and Scalable Sparse Triangular Solver for Multi-GPU Based HPC Architectures. CoRR Chenhao Xie, Jieyang Chen, Jesun Sahariar Firoz, Jiajia Li, Shuaiwen Leon Song, Kevin J. Barker, Mark Raugas, Ang Li
2020	J	`jnl`	ISM2: Optimizing Irregular-Shaped Matrix-Matrix Multiplication on GPUs. CoRR Cody Rivera, Jieyang Chen, Nan Xiong, Shuaiwen Leon Song, Dingwen Tao
2020	J	`jnl`	OO-VR: NUMA Friendly Object-Oriented VR Rendering Framework For Future NUMA-Based Multi-GPU Systems. CoRR Chenhao Xie, Xin Fu, Mingsong Chen, Shuaiwen Leon Song
2019	A	`conf`	BSTC: a novel binarized-soft-tensor-core design for accelerating bit-based approximated neural nets. SC Ang Li, Tong Geng, Tianqi Wang, Martin C. Herbordt, Shuaiwen Leon Song, Kevin J. Barker
2019	J	`jnl`	Enabling Highly Efficient Capsule Networks Processing Through A PIM-Based Architecture Design. CoRR Xingyao Zhang, Shuaiwen Leon Song, Chenhao Xie, Jing Wang, Weigong Zhang, Xin Fu
2019	J	`jnl`	Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect. CoRR Ang Li, Shuaiwen Leon Song, Jieyang Chen, Jiajia Li, Xu Liu, Nathan R. Tallent, Kevin J. Barker
2019	—	`conf`	LP-BNN: Ultra-low-Latency BNN Inference with Layer Parallelism. ASAP Tong Geng, Tianqi Wang, Chunshu Wu, Chen Yang, Shuaiwen Leon Song, Ang Li, Martin C. Herbordt
2019	A	`conf`	LoSCache: Leveraging Locality Similarity to Build Energy-Efficient GPU L2 Cache. DATE Jingweijia Tan, Kaige Yan, Shuaiwen Leon Song, Xin Fu
2019	A*	`conf`	OO-VR: NUMA friendly object-oriented VR rendering framework for future NUMA-based multi-GPU systems. ISCA Chenhao Xie, Xin Fu, Mingsong Chen, Shuaiwen Leon Song
2019	J	`jnl`	Speeding up Collective Communications Through Inter-GPU Re-Routing. IEEE Comput. Archit. Lett. Kiran Ranganath, AmirAli Abdolrashidi, Shuaiwen Leon Song, Daniel Wong
2018	A	`conf`	CUDAAdvisor: LLVM-based runtime profiling for modern GPUs. CGO Du Shen, Shuaiwen Leon Song, Ang Li, Xu Liu
2018	—	`conf`	Introduction to HPPAC 2018. IPDPS Workshops Shuaiwen Leon Song, Natalie J. Bates, Ang Li
2018	A	`conf`	Lightweight detection of cache conflicts. CGO Probir Roy, Shuaiwen Leon Song, Sriram Krishnamoorthy, Xu Liu
2018	J	`jnl`	NUMA-Caffe: NUMA-Aware Deep Learning Neural Networks. ACM Trans. Archit. Code Optim. Probir Roy, Shuaiwen Leon Song, Sriram Krishnamoorthy, Abhinav Vishnu, Dipanjan Sengupta, Xu Liu
2018	J	`jnl`	SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks. CoRR Linnan Wang, Jinmian Ye, Yiyang Zhao, Wei Wu, Ang Li, Shuaiwen Leon Song, Zenglin Xu, Tim Kraska
2018	B	`conf`	Superneurons: dynamic GPU memory management for training deep neural networks. PPoPP Linnan Wang, Jinmian Ye, Yiyang Zhao, Wei Wu, Ang Li, Shuaiwen Leon Song, Zenglin Xu, Tim Kraska
2018	—	`conf`	Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite. IISWC Ang Li, Shuaiwen Leon Song, Jieyang Chen, Xu Liu, Nathan R. Tallent, Kevin J. Barker
2018	A	`conf`	Warp-Consolidation: A Novel Execution Model for GPUs. ICS Ang Li, Weifeng Liu, Linnan Wang, Kevin J. Barker, Shuaiwen Leon Song
2017	A*	`conf`	BVF: enabling significant on-chip power savings via bit-value-favor for throughput processors. MICRO Ang Li, Wenfeng Zhao, Shuaiwen Leon Song
2017	A	`conf`	Enabling scalability-sensitive speculative parallelization for FSM computations. ICS Junqiao Qiu, Zhijia Zhao, Bo Wu, Abhinav Vishnu, Shuaiwen Leon Song
2017	—	`conf`	Evaluating GPGPU Memory Performance Through the C-AMAT Model. MCHPC@SC Ning Zhang, Chuntao Jiang, Xian-He Sun, Shuaiwen Leon Song
2017	C	`conf`	EvoGraph: On-the-Fly Efficient Mining of Evolving Graphs on GPU. ISC Dipanjan Sengupta, Shuaiwen Leon Song
2017	A	`conf`	Exploring and analyzing the real impact of modern on-package memory on HPC scientific kernels. SC Ang Li, Weifeng Liu, Mads Ruben Burgdorff Kristensen, Brian Vinter, Hao Wang, Kaixi Hou, Andres Marquez, Shuaiwen Leon Song
2017	—	`conf`	HPPAC Workshop Introduction. IPDPS Workshops Shuaiwen Leon Song, Richard W. Vuduc
2017	—	`conf`	IPDRM Workshop Introduction. IPDPS Workshops Shuaiwen Leon Song, Torsten Hoefler
2017	A*	`conf`	Locality-Aware CTA Clustering for Modern GPUs. ASPLOS Ang Li, Shuaiwen Leon Song, Weifeng Liu, Xu Liu, Akash Kumar, Henk Corporaal
2017	A*	`conf`	Processing-in-Memory Enabled Graphics Processors for 3D Rendering. HPCA Chenhao Xie, Shuaiwen Leon Song, Jing Wang, Weigong Zhang, Xin Fu
2016	J	`jnl`	A Graph-based Model for GPU Caching Problems. CoRR Lingda Li, Ari B. Hayes, Stephen A. Hackler, Eddy Z. Zhang, Mario Szegedy, Shuaiwen Leon Song
2016	B	`conf`	Combating the Reliability Challenge of GPU Register File at Low Supply Voltage. PACT Jingweijia Tan, Shuaiwen Leon Song, Kaige Yan, Xin Fu, Andrés Márquez, Darren J. Kerbyson
2016	A	`conf`	Critical points based register-concurrency autotuning for GPUs. DATE Ang Li, Shuaiwen Leon Song, Akash Kumar, Eddy Z. Zhang, Daniel G. Chavarría-Miranda, Henk Corporaal
2016	—	`conf`	HPPAC Introduction and Committees. IPDPS Workshops Barry Rountree, Shuaiwen Leon Song
2016	—	`conf`	IPDRM Introduction and Committees. IPDPS Workshops Shuaiwen Leon Song, Todd Gamblin
2016	A	`conf`	New-Sum: A Novel Online ABFT Scheme For General Iterative Methods. HPDC Dingwen Tao, Shuaiwen Leon Song, Sriram Krishnamoorthy, Panruo Wu, Xin Liang, Eddy Z. Zhang, Darren J. Kerbyson, Zizhong Chen
2016	A	`conf`	Orion: A Framework for GPU Occupancy Tuning. Middleware Ari B. Hayes, Lingda Li, Daniel G. Chavarría-Miranda, Shuaiwen Leon Song, Eddy Z. Zhang
2016	A	`conf`	SFU-Driven Transparent Approximation Acceleration on GPUs. ICS Ang Li, Shuaiwen Leon Song, Mark Wijtvliet, Akash Kumar, Henk Corporaal
2016	A	`conf`	SMT-Aware Instantaneous Footprint Optimization. HPDC Probir Roy, Xu Liu, Shuaiwen Leon Song
2016	J	`jnl`	Scalable Energy Efficiency with Resilience for High Performance Computing Systems: A Quantitative Methodology. ACM Trans. Archit. Code Optim. Li Tan, Zizhong Chen, Shuaiwen Leon Song
2016	A	`conf`	Tag-Split Cache for Efficient GPGPU Cache Utilization. ICS Lingda Li, Ari B. Hayes, Shuaiwen Leon Song, Eddy Z. Zhang
2016	A	`conf`	X: A Comprehensive Analytic Model for Parallel Machines. IPDPS Ang Li, Shuaiwen Leon Song, Eric Brugel, Akash Kumar, Daniel G. Chavarría-Miranda, Henk Corporaal
2015	—	`conf`	GraphReduce: Large-Scale Graph Analytics on Accelerator-Based HPC Systems. IPDPS Workshops Dipanjan Sengupta, Kapil Agarwal, Shuaiwen Leon Song, Karsten Schwan
2015	A	`conf`	GraphReduce: processing large-scale graphs on accelerator-based systems. SC Dipanjan Sengupta, Shuaiwen Leon Song, Kapil Agarwal, Karsten Schwan
2015	A	`conf`	Investigating the Interplay between Energy Efficiency and Resilience in High Performance Computing. IPDPS Li Tan, Shuaiwen Leon Song, Panruo Wu, Zizhong Chen, Rong Ge, Darren J. Kerbyson
2015	A	`conf`	Locality-Driven Dynamic GPU Cache Bypassing. ICS Chao Li, Shuaiwen Leon Song, Hongwen Dai, Albert Sidelnik, Siva Kumar Sastry Hari, Huiyang Zhou
2015	J	`jnl`	Scaling Support Vector Machines on modern HPC platforms. J. Parallel Distributed Comput. Yang You, Haohuan Fu, Shuaiwen Leon Song, Amanda Peters Randles, Darren J. Kerbyson, Andres Marquez, Guangwen Yang, Adolfy Hoisie
2014	B	`conf`	ACDT: Architected Composite Data Types trading-in unfettered data access for improved execution. ICPADS Andres Marquez, Joseph B. Manzano, Shuaiwen Leon Song, Benoît Meister, Sunil Shrestha, Thomas St. John, Guang R. Gao
2014	A	`conf`	An adaptive cross-architecture combination method for graph traversal. ICS Yang You, Shuaiwen Leon Song, Darren J. Kerbyson
2014	J	`jnl`	Evaluating multi-core and many-core architectures through accelerating the three-dimensional Lax-Wendroff correction stencil. Int. J. High Perform. Comput. Appl. Yang You, Haohuan Fu, Shuaiwen Leon Song, Maryam Mehri Dehnavi, Lin Gan, Xiaomeng Huang, Guangwen Yang
2014	A	`conf`	MIC-SVM: Designing a Highly Efficient Support Vector Machine for Advanced Modern Multi-core and Many-Core Architectures. IPDPS Yang You, Shuaiwen Leon Song, Haohuan Fu, Andres Marquez, Maryam Mehri Dehnavi, Kevin J. Barker, Kirk W. Cameron, Amanda Peters Randles, Guangwen Yang
2013	C	`conf`	EDR: An energy-aware runtime load distribution system for data-intensive applications in the cloud. CLUSTER Bo Li, Shuaiwen Leon Song, Ivona Bezáková, Kirk W. Cameron
2013	—	`conf`	Unified performance and power modeling of scientific workloads. E2SC@SC Shuaiwen Leon Song, Kevin J. Barker, Darren J. Kerbyson
2012	—	`conf`	Abstract: Three Steps to Model Power-Performance Efficiency for Emergent GPU-Based Parallel Systems. SC Companion Shuaiwen Leon Song, Chun-Yi Su, Barry Rountree, Kirk W. Cameron
2012	—	`conf`	Poster: Three Steps to Model Power-Performance Efficiency for Emergent GPU-Based Parallel Systems. SC Companion Shuaiwen Leon Song