Yuxiong He - RankMe

187 papers A* 34A 25B 9C 2Misc 1Journal 86Unranked 29

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning. CoRR Zhaoyang Wang, Canwen Xu, Boyi Liu, Yite Wang, Siwei Han, Zhewei Yao, Huaxiu Yao, Yuxiong He
2026	J	`jnl`	DARE-bench: Evaluating Modeling and Instruction Fidelity of LLMs in Data Science. CoRR Fan Shu, Yite Wang, Ruofan Wu, Boyi Liu, Zhewei Yao, Yuxiong He, Feng Yan
2026	J	`jnl`	Learning to Self-Evolve. CoRR Xiaoyin Chen, Canwen Xu, Yite Wang, Boyi Liu, Zhewei Yao, Yuxiong He
2026	—	`conf`	Shift Parallelism: Low-Latency, High-Throughput LLM Inference for Dynamic Workloads. ASPLOS (2) Mert Hidayetoglu, Aurick Qiao, Michael Wyatt, Jeff Rasley, Yuxiong He, Samyam Rajbhandari
2026	—	`conf`	TAGQuant: Token-Aware Clustering for Group-Wise Quantization. EACL (Industry Track) Jaeseong Lee, Seung-won Hwang, Aurick Qiao, Zhewei Yao, Yuxiong He
2025	J	`jnl`	Agentic Verification for Ambiguous Query Disambiguation. CoRR Youngwon Lee, Seung-won Hwang, Ruofan Wu, Feng Yan, Danmei Xu, Moutasem Akkad, Zhewei Yao, Yuxiong He
2025	J	`jnl`	Arctic Inference with Shift Parallelism: Fast and Efficient Open Source Inference System for Enterprise AI. CoRR Samyam Rajbhandari, Mert Hidayetoglu, Aurick Qiao, Ye Wang, Juncheng Yang, Jeff Rasley, Michael Wyatt, Yuxiong He
2025	J	`jnl`	Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences. CoRR Stas Bekman, Samyam Rajbhandari, Michael Wyatt, Jeff Rasley, Tunji Ruwase, Zhewei Yao, Aurick Qiao, Yuxiong He
2025	J	`jnl`	Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL. CoRR Zhewei Yao, Guoheng Sun, Lukasz Borchmann, Zheyu Shen, Minghang Deng, Bohan Zhai, Hao Zhang, Ang Li, Yuxiong He
2025	—	`conf`	CORD: Balancing COnsistency and Rank Distillation for Robust Retrieval-Augmented Generation. NAACL (Short Papers) Youngwon Lee, Seung-won Hwang, Daniel F. Campos, Filip Gralinski, Zhewei Yao, Yuxiong He
2025	J	`jnl`	ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering. CoRR Ruofan Wu, Youngwon Lee, Fan Shu, Danmei Xu, Seung-won Hwang, Zhewei Yao, Yuxiong He, Feng Yan
2025	A*	`conf`	ConvCodeWorld: Benchmarking Conversational Code Generation in Reproducible Feedback Environments. ICLR Hojae Han, Seung-won Hwang, Rajhans Samdani, Yuxiong He
2025	J	`jnl`	ConvCodeWorld: Benchmarking Conversational Code Generation in Reproducible Feedback Environments. CoRR Hojae Han, Seung-won Hwang, Rajhans Samdani, Yuxiong He
2025	J	`jnl`	ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedback. CoRR Bohan Zhai, Canwen Xu, Yuxiong He, Zhewei Yao
2025	J	`jnl`	Fast and Accurate Causal Parallel Decoding using Jacobi Forcing. CoRR Lanxiang Hu, Siqi Kou, Yichao Fu, Samyam Rajbhandari, Tajana Rosing, Yuxiong He, Zhijie Deng, Hao Zhang
2025	J	`jnl`	FedCust: Offloading hyperparameter customization for federated learning. Perform. Evaluation Syed Zawad, Xiaolong Ma, Jun Yi, Cheng Li, Minjia Zhang, Lei Yang, Feng Yan, Yuxiong He
2025	—	`conf`	Inference Scaling for Bridging Retrieval and Augmented Generation. NAACL (Findings) Youngwon Lee, Seung-won Hwang, Daniel F. Campos, Filip Gralinski, Zhewei Yao, Yuxiong He
2025	J	`jnl`	MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility. CoRR Yexiao He, Ang Li, Boyi Liu, Zhewei Yao, Yuxiong He
2025	—	`conf`	Optimizing Reasoning for Text-to-SQL with Execution Feedback. ACL (Findings) Bohan Zhai, Canwen Xu, Yuxiong He, Zhewei Yao
2025	J	`jnl`	RenAIssance: A Survey Into AI Text-to-Image Generation in the Era of Large Model. IEEE Trans. Pattern Anal. Mach. Intell. Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Ameneh Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song
2025	B	`conf`	SEE++: Evolving Snowpark Execution Environment for Modern Workloads. IEEE Big Data Gaurav Jain, Brandon Baker, Joe Yin, Chenwei Xie, Zihao Ye, Sidh Kulkarni, Sara Abdelrahman, Nova Qi, Urjeet Shrestha, Mike Halcrow, Dave Bailey, Yuxiong He
2025	J	`jnl`	SEE++: Evolving Snowpark Execution Environment for Modern Workloads. CoRR Gaurav Jain, Brandon Baker, Joe Yin, Chenwei Xie, Zihao Ye, Sidh Kulkarni, Sara Abdelrahman, Nova Qi, Urjeet Shrestha, Mike Halcrow, Dave Bailey, Yuxiong He
2025	—	`conf`	STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning. ACL (1) Jaeseong Lee, Seung-won Hwang, Aurick Qiao, Daniel F. Campos, Zhewei Yao, Yuxiong He
2025	J	`jnl`	Shift Parallelism: Low-Latency, High-Throughput LLM Inference for Dynamic Workloads. CoRR Mert Hidayetoglu, Aurick Qiao, Michael Wyatt, Jeff Rasley, Yuxiong He, Samyam Rajbhandari
2025	J	`jnl`	Snowpark: Performant, Secure, User-Friendly Data Engineering and AI/ML Next To Your Data. CoRR Brandon Baker, Elliott Brossard, Chenwei Xie, Zihao Ye, Deen Liu, Yijun Xie, Arthur Zwiegincew, Nitya Kumar Sharma, Gaurav Jain, Eugene Retunsky, Mike Halcrow, Derek Denny-Brown, Istvan Cseri, Tyler Akidau, Yuxiong He
2025	A*	`conf`	SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation. EMNLP Aurick Qiao, Zhewei Yao, Samyam Rajbhandari, Yuxiong He
2025	J	`jnl`	TALE: Token-Adaptive Low-Rank KVCache Approximation with Reconstruction Elimination. Trans. Assoc. Comput. Linguistics Jaeseong Lee, Seung-won Hwang, Aurick Qiao, Daniel F. Campos, Zhewei Yao, Yuxiong He
2024	J	`jnl`	CORD: Balancing COnsistency and Rank Distillation for Robust Retrieval-Augmented Generation. CoRR Youngwon Lee, Seung-won Hwang, Daniel F. Campos, Filip Gralinski, Zhewei Yao, Yuxiong He
2024	A*	`conf`	DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing. AAAI Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Connor Holmes, Cheng Li, Yuxiong He
2024	J	`jnl`	DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference. CoRR Connor Holmes, Masahiro Tanaka, Michael Wyatt, Ammar Ahmad Awan, Jeff Rasley, Samyam Rajbhandari, Reza Yazdani Aminabadi, Heyang Qin, Arash Bakhtiari, Lev Kurilenko, Yuxiong He
2024	A*	`conf`	Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation. AAAI Zhewei Yao, Xiaoxia Wu, Cheng Li, Stephen Youn, Yuxiong He
2024	J	`jnl`	FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design. CoRR Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song
2024	J	`jnl`	FastPersist: Accelerating Model Checkpointing in Deep Learning. CoRR Guanhua Wang, Olatunji Ruwase, Bing Xie, Yuxiong He
2024	J	`jnl`	Inference Scaling for Bridging Retrieval and Augmented Generation. CoRR Youngwon Lee, Seung-won Hwang, Daniel F. Campos, Filip Gralinski, Zhewei Yao, Yuxiong He
2024	—	`conf`	Quant-LLM: Accelerating the Serving of Large Language Models via FP6-Centric Algorithm-System Co-Design on Modern GPUs. USENIX ATC Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song
2024	J	`jnl`	STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning. CoRR Jaeseong Lee, Seung-won Hwang, Aurick Qiao, Daniel F. Campos, Zhewei Yao, Yuxiong He
2024	J	`jnl`	SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation. CoRR Aurick Qiao, Zhewei Yao, Samyam Rajbhandari, Yuxiong He
2024	—	`conf`	System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. IPDPS (Workshops) Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Reza Yazdani Aminabadi, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He
2024	A*	`conf`	System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. PODC Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Reza Yazdani Aminadabi, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He
2024	A*	`conf`	ZeRO++: Extremely Efficient Collective Communication for Large Model Training. ICLR Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He
2023	J	`jnl`	A Comprehensive Study on Post-Training Quantization for Large Language Models. CoRR Zhewei Yao, Cheng Li, Xiaoxia Wu, Stephen Youn, Yuxiong He
2023	A	`conf`	A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training. ICS Siddharth Singh, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He, Abhinav Bhatele
2023	J	`jnl`	A Novel Tensor-Expert Hybrid Parallelism Approach to Scale Mixture-of-Experts Training. CoRR Siddharth Singh, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He, Abhinav Bhatele
2023	J	`jnl`	DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. CoRR Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Shuaiwen Leon Song, Samyam Rajbhandari, Yuxiong He
2023	J	`jnl`	DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales. CoRR Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, Zhongzhu Zhou, Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He
2023	J	`jnl`	DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention. CoRR Zhewei Yao, Xiaoxia Wu, Conglong Li, Minjia Zhang, Heyang Qin, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He
2023	J	`jnl`	DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. CoRR Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan A. Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael W. Irvin, J. Gregory Pauloski, Logan T. Ward, Valérie Hayot-Sasson, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian T. Foster, James J. Davis, Michael E. Papka, Thomas S. Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi A. Hanson, Thomas E. Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton D. Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin M. Aji, Angela Dalton, Michael J. Schulte, Karl W. Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens
2023	A*	`conf`	DySR: Adaptive Super-Resolution via Algorithm and System Co-design. ICLR Syed Zawad, Cheng Li, Zhewei Yao, Elton Zheng, Yuxiong He, Feng Yan
2023	A	`conf`	HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. ICS Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao
2023	J	`jnl`	HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. CoRR Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao
2023	A	`conf`	MCR-DL: Mix-and-Match Communication Runtime for Deep Learning. IPDPS Quentin Anthony, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He, Aamir Shafi, Mustafa Abduljabbar, Hari Subramoni, Dhabaleswar K. Panda
2023	J	`jnl`	MCR-DL: Mix-and-Match Communication Runtime for Deep Learning. CoRR Quentin Anthony, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He, Aamir Shafi, Mustafa Abduljabbar, Hari Subramoni, Dhabaleswar K. Panda
2023	A*	`conf`	Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam. ICLR Yucheng Lu, Conglong Li, Minjia Zhang, Christopher De Sa, Yuxiong He
2023	J	`jnl`	RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model. CoRR Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Ameneh Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song
2023	A	`conf`	Revisiting the Efficiency-Accuracy Tradeoff in Adapting Transformer Models via Adversarial Fine-Tuning. ECAI Minjia Zhang, Uma-Naresh Niranjan, Yuxiong He
2023	J	`jnl`	SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks. ACM Trans. Embed. Comput. Syst. Reza Yazdani Aminabadi, Olatunji Ruwase, Minjia Zhang, Yuxiong He, José-María Arnau, Antonio González
2023	—	`conf`	Scaling Vision-Language Models with Sparse Mixture of Experts. EMNLP (Findings) Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, Yuxiong He
2023	J	`jnl`	Scaling Vision-Language Models with Sparse Mixture of Experts. CoRR Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, Yuxiong He
2023	J	`jnl`	Selective Guidance: Are All the Denoising Steps of Guided Diffusion Important? CoRR Pareesa Ameneh Golnari, Zhewei Yao, Yuxiong He
2023	J	`jnl`	Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases. CoRR Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He
2023	A*	`conf`	Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases. ICML Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He
2023	J	`jnl`	ZeRO++: Extremely Efficient Collective Communication for Giant Model Training. CoRR Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He
2023	J	`jnl`	ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks. CoRR Xiaoxia Wu, Haojun Xia, Stephen Youn, Zhen Zheng, Shiyang Chen, Arash Bakhtiari, Michael Wyatt, Reza Yazdani Aminabadi, Yuxiong He, Olatunji Ruwase, Leon Song, Zhewei Yao
2023	J	`jnl`	ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats. CoRR Xiaoxia Wu, Zhewei Yao, Yuxiong He
2023	J	`jnl`	ZeroQuant-HERO: Hardware-Enhanced Robust Optimized Post-Training Quantization Framework for W8A8 Transformers. CoRR Zhewei Yao, Reza Yazdani Aminabadi, Stephen Youn, Xiaoxia Wu, Elton Zheng, Yuxiong He
2022	Misc	`conf`	1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence Speed. HIPC Conglong Li, Ammar Ahmad Awan, Hanlin Tang, Samyam Rajbhandari, Yuxiong He
2022	A*	`conf`	Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers. AAAI Minjia Zhang, Uma-Naresh Niranjan, Yuxiong He
2022	J	`jnl`	BiFeat: Supercharge GNN Training via Graph Feature Quantization. CoRR Yuxin Ma, Ping Gong, Jun Yi, Zhewei Yao, Minjie Wang, Cheng Li, Yuxiong He, Feng Yan
2022	J	`jnl`	Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding. CoRR Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu
2022	J	`jnl`	DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing. CoRR Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Connor Holmes, Cheng Li, Yuxiong He
2022	J	`jnl`	DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale. CoRR Reza Yazdani Aminabadi, Samyam Rajbhandari, Minjia Zhang, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Jeff Rasley, Shaden Smith, Olatunji Ruwase, Yuxiong He
2022	A	`conf`	DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale. SC Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Olatunji Ruwase, Shaden Smith, Minjia Zhang, Jeff Rasley, Yuxiong He
2022	A*	`conf`	DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale. ICML Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He
2022	J	`jnl`	DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale. CoRR Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He
2022	J	`jnl`	Extreme Compression for Pre-trained Transformers Made Simple and Efficient. CoRR Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He
2022	A	`conf`	GraSP: Optimizing Graph-based Nearest Neighbor Search with Subgraph Sampling and Pruning. WSDM Minjia Zhang, Wenhan Wang, Yuxiong He
2022	J	`jnl`	Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam. CoRR Yucheng Lu, Conglong Li, Minjia Zhang, Christopher De Sa, Yuxiong He
2022	J	`jnl`	Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers. CoRR Zhewei Yao, Xiaoxia Wu, Conglong Li, Connor Holmes, Minjia Zhang, Cheng Li, Yuxiong He
2022	J	`jnl`	ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise. CoRR Minjia Zhang, Uma-Naresh Niranjan, Yuxiong He
2022	—	`conf`	Task Offloading Based on GRU Model in IoT. EITCE Xiao Zhang, Yuxiong He, Youhuai Wang, Xiaoming Chen, Shi Jin, Ye Liang
2022	A*	`conf`	The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models. NeurIPS Conglong Li, Minjia Zhang, Yuxiong He
2022	J	`jnl`	Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model. CoRR Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro
2022	A*	`conf`	XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient. NeurIPS Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He
2022	A*	`conf`	ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers. NeurIPS Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He
2022	J	`jnl`	ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers. CoRR Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He
2021	A*	`conf`	1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed. ICML Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He
2021	J	`jnl`	1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed. CoRR Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He
2021	J	`jnl`	1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence Speed. CoRR Conglong Li, Ammar Ahmad Awan, Hanlin Tang, Samyam Rajbhandari, Yuxiong He
2021	J	`jnl`	Curriculum Learning: A Regularization Method for Efficient and Stable Billion-Scale GPT Model Pre-Training. CoRR Conglong Li, Minjia Zhang, Yuxiong He
2021	A*	`conf`	NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM. NeurIPS Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu
2021	J	`jnl`	NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM. CoRR Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu
2021	J	`jnl`	Scalable and Efficient MoE Training for Multitask Multilingual Models. CoRR Young Jin Kim, Ammar Ahmad Awan, Alexandre Muzio, Andrés Felipe Cruz-Salinas, Liyang Lu, Amr Hendy, Samyam Rajbhandari, Yuxiong He, Hany Hassan Awadalla
2021	A*	`conf`	SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement. NeurIPS Heyang Qin, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He
2021	J	`jnl`	ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning. CoRR Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
2021	—	`conf`	ZeRO-Offload: Democratizing Billion-Scale Model Training. USENIX ATC Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, Yuxiong He
2021	J	`jnl`	ZeRO-Offload: Democratizing Billion-Scale Model Training. CoRR Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, Yuxiong He
2021	A	`conf`	ZeRO-infinity: breaking the GPU memory wall for extreme scale deep learning. SC Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
2020	J	`jnl`	APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm. CoRR Hanlin Tang, Shaoduo Gan, Samyam Rajbhandari, Xiangru Lian, Ji Liu, Yuxiong He, Ce Zhang
2020	A*	`conf`	Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping. NeurIPS Minjia Zhang, Yuxiong He
2020	J	`jnl`	Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping. CoRR Minjia Zhang, Yuxiong He
2020	A*	`conf`	DeepSpeed: System Optimizations Enable Training Deep Learning Models with Over 100 Billion Parameters. KDD Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, Yuxiong He
2020	J	`jnl`	Fast LSTM by dynamic decomposition on cloud and distributed systems. Knowl. Inf. Syst. Yang You, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Cho-Jui Hsieh, Kurt Keutzer, James Demmel
2020	—	`conf`	Improving Approximate Nearest Neighbor Search through Learned Adaptive Early Termination. SIGMOD Conference Conglong Li, Minjia Zhang, David G. Andersen, Yuxiong He
2020	J	`jnl`	Local trend discovery on real-time microblogs with uncertain locations in tight memory environments. GeoInformatica Abdulaziz Almaslukh, Amr Magdy, Ahmed M. Aly, Mohamed F. Mokbel, Sameh Elnikety, Yuxiong He, Suman Nath, Walid G. Aref
2020	A	`conf`	ZeRO: memory optimizations toward training trillion parameter models. SC Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He
2019	—	`conf`	Accelerating Large Scale Deep Learning Inference through DeepCPU at Microsoft. OpML Minjia Zhang, Samyam Rajbhandari, Wenhan Wang, Elton Zheng, Olatunji Ruwase, Jeff Rasley, Jason Li, Junhua Wang, Yuxiong He
2019	J	`jnl`	AntMan: Sparse Low-Rank Compression to Accelerate RNN inference. CoRR Samyam Rajbhandari, Harsh Shrivastava, Yuxiong He
2019	J	`jnl`	Communication-Aware Scheduling of Precedence-Constrained Tasks. SIGMETRICS Perform. Evaluation Rev. Yu Su, Xiaoqi Ren, Shai Vardi, Adam Wierman, Yuxiong He
2019	—	`conf`	Deep Learning Inference Service at Microsoft. OpML Jonathan Soifer, Jason Li, Mingqin Li, Jeffrey Zhu, Yingnan Li, Yuxiong He, Elton Zheng, Adi Oltean, Maya Mosyak, Chris Barnes, Thomas Liu, Junhua Wang
2019	A*	`conf`	Fast LSTM Inference by Dynamic Decomposition on Cloud Systems. ICDM Yang You, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Cho-Jui Hsieh, Kurt Keutzer, James Demmel
2019	A	`conf`	GRIP: Multi-Store Capacity-Optimized High-Performance Nearest Neighbor Search for Vector Search Engine. CIKM Minjia Zhang, Yuxiong He
2019	A	`conf`	GRNN: Low-Latency and Scalable RNN Inference on GPUs. EuroSys Connor Holmes, Daniel Mawhirter, Yuxiong He, Feng Yan, Bo Wu
2019	J	`jnl`	LSTM-Sharp: An Adaptable, Energy-Efficient Hardware Accelerator for Long Short-Term Memory. CoRR Reza Yazdani, Olatunji Ruwase, Minjia Zhang, Yuxiong He, José-María Arnau, Antonio González
2019	J	`jnl`	ZeRO: Memory Optimization Towards Training A Trillion Parameter Models. CoRR Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He
2018	A*	`conf`	Better Caching in Search Advertising Systems with Rapid Refresh Predictions. WWW Conglong Li, David G. Andersen, Qiang Fu, Sameh Elnikety, Yuxiong He
2018	—	`conf`	DeepCPU: Serving RNN-based Deep Learning Models 10x Faster. USENIX ATC Minjia Zhang, Samyam Rajbhandari, Wenhan Wang, Yuxiong He
2018	J	`jnl`	Efficient Deep Neural Network Serving: Fast and Furious. IEEE Trans. Netw. Serv. Manag. Feng Yan, Yuxiong He, Olatunji Ruwase, Evgenia Smirni
2018	—	`conf`	Learning Intrinsic Sparse Structures within Long Short-Term Memory. ICLR (Poster) Wei Wen, Yuxiong He, Samyam Rajbhandari, Minjia Zhang, Wenhan Wang, Fang Liu, Bin Hu, Yiran Chen, Hai Li
2018	A*	`conf`	Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models. NeurIPS Minjia Zhang, Wenhan Wang, Xiaodong Liu, Jianfeng Gao, Yuxiong He
2018	J	`jnl`	Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models. CoRR Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
2018	J	`jnl`	Stochastic Modeling and Optimization of Stragglers. IEEE Trans. Cloud Comput. Farshid Farhat, Diman Zad Tootaghaj, Yuxiong He, Anand Sivasubramaniam, Mahmut T. Kandemir, Chita R. Das
2018	J	`jnl`	Zoom: SSD-based Vector Search for Optimizing Accuracy, Latency and Memory. CoRR Minjia Zhang, Yuxiong He
2017	A*	`conf`	BitFunnel: Revisiting Signatures for Search. SIGIR Bob Goodwin, Michael Hopcroft, Dan Luu, Alex Clemmer, Mihaela Curmei, Sameh Elnikety, Yuxiong He
2017	A*	`conf`	Exploiting heterogeneity for tail latency and energy efficiency. MICRO Md. Enamul Haque, Yuxiong He, Sameh Elnikety, Thu D. Nguyen, Ricardo Bianchini, Kathryn S. McKinley
2017	A	`conf`	HyperDrive: exploring hyperparameters with POP scheduling. Middleware Jeff Rasley, Yuxiong He, Feng Yan, Olatunji Ruwase, Rodrigo Fonseca
2017	J	`jnl`	Learning Intrinsic Sparse Structures within Long Short-term Memory. CoRR Wei Wen, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Fang Liu, Bin Hu, Yiran Chen, Hai Li
2017	J	`jnl`	Obtaining and Managing Answer Quality for Online Data-Intensive Services. ACM Trans. Model. Perform. Evaluation Comput. Syst. Jaimie Kelley, Christopher Stewart, Nathaniel Morris, Devesh Tiwari, Yuxiong He, Sameh Elnikety
2017	B	`conf`	Optimal Reissue Policies for Reducing Tail Latency. SPAA Tim Kaler, Yuxiong He, Sameh Elnikety
2017	A*	`conf`	Optimizing CNNs on Multicores for Scalability, Performance and Goodput. ASPLOS Samyam Rajbhandari, Yuxiong He, Olatunji Ruwase, Michael Carbin, Trishul M. Chilimbi
2017	A	`conf`	Swayam: distributed autoscaling to meet SLAs of machine learning inference services with resource efficiency. Middleware Arpan Gujarati, Sameh Elnikety, Yuxiong He, Kathryn S. McKinley, Björn B. Brandenburg
2017	—	`conf`	When Good Enough Is Better: Energy-Aware Scheduling for Multicore Servers. IPDPS Workshops Xinning Hui, Zhihui Du, Jason Liu, Hongyang Sun, Yuxiong He, David A. Bader
2017	—	`conf`	Workload analysis and caching strategies for search advertising systems. SoCC Conglong Li, David G. Andersen, Qiang Fu, Sameh Elnikety, Yuxiong He
2016	—	`conf`	GeoTrend: spatial trending queries on real-time microblogs. SIGSPATIAL/GIS Amr Magdy, Ahmed M. Aly, Mohamed F. Mokbel, Sameh Elnikety, Yuxiong He, Suman Nath, Walid G. Aref
2016	J	`jnl`	Prediction and Predictability for Search Query Acceleration. ACM Trans. Web Seung-won Hwang, Saehoon Kim, Yuxiong He, Sameh Elnikety, Seungjin Choi
2016	A	`conf`	SERF: efficient scheduling for fast deep neural network serving via judicious parallelism. SC Feng Yan, Yuxiong He, Olatunji Ruwase, Evgenia Smirni
2016	A*	`conf`	TPC: Target-Driven Parallelism Combining Prediction and Correction to Reduce Tail Latency in Interactive Services. ASPLOS Myeongjae Jeon, Yuxiong He, Hwanju Kim, Sameh Elnikety, Scott Rixner, Alan L. Cox
2016	J	`jnl`	Venus: Scalable Real-Time Spatial Queries on Microblogs with Adaptive Load Shedding. IEEE Trans. Knowl. Data Eng. Amr Magdy, Mohamed F. Mokbel, Sameh Elnikety, Suman Nath, Yuxiong He
2016	B	`conf`	Work stealing for interactive services to meet target latency. PPoPP Jing Li, Kunal Agrawal, Sameh Elnikety, Yuxiong He, I-Ting Angelina Lee, Chenyang Lu, Kathryn S. McKinley
2015	B	`conf`	BATS: Budget-Constrained Autoscaling for Cloud Performance Optimization. MASCOTS A. Hasan Mahmud, Yuxiong He, Shaolei Ren
2015	A	`conf`	Delayed-Dynamic-Selective (DDS) Prediction for Reducing Extreme Tail Latency in Web Search. WSDM Saehoon Kim, Yuxiong He, Seung-won Hwang, Sameh Elnikety, Seungjin Choi
2015	A*	`conf`	Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services. ASPLOS Md. Enamul Haque, Yong Hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S. McKinley
2015	—	`conf`	Measuring and Managing Answer Quality for Online Data-Intensive Services. ICAC Jaimie Kelley, Christopher Stewart, Nathaniel Morris, Devesh Tiwari, Yuxiong He, Sameh Elnikety
2015	J	`jnl`	Measuring and Managing Answer Quality for Online Data-Intensive Services. CoRR Jaimie Kelley, Christopher Stewart, Nathaniel Morris, Devesh Tiwari, Yuxiong He, Sameh Elnikety
2015	—	`ch.`	Online Resource Management for Carbon-Neutral Cloud Computing. Handbook on Data Centers Kishwar Ahmed, Shaolei Ren, Yuxiong He, Athanasios V. Vasilakos
2015	A*	`conf`	Optimal Aggregation Policy for Reducing Tail Latency of Web Search. SIGIR Jeong-Min Yun, Yuxiong He, Sameh Elnikety, Shaolei Ren
2015	A*	`conf`	Performance Modeling and Scalability Optimization of Distributed Deep Learning Systems. KDD Feng Yan, Olatunji Ruwase, Yuxiong He, Trishul M. Chilimbi
2015	J	`jnl`	Processing and Optimizing Main Memory Spatial-Keyword Queries. Proc. VLDB Endow. Taesung Lee, Jin-Woo Park, Sanghoon Lee, Seung-won Hwang, Sameh Elnikety, Yuxiong He
2014	A	`conf`	A Theoretical Foundation for Scheduling and Designing Heterogeneous Processors for Interactive Applications. DISC Shaolei Ren, Yuxiong He, Kathryn S. McKinley
2014	A*	`conf`	BATS: budget-constrained autoscaling for cloud performance optimization. SIGMETRICS A. Hasan Mahmud, Yuxiong He, Shaolei Ren
2014	J	`jnl`	Energy-efficient multiprocessor scheduling for flow time and makespan. Theor. Comput. Sci. Hongyang Sun, Yuxiong He, Wen-Jing Hsu, Rui Fan
2014	J	`jnl`	Hybrid query execution engine for large attributed graphs. Inf. Syst. Sherif Sakr, Sameh Elnikety, Yuxiong He
2014	A*	`conf`	Mars: Real-time spatio-temporal queries on microblogs. ICDE Amr Magdy, Ahmed M. Aly, Mohamed F. Mokbel, Sameh Elnikety, Yuxiong He, Suman Nath
2014	A*	`conf`	Mercury: A memory-constrained spatio-temporal real-time search on microblogs. ICDE Amr Magdy, Mohamed F. Mokbel, Sameh Elnikety, Suman Nath, Yuxiong He
2014	A*	`conf`	Predictive parallelization: taming tail latencies in web search. SIGIR Myeongjae Jeon, Saehoon Kim, Seung-won Hwang, Yuxiong He, Sameh Elnikety, Alan L. Cox, Scott Rixner
2013	A	`conf`	Adaptive parallelism for web search. EuroSys Myeongjae Jeon, Yuxiong He, Sameh Elnikety, Alan L. Cox, Scott Rixner
2013	A	`conf`	COCA: online distributed resource management for cost minimization and carbon neutrality in data centers. SC Shaolei Ren, Yuxiong He
2013	A	`conf`	Energy-Efficient Scheduling for Best-Effort Interactive Services to Achieve High Response Quality. IPDPS Zhihui Du, Hongyang Sun, Yuxiong He, Yu He, David A. Bader, Huazhe Zhang
2013	—	`conf`	Exploiting Processor Heterogeneity in Interactive Services. ICAC Shaolei Ren, Yuxiong He, Sameh Elnikety, Kathryn S. McKinley
2013	J	`jnl`	Horton+: A Distributed System for Processing Declarative Reachability Queries over Partitioned Graphs. Proc. VLDB Endow. Mohamed Sarwat, Sameh Elnikety, Yuxiong He, Mohamed F. Mokbel
2013	—	`conf`	Performance Inconsistency in Large Scale Data Processing Clusters. ICAC Mingyuan Xia, Nan Zhu, Sameh Elnikety, Xue Liu, Yuxiong He
2013	B	`conf`	Power-effiicent resource allocation in MapReduce clusters. IM Kaiqi Xiong, Yuxiong He
2013	—	`conf`	QACO: exploiting partial execution in web servers. CAC Jinhan Kim, Sameh Elnikety, Yuxiong He, Seung-won Hwang, Shaolei Ren
2013	C	`conf`	Solving Graph Isomorphism Using Parameterized Matching. SPIRE Juan Mendivelso, Sunghwan Kim, Sameh Elnikety, Yuxiong He, Seung-won Hwang, Yoan J. Pinzón
2013	—	`conf`	Topic 3: Scheduling and Load Balancing - (Introduction). Euro-Par Zhihui Du, Ramin Yahyapour, Yuxiong He, Nectarios Koziris, Bilha Mendelson, Veronika Sonigo, Achim Streit, Andrei Tchernykh
2012	—	`conf`	Budget-based control for interactive services with adaptive execution. ICAC Yuxiong He, Zihao Ye, Qiang Fu, Sameh Elnikety
2012	A	`conf`	G-SPARQL: a hybrid engine for querying large attributed graphs. CIKM Sherif Sakr, Sameh Elnikety, Yuxiong He
2012	A*	`conf`	Horton: Online Query Execution Engine for Large Distributed Graphs. ICDE Mohamed Sarwat, Sameh Elnikety, Yuxiong He, Gabriel Kliot
2012	A	`conf`	Provably-Efficient Job Scheduling for Energy and Fairness in Geographically Distributed Data Centers. ICDCS Shaolei Ren, Yuxiong He, Fei Xu
2012	—	`conf`	Zeta: scheduling interactive services with partial execution. SoCC Yuxiong He, Sameh Elnikety, James R. Larus, Chenyu Yan
2011	—	`conf`	Position Paper: Embracing Heterogeneity - Improving Energy Efficiency for Interactive Services on Heterogeneous Data Center Hardware. AI for Data Center Management and Cloud Computing Yuxiong He, Sameh Elnikety
2011	A	`conf`	Scheduling Functionally Heterogeneous Systems with Utilization Balancing. IPDPS Yuxiong He, Jie Liu, Hongyang Sun
2011	—	`conf`	Scheduling for data center interactive services. Allerton Yuxiong He, Sameh Elnikety
2011	—	`conf`	Speed Scaling for Energy and Performance with Instantaneous Parallelism. TAPAS Hongyang Sun, Yuxiong He, Wen-Jing Hsu
2011	A	`conf`	Tians Scheduling: Using Partial Processing in Best-Effort Applications. ICDCS Yuxiong He, Sameh Elnikety, Hongyang Sun
2010	J	`jnl`	Energy-Efficient Multiprocessor Scheduling for Flow Time and Makespan CoRR Hongyang Sun, Yuxiong He, Wen-Jing Hsu
2010	J	`jnl`	Improved results for scheduling batched parallel jobs by using a generalized analysis framework. J. Parallel Distributed Comput. Yuxiong He, Hongyang Sun, Wen-Jing Hsu
2010	B	`conf`	The Cilkview scalability analyzer. SPAA Yuxiong He, Charles E. Leiserson, William M. Leiserson
2008	J	`jnl`	Adaptive work-stealing with parallelism feedback. ACM Trans. Comput. Syst. Kunal Agrawal, Charles E. Leiserson, Yuxiong He, Wen-Jing Hsu
2008	J	`jnl`	Provably Efficient Online Nonclairvoyant Adaptive Scheduling. IEEE Trans. Parallel Distributed Syst. Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson
2007	B	`conf`	Adaptive Scheduling of Parallel Jobs on Functionally Heterogeneous Resources. ICPP Yuxiong He, Hongyang Sun, Wen-Jing Hsu
2007	A	`conf`	Adaptive Scheduling with Parallelism Feedback. IPDPS Kunal Agrawal, Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson
2007	B	`conf`	Adaptive work stealing with parallelism feedback. PPoPP Kunal Agrawal, Yuxiong He, Charles E. Leiserson
2007	A	`conf`	Provably Efficient Online Non-clairvoyant Adaptive Scheduling. IPDPS Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson
2006	B	`conf`	Adaptive scheduling with parallelism feedback. PPoPP Kunal Agrawal, Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson
2006	A	`conf`	An Empirical Evaluation ofWork Stealing with Parallelism Feedback. ICDCS Kunal Agrawal, Yuxiong He, Charles E. Leiserson
2006	C	`conf`	Provably Efficient Two-Level Adaptive Scheduling. JSSPP Yuxiong He, Wen-Jing Hsu, Charles E. Leiserson
2004	J	`jnl`	Secure communications between bandwidth brokers. ACM SIGOPS Oper. Syst. Rev. Bu-Sung Lee, Wing-Keong Woo, Chai Kiat Yeo, Teck Meng Lim, Bee-Hwa Lim, Yuxiong He, Jie Song