Shuai Zheng - RankMe

48 papers A* 14A 2B 1Misc 1Journal 25Unranked 5

Year	Rank	Type	Title / Venue / Authors
2024	Misc	`conf`	DISTMM: Accelerating Distributed Multimodal Model Training. NSDI Jun Huang, Zhen Zhang, Shuai Zheng, Feng Qin, Yida Wang
2024	A	`conf`	DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines. EuroSys Chenyu Jiang, Zhen Jia, Shuai Zheng, Yida Wang, Chuan Wu
2024	—	`conf`	Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping. MLSys Chenyu Jiang, Ye Tian, Zhen Jia, Shuai Zheng, Chuan Wu, Yida Wang
2024	J	`jnl`	Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping. CoRR Chenyu Jiang, Ye Tian, Zhen Jia, Shuai Zheng, Chuan Wu, Yida Wang
2024	—	`conf`	Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training. ASPLOS (2) Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang
2023	J	`jnl`	Decoupled Model Schedule for Deep Learning Training. CoRR Hongzheng Chen, Cody Hao Yu, Shuai Zheng, Zhen Zhang, Zhiru Zhang, Yida Wang
2023	J	`jnl`	DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines. CoRR Chenyu Jiang, Zhen Jia, Shuai Zheng, Yida Wang, Chuan Wu
2023	A*	`conf`	GEMINI: Fast Failure Recovery in Distributed Training with In-Memory Checkpoints. SOSP Zhuang Wang, Zhen Jia, Shuai Zheng, Zhen Zhang, Xinwei Fu, T. S. Eugene Ng, Yida Wang
2023	A*	`conf`	Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition. NeurIPS Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alexander J. Smola, Xu Sun
2023	J	`jnl`	Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition. CoRR Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alex Smola, Xu Sun
2022	A*	`conf`	Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. KDD Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudré, Dilek Hakkani-Tur, Wael Hamza, Jonathan J. Hüser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Lizhen Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gökhan Tür, Prem Natarajan
2022	J	`jnl`	Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. CoRR Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudré, Dilek Hakkani-Tur, Wael Hamza, Jonathan J. Hüser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Liz Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gökhan Tür, Prem Natarajan
2022	—	`conf`	DCAF-BERT: A Distilled Cachable Adaptable Factorized Model For Improved Ads CTR Prediction. WWW (Companion Volume) Aashiq Muhamed, Jaspreet Singh, Shuai Zheng, Iman Keivanloo, Sujan Perera, James Mracek, Yi Xu, Qingjun Cui, Santosh Rajagopalan, Belinda Zeng, Trishul Chilimbi
2022	J	`jnl`	MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud. CoRR Zhen Zhang, Shuai Zheng, Yida Wang, Justin Chiu, George Karypis, Trishul Chilimbi, Mu Li, Xin Jin
2022	J	`jnl`	MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud. Proc. VLDB Endow. Zhen Zhang, Shuai Zheng, Yida Wang, Justin Chiu, George Karypis, Trishul Chilimbi, Mu Li, Xin Jin
2022	A*	`conf`	Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition. ICML Haotao Wang, Aston Zhang, Yi Zhu, Shuai Zheng, Mu Li, Alex J. Smola, Zhangyang Wang
2022	J	`jnl`	Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition. CoRR Haotao Wang, Aston Zhang, Yi Zhu, Shuai Zheng, Mu Li, Alex Smola, Zhangyang Wang
2022	A*	`conf`	Removing Batch Normalization Boosts Adversarial Training. ICML Haotao Wang, Aston Zhang, Shuai Zheng, Xingjian Shi, Mu Li, Zhangyang Wang
2022	J	`jnl`	Removing Batch Normalization Boosts Adversarial Training. CoRR Haotao Wang, Aston Zhang, Shuai Zheng, Xingjian Shi, Mu Li, Zhangyang Wang
2022	J	`jnl`	SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing. CoRR Chaoyang He, Shuai Zheng, Aston Zhang, George Karypis, Trishul Chilimbi, Mahdi Soltanolkotabi, Salman Avestimehr
2022	J	`jnl`	SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning. CoRR M. Saiful Bari, Aston Zhang, Shuai Zheng, Xingjian Shi, Yi Zhu, Shafiq Joty, Mu Li
2021	J	`jnl`	Compressed Communication for Distributed Training: Adaptive Methods and System. CoRR Yuchen Zhong, Cong Xie, Shuai Zheng, Haibin Lin
2020	J	`jnl`	Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes. CoRR Shuai Zheng, Haibin Lin, Sheng Zha, Mu Li
2020	A*	`conf`	CSER: Communication-efficient SGD with Error Reset. NeurIPS Cong Xie, Shuai Zheng, Oluwasanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin
2020	J	`jnl`	CSER: Communication-efficient SGD with Error Reset. CoRR Cong Xie, Shuai Zheng, Oluwasanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin
2020	J	`jnl`	GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. J. Mach. Learn. Res. Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng, Yi Zhu
2019	J	`jnl`	Blockwise Adaptivity: Faster Training and Better Generalization in Deep Learning. CoRR Shuai Zheng, James T. Kwok
2019	A*	`conf`	Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback. NeurIPS Shuai Zheng, Ziyue Huang, James T. Kwok
2019	J	`jnl`	Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback. CoRR Shuai Zheng, Ziyue Huang, James T. Kwok
2019	A	`conf`	Give Me a Hint! Navigating Image Databases Using Human-in-the-Loop Feedback. WACV Bryan A. Plummer, M. Hadi Kiapour, Shuai Zheng, Robinson Piramuthu
2019	J	`jnl`	GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. CoRR Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng
2018	—	`conf`	Conditional Image-Text Embedding Networks. ECCV (12) Bryan A. Plummer, Paige Kordas, M. Hadi Kiapour, Shuai Zheng, Robinson Piramuthu, Svetlana Lazebnik
2018	J	`jnl`	Give me a hint! Navigating Image Databases using Human-in-the-loop Feedback. CoRR Bryan A. Plummer, M. Hadi Kiapour, Shuai Zheng, Robinson Piramuthu
2018	A*	`conf`	Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data. ICML Shuai Zheng, James Tin-Yau Kwok
2018	J	`jnl`	Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data. CoRR Shuai Zheng, James T. Kwok
2018	J	`jnl`	ModaNet: A Large-Scale Street Fashion Dataset with Polygon Annotations. CoRR Shuai Zheng, Fan Yang, M. Hadi Kiapour, Robinson Piramuthu
2018	A*	`conf`	ModaNet: A Large-scale Street Fashion Dataset with Polygon Annotations. ACM Multimedia Shuai Zheng, Fan Yang, M. Hadi Kiapour, Robinson Piramuthu
2017	J	`jnl`	Conditional Image-Text Embedding Networks. CoRR Bryan A. Plummer, Paige Kordas, M. Hadi Kiapour, Shuai Zheng, Robinson Piramuthu, Svetlana Lazebnik
2017	A*	`conf`	Follow the Moving Leader in Deep Learning. ICML Shuai Zheng, James T. Kwok
2016	A*	`conf`	Asynchronous Distributed Semi-Stochastic Gradient Optimization. AAAI Ruiliang Zhang, Shuai Zheng, James T. Kwok
2016	A*	`conf`	Fast Nonsmooth Regularized Risk Minimization with Continuation. AAAI Shuai Zheng, Ruiliang Zhang, James T. Kwok
2016	J	`jnl`	Fast Nonsmooth Regularized Risk Minimization with Continuation. CoRR Shuai Zheng, Ruiliang Zhang, James Tin-Yau Kwok
2016	A*	`conf`	Fast-and-Light Stochastic ADMM. IJCAI Shuai Zheng, James T. Kwok
2016	J	`jnl`	Fast-and-Light Stochastic ADMM. CoRR Shuai Zheng, James T. Kwok
2015	J	`jnl`	Fast Distributed Asynchronous SGD with Variance Reduction. CoRR Ruiliang Zhang, Shuai Zheng, James T. Kwok
2014	A*	`conf`	Accurate Integration of Aerosol Predictions by Smoothing on a Manifold. AAAI Shuai Zheng, James T. Kwok
2013	B	`conf`	Flexible navigation in smartphones and tablets using scalable storyboards. ICMR Shuai Zheng, Luis Herranz, Shuqiang Jiang
2012	—	`conf`	Basis Technology at TAC 2012 Entity Linking. TAC James Clarke, Yuval Merhav, Ghalib Suleiman, Shuai Zheng, David Murgatroyd