Sheng Shen

71 papers A* 20A 1Journal 36Unranked 13
YearRankTypeTitle / Venue / Authors
2024 A* conf
AgentBench: Evaluating LLMs as Agents.
ICLR
Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, Jie Tang
2024 — conf
Aligning Large Multimodal Models with Factually Augmented RLHF.
ACL (Findings)
Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liangyan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, Trevor Darrell
2024 J jnl
BLIP3-KALE: Knowledge Augmented Large-Scale Dense Captions.
CoRR
Anas Awadalla, Le Xue, Manli Shu, An Yan, Jun Wang, Senthil Purushwalkam, Sheng Shen, Hannah Lee, Oscar Lo, Jae Sung Park, Etash Kumar Guha, Silvio Savarese, Ludwig Schmidt, Yejin Choi, Caiming Xiong, Ran Xu
2024 — —
Efficient and Scalable Large Multimodal Models
Sheng Shen
2024 A* conf
Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
NeurIPS
Yihe Deng, Pan Lu, Fan Yin, Ziniu Hu, Sheng Shen, Quanquan Gu, James Y. Zou, Kai-Wei Chang, Wei Wang
2024 J jnl
Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
CoRR
Yihe Deng, Pan Lu, Fan Yin, Ziniu Hu, Sheng Shen, James Zou, Kai-Wei Chang, Wei Wang
2024 — conf
LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement.
ACL (Findings)
Nicholas Lee, Thanakul Wattanawong, Sehoon Kim, Karttikeya Mangalam, Sheng Shen, Gopala Anumanchipalli, Michael W. Mahoney, Kurt Keutzer, Amir Gholami
2024 J jnl
LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement.
CoRR
Nicholas Lee, Thanakul Wattanawong, Sehoon Kim, Karttikeya Mangalam, Sheng Shen, Gopala Anumanchipalli, Michael W. Mahoney, Kurt Keutzer, Amir Gholami
2024 A* conf
MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens.
NeurIPS
Anas Awadalla, Le Xue, Oscar Lo, Manli Shu, Hannah Lee, Etash Kumar Guha, Sheng Shen, Mohamed Awadalla, Silvio Savarese, Caiming Xiong, Ran Xu, Yejin Choi, Ludwig Schmidt
2024 J jnl
MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens.
CoRR
Anas Awadalla, Le Xue, Oscar Lo, Manli Shu, Hannah Lee, Etash Kumar Guha, Matt Jordan, Sheng Shen, Mohamed Awadalla, Silvio Savarese, Caiming Xiong, Ran Xu, Yejin Choi, Ludwig Schmidt
2024 A* conf
Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models.
ICLR
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
2024 A conf
Multitask Vision-Language Prompt Tuning.
WACV
Sheng Shen, Shijia Yang, Tianjun Zhang, Bohan Zhai, Joseph E. Gonzalez, Kurt Keutzer, Trevor Darrell
2024 J jnl
RAFT: Adapting Language Model to Domain Specific RAG.
CoRR
Tianjun Zhang, Shishir G. Patil, Naman Jain, Sheng Shen, Matei Zaharia, Ion Stoica, Joseph E. Gonzalez
2024 A* conf
SqueezeLLM: Dense-and-Sparse Quantization.
ICML
Sehoon Kim, Coleman Hooper, Amir Gholami, Zhen Dong, Xiuyu Li, Sheng Shen, Michael W. Mahoney, Kurt Keutzer
2023 J jnl
AgentBench: Evaluating LLMs as Agents.
CoRR
Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, Jie Tang
2023 J jnl
Aligning Large Multimodal Models with Factually Augmented RLHF.
CoRR
Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liang-Yan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, Trevor Darrell
2023 — conf
Crosslingual Generalization through Multitask Finetuning.
ACL (1)
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel
2023 J jnl
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts.
CoRR
Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
2023 J jnl
From Text to Tactic: Evaluating LLMs Playing the Game of Avalon.
CoRR
Jonathan Light, Min Cai, Sheng Shen, Ziniu Hu
2023 J jnl
HallE-Switch: Rethinking and Controlling Object Existence Hallucinations in Large Vision Language Models for Detailed Caption.
CoRR
Bohan Zhai, Shijia Yang, Xiangchen Zhao, Chenfeng Xu, Sheng Shen, Dongdi Zhao, Kurt Keutzer, Manling Li, Tan Yan, Xiangjun Fan
2023 A* conf
Large Language Models are Visual Reasoning Coordinators.
NeurIPS
Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu
2023 J jnl
Large Language Models are Visual Reasoning Coordinators.
CoRR
Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu
2023 A* conf
Poisoning Language Models During Instruction Tuning.
ICML
Alexander Wan, Eric Wallace, Sheng Shen, Dan Klein
2023 J jnl
Poisoning Language Models During Instruction Tuning.
CoRR
Alexander Wan, Eric Wallace, Sheng Shen, Dan Klein
2023 — conf
Scaling Vision-Language Models with Sparse Mixture of Experts.
EMNLP (Findings)
Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, Yuxiong He
2023 J jnl
Scaling Vision-Language Models with Sparse Mixture of Experts.
CoRR
Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, Yuxiong He
2023 J jnl
SqueezeLLM: Dense-and-Sparse Quantization.
CoRR
Sehoon Kim, Coleman Hooper, Amir Gholami, Zhen Dong, Xiuyu Li, Sheng Shen, Michael W. Mahoney, Kurt Keutzer
2022 J jnl
Crosslingual Generalization through Multitask Finetuning.
CoRR
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel
2022 — conf
Exposing the Limits of Video-Text Models through Contrast Sets.
NAACL-HLT
Jae Sung Park, Sheng Shen, Ali Farhadi, Trevor Darrell, Yejin Choi, Anna Rohrbach
2022 A* conf
How Much Can CLIP Benefit Vision-and-Language Tasks?
ICLR
Sheng Shen, Liunian Harold Li, Hao Tan, Mohit Bansal, Anna Rohrbach, Kai-Wei Chang, Zhewei Yao, Kurt Keutzer
2022 A* conf
K-LITE: Learning Transferable Visual Models with External Knowledge.
NeurIPS
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
2022 J jnl
K-LITE: Learning Transferable Visual Models with External Knowledge.
CoRR
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Anna Rohrbach, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Jianfeng Gao
2022 A* conf
Learned Token Pruning for Transformers.
KDD
Sehoon Kim, Sheng Shen, David Thorsley, Amir Gholami, Woosuk Kwon, Joseph Hassoun, Kurt Keutzer
2022 A* conf
Multitask Prompted Training Enables Zero-Shot Task Generalization.
ICLR
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Teven Le Scao, Stella Biderman, Leo Gao, Thomas Wolf, Alexander M. Rush
2022 J jnl
Multitask Vision-Language Prompt Tuning.
CoRR
Sheng Shen, Shijia Yang, Tianjun Zhang, Bohan Zhai, Joseph E. Gonzalez, Kurt Keutzer, Trevor Darrell
2022 A* conf
Staged Training for Transformer Language Models.
ICML
Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy
2022 J jnl
Staged Training for Transformer Language Models.
CoRR
Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy
2022 — conf
What Language Model to Train if You Have One Million GPU Hours?
EMNLP (Findings)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
2022 J jnl
What Language Model to Train if You Have One Million GPU Hours?
CoRR
Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
2021 A* conf
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning.
AAAI
Zhewei Yao, Amir Gholami, Sheng Shen, Mustafa Mustafa, Kurt Keutzer, Michael W. Mahoney
2021 A* conf
Discovering Non-monotonic Autoregressive Orderings with Variational Inference.
ICLR
Xuanlin Li, Brandon Trabucco, Dong Huk Park, Michael Luo, Sheng Shen, Trevor Darrell, Yang Gao
2021 J jnl
Discovering Non-monotonic Autoregressive Orderings with Variational Inference.
CoRR
Xuanlin Li, Brandon Trabucco, Dong Huk Park, Michael Luo, Sheng Shen, Trevor Darrell, Yang Gao
2021 J jnl
How Much Can CLIP Benefit Vision-and-Language Tasks?
CoRR
Sheng Shen, Liunian Harold Li, Hao Tan, Mohit Bansal, Anna Rohrbach, Kai-Wei Chang, Zhewei Yao, Kurt Keutzer
2021 J jnl
Learned Token Pruning for Transformers.
CoRR
Sehoon Kim, Sheng Shen, David Thorsley, Amir Gholami, Joseph Hassoun, Kurt Keutzer
2021 J jnl
MLPruning: A Multilevel Structured Pruning Framework for Transformer-based Models.
CoRR
Zhewei Yao, Linjian Ma, Sheng Shen, Kurt Keutzer, Michael W. Mahoney
2021 J jnl
Multitask Prompted Training Enables Zero-Shot Task Generalization.
CoRR
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M. Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, Alexander M. Rush
2021 — conf
Noisy Self-Knowledge Distillation for Text Summarization.
NAACL-HLT
Yang Liu, Sheng Shen, Mirella Lapata
2021 — conf
Reservoir Transformers.
ACL/IJCNLP (1)
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
2021 — conf
What's Hidden in a One-layer Randomly Weighted Transformer?
EMNLP (1)
Sheng Shen, Zhewei Yao, Douwe Kiela, Kurt Keutzer, Michael W. Mahoney
2021 J jnl
What's Hidden in a One-layer Randomly Weighted Transformer?
CoRR
Sheng Shen, Zhewei Yao, Douwe Kiela, Kurt Keutzer, Michael W. Mahoney
2020 J jnl
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning.
CoRR
Zhewei Yao, Amir Gholami, Sheng Shen, Kurt Keutzer, Michael W. Mahoney
2020 A* conf
Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification (Extended Abstract).
IJCAI
Zhenpeng Chen, Sheng Shen, Ziniu Hu, Xuan Lu, Qiaozhu Mei, Xuanzhe Liu
2020 — conf
MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding.
EMNLP (1)
Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney, Zhewei Yao
2020 J jnl
MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding.
CoRR
Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney, Zhewei Yao
2020 J jnl
Noisy Self-Knowledge Distillation for Text Summarization.
CoRR
Yang Liu, Sheng Shen, Mirella Lapata
2020 A* conf
On the Generation of Medical Question-Answer Pairs.
AAAI
Sheng Shen, Yaliang Li, Nan Du, Xian Wu, Yusheng Xie, Shen Ge, Tao Yang, Kai Wang, Xingzheng Liang, Wei Fan
2020 A* conf
PowerNorm: Rethinking Batch Normalization in Transformers.
ICML
Sheng Shen, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer
2020 A* conf
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT.
AAAI
Sheng Shen, Zhen Dong, Jiayu Ye, Linjian Ma, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer
2020 J jnl
Reservoir Transformer.
CoRR
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
2020 J jnl
Rethinking Batch Normalization in Transformers.
CoRR
Sheng Shen, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer
2020 A* conf
Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers.
ICML
Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, Joey Gonzalez
2020 J jnl
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers.
CoRR
Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, Joseph E. Gonzalez
2019 — conf
An annotated dataset of literary entities.
NAACL-HLT (1)
David Bamman, Sejal Popat, Sheng Shen
2019 A* conf
Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification.
WWW
Zhenpeng Chen, Sheng Shen, Ziniu Hu, Xuan Lu, Qiaozhu Mei, Xuanzhe Liu
2019 — conf
Pragmatically Informative Text Generation.
NAACL-HLT (1)
Sheng Shen, Daniel Fried, Jacob Andreas, Dan Klein
2019 J jnl
Pragmatically Informative Text Generation.
CoRR
Sheng Shen, Daniel Fried, Jacob Andreas, Dan Klein
2019 J jnl
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT.
CoRR
Sheng Shen, Zhen Dong, Jiayu Ye, Linjian Ma, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer
2018 J jnl
Ermes: Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification.
CoRR
Zhenpeng Chen, Sheng Shen, Ziniu Hu, Xuan Lu, Qiaozhu Mei, Xuanzhe Liu
2018 J jnl
On the Generation of Medical Question-Answer Pairs.
CoRR
Sheng Shen, Yaliang Li, Nan Du, Xian Wu, Yusheng Xie, Shen Ge, Tao Yang, Kai Wang, Xingzheng Liang, Wei Fan
2017 — conf
Towards Release Strategy Optimization for Apps in Google Play.
Internetware
Sheng Shen, Xuan Lu, Ziniu Hu, Xuanzhe Liu
2017 J jnl
Towards Release Strategy Optimization for Apps in Google Play.
CoRR
Sheng Shen, Xuan Lu, Ziniu Hu