Shuohuan Wang - RankMe

64 papers A* 7Journal 37Unranked 20

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Learning to Generate via Understanding: Understanding-Driven Intrinsic Rewarding for Unified Multimodal Models. CoRR Jiadong Pan, Liang Li, Yuxin Peng, Yu-Ming Tang, Shuohuan Wang, Yu Sun, Hua Wu, Qingming Huang, Haifeng Wang
2026	J	`jnl`	Mixture of Universal Experts: Scaling Virtual Width via Depth-Width Transformation. CoRR Yilong Chen, Naibin Gu, Junyuan Shang, Zhenyu Zhang, Yuchen Feng, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2026	J	`jnl`	Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping. CoRR Yao Chen, Yilong Chen, Yinqi Yang, Junyuan Shang, Zhenyu Zhang, Zefeng Zhang, Shuaiyi Nie, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang, Tingwen Liu
2026	J	`jnl`	VideoAR: Autoregressive Video Generation via Next-Frame & Scale Prediction. CoRR Longbin Ji, Xiaoxiong Liu, Junyuan Shang, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2025	J	`jnl`	Advantageous Parameter Expansion Training Makes Better Large Language Models. CoRR Naibin Gu, Yilong Chen, Zhenyu Zhang, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang
2025	—	`conf`	BeamLoRA: Beam-Constraint Low-Rank Adaptation. ACL (1) Naibin Gu, Zhenyu Zhang, Xiyu Liu, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang
2025	J	`jnl`	BeamLoRA: Beam-Constraint Low-Rank Adaptation. CoRR Naibin Gu, Zhenyu Zhang, Xiyu Liu, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang
2025	J	`jnl`	Blink: Dynamic Visual Token Resolution for Enhanced Multimodal Understanding. CoRR Yuchen Feng, Zhenyu Zhang, Naibin Gu, Yilong Chen, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang
2025	—	`conf`	Curiosity-Driven Reinforcement Learning from Human Feedback. ACL (1) Haoran Sun, Yekun Chai, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2025	J	`jnl`	Curiosity-Driven Reinforcement Learning from Human Feedback. CoRR Haoran Sun, Yekun Chai, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2025	J	`jnl`	Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts. CoRR Naibin Gu, Zhenyu Zhang, Yuchen Feng, Yilong Chen, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang
2025	—	`conf`	HFT: Half Fine-Tuning for Large Language Models. ACL (1) Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Weiran Xu, Yu Sun, Hua Wu
2025	—	`conf`	Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking. ACL (1) Yilong Chen, Junyuan Shang, Zhenyu Zhang, Yanxi Xie, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2025	J	`jnl`	Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking. CoRR Yilong Chen, Junyuan Shang, Zhenyu Zhang, Yanxi Xie, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2025	A*	`conf`	MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions. ICLR Yekun Chai, Haoran Sun, Huang Fang, Shuohuan Wang, Yu Sun, Hua Wu
2025	A*	`conf`	Mixture of Hidden-Dimensions: Not All Hidden-States' Dimensions are Needed in Transformer. ICML Yilong Chen, Junyuan Shang, Zhenyu Zhang, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2025	—	`conf`	Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging. ACL (1) Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Yu Sun, Hua Wu, Sen Su
2025	J	`jnl`	V-ITI: Mitigating Hallucinations in Multimodal Large Language Models via Visual Inference-Time Intervention. CoRR Nan Sun, Zhenyu Zhang, Xixun Lin, Kun Wang, Yanmin Shang, Naibin Gu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang, Yanan Cao
2024	A*	`conf`	Autoregressive Pre-Training on Pixels and Texts. EMNLP Yekun Chai, Qingyi Liu, Jingwu Xiao, Shuohuan Wang, Yu Sun, Hua Wu
2024	A*	`conf`	DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion. NeurIPS Yilong Chen, Linhao Zhang, Junyuan Shang, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun
2024	J	`jnl`	DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion. CoRR Yilong Chen, Linhao Zhang, Junyuan Shang, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun
2024	J	`jnl`	Dual Modalities of Text: Visual and Textual Generative Pre-training. CoRR Yekun Chai, Qingyi Liu, Jingwu Xiao, Shuohuan Wang, Yu Sun, Hua Wu
2024	J	`jnl`	HFT: Half Fine-Tuning for Large Language Models. CoRR Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Weiran Xu, Yu Sun, Hua Wu
2024	—	`conf`	LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion. ACL (1) Yilong Chen, Junyuan Shang, Zhenyu Zhang, Shiyao Cui, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu
2024	J	`jnl`	MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions. CoRR Yekun Chai, Haoran Sun, Huang Fang, Shuohuan Wang, Yu Sun, Hua Wu
2024	J	`jnl`	Mixture of Hidden-Dimensions Transformer. CoRR Yilong Chen, Junyuan Shang, Zhengyu Zhang, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
2024	—	`conf`	NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time. ACL (1) Yilong Chen, Guoxia Wang, Junyuan Shang, Shiyao Cui, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun, Dianhai Yu, Hua Wu
2024	J	`jnl`	NACL: A General and Effective KV Cache Eviction Framework for LLMs at Inference Time. CoRR Yilong Chen, Guoxia Wang, Junyuan Shang, Shiyao Cui, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun, Dianhai Yu, Hua Wu
2024	A*	`conf`	On Training Data Influence of GPT Models. EMNLP Yekun Chai, Qingyi Liu, Shuohuan Wang, Yu Sun, Qiwei Peng, Hua Wu
2024	J	`jnl`	On Training Data Influence of GPT Models. CoRR Qingyi Liu, Yekun Chai, Shuohuan Wang, Yu Sun, Qiwei Peng, Keze Wang, Hua Wu
2024	A*	`conf`	Tool-Augmented Reward Modeling. ICLR Lei Li, Yekun Chai, Shuohuan Wang, Yu Sun, Hao Tian, Ningyu Zhang, Hua Wu
2024	J	`jnl`	Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging. CoRR Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Yu Sun, Hua Wu, Sen Su
2023	—	`conf`	ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages. ACL (Findings) Yekun Chai, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu
2023	J	`jnl`	ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Models. CoRR Pengfei Zhu, Chao Pang, Shuohuan Wang, Yekun Chai, Yu Sun, Hao Tian, Hua Wu
2023	—	`conf`	Retrieval-Augmented Domain Adaptation of Language Models. RepL4NLP@ACL Benfeng Xu, Chunxu Zhao, Wenbin Jiang, Pengfei Zhu, Songtai Dai, Chao Pang, Zhuo Sun, Shuohuan Wang, Yu Sun
2023	J	`jnl`	Tool-Augmented Reward Modeling. CoRR Lei Li, Yekun Chai, Shuohuan Wang, Yu Sun, Hao Tian, Ningyu Zhang, Hua Wu
2022	—	`conf`	Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards. EMNLP (Findings) Yekun Chai, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2022	J	`jnl`	Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards. CoRR Yekun Chai, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2022	J	`jnl`	ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages. CoRR Yekun Chai, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu
2022	J	`jnl`	ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech. CoRR Xiaoran Fan, Chao Pang, Tian Yuan, He Bai, Renjie Zheng, Pengfei Zhu, Shuohuan Wang, Jun-Kun Chen, Zeyu Chen, Liang Huang, Yu Sun, Hua Wu
2022	J	`jnl`	ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation. CoRR Bin Shan, Yaqian Han, Weichong Yin, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2022	J	`jnl`	Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters. CoRR Yang Xiang, Zhihua Wu, Weibao Gong, Siyu Ding, Xianjie Mo, Yuang Liu, Shuohuan Wang, Peng Liu, Yongshuai Hou, Long Li, Bin Wang, Shaohuai Shi, Yaqian Han, Yue Yu, Ge Li, Yu Sun, Yanjun Ma, Dianhai Yu
2022	—	`conf`	X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection. SemEval@NAACL Ya Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang
2022	J	`jnl`	X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection. CoRR Yaqian Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang
2022	—	`conf`	X-PuDu at SemEval-2022 Task 7: A Replaced Token Detection Task Pre-trained Model with Pattern-aware Ensembling for Identifying Plausible Clarifications. SemEval@NAACL Junyuan Shang, Shuohuan Wang, Yu Sun, Yanjun Yu, Yue Zhou, Li Xiang, Guixiu Yang
2022	J	`jnl`	X-PuDu at SemEval-2022 Task 7: A Replaced Token Detection Task Pre-trained Model with Pattern-aware Ensembling for Identifying Plausible Clarifications. CoRR Junyuan Shang, Shuohuan Wang, Yu Sun, Yanjun Yu, Yue Zhou, Li Xiang, Guixiu Yang
2021	—	`conf`	Correcting Chinese Spelling Errors with Phonetic Pre-training. ACL/IJCNLP (Findings) Ruiqing Zhang, Chao Pang, Chuanqiang Zhang, Shuohuan Wang, Zhongjun He, Yu Sun, Hua Wu, Haifeng Wang
2021	J	`jnl`	ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation. CoRR Shuohuan Wang, Yu Sun, Yang Xiang, Zhihua Wu, Siyu Ding, Weibao Gong, Shikun Feng, Junyuan Shang, Yanbin Zhao, Chao Pang, Jiaxiang Liu, Xuyi Chen, Yuxiang Lu, Weixin Liu, Xi Wang, Yangfan Bai, Qiuliang Chen, Li Zhao, Shiyong Li, Peng Sun, Dianhai Yu, Yanjun Ma, Hao Tian, Hua Wu, Tian Wu, Wei Zeng, Ge Li, Wen Gao, Haifeng Wang
2021	J	`jnl`	ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation. CoRR Yu Sun, Shuohuan Wang, Shikun Feng, Siyu Ding, Chao Pang, Junyuan Shang, Jiaxiang Liu, Xuyi Chen, Yanbin Zhao, Yuxiang Lu, Weixin Liu, Zhihua Wu, Weibao Gong, Jianzhong Liang, Zhizhou Shang, Peng Sun, Wei Liu, Xuan Ouyang, Dianhai Yu, Hao Tian, Hua Wu, Haifeng Wang
2021	—	`conf`	ERNIE-Doc: A Retrospective Long-Document Modeling Transformer. ACL/IJCNLP (1) Siyu Ding, Junyuan Shang, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2021	—	`conf`	ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora. EMNLP (1) Xuan Ouyang, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2021	—	`conf`	abcbpc at SemEval-2021 Task 7: ERNIE-based Multi-task Model for Detecting and Rating Humor and Offense. SemEval@ACL/IJCNLP Chao Pang, Xiaoran Fan, Weiyue Su, Xuyi Chen, Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Shikun Feng, Yu Sun
2020	A*	`conf`	ERNIE 2.0: A Continual Pre-Training Framework for Language Understanding. AAAI Yu Sun, Shuohuan Wang, Yu-Kun Li, Shikun Feng, Hao Tian, Hua Wu, Haifeng Wang
2020	—	`conf`	ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model. SemEval@COLING Zhengjie Huang, Shikun Feng, Weiyue Su, Xuyi Chen, Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Yu Sun
2020	J	`jnl`	ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model. CoRR Zhengjie Huang, Shikun Feng, Weiyue Su, Xuyi Chen, Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Yu Sun
2020	J	`jnl`	ERNIE-DOC: The Retrospective Long-Document Modeling Transformer. CoRR Siyu Ding, Junyuan Shang, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2020	J	`jnl`	ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora. CoRR Xuan Ouyang, Shuohuan Wang, Chao Pang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
2020	—	`conf`	Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification Using Pre-trained Language Models. SemEval@COLING Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Yu Sun
2020	J	`jnl`	Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models. CoRR Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Yu Sun
2020	—	`conf`	Kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification. SemEval@COLING Jiaxiang Liu, Xuyi Chen, Shikun Feng, Shuohuan Wang, Xuan Ouyang, Yu Sun, Zhengjie Huang, Weiyue Su
2020	J	`jnl`	kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification. CoRR Jiaxiang Liu, Xuyi Chen, Shikun Feng, Shuohuan Wang, Xuan Ouyang, Yu Sun, Zhengjie Huang, Weiyue Su
2019	J	`jnl`	ERNIE 2.0: A Continual Pre-training Framework for Language Understanding. CoRR Yu Sun, Shuohuan Wang, Yu-Kun Li, Shikun Feng, Hao Tian, Hua Wu, Haifeng Wang
2019	J	`jnl`	ERNIE: Enhanced Representation through Knowledge Integration. CoRR Yu Sun, Shuohuan Wang, Yu-Kun Li, Shikun Feng, Xuyi Chen, Han Zhang, Xin Tian, Danxiang Zhu, Hao Tian, Hua Wu
2019	—	`conf`	OleNet at SemEval-2019 Task 9: BERT based Multi-Perspective Models for Suggestion Mining. SemEval@NAACL-HLT Jiaxiang Liu, Shuohuan Wang, Yu Sun