Wenhui Wang

65 papers A* 16A 1Journal 38Unranked 10
YearRankTypeTitle / Venue / Authors
2026 J jnl
VIBEVOICE-ASR Technical Report.
CoRR
Zhiliang Peng, Jianwei Yu, Yaoyao Chang, Zilong Wang, Li Dong, Yingbo Hao, Yujie Tu, Chenyu Yang, Wenhui Wang, Songchen Xu, Yutao Sun, Hangbo Bao, Weijiang Xu, Yi Zhu, Zehua Wang, Ting Song, Yan Xia, Zewen Chi, Shaohan Huang, Liang Wang, Chuang Ding, Shuai Wang, Xie Chen, Furu Wei
2025 J jnl
BitNet Distillation.
CoRR
Xun Wu, Shaohan Huang, Wenhui Wang, Ting Song, Li Dong, Yan Xia, Furu Wei
2025 J jnl
BitNet: 1-bit Pre-training for Large Language Models.
J. Mach. Learn. Res.
Hongyu Wang, Shuming Ma, Lingxiao Ma, Lei Wang, Wenhui Wang, Li Dong, Shaohan Huang, Huaijie Wang, Jilong Xue, Ruiping Wang, Yi Wu, Furu Wei
2025 J jnl
VibeVoice Technical Report.
CoRR
Zhiliang Peng, Jianwei Yu, Wenhui Wang, Yaoyao Chang, Yutao Sun, Li Dong, Yi Zhu, Weijiang Xu, Hangbo Bao, Zehua Wang, Shaohan Huang, Yan Xia, Furu Wei
2024 J jnl
Fine-tuning pretrained transformer encoders for sequence-to-sequence learning.
Int. J. Mach. Learn. Cybern.
Hangbo Bao, Li Dong, Wenhui Wang, Nan Yang, Songhao Piao, Furu Wei
2024 A* conf
Grounding Multimodal Large Language Models to the World.
ICLR
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Qixiang Ye, Furu Wei
2024 A conf
KOSMOS-E : Learning to Follow Instruction for Robotic Grasping.
IROS
Zhi Wang, Xun Wu, Shaohan Huang, Li Dong, Wenhui Wang, Shuming Ma, Furu Wei
2024 A* conf
Multi-Head Mixture-of-Experts.
NeurIPS
Xun Wu, Shaohan Huang, Wenhui Wang, Shuming Ma, Li Dong, Furu Wei
2024 J jnl
Multi-Head Mixture-of-Experts.
CoRR
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
2024 J jnl
Multimodal Latent Language Modeling with Next-Token Diffusion.
CoRR
Yutao Sun, Hangbo Bao, Wenhui Wang, Zhiliang Peng, Li Dong, Shaohan Huang, Jianyong Wang, Furu Wei
2024 J jnl
RedStone: Curating General, Code, Math, and QA Data for Large Language Models.
CoRR
Yaoyao Chang, Lei Cui, Li Dong, Shaohan Huang, Yangyu Huang, Yupan Huang, Scarlett Li, Tengchao Lv, Shuming Ma, Qinzheng Sun, Wenhui Wang, Furu Wei, Ying Xin, Mao Yang, Qiufeng Yin, Xingxing Zhang
2024 J jnl
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits.
CoRR
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei
2024 A* conf
You Only Cache Once: Decoder-Decoder Architectures for Language Models.
NeurIPS
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
2024 J jnl
You Only Cache Once: Decoder-Decoder Architectures for Language Models.
CoRR
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
2023 A* conf
Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks.
CVPR
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei
2023 J jnl
Kosmos-2.5: A Multimodal Literate Model.
CoRR
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
2023 J jnl
Kosmos-2: Grounding Multimodal Large Language Models to the World.
CoRR
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Furu Wei
2023 A* conf
Language Is Not All You Need: Aligning Perception with Language Models.
NeurIPS
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Nils Johan Bertil Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
2023 J jnl
Language Is Not All You Need: Aligning Perception with Language Models.
CoRR
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
2023 J jnl
LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens.
CoRR
Jiayu Ding, Shuming Ma, Li Dong, Xingxing Zhang, Shaohan Huang, Wenhui Wang, Nanning Zheng, Furu Wei
2023 A* conf
Magneto: A Foundation Transformer.
ICML
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
2023 J jnl
When an Image is Worth 1, 024 x 1, 024 Words: A Case Study in Computational Pathology.
CoRR
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
2022 J jnl
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models.
CoRR
Dongkuan Xu, Subhabrata Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Hassan Awadallah, Jianfeng Gao
2022 A* conf
Distilled Dual-Encoder Model for Vision-Language Understanding.
EMNLP
Zekun Wang, Wenhui Wang, Haichao Zhu, Ming Liu, Bing Qin, Furu Wei
2022 A* conf
Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models.
NeurIPS
Dongkuan Xu, Subhabrata Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Hassan Awadallah, Jianfeng Gao
2022 J jnl
Foundation Transformers.
CoRR
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
2022 J jnl
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks.
CoRR
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei
2022 J jnl
Language Models are General-Purpose Interfaces.
CoRR
Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei
2022 J jnl
TorchScale: Transformers at Scale.
CoRR
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei
2022 J jnl
VL-BEiT: Generative Vision-Language Pretraining.
CoRR
Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei
2022 A* conf
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts.
NeurIPS
Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, Furu Wei
2021 — conf
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains.
ACL/IJCNLP (Findings)
Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei
2021 J jnl
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains.
CoRR
Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei
2021 — conf
Consistency Regularization for Cross-Lingual Fine-Tuning.
ACL/IJCNLP (1)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
2021 J jnl
Consistency Regularization for Cross-Lingual Fine-Tuning.
CoRR
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
2021 J jnl
Distilled Dual-Encoder Model for Vision-Language Understanding.
CoRR
Zekun Wang, Wenhui Wang, Haichao Zhu, Ming Liu, Bing Qin, Furu Wei
2021 — conf
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training.
NAACL-HLT
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
2021 — conf
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers.
ACL/IJCNLP (Findings)
Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei
2021 J jnl
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts.
CoRR
Wenhui Wang, Hangbo Bao, Li Dong, Furu Wei
2021 J jnl
s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning.
CoRR
Hangbo Bao, Li Dong, Wenhui Wang, Nan Yang, Furu Wei
2020 A* conf
Cross-Lingual Natural Language Generation via Pre-Training.
AAAI
Zewen Chi, Li Dong, Furu Wei, Wenhui Wang, Xian-Ling Mao, Heyan Huang
2020 A* conf
Harvesting and Refining Question-Answer Pairs for Unsupervised QA.
ACL
Zhongli Li, Wenhui Wang, Li Dong, Furu Wei, Ke Xu
2020 J jnl
Harvesting and Refining Question-Answer Pairs for Unsupervised QA.
CoRR
Zhongli Li, Wenhui Wang, Li Dong, Furu Wei, Ke Xu
2020 J jnl
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training.
CoRR
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
2020 A* conf
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers.
NeurIPS
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
2020 J jnl
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers.
CoRR
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
2020 J jnl
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers.
CoRR
Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei
2020 A* conf
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training.
ICML
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Jianfeng Gao, Songhao Piao, Ming Zhou, Hsiao-Wuen Hon
2020 J jnl
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training.
CoRR
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
2019 J jnl
Cross-Lingual Natural Language Generation via Pre-Training.
CoRR
Zewen Chi, Li Dong, Furu Wei, Wenhui Wang, Xianling Mao, Heyan Huang
2019 — conf
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension.
MRQA@EMNLP
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Lei Cui, Songhao Piao, Ming Zhou
2019 — conf
Learning to Ask Unanswerable Questions for Machine Reading Comprehension.
ACL (1)
Haichao Zhu, Li Dong, Furu Wei, Wenhui Wang, Bing Qin, Ting Liu
2019 J jnl
Learning to Ask Unanswerable Questions for Machine Reading Comprehension.
CoRR
Haichao Zhu, Li Dong, Furu Wei, Wenhui Wang, Bing Qin, Ting Liu
2019 A* conf
Unified Language Model Pre-training for Natural Language Understanding and Generation.
NeurIPS
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
2019 J jnl
Unified Language Model Pre-training for Natural Language Understanding and Generation.
CoRR
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
2018 A* conf
Improved Dependency Parsing using Implicit Word Connections Learned from Unlabeled Data.
EMNLP
Wenhui Wang, Baobao Chang, Mairgup Mansur
2018 A* conf
Multiway Attention Networks for Modeling Sentence Pairs.
IJCAI
Chuanqi Tan, Furu Wei, Wenhui Wang, Weifeng Lv, Ming Zhou
2017 — conf
Gated Self-Matching Networks for Reading Comprehension and Question Answering.
ACL (1)
Wenhui Wang, Nan Yang, Furu Wei, Baobao Chang, Ming Zhou
2016 — conf
Graph-based Dependency Parsing with Bidirectional LSTM.
ACL (1)
Wenhui Wang, Baobao Chang
2016 — conf
Improved Graph-Based Dependency Parsing via Hierarchical LSTM Networks.
CCL
Wenhui Wang, Baobao Chang
2015 J jnl
Network tuned multiple rank aggregation and applications to gene ranking.
BMC Bioinform.
Wenhui Wang, Xianghong Jasmine Zhou, Zhenqiu Liu, Fengzhu Sun
2014 J jnl
Drug repositioning by integrating target information through a heterogeneous network model.
Bioinform.
Wenhui Wang, Sen Yang, Xiang Zhang, Jing Li
2013 J jnl
Rare variant discovery and calling by sequencing pooled samples with overlaps.
Bioinform.
Wenhui Wang, Xiaolin Yin, Yoon Soo Pyon, Matthew Hayes, Jing Li
2009 — conf
Comparison of Different Methods for Handling Linkage Disequilibrium in Genetic-Association Analyses via Simulation.
BMEI
Yongke Wang, Wenhui Wang, Yihui Luan
2009 J jnl
Usefulness and limitations of dK random graph models to predict interactions and functional homogeneity in biological networks under a pseudo-likelihood parameter estimation approach.
BMC Bioinform.
Wenhui Wang, Juan Nunez-Iglesias, Yihui Luan, Fengzhu Sun