Chen Liang

40 papers A* 10B 1Journal 21Unranked 7
YearRankTypeTitle / Venue / Authors
2025 J jnl
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs.
CoRR
Abdelrahman Abouelenin, Atabak Ashfaq, Adam Atkinson, Hany Awadalla, Nguyen Bach, Jianmin Bao, Alon Benhaim, Martin Cai, Vishrav Chaudhary, Congcong Chen, Dong Chen, Dongdong Chen, Jun-Kun Chen, Weizhu Chen, Yen-Chun Chen, Yi-ling Chen, Qi Dai, Xiyang Dai, Ruchao Fan, Mei Gao, Min Gao, Amit Garg, Abhishek Goswami, Junheng Hao, Amr Hendy, Yuxuan Hu, Xin Jin, Mahmoud Khademi, Dongwoo Kim, Young Jin Kim, Gina Lee, Jinyu Li, Yunsheng Li, Chen Liang, Xihui Lin, Zeqi Lin, Mengchen Liu, Yang Liu, Gilsinia Lopez, Chong Luo, Piyush Madan, Vadim Mazalov, Arindam Mitra, Ali Mousavi, Anh Nguyen, Jing Pan, Daniel Perez-Becker, Jacob Platin, Thomas Portet, Kai Qiu, Bo Ren, Liliang Ren, Sambuddha Roy, Ning Shang, Yelong Shen, Saksham Singhal, Subhojit Som, Xia Song, Tetyana Sych, Praneetha Vaddamanu, Shuohang Wang, Yiming Wang, Zhenghao Wang, Haibin Wu, Haoran Xu, Weijian Xu, Yifan Yang, Ziyi Yang, Donghan Yu, Ishmam Zabir, Jianwen Zhang, Li Lyna Zhang, Yunan Zhang, Xiren Zhou
2025 A* conf
Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling.
ICLR
Liliang Ren, Yang Liu, Yadong Lu, Yelong Shen, Chen Liang, Weizhu Chen
2025 J jnl
SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation.
CoRR
Zichong Li, Chen Liang, Zixuan Zhang, Ilgee Hong, Young Jin Kim, Weizhu Chen, Tuo Zhao
2025 B conf
Taxonomy-Based Negative Sampling in Personalized Semantic Search for E-Commerce.
IEEE Big Data
Uthman Jinadu, Siawpeng Er, Le Yu, Chen Liang, Bingxin Li, Yi Ding, Aleksandar Velkoski
2025 J jnl
Taxonomy-based Negative Sampling In Personalized Semantic Search for E-commerce.
CoRR
Uthman Jinadu, Siawpeng Er, Le Yu, Chen Liang, Bingxin Li, Yi Ding, Aleksandar Velkoski
2024 J jnl
GRIN: GRadient-INformed MoE.
CoRR
Liyuan Liu, Young Jin Kim, Shuohang Wang, Chen Liang, Yelong Shen, Hao Cheng, Xiaodong Liu, Masahiro Tanaka, Xiaoxia Wu, Wenxiang Hu, Vishrav Chaudhary, Zeqi Lin, Chengruidong Zhang, Jilong Xue, Hany Awadalla, Jianfeng Gao, Weizhu Chen
2024 A* conf
LoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models.
ICLR
Yixiao Li, Yifan Yu, Chen Liang, Nikos Karampatziakis, Pengcheng He, Weizhu Chen, Tuo Zhao
2024 — —
On Parameter Efficiency of Neural Language Models.
Chen Liang
2024 J jnl
Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling.
CoRR
Liliang Ren, Yang Liu, Yadong Lu, Yelong Shen, Chen Liang, Weizhu Chen
2023 A* conf
HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers.
ICLR
Chen Liang, Haoming Jiang, Zheng Li, Xianfeng Tang, Bing Yin, Tuo Zhao
2023 J jnl
HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers.
CoRR
Chen Liang, Haoming Jiang, Zheng Li, Xianfeng Tang, Bin Yin, Tuo Zhao
2023 A* conf
Less is More: Task-aware Layer-wise Distillation for Language Model Compression.
ICML
Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao
2023 A* conf
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.
ICML
Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
2023 J jnl
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.
CoRR
Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
2023 J jnl
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models.
CoRR
Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao
2023 A* conf
Module-wise Adaptive Distillation for Multimodality Foundation Models.
NeurIPS
Chen Liang, Jiahui Yu, Ming-Hsuan Yang, Matthew Brown, Yin Cui, Tuo Zhao, Boqing Gong, Tianyi Zhou
2023 J jnl
Module-wise Adaptive Distillation for Multimodality Foundation Models.
CoRR
Chen Liang, Jiahui Yu, Ming-Hsuan Yang, Matthew Brown, Yin Cui, Tuo Zhao, Boqing Gong, Tianyi Zhou
2022 — conf
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing.
ACL (1)
Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao
2022 J jnl
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing.
CoRR
Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao
2022 J jnl
Less is More: Task-aware Layer-wise Distillation for Language Model Compression.
CoRR
Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao
2022 — conf
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.
NAACL-HLT
Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen
2022 J jnl
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.
CoRR
Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen
2022 A* conf
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models.
ICLR
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2022 J jnl
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models.
CoRR
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2022 A* conf
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance.
ICML
Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao
2022 J jnl
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance.
CoRR
Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao
2022 — conf
Self-Training with Differentiable Teacher.
NAACL-HLT (Findings)
Simiao Zuo, Yue Yu, Chen Liang, Haoming Jiang, Siawpeng Er, Chao Zhang, Tuo Zhao, Hongyuan Zha
2021 — conf
ARCH: Efficient Adversarial Regularized Training with Caching.
EMNLP (Findings)
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 J jnl
ARCH: Efficient Adversarial Regularized Training with Caching.
CoRR
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 — conf
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach.
EMNLP (1)
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 J jnl
Adversarial Training as Stackelberg Game: An Unrolled Optimization Approach.
CoRR
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 J jnl
Self-Training with Differentiable Teacher.
CoRR
Simiao Zuo, Yue Yu, Chen Liang, Haoming Jiang, Siawpeng Er, Chao Zhang, Tuo Zhao, Hongyuan Zha
2021 — conf
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization.
ACL/IJCNLP (1)
Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
2021 J jnl
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization.
CoRR
Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
2021 — conf
Token-wise Curriculum Learning for Neural Machine Translation.
EMNLP (Findings)
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao
2021 J jnl
Token-wise Curriculum Learning for Neural Machine Translation.
CoRR
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao
2020 A* conf
BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision.
KDD
Chen Liang, Yue Yu, Haoming Jiang, Siawpeng Er, Ruijia Wang, Tuo Zhao, Chao Zhang
2020 J jnl
BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision.
CoRR
Chen Liang, Yue Yu, Haoming Jiang, Siawpeng Er, Ruijia Wang, Tuo Zhao, Chao Zhang
2020 A* conf
Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing.
ACL
Haoming Jiang, Chen Liang, Chong Wang, Tuo Zhao
2019 J jnl
Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing.
CoRR
Haoming Jiang, Chen Liang, Chong Wang, Tuo Zhao