Zihan Qiu

41 papers A* 5A 1Journal 23Unranked 12
YearRankTypeTitle / Venue / Authors
2026 J jnl
A Unified View of Attention and Residual Sinks: Outlier-Driven Rescaling is Essential for Transformer Training.
CoRR
Zihan Qiu, Zeyu Huang, Kaiyue Wen, Peng Jin, Bo Zheng, Yuxin Zhou, Haofeng Huang, Zekun Wang, Xiao Li, Huaqing Zhang, Yang Xu, Haoran Lian, Siqi Zhang, Rui Men, Jianwei Zhang, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin
2026 J jnl
Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers.
CoRR
Liangyu Wang, Siqi Zhang, Junjie Wang, Yiming Dong, Bo Zheng, Zihan Qiu, Shengkun Tang, Di Wang, Rui Men, Dayiheng Liu
2025 — conf
A Closer Look into Mixture-of-Experts in Large Language Models.
NAACL (Findings)
Ka Man Lo, Zeyu Huang, Zihan Qiu, Zili Wang, Jie Fu
2025 J jnl
A Controllable Examination for Long-Context Language Models.
CoRR
Yijun Yang, Zeyu Huang, Wenhao Zhu, Zihan Qiu, Fei Yuan, Jeff Z. Pan, Ivan Titov
2025 J jnl
A survey on multilingual large language models: corpora, alignment, and bias.
Frontiers Comput. Sci.
Yuemei Xu, Ling Hu, Jiayi Zhao, Zihan Qiu, Kexin Xu, Yuqi Ye, Hanwen Gu
2025 J jnl
Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling.
CoRR
Zeyu Huang, Tianhao Cheng, Zihan Qiu, Zili Wang, Yinghui Xu, Edoardo M. Ponti, Ivan Titov
2025 — conf
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models.
ACL (1)
Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin
2025 J jnl
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models.
CoRR
Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin
2025 — conf
Demonstration of Nanoseconds Reconfigurable All-Optical Switching Network for Distributed Deep Learning.
ECOC
Xianchen Wu, Daohang Dang, Xiangfei Chen, Bingli Guo, Shikui Shen, Zihan Qiu, Yuanzhi Guo, Changsheng Yang, Yisong Zhao, Wenzhe Li, Shanguo Huang, Xuwei Xue
2025 J jnl
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free.
CoRR
Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, Junyang Lin
2025 A* conf
Layerwise Recurrent Router for Mixture-of-Experts.
ICLR
Zihan Qiu, Zeyu Huang, Shuang Cheng, Yizhi Zhou, Zili Wang, Ivan Titov, Jie Fu
2025 A conf
Neo-TKGC: Enhancing Temporal Knowledge Graph Completion with Integrated Node Weights and Future Information.
WSDM
Zihan Qiu, Xiaoling Zhou, Chunyan An, Qiang Yang, Zhixu Li
2025 A* conf
Post-hoc Reward Calibration: A Case Study on Length Bias.
ICLR
Zeyu Huang, Zihan Qiu, Zili Wang, Edoardo M. Ponti, Ivan Titov
2025 A* conf
Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark.
AAAI
Yongliang Wu, Wenbo Zhu, Jiawang Cao, Yi Lu, Bozheng Li, Weiheng Chi, Zihan Qiu, Lirian Su, Haolin Zheng, Jay Wu, Xu Yang
2024 J jnl
A Closer Look into Mixture-of-Experts in Large Language Models.
CoRR
Ka Man Lo, Zeyu Huang, Zihan Qiu, Zili Wang, Jie Fu
2024 J jnl
A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias.
CoRR
Yuemei Xu, Ling Hu, Jiayi Zhao, Zihan Qiu, Yuqi Ye, Hanwen Gu
2024 J jnl
DSIFNet: Implicit feature network for nasal cavity and vestibule segmentation from 3D head CT.
Comput. Medical Imaging Graph.
Yi Lu, Hongjian Gao, Jikuan Qiu, Zihan Qiu, Junxiu Liu, Xiangzhi Bai
2024 — conf
Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers.
Tiny Papers @ ICLR
Zihan Qiu, Zeyu Huang, Youcheng Huang, Jie Fu
2024 J jnl
Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers.
CoRR
Zihan Qiu, Zeyu Huang, Youcheng Huang, Jie Fu
2024 J jnl
GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory.
CoRR
Haoze Wu, Zihan Qiu, Zili Wang, Hang Zhao, Jie Fu
2024 J jnl
HyperMoE: Paying Attention to Unselected Experts in Mixture of Experts via Dynamic Transfer.
CoRR
Hao Zhao, Zihan Qiu, Huijia Wu, Zili Wang, Zhaofeng He, Jie Fu
2024 — conf
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts.
ACL (1)
Hao Zhao, Zihan Qiu, Huijia Wu, Zili Wang, Zhaofeng He, Jie Fu
2024 J jnl
Layerwise Recurrent Router for Mixture-of-Experts.
CoRR
Zihan Qiu, Zeyu Huang, Shuang Cheng, Yizhi Zhou, Zili Wang, Ivan Titov, Jie Fu
2024 J jnl
Post-hoc Reward Calibration: A Case Study on Length Bias.
CoRR
Zeyu Huang, Zihan Qiu, Zili Wang, Edoardo M. Ponti, Ivan Titov
2024 J jnl
Qwen2.5 Technical Report.
CoRR
An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng Xue, Pei Zhang, Qin Zhu, Rui Men, Runji Lin, Tianhao Li, Tingyu Xia, Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zihan Qiu
2024 J jnl
Reconstructing Global Daily CO2 Emissions via Machine Learning.
CoRR
Tao Li, Lixing Wang, Zihan Qiu, Philippe Ciais, Taochun Sun, Matthew W. Jones, Robbie M. Andrew, Glen P. Peters, Piyu Ke, Xiaoting Huang, Robert B. Jackson, Zhu Liu
2024 A* conf
Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training.
NeurIPS
Wenyu Du, Tongxu Luo, Zihan Qiu, Zeyu Huang, Yikang Shen, Reynold Cheng, Yike Guo, Jie Fu
2024 J jnl
Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training.
CoRR
Wenyu Du, Tongxu Luo, Zihan Qiu, Zeyu Huang, Yikang Shen, Reynold Cheng, Yike Guo, Jie Fu
2024 — conf
Unlocking Continual Learning Abilities in Language Models.
EMNLP (Findings)
Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu
2024 J jnl
Unlocking Continual Learning Abilities in Language Models.
CoRR
Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu
2024 — conf
Unlocking Emergent Modularity in Large Language Models.
NAACL-HLT
Zihan Qiu, Zeyu Huang, Jie Fu
2024 — conf
ValueCSV: Evaluating Core Socialist Values Understanding in Large Language Models.
NLPCC (4)
Yuemei Xu, Ling Hu, Zihan Qiu
2024 J jnl
Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark.
CoRR
Yongliang Wu, Wenbo Zhu, Jiawang Cao, Yi Lu, Bozheng Li, Weiheng Chi, Zihan Qiu, Lirian Su, Haolin Zheng, Jay Wu, Xu Yang
2023 J jnl
Emergent Mixture-of-Experts: Can Dense Pre-trained Transformers Benefit from Emergent Modular Structures?
CoRR
Zihan Qiu, Zeyu Huang, Jie Fu
2023 J jnl
Heterogenous Memory Augmented Neural Networks.
CoRR
Zihan Qiu, Zhen Liu, Shuicheng Yan, Shanghang Zhang, Jie Fu
2022 A* conf
Supported Policy Optimization for Offline Reinforcement Learning.
NeurIPS
Jialong Wu, Haixu Wu, Zihan Qiu, Jianmin Wang, Mingsheng Long
2022 J jnl
Supported Policy Optimization for Offline Reinforcement Learning.
CoRR
Jialong Wu, Haixu Wu, Zihan Qiu, Jianmin Wang, Mingsheng Long
2021 — conf
A University Portrait System Incorporating Academic Social Network.
ChineseCSCW (2)
Yu Lai, Liantao Lan, Rui Liang, Li Huang, Zihan Qiu, Yong Tang
2021 — conf
Academic Article Classification Algorithm Based on Pre-trained Model and Keyword Extraction.
ChineseCSCW (2)
Zekai Zhou, Dongyang Zheng, Zihan Qiu, Ronghua Lin, Zhengyang Wu, Chengzhe Yuan
2021 — conf
Detection of Advertising Users Based on K-SMOTE and Ensemble Learning.
HCC
Zihan Qiu, Zekai Zhou, Yongxu Long, Chang Ji, Jianguo Li, Yong Tang
2021 — conf
ResConvE: Deeper Convolution-Based Knowledge Graph Embeddings.
ChineseCSCW (2)
Yongxu Long, Zihan Qiu, Dongyang Zheng, Zhengyang Wu, Jianguo Li, Yong Tang