Kai Lv

23 papers A* 3Journal 13Unranked 7
YearRankTypeTitle / Venue / Authors
2026 J jnl
Explicit Multi-head Attention for Inter-head Interaction in Large Language Models.
CoRR
Runyu Peng, Yunhua Zhou, Demin Song, Kai Lv, Bo Wang, Qipeng Guo, Xipeng Qiu
2026 J jnl
Mousse: Rectifying the Geometry of Muon with Curvature-Aware Preconditioning.
CoRR
Yechen Zhang, Shuhao Xing, Junhao Huang, Kai Lv, Yunhua Zhou, Xipeng Qiu, Qipeng Guo, Kai Chen
2025 — conf
CritiQ: Mining Data Quality Criteria from Human Preferences.
ACL (1)
Honglin Guo, Kai Lv, Qipeng Guo, Tianyi Liang, Zhiheng Xi, Demin Song, Qiuyinzhe Zhang, Yu Sun, Kai Chen, Xipeng Qiu, Tao Gui
2025 J jnl
CritiQ: Mining Data Quality Criteria from Human Preferences.
CoRR
Honglin Guo, Kai Lv, Qipeng Guo, Tianyi Liang, Zhiheng Xi, Demin Song, Qi Zhang, Yu Sun, Kai Chen, Xipeng Qiu, Tao Gui
2025 J jnl
DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting.
CoRR
Kai Lv, Honglin Guo, Qipeng Guo, Xipeng Qiu
2025 — conf
FastMCTS: A Simple Sampling Strategy for Data Synthesis.
ACL (1)
Peiji Li, Kai Lv, Yunfan Shao, Yichuan Ma, Linyang Li, Xiaoqing Zheng, Xipeng Qiu, Qipeng Guo
2025 J jnl
FastMCTS: A Simple Sampling Strategy for Data Synthesis.
CoRR
Peiji Li, Kai Lv, Yunfan Shao, Yichuan Ma, Linyang Li, Xiaoqing Zheng, Xipeng Qiu, Qipeng Guo
2025 A* conf
Firewall Routing: Blocking Leads to Better Hybrid Inference for LLMs.
EMNLP
Runyu Peng, Yunhua Zhou, Kai Lv, Yang Gao, Qipeng Guo, Xipeng Qiu
2025 A* conf
ReAttention: Training-Free Infinite Context with Finite Attention Scope.
ICLR
Xiaoran Liu, Ruixiao Li, Zhigeng Liu, Qipeng Guo, Yuerong Song, Kai Lv, Hang Yan, Linlin Li, Qun Liu, Xipeng Qiu
2024 — conf
AdaLomo: Low-memory Optimization with Adaptive Learning Rate.
ACL (Findings)
Kai Lv, Hang Yan, Qipeng Guo, Haijun Lv, Xipeng Qiu
2024 J jnl
Farewell to Length Extrapolation, a Training-Free Infinite Context with Finite Attention Scope.
CoRR
Xiaoran Liu, Qipeng Guo, Yuerong Song, Zhigeng Liu, Kai Lv, Hang Yan, Linlin Li, Qun Liu, Xipeng Qiu
2024 — conf
Full Parameter Fine-tuning for Large Language Models with Limited Resources.
ACL (1)
Kai Lv, Yuqing Yang, Tengxiao Liu, Qipeng Guo, Xipeng Qiu
2024 J jnl
InternLM2 Technical Report.
CoRR
Zheng Cai, Maosong Cao, Haojiong Chen, Kai Chen, Keyu Chen, Xin Chen, Xun Chen, Zehui Chen, Zhi Chen, Pei Chu, Xiaoyi Dong, Haodong Duan, Qi Fan, Zhaoye Fei, Yang Gao, Jiaye Ge, Chenya Gu, Yuzhe Gu, Tao Gui, Aijia Guo, Qipeng Guo, Conghui He, Yingfan Hu, Ting Huang, Tao Jiang, Penglong Jiao, Zhenjiang Jin, Zhikai Lei, Jiaxing Li, Jingwen Li, Linyang Li, Shuaibin Li, Wei Li, Yining Li, Hongwei Liu, Jiangning Liu, Jiawei Hong, Kaiwen Liu, Kuikun Liu, Xiaoran Liu, Chengqi Lv, Haijun Lv, Kai Lv, Li Ma, Runyuan Ma, Zerun Ma, Wenchang Ning, Linke Ouyang, Jiantao Qiu, Yuan Qu, Fukai Shang, Yunfan Shao, Demin Song, Zifan Song, Zhihao Sui, Peng Sun, Yu Sun, Huanze Tang, Bin Wang, Guoteng Wang, Jiaqi Wang, Jiayu Wang, Rui Wang, Yudong Wang, Ziyi Wang, Xingjian Wei, Qizhen Weng, Fan Wu, Yingtong Xiong, Xiaomeng Zhao, et al.
2024 — conf
LongWanjuan: Towards Systematic Measurement for Long Text Quality.
EMNLP (Findings)
Xiaoran Liu, Kai Lv, Qipeng Guo, Hang Yan, Conghui He, Xipeng Qiu, Dahua Lin
2024 J jnl
LongWanjuan: Towards Systematic Measurement for Long Text Quality.
CoRR
Kai Lv, Xiaoran Liu, Qipeng Guo, Hang Yan, Conghui He, Xipeng Qiu, Dahua Lin
2023 J jnl
AdaLomo: Low-memory Optimization with Adaptive Learning Rate.
CoRR
Kai Lv, Hang Yan, Qipeng Guo, Haijun Lv, Xipeng Qiu
2023 — conf
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way.
EMNLP (Demos)
Kai Lv, Shuo Zhang, Tianle Gu, Shuhao Xing, Jiawei Hong, Keyu Chen, Xiaoran Liu, Yuqing Yang, Honglin Guo, Tengxiao Liu, Yu Sun, Qipeng Guo, Hang Yan, Xipeng Qiu
2023 J jnl
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way.
CoRR
Kai Lv, Shuo Zhang, Tianle Gu, Shuhao Xing, Jiawei Hong, Keyu Chen, Xiaoran Liu, Yuqing Yang, Honglin Guo, Tengxiao Liu, Yu Sun, Qipeng Guo, Hang Yan, Xipeng Qiu
2023 J jnl
Full Parameter Fine-tuning for Large Language Models with Limited Resources.
CoRR
Kai Lv, Yuqing Yang, Tengxiao Liu, Qinghui Gao, Qipeng Guo, Xipeng Qiu
2023 — conf
Unified Demonstration Retriever for In-Context Learning.
ACL (1)
Xiaonan Li, Kai Lv, Hang Yan, Tianyang Lin, Wei Zhu, Yuan Ni, Guotong Xie, Xiaoling Wang, Xipeng Qiu
2023 J jnl
Unified Demonstration Retriever for In-Context Learning.
CoRR
Xiaonan Li, Kai Lv, Hang Yan, Tianyang Lin, Wei Zhu, Yuan Ni, Guotong Xie, Xiaoling Wang, Xipeng Qiu
2022 A* conf
CoNT: Contrastive Neural Text Generation.
NeurIPS
Chenxin An, Jiangtao Feng, Kai Lv, Lingpeng Kong, Xipeng Qiu, Xuanjing Huang
2022 J jnl
CoNT: Contrastive Neural Text Generation.
CoRR
Chenxin An, Jiangtao Feng, Kai Lv, Lingpeng Kong, Xipeng Qiu, Xuanjing Huang