Xinfa Zhu

56 papers A* 4A 7C 4Misc 4Journal 33Unranked 4
YearRankTypeTitle / Venue / Authors
2026 A* conf
KALL-E: Autoregressive Speech Synthesis with Next-Distribution Prediction.
AAAI
Kangxiang Xia, Xinfa Zhu, Jixun Yao, Wenjie Tian, Wenhao Li, Lei Xie
2025 J jnl
CosyAudio: Improving Audio Generation with Confidence Scores and Synthetic Captions.
CoRR
Xinfa Zhu, Wenjie Tian, Xinsheng Wang, Lei He, Xi Wang, Sheng Zhao, Lei Xie
2025 J jnl
DialoSpeech: Dual-Speaker Dialogue Generation with LLM and Flow Matching.
CoRR
Hanke Xie, Dake Guo, Chengyou Wang, Yue Li, Wenjie Tian, Xinfa Zhu, Xinsheng Wang, Xiulin Li, Guanqiong Miao, Bo Liu, Lei Xie
2025 — conf
Dialospeech: Dual-Speaker Dialogue Generation with LLM and Flow Matching.
APSIPA
Hanke Xie, Dake Guo, Chengyou Wang, Yue Li, Wenjie Tian, Xinfa Zhu, Xinsheng Wang, Xiulin Li, Guanqiong Miao, Bo Liu, Lei Xie
2025 A* conf
DualDub: Video-to-Soundtrack Generation via Joint Speech and Background Audio Synthesis.
ACM Multimedia
Wenjie Tian, Xinfa Zhu, Haohe Liu, Zhixian Zhao, Zihao Chen, Chaofan Ding, Xinhan Di, Junjie Zheng, Lei Xie
2025 J jnl
DualDub: Video-to-Soundtrack Generation via Joint Speech and Background Audio Synthesis.
CoRR
Wenjie Tian, Xinfa Zhu, Haohe Liu, Zhixian Zhao, Zihao Chen, Chaofan Ding, Xinhan Di, Junjie Zheng, Lei Xie
2025 A conf
FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching.
INTERSPEECH
Ziqian Wang, Zikai Liu, Xinfa Zhu, Yike Zhu, Mingshuai Liu, Jun Chen, Longshuai Xiao, Chao Weng, Lei Xie
2025 — conf
LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement.
ACL (1)
Boyi Kang, Xinfa Zhu, Zihan Zhang, Zhen Ye, Mingshuai Liu, Ziqian Wang, Yike Zhu, Guobin Ma, Jun Chen, Longshuai Xiao, Chao Weng, Wei Xue, Lei Xie
2025 J jnl
LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement.
CoRR
Boyi Kang, Xinfa Zhu, Zihan Zhang, Zhen Ye, Mingshuai Liu, Ziqian Wang, Yike Zhu, Guobin Ma, Jun Chen, Longshuai Xiao, Chao Weng, Wei Xue, Lei Xie
2025 C conf
Llasa+: Free Lunch for Accelerated and Streaming Llama-Based Speech Synthesis.
ASRU
Wenjie Tian, Xinfa Zhu, Hanke Xie, Zhen Ye, Wei Xue, Lei Xie
2025 J jnl
Llasa+: Free Lunch for Accelerated and Streaming Llama-Based Speech Synthesis.
CoRR
Wenjie Tian, Xinfa Zhu, Hanke Xie, Zhen Ye, Wei Xue, Lei Xie
2025 J jnl
Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesis.
CoRR
Zhen Ye, Xinfa Zhu, Chi-Min Chan, Xinsheng Wang, Xu Tan, Jiahe Lei, Yi Peng, Haohe Liu, Yizhu Jin, Zheqi Dai, Hongzhan Lin, Jianyi Chen, Xingjian Du, Liumeng Xue, Yunlin Chen, Zhifei Li, Lei Xie, Qiuqiang Kong, Yike Guo, Wei Xue
2025 J jnl
MPO: Multidimensional Preference Optimization for Language Model-based Text-to-Speech.
CoRR
Kangxiang Xia, Xinfa Zhu, Jixun Yao, Lei Xie
2025 J jnl
OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia.
CoRR
Xuelong Geng, Kun Wei, Qijie Shao, Shuiyun Liu, Zhennan Lin, Zhixian Zhao, Guojian Li, Wenjie Tian, Peikun Chen, Yangze Li, Pengcheng Guo, Mingchen Shao, Shuiyuan Wang, Yuang Cao, Chengyou Wang, Tianyi Xu, Yuhang Dai, Xinfa Zhu, Yue Li, Li Zhang, Lei Xie
2025 J jnl
PodEval: A Multimodal Evaluation Framework for Podcast Audio Generation.
CoRR
Yujia Xiao, Liumeng Xue, Lei He, Xinyi Chen, Aemon Yat Fei Chiu, Wenjie Tian, Shaofei Zhang, Qiuqiang Kong, Xinfa Zhu, Wei Xue, Tan Lee
2025 J jnl
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens.
CoRR
Xinsheng Wang, Mingqi Jiang, Ziyang Ma, Ziyu Zhang, Songxiang Liu, Linqin Li, Zheng Liang, Qixi Zheng, Rui Wang, Xiaoqin Feng, Weizhen Bian, Zhen Ye, Sitong Cheng, Ruibin Yuan, Zhixian Zhao, Xinfa Zhu, Jiahao Pan, Liumeng Xue, Pengcheng Zhu, Yunlin Chen, Zhifei Li, Xie Chen, Lei Xie, Yike Guo, Wei Xue
2025 J jnl
Steering Language Model to Stable Speech Emotion Recognition via Contextual Perception and Chain of Thought.
CoRR
Zhixian Zhao, Xinfa Zhu, Xinsheng Wang, Shuiyuan Wang, Xuelong Geng, Wenjie Tian, Lei Xie
2025 A conf
U-SAM: An Audio Language Model for Unified Speech, Audio, and Music Understanding.
INTERSPEECH
Ziqian Wang, Xianjun Xia, Xinfa Zhu, Lei Xie
2025 J jnl
U-SAM: An audio language Model for Unified Speech, Audio, and Music Understanding.
CoRR
Ziqian Wang, Xianjun Xia, Xinfa Zhu, Lei Xie
2025 A conf
Weakly Supervised Data Refinement and Flexible Sequence Compression for Efficient Thai LLM-based ASR.
INTERSPEECH
Mingchen Shao, Xinfa Zhu, Chengyou Wang, Bingshen Mu, Hai Li, Ying Yan, Junhui Liu, Danming Xie, Lei Xie
2025 J jnl
Weakly Supervised Data Refinement and Flexible Sequence Compression for Efficient Thai LLM-based ASR.
CoRR
Mingchen Shao, Xinfa Zhu, Chengyou Wang, Bingshen Mu, Hai Li, Ying Yan, Junhui Liu, Danming Xie, Lei Xie
2025 C conf
XEmoRAG: Cross-Lingual Emotion Transfer with Controllable Intensity Using Retrieval-Augmented Generation.
ASRU
Tianlun Zuo, Jingbin Hu, Yuke Li, Xinfa Zhu, Hai Li, Ying Yan, Junhui Liu, Danming Xie, Lei Xie
2025 Misc conf
ZSVC: Zero-shot Style Voice Conversion with Disentangled Latent Diffusion Models and Adversarial Training.
ICASSP
Xinfa Zhu, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
2025 J jnl
ZSVC: Zero-shot Style Voice Conversion with Disentangled Latent Diffusion Models and Adversarial Training.
CoRR
Xinfa Zhu, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
2024 J jnl
Autoregressive Speech Synthesis with Next-Distribution Prediction.
CoRR
Xinfa Zhu, Wenjie Tian, Lei Xie
2024 A conf
Boosting Multi-Speaker Expressive Speech Synthesis with Semi-Supervised Contrastive Learning.
ICME
Xinfa Zhu, Yuke Li, Yi Lei, Ning Jiang, Guoqing Zhao, Lei Xie
2024 J jnl
CoDiff-VC: A Codec-Assisted Diffusion Model for Zero-shot Voice Conversion.
CoRR
Yuke Li, Xinfa Zhu, Hanzhao Li, Jixun Yao, Wenjie Tian, Xipeng Yang, Yunlin Chen, Zhifei Li, Lei Xie
2024 A* conf
Contrastive Context-Speech Pretraining for Expressive Text-to-Speech Synthesis.
ACM Multimedia
Yujia Xiao, Xi Wang, Xu Tan, Lei He, Xinfa Zhu, Sheng Zhao, Tan Lee
2024 J jnl
METTS: Multilingual Emotional Text-to-Speech by Cross-Speaker and Cross-Lingual Emotion Transfer.
IEEE ACM Trans. Audio Speech Lang. Process.
Xinfa Zhu, Yi Lei, Tao Li, Yongmao Zhang, Hongbin Zhou, Heng Lu, Lei Xie
2024 Misc conf
SELM: Speech Enhancement using Discrete Tokens and Language Models.
ICASSP
Ziqian Wang, Xinfa Zhu, Zihan Zhang, Yuanjun Lv, Ning Jiang, Guoqing Zhao, Lei Xie
2024 A conf
Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation.
INTERSPEECH
Hanzhao Li, Liumeng Xue, Haohan Guo, Xinfa Zhu, Yuanjun Lv, Lei Xie, Yunlin Chen, Hao Yin, Zhifei Li
2024 Misc conf
Spontts: Modeling and Transferring Spontaneous Style for TTS.
ICASSP
Hanzhao Li, Xinfa Zhu, Liumeng Xue, Yang Song, Yunlin Chen, Lei Xie
2024 A conf
Text-aware and Context-aware Expressive Audiobook Speech Synthesis.
INTERSPEECH
Dake Guo, Xinfa Zhu, Liumeng Xue, Yongmao Zhang, Wenjie Tian, Lei Xie
2024 — conf
The NPU-HWC System for the ISCSLP 2024 Inspirational and Convincing Audio Generation Challenge.
ISCSLP
Dake Guo, Jixun Yao, Xinfa Zhu, Kangxiang Xia, Zhao Guo, Ziyu Zhang, Yao Wang, Jie Liu, Lei Xie
2024 J jnl
The NPU-HWC System for the ISCSLP 2024 Inspirational and Convincing Audio Generation Challenge.
CoRR
Dake Guo, Jixun Yao, Xinfa Zhu, Kangxiang Xia, Zhao Guo, Ziyu Zhang, Yao Wang, Jie Liu, Lei Xie
2024 J jnl
U-Style: Cascading U-Nets With Multi-Level Speaker and Style Modeling for Zero-Shot Voice Cloning.
IEEE ACM Trans. Audio Speech Lang. Process.
Tao Li, Zhichao Wang, Xinfa Zhu, Jian Cong, Qiao Tian, Yuping Wang, Lei Xie
2024 A* conf
UniStyle: Unified Style Modeling for Speaking Style Captioning and Stylistic Speech Synthesis.
ACM Multimedia
Xinfa Zhu, Wenjie Tian, Xinsheng Wang, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
2024 A conf
Vec-Tok-VC+: Residual-enhanced Robust Zero-shot Voice Conversion with Progressive Constraints in a Dual-mode Training Strategy.
INTERSPEECH
Linhan Ma, Xinfa Zhu, Yuanjun Lv, Zhichao Wang, Ziqian Wang, Wendi He, Hongbin Zhou, Lei Xie
2024 J jnl
Vec-Tok-VC+: Residual-enhanced Robust Zero-shot Voice Conversion with Progressive Constraints in a Dual-mode Training Strategy.
CoRR
Linhan Ma, Xinfa Zhu, Yuanjun Lv, Zhichao Wang, Ziqian Wang, Wendi He, Hongbin Zhou, Lei Xie
2024 J jnl
YingSound: Video-Guided Sound Effects Generation with Multi-modal Chain-of-Thought Controls.
CoRR
Zihao Chen, Haomin Zhang, Xinhan Di, Haoyu Wang, Sizhe Shan, Junjie Zheng, Yunming Liang, Yihan Fan, Xinfa Zhu, Wenjie Tian, Yihua Wang, Chaofan Ding, Lei Xie
2023 J jnl
Accent-VITS: accent transfer for end-to-end TTS.
CoRR
Linhan Ma, Yongmao Zhang, Xinfa Zhu, Yi Lei, Ziqian Ning, Pengcheng Zhu, Lei Xie
2023 J jnl
DiCLET-TTS: Diffusion Model Based Cross-Lingual Emotion Transfer for Text-to-Speech - A Study Between English and Mandarin.
IEEE ACM Trans. Audio Speech Lang. Process.
Tao Li, Chenxu Hu, Jian Cong, Xinfa Zhu, Jingbei Li, Qiao Tian, Yuping Wang, Lei Xie
2023 J jnl
DiCLET-TTS: Diffusion Model based Cross-lingual Emotion Transfer for Text-to-Speech - A Study between English and Mandarin.
CoRR
Tao Li, Chenxu Hu, Jian Cong, Xinfa Zhu, Jingbei Li, Qiao Tian, Yuping Wang, Lei Xie
2023 C conf
HIGNN-TTS: Hierarchical Prosody Modeling With Graph Neural Networks for Expressive Long-Form TTS.
ASRU
Dake Guo, Xinfa Zhu, Liumeng Xue, Tao Li, Yuanjun Lv, Yuepeng Jiang, Lei Xie
2023 J jnl
HiGNN-TTS: Hierarchical Prosody Modeling with Graph Neural Networks for Expressive Long-form TTS.
CoRR
Dake Guo, Xinfa Zhu, Liumeng Xue, Tao Li, Yuanjun Lv, Yuepeng Jiang, Lei Xie
2023 Misc conf
Multi-Speaker Expressive Speech Synthesis via Multiple Factors Decoupling.
ICASSP
Xinfa Zhu, Yi Lei, Kun Song, Yongmao Zhang, Tao Li, Lei Xie
2023 J jnl
Multi-Speaker Expressive Speech Synthesis via Semi-supervised Contrastive Learning.
CoRR
Xinfa Zhu, Yuke Li, Yi Lei, Ning Jiang, Guoqing Zhao, Lei Xie
2023 J jnl
SponTTS: modeling and transferring spontaneous style for TTS.
CoRR
Hanzhao Li, Xinfa Zhu, Liumeng Xue, Yang Song, Yunlin Chen, Lei Xie
2023 J jnl
U-Style: Cascading U-nets with Multi-level Speaker and Style Modeling for Zero-Shot Voice Cloning.
CoRR
Tao Li, Zhichao Wang, Xinfa Zhu, Jian Cong, Qiao Tian, Yuping Wang, Lei Xie
2023 J jnl
Vec-Tok Speech: speech vectorization and tokenization for neural speech generation.
CoRR
Xinfa Zhu, Yuanjun Lv, Yi Lei, Tao Li, Wendi He, Hongbin Zhou, Heng Lu, Lei Xie
2023 J jnl
Zero-Shot Emotion Transfer For Cross-Lingual Speech Synthesis.
CoRR
Yuke Li, Xinfa Zhu, Yi Lei, Hai Li, Junhui Liu, Danming Xie, Lei Xie
2023 C conf
Zero-Shot Emotion Transfer for Cross-Lingual Speech Synthesis.
ASRU
Yuke Li, Xinfa Zhu, Yi Lei, Hai Li, Junhui Liu, Danming Xie, Lei Xie
2022 J jnl
Cross-Speaker Emotion Transfer Through Information Perturbation in Emotional Speech Synthesis.
IEEE Signal Process. Lett.
Yi Lei, Shan Yang, Xinfa Zhu, Lei Xie, Dan Su
2022 J jnl
Multi-Speaker Expressive Speech Synthesis via Multiple Factors Decoupling.
CoRR
Xinfa Zhu, Yi Lei, Kun Song, Yongmao Zhang, Tao Li, Lei Xie
2022 — conf
The NPU-ASLP System for The ISCSLP 2022 Magichub Code-Swiching ASR Challenge.
ISCSLP
Yuhao Liang, Peikun Chen, Fan Yu, Xinfa Zhu, Tianyi Xu, Yingying Gao, Lei Xie
2022 J jnl
The NPU-ASLP System for The ISCSLP 2022 Magichub Code-Swiching ASR Challenge.
CoRR
Yuhao Liang, Peikun Chen, Fan Yu, Xinfa Zhu, Tianyi Xu, Lei Xie