Chenpeng Du

61 papers A* 5A 5Misc 12Journal 34Unranked 5
YearRankTypeTitle / Venue / Authors
2026 J jnl
Recent Advances in Discrete Speech Tokens: A Review.
IEEE Trans. Pattern Anal. Mach. Intell.
Yiwei Guo, Zhihan Li, Hankun Wang, Bohan Li, Chongtian Shao, Hanglei Zhang, Chenpeng Du, Xie Chen, Shujie Liu, Kai Yu
2025 J jnl
DiSTAR: Diffusion over a Scalable Token Autoregressive Representation for Speech Generation.
CoRR
Yakun Song, Xiaobin Zhuang, Jiawei Chen, Zhikang Niu, Guanrou Yang, Chenpeng Du, Dongya Jia, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xie Chen
2025 A* conf
DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation.
ICML
Dongya Jia, Zhuo Chen, Jiawei Chen, Chenpeng Du, Jian Wu, Jian Cong, Xiaobin Zhuang, Chumin Li, Zhen Wei, Yuping Wang, Yuxuan Wang
2025 J jnl
DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation.
CoRR
Dongya Jia, Zhuo Chen, Jiawei Chen, Chenpeng Du, Jian Wu, Jian Cong, Xiaobin Zhuang, Chumin Li, Zhen Wei, Yuping Wang, Yuxuan Wang
2025 A conf
LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec.
INTERSPEECH
Yiwei Guo, Zhihan Li, Chenpeng Du, Hankun Wang, Xie Chen, Kai Yu
2025 A* conf
Language Model Can Listen While Speaking.
AAAI
Ziyang Ma, Yakun Song, Chenpeng Du, Jian Cong, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xie Chen
2025 J jnl
MagiCodec: Simple Masked Gaussian-Injected Codec for High-Fidelity Reconstruction and Generation.
CoRR
Yakun Song, Jiawei Chen, Xiaobin Zhuang, Chenpeng Du, Ziyang Ma, Jian Wu, Jian Cong, Dongya Jia, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xie Chen
2025 J jnl
Recent Advances in Discrete Speech Tokens: A Review.
CoRR
Yiwei Guo, Zhihan Li, Hankun Wang, Bohan Li, Chongtian Shao, Hanglei Zhang, Chenpeng Du, Xie Chen, Shujie Liu, Kai Yu
2025 — conf
Towards Reliable Large Audio Language Model.
ACL (Findings)
Ziyang Ma, Xiquan Li, Yakun Song, Wenxi Chen, Chenpeng Du, Jian Wu, Yuanzhe Chen, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xie Chen
2025 J jnl
Towards Reliable Large Audio Language Model.
CoRR
Ziyang Ma, Xiquan Li, Yakun Song, Wenxi Chen, Chenpeng Du, Jian Wu, Yuanzhe Chen, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xie Chen
2025 Misc conf
VALL-T: Decoder-Only Generative Transducer for Robust and Decoding-Controllable Text-to-Speech.
ICASSP
Chenpeng Du, Yiwei Guo, Hankun Wang, Yifan Yang, Zhikang Niu, Shuai Wang, Hui Zhang, Xie Chen, Kai Yu
2024 Misc conf
Acoustic BPE for Speech Generation with Discrete Tokens.
ICASSP
Feiyu Shen, Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
2024 A* conf
AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding.
ACM Multimedia
Tao Liu, Feilong Chen, Shuai Fan, Chenpeng Du, Qi Chen, Xie Chen, Kai Yu
2024 J jnl
AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding.
CoRR
Tao Liu, Feilong Chen, Shuai Fan, Chenpeng Du, Qi Chen, Xie Chen, Kai Yu
2024 — conf
Attention-Constrained Inference For Robust Decoder-Only Text-to-Speech.
SLT
Hankun Wang, Chenpeng Du, Yiwei Guo, Shuai Wang, Xie Chen, Kai Yu
2024 J jnl
Attention-Constrained Inference for Robust Decoder-Only Text-to-Speech.
CoRR
Hankun Wang, Chenpeng Du, Yiwei Guo, Shuai Wang, Xie Chen, Kai Yu
2024 Misc conf
DiffDub: Person-Generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-Encoder.
ICASSP
Tao Liu, Chenpeng Du, Shuai Fan, Feilong Chen, Kai Yu
2024 J jnl
E$^{3}$TTS: End-to-End Text-Based Speech Editing TTS System and Its Applications.
IEEE ACM Trans. Audio Speech Lang. Process.
Zheng Liang, Ziyang Ma, Chenpeng Du, Kai Yu, Xie Chen
2024 J jnl
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting.
CoRR
Bo Chen, Shoukang Hu, Qi Chen, Chenpeng Du, Ran Yi, Yanmin Qian, Xie Chen
2024 Misc conf
Generation-Based Target Speech Extraction with Speech Discretization and Vocoder.
ICASSP
Linfeng Yu, Wangyou Zhang, Chenpeng Du, Leying Zhang, Zheng Liang, Yanmin Qian
2024 J jnl
LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec.
CoRR
Yiwei Guo, Zhihan Li, Chenpeng Du, Hankun Wang, Xie Chen, Kai Yu
2024 J jnl
Language Model Can Listen While Speaking.
CoRR
Ziyang Ma, Yakun Song, Chenpeng Du, Jian Cong, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xie Chen
2024 J jnl
The X-LANCE Technical Report for Interspeech 2024 Speech Processing Using Discrete Speech Unit Challenge.
CoRR
Yiwei Guo, Chenrun Wang, Yifan Yang, Hankun Wang, Ziyang Ma, Chenpeng Du, Shuai Wang, Hanzheng Li, Shuai Fan, Hui Zhang, Xie Chen, Kai Yu
2024 — conf
The X-Lance Technical Report for Interspeech 2024 Speech Processing using Discrete Speech Unit Challenge.
ISCSLP
Yiwei Guo, Chenrun Wang, Yifan Yang, Hankun Wang, Ziyang Ma, Chenpeng Du, Shuai Wang, Hanzheng Li, Xu Li, Shuai Fan, Hui Zhang, Xie Chen, Kai Yu
2024 Misc conf
Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS.
ICASSP
Yifan Yang, Feiyu Shen, Chenpeng Du, Ziyang Ma, Kai Yu, Daniel Povey, Xie Chen
2024 A* conf
UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding.
AAAI
Chenpeng Du, Yiwei Guo, Feiyu Shen, Zhijun Liu, Zheng Liang, Xie Chen, Shuai Wang, Hui Zhang, Kai Yu
2024 J jnl
VALL-T: Decoder-Only Generative Transducer for Robust and Decoding-Controllable Text-to-Speech.
CoRR
Chenpeng Du, Yiwei Guo, Hankun Wang, Yifan Yang, Zhikang Niu, Shuai Wang, Hui Zhang, Xie Chen, Kai Yu
2024 Misc conf
VoiceFlow: Efficient Text-To-Speech with Rectified Flow Matching.
ICASSP
Yiwei Guo, Chenpeng Du, Ziyang Ma, Xie Chen, Kai Yu
2024 J jnl
Why Do Speech Language Models Fail to Generate Semantically Coherent Outputs? A Modality Evolving Perspective.
CoRR
Hankun Wang, Haoran Wang, Yiwei Guo, Zhihan Li, Chenpeng Du, Xie Chen, Kai Yu
2024 J jnl
vec2wav 2.0: Advancing Voice Conversion via Discrete Token Vocoders.
CoRR
Yiwei Guo, Zhihan Li, Junjie Li, Chenpeng Du, Hankun Wang, Shuai Wang, Xie Chen, Kai Yu
2023 J jnl
Acoustic BPE for Speech Generation with Discrete Tokens.
CoRR
Feiyu Shen, Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
2023 A* conf
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder.
ACM Multimedia
Chenpeng Du, Qi Chen, Tianyu He, Xu Tan, Xie Chen, Kai Yu, Sheng Zhao, Jiang Bian
2023 J jnl
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder.
CoRR
Chenpeng Du, Qi Chen, Tianyu He, Xu Tan, Xie Chen, Kai Yu, Sheng Zhao, Jiang Bian
2023 A conf
DSE-TTS: Dual Speaker Embedding for Cross-Lingual Text-to-Speech.
INTERSPEECH
Sen Liu, Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
2023 J jnl
DSE-TTS: Dual Speaker Embedding for Cross-Lingual Text-to-Speech.
CoRR
Sen Liu, Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
2023 J jnl
DiffDub: Person-generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-encoder.
CoRR
Tao Liu, Chenpeng Du, Shuai Fan, Feilong Chen, Kai Yu
2023 Misc conf
Emodiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidance.
ICASSP
Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
2023 A conf
Improving Code-Switching and Name Entity Recognition in ASR with Speech Editing based Data Augmentation.
INTERSPEECH
Zheng Liang, Zheshu Song, Ziyang Ma, Chenpeng Du, Kai Yu, Xie Chen
2023 J jnl
Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation.
CoRR
Zheng Liang, Zheshu Song, Ziyang Ma, Chenpeng Du, Kai Yu, Xie Chen
2023 Misc conf
Multi-Speaker Multi-Lingual VQTTS System for LIMMITS 2023 Challenge.
ICASSP
Chenpeng Du, Yiwei Guo, Feiyu Shen, Kai Yu
2023 J jnl
Multi-Speaker Multi-Lingual VQTTS System for LIMMITS 2023 Challenge.
CoRR
Chenpeng Du, Yiwei Guo, Feiyu Shen, Kai Yu
2023 J jnl
Speaker Adaptive Text-to-Speech With Timbre-Normalized Vector-Quantized Feature.
IEEE ACM Trans. Audio Speech Lang. Process.
Chenpeng Du, Yiwei Guo, Xie Chen, Kai Yu
2023 J jnl
Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS.
CoRR
Yifan Yang, Feiyu Shen, Chenpeng Du, Ziyang Ma, Kai Yu, Daniel Povey, Xie Chen
2023 J jnl
UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding.
CoRR
Chenpeng Du, Yiwei Guo, Feiyu Shen, Zhijun Liu, Zheng Liang, Xie Chen, Shuai Wang, Hui Zhang, Kai Yu
2023 J jnl
VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching.
CoRR
Yiwei Guo, Chenpeng Du, Ziyang Ma, Xie Chen, Kai Yu
2022 J jnl
EmoDiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidance.
CoRR
Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
2022 J jnl
Neural Fusion for Voice Cloning.
IEEE ACM Trans. Audio Speech Lang. Process.
Bo Chen, Chenpeng Du, Kai Yu
2022 J jnl
Phone-Level Prosody Modelling With GMM-Based MDN for Diverse and Controllable Speech Synthesis.
IEEE ACM Trans. Audio Speech Lang. Process.
Chenpeng Du, Kai Yu
2022 Misc conf
Unsupervised Word-Level Prosody Tagging for Controllable Speech Synthesis.
ICASSP
Yiwei Guo, Chenpeng Du, Kai Yu
2022 J jnl
Unsupervised word-level prosody tagging for controllable speech synthesis.
CoRR
Yiwei Guo, Chenpeng Du, Kai Yu
2022 A conf
VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature.
INTERSPEECH
Chenpeng Du, Yiwei Guo, Xie Chen, Kai Yu
2022 J jnl
VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature.
CoRR
Chenpeng Du, Yiwei Guo, Xie Chen, Kai Yu
2021 — conf
Data Augmentation for end-to-end Code-Switching Speech Recognition.
SLT
Chenpeng Du, Hao Li, Yizhou Lu, Lan Wang, Yanmin Qian
2021 J jnl
Diverse and Controllable Speech Synthesis with GMM-Based Phone-Level Prosody Modelling.
CoRR
Chenpeng Du, Kai Yu
2021 J jnl
Mixture Density Network for Phone-Level Prosody Modelling in Speech Synthesis.
CoRR
Chenpeng Du, Kai Yu
2021 A conf
Rich Prosody Diversity Modelling with Phone-Level Mixture Density Network.
Interspeech
Chenpeng Du, Kai Yu
2021 Misc conf
SynAug: Synthesis-Based Data Augmentation for Text-Dependent Speaker Verification.
ICASSP
Chenpeng Du, Bing Han, Shuai Wang, Yanmin Qian, Kai Yu
2021 Misc conf
Towards Data Selection on TTS Data for Children's Speech Recognition.
ICASSP
Wei Wang, Zhikai Zhou, Yizhou Lu, Hongji Wang, Chenpeng Du, Yanmin Qian
2020 J jnl
Data Augmentation for End-to-end Code-switching Speech Recognition.
CoRR
Chenpeng Du, Hao Li, Yizhou Lu, Lan Wang, Yanmin Qian
2020 Misc conf
Speaker Augmentation for Low Resource Speech Recognition.
ICASSP
Chenpeng Du, Kai Yu
2019 — conf
SJTU Entry in Blizzard Challenge 2019.
Blizzard Challenge
Bo Chen, Kuan Chen, Zhijun Liu, Zhihang Xu, Songze Wu, Chenpeng Du, Muyang Li, Sijun Li, Kai Yu