Ziyue Jiang

64 papers A* 12A 4B 1Misc 1Journal 36Unranked 10
YearRankTypeTitle / Venue / Authors
2025 J jnl
Astrea: A MOE-based Visual Understanding Model with Progressive Alignment.
CoRR
Xiaoda Yang, Junyu Lu, Hongshun Qiu, Sijing Li, Hao Li, Shengpeng Ji, Xudong Tang, Jiayang Xu, Jiaqi Duan, Ziyue Jiang, Cong Lin, Sihang Cai, Zejian Xie, Zhuoyang Song, Songxin Zhang
2025 — conf
BrainLoc: Brain Signal-Based Object Detection with Multi-modal Alignment.
EMNLP (Findings)
Jiaqi Duan, Xiaoda Yang, Kaixuan Luan, Hongshun Qiu, Weicai Yan, Xueyi Zhang, Youliang Zhang, Zhaoyang Li, Donglin Huang, Junyu Lu, Ziyue Jiang, Xifeng Yang
2025 J jnl
DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration.
CoRR
Yanru Huo, Ziyue Jiang, Zuoli Tang, Qingyang Hong, Zhou Zhao
2025 A conf
Discl-VC: Disentangled Discrete Tokens and In-Context Learning for Controllable Zero-Shot Voice Conversion.
INTERSPEECH
Kaidi Wang, Wenhao Guan, Ziyue Jiang, Hukai Huang, Peijie Chen, Weijie Wu, Qingyang Hong, Lin Li
2025 J jnl
Discl-VC: Disentangled Discrete Tokens and In-Context Learning for Controllable Zero-Shot Voice Conversion.
CoRR
Kaidi Wang, Wenhao Guan, Ziyue Jiang, Hukai Huang, Peijie Chen, Weijie Wu, Qingyang Hong, Lin Li
2025 Misc conf
Enhancing Expressive Voice Conversion with Discrete Pitch-Conditioned Flow Matching Model.
ICASSP
Jialong Zuo, Shengpeng Ji, Minghui Fang, Ziyue Jiang, Xize Cheng, Qian Yang, Wenrui Liu, Guangyan Zhang, Zehai Tu, Yiwen Guo, Zhou Zhao
2025 J jnl
Enhancing Expressive Voice Conversion with Discrete Pitch-Conditioned Flow Matching Model.
CoRR
Jialong Zuo, Shengpeng Ji, Minghui Fang, Ziyue Jiang, Xize Cheng, Qian Yang, Wenrui Liu, Guangyan Zhang, Zehai Tu, Yiwen Guo, Zhou Zhao
2025 — conf
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching.
ACL (1)
Jialong Zuo, Shengpeng Ji, Minghui Fang, Mingze Li, Ziyue Jiang, Xize Cheng, Xiaoda Yang, Feiyang Chen, Xinyu Duan, Zhou Zhao
2025 J jnl
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching.
CoRR
Jialong Zuo, Shengpeng Ji, Minghui Fang, Mingze Li, Ziyue Jiang, Xize Cheng, Xiaoda Yang, Feiyang Chen, Xinyu Duan, Zhou Zhao
2025 J jnl
Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis.
CoRR
Ziyue Jiang, Yi Ren, Ruiqi Li, Shengpeng Ji, Zhenhui Ye, Chen Zhang, Jionghao Bai, Xiaoda Yang, Jialong Zuo, Yu Zhang, Rui Liu, Xiang Yin, Zhou Zhao
2025 A* conf
Speech Watermarking with Discrete Intermediate Representations.
AAAI
Shengpeng Ji, Ziyue Jiang, Jialong Zuo, Minghui Fang, Yifu Chen, Tao Jin, Zhou Zhao
2025 — conf
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis.
ACL (Findings)
Yu Zhang, Wenxiang Guo, Changhao Pan, Dongyu Yao, Zhiyuan Zhu, Ziyue Jiang, Yuhan Wang, Tao Jin, Zhou Zhao
2025 J jnl
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis.
CoRR
Yu Zhang, Wenxiang Guo, Changhao Pan, Dongyu Yao, Zhiyuan Zhu, Ziyue Jiang, Yuhan Wang, Tao Jin, Zhou Zhao
2025 J jnl
UniVoice: Unifying Autoregressive ASR and Flow-Matching based TTS with Large Language Models.
CoRR
Wenhao Guan, Zhikang Niu, Ziyue Jiang, Kaidi Wang, Peijie Chen, Qingyang Hong, Lin Li, Xie Chen
2025 — conf
Versatile Framework for Song Generation with Prompt-based Control.
EMNLP (Findings)
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, Jingyu Lu, Rongjie Huang, Ruiyuan Zhang, Zhiqing Hong, Ziyue Jiang, Zhou Zhao
2025 J jnl
Versatile Framework for Song Generation with Prompt-based Control.
CoRR
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, Jingyu Lu, Rongjie Huang, Ruiyuan Zhang, Zhiqing Hong, Ziyue Jiang, Zhou Zhao
2025 B conf
VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation.
COLING
Wenrui Liu, Jionghao Bai, Xize Cheng, Jialong Zuo, Ziyue Jiang, Shengpeng Ji, Minghui Fang, Xiaoda Yang, Qian Yang, Zhou Zhao
2025 J jnl
WavReward: Spoken Dialogue Models With Generalist Reward Evaluators.
CoRR
Shengpeng Ji, Tianle Liang, Yangzhuo Li, Jialong Zuo, Minghui Fang, Jinzheng He, Yifu Chen, Zhengqing Liu, Ziyue Jiang, Xize Cheng, Siqi Zheng, Jin Xu, Junyang Lin, Zhou Zhao
2025 A* conf
WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling.
ICLR
Shengpeng Ji, Ziyue Jiang, Wen Wang, Yifu Chen, Minghui Fang, Jialong Zuo, Qian Yang, Xize Cheng, Zehan Wang, Ruiqi Li, Ziang Zhang, Xiaoda Yang, Rongjie Huang, Yidi Jiang, Qian Chen, Siqi Zheng, Zhou Zhao
2024 — conf
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension.
ACL (1)
Qian Yang, Jin Xu, Wenrui Liu, Yunfei Chu, Ziyue Jiang, Xiaohuan Zhou, Yichong Leng, Yuanjun Lv, Zhou Zhao, Chang Zhou, Jingren Zhou
2024 J jnl
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension.
CoRR
Qian Yang, Jin Xu, Wenrui Liu, Yunfei Chu, Ziyue Jiang, Xiaohuan Zhou, Yichong Leng, Yuanjun Lv, Zhou Zhao, Chang Zhou, Jingren Zhou
2024 J jnl
ControlSpeech: Towards Simultaneous Zero-shot Speaker Cloning and Zero-shot Language Style Control With Decoupled Codec.
CoRR
Shengpeng Ji, Jialong Zuo, Minghui Fang, Siqi Zheng, Qian Chen, Wen Wang, Ziyue Jiang, Hai Huang, Xize Cheng, Rongjie Huang, Zhou Zhao
2024 J jnl
DiffEditor: Enhancing Speech Editing with Semantic Enrichment and Acoustic Consistency.
CoRR
Yang Chen, Yuhang Jia, Shiwan Zhao, Ziyue Jiang, Haoran Li, Jiarong Kang, Yong Qin
2024 J jnl
FluentEditor+: Text-based Speech Editing by Modeling Local Hierarchical Acoustic Smoothness and Global Prosody Consistency.
CoRR
Rui Liu, Jiatian Xi, Ziyue Jiang, Haizhou Li
2024 A conf
FluentEditor: Text-based Speech Editing by Considering Acoustic and Prosody Consistency.
INTERSPEECH
Rui Liu, Jiatian Xi, Ziyue Jiang, Haizhou Li
2024 A* conf
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks.
NeurIPS
Yu Zhang, Changhao Pan, Wenxiang Guo, Ruiqi Li, Zhiyuan Zhu, Jialei Wang, Wenhao Xu, Jingyu Lu, Zhiqing Hong, Chuxin Wang, Lichao Zhang, Jinzheng He, Ziyue Jiang, Yuxin Chen, Chen Yang, Jiecheng Zhou, Xinyu Cheng, Zhou Zhao
2024 J jnl
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks.
CoRR
Yu Zhang, Changhao Pan, Wenxiang Guo, Ruiqi Li, Zhiyuan Zhu, Jialei Wang, Wenhao Xu, Jingyu Lu, Zhiqing Hong, Chuxin Wang, Lichao Zhang, Jinzheng He, Ziyue Jiang, Yuxin Chen, Chen Yang, Jiecheng Zhou, Xinyu Cheng, Zhou Zhao
2024 A* conf
InstructSpeech: Following Speech Editing Instructions via Large Language Models.
ICML
Rongjie Huang, Ruofan Hu, Yongqi Wang, Zehan Wang, Xize Cheng, Ziyue Jiang, Zhenhui Ye, Dongchao Yang, Luping Liu, Peng Gao, Zhou Zhao
2024 J jnl
Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models.
CoRR
Shengpeng Ji, Minghui Fang, Ziyue Jiang, Rongjie Huang, Jialong Zuo, Shulei Wang, Zhou Zhao
2024 A conf
MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis.
INTERSPEECH
Qian Yang, Jialong Zuo, Zhe Su, Ziyue Jiang, Mingze Li, Zhou Zhao, Feiyang Chen, Zhefeng Wang, Baoxing Huai
2024 J jnl
MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis.
CoRR
Qian Yang, Jialong Zuo, Zhe Su, Ziyue Jiang, Mingze Li, Zhou Zhao, Feiyang Chen, Zhefeng Wang, Baoxing Huai
2024 — conf
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners.
ACL (1)
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu
2024 A* conf
Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis.
ICLR
Ziyue Jiang, Jinglin Liu, Yi Ren, Jinzheng He, Zhenhui Ye, Shengpeng Ji, Qian Yang, Chen Zhang, Pengfei Wei, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao
2024 A* conf
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes.
NeurIPS
Zhenhui Ye, Tianyun Zhong, Yi Ren, Ziyue Jiang, Jiawei Huang, Rongjie Huang, Jinglin Liu, Jinzheng He, Chen Zhang, Zehan Wang, Xize Cheng, Xiang Yin, Zhou Zhao
2024 J jnl
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes.
CoRR
Zhenhui Ye, Tianyun Zhong, Yi Ren, Ziyue Jiang, Jiawei Huang, Rongjie Huang, Jinglin Liu, Jinzheng He, Chen Zhang, Zehan Wang, Xize Chen, Xiang Yin, Zhou Zhao
2024 — conf
MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech.
ACL (1)
Shengpeng Ji, Ziyue Jiang, Hanting Wang, Jialong Zuo, Zhou Zhao
2024 J jnl
MulliVC: Multi-lingual Voice Conversion With Cycle Consistency.
CoRR
Jiawei Huang, Chen Zhang, Yi Ren, Ziyue Jiang, Zhenhui Ye, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao
2024 A* conf
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis.
ICLR
Zhenhui Ye, Tianyun Zhong, Yi Ren, Jiaqi Yang, Weichuang Li, Jiawei Huang, Ziyue Jiang, Jinzheng He, Rongjie Huang, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao
2024 J jnl
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis.
CoRR
Zhenhui Ye, Tianyun Zhong, Yi Ren, Jiaqi Yang, Weichuang Li, Jiawei Huang, Ziyue Jiang, Jinzheng He, Rongjie Huang, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao
2024 J jnl
Speech Watermarking with Discrete Intermediate Representations.
CoRR
Shengpeng Ji, Ziyue Jiang, Jialong Zuo, Minghui Fang, Yifu Chen, Tao Jin, Zhou Zhao
2024 A* conf
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control.
EMNLP
Yu Zhang, Ziyue Jiang, Ruiqi Li, Changhao Pan, Jinzheng He, Rongjie Huang, Chuxin Wang, Zhou Zhao
2024 J jnl
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control.
CoRR
Yu Zhang, Ziyue Jiang, Ruiqi Li, Changhao Pan, Jinzheng He, Rongjie Huang, Chuxin Wang, Zhou Zhao
2024 A* conf
VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation.
ACM Multimedia
Rongjie Huang, Yongqi Wang, Ruofan Hu, Xiaoshan Xu, Zhiqing Hong, Dongchao Yang, Xize Cheng, Zehan Wang, Ziyue Jiang, Zhenhui Ye, Luping Liu, Siqi Zheng, Zhou Zhao
2024 J jnl
WavChat: A Survey of Spoken Dialogue Models.
CoRR
Shengpeng Ji, Yifu Chen, Minghui Fang, Jialong Zuo, Jingyu Lu, Hanting Wang, Ziyue Jiang, Long Zhou, Shujie Liu, Xize Cheng, Xiaoda Yang, Zehan Wang, Qian Yang, Jian Li, Yidi Jiang, Jingzhen He, Yunfei Chu, Jin Xu, Zhou Zhao
2024 J jnl
WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling.
CoRR
Shengpeng Ji, Ziyue Jiang, Xize Cheng, Yifu Chen, Minghui Fang, Jialong Zuo, Qian Yang, Ruiqi Li, Ziang Zhang, Xiaoda Yang, Rongjie Huang, Yidi Jiang, Qian Chen, Siqi Zheng, Wen Wang, Zhou Zhao
2023 J jnl
Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis.
CoRR
Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao
2023 — conf
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training.
ACL (1)
Zhenhui Ye, Rongjie Huang, Yi Ren, Ziyue Jiang, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao
2023 J jnl
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-training.
CoRR
Zhenhui Ye, Rongjie Huang, Yi Ren, Ziyue Jiang, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao
2023 — conf
FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis.
ACL (Findings)
Rongjie Huang, Yi Ren, Ziyue Jiang, Chenye Cui, Jinglin Liu, Zhou Zhao
2023 J jnl
FluentEditor: Text-based Speech Editing by Considering Acoustic and Prosody Consistency.
CoRR
Rui Liu, Jiatian Xi, Ziyue Jiang, Haizhou Li
2023 — conf
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models.
ACL (Findings)
Ziyue Jiang, Qian Yang, Jialong Zuo, Zhenhui Ye, Rongjie Huang, Yi Ren, Zhou Zhao
2023 J jnl
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models.
CoRR
Ziyue Jiang, Qian Yang, Jialong Zuo, Zhenhui Ye, Rongjie Huang, Yi Ren, Zhou Zhao
2023 J jnl
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation.
CoRR
Zhenhui Ye, Jinzheng He, Ziyue Jiang, Rongjie Huang, Jiawei Huang, Jinglin Liu, Yi Ren, Xiang Yin, Zejun Ma, Zhou Zhao
2023 A* conf
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis.
ICLR
Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Jinzheng He, Zhou Zhao
2023 J jnl
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis.
CoRR
Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Jinzheng He, Zhou Zhao
2023 J jnl
Make-A-Voice: Unified Voice Synthesis With Discrete Representation.
CoRR
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Luping Liu, Zhenhui Ye, Ziyue Jiang, Chao Weng, Zhou Zhao, Dong Yu
2023 J jnl
Mega-TTS 2: Zero-Shot Text-to-Speech with Arbitrary Length Speech Prompts.
CoRR
Ziyue Jiang, Jinglin Liu, Yi Ren, Jinzheng He, Chen Zhang, Zhenhui Ye, Pengfei Wei, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao
2023 J jnl
Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias.
CoRR
Ziyue Jiang, Yi Ren, Zhenhui Ye, Jinglin Liu, Chen Zhang, Qian Yang, Shengpeng Ji, Rongjie Huang, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao
2023 J jnl
TextrolSpeech: A Text Style Control Speech Corpus With Codec Language Text-to-Speech Models.
CoRR
Shengpeng Ji, Jialong Zuo, Minghui Fang, Ziyue Jiang, Feiyang Chen, Xinyu Duan, Baoxing Huai, Zhou Zhao
2022 A* conf
Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech.
NeurIPS
Ziyue Jiang, Su Zhe, Zhou Zhao, Qian Yang, Yi Ren, Jinglin Liu, Zhenhui Ye
2022 J jnl
Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech.
CoRR
Ziyue Jiang, Su Zhe, Zhou Zhao, Qian Yang, Yi Ren, Jinglin Liu, Zhenhui Ye
2021 A* conf
FedSpeech: Federated Text-to-Speech with Continual Learning.
IJCAI
Ziyue Jiang, Yi Ren, Ming Lei, Zhou Zhao
2021 J jnl
FedSpeech: Federated Text-to-Speech with Continual Learning.
CoRR
Ziyue Jiang, Yi Ren, Ming Lei, Zhou Zhao
2020 A conf
Self-Supervised Spoofing Audio Detection Scheme.
INTERSPEECH
Ziyue Jiang, Hongcheng Zhu, Li Peng, Wenbing Ding, Yanzhen Ren