Zhenhui Ye

51 papers A* 12Journal 32Unranked 7
YearRankTypeTitle / Venue / Authors
2025 J jnl
HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation.
CoRR
Qijun Gan, Yi Ren, Chen Zhang, Zhenhui Ye, Pan Xie, Xiang Yin, Zehuan Yuan, Bingyue Peng, Jianke Zhu
2025 J jnl
SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer.
CoRR
Jimin Xu, Bosheng Qin, Tao Jin, Zhou Zhao, Zhenhui Ye, Jun Yu, Fei Wu
2025 J jnl
Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis.
CoRR
Ziyue Jiang, Yi Ren, Ruiqi Li, Shengpeng Ji, Zhenhui Ye, Chen Zhang, Jionghao Bai, Xiaoda Yang, Jialong Zuo, Yu Zhang, Rui Liu, Xiang Yin, Zhou Zhao
2025 — conf
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback.
ACL (1)
Zehan Wang, Ke Lei, Chen Zhu, Jiawei Huang, Sashuai Zhou, Luping Liu, Xize Cheng, Shengpeng Ji, Zhenhui Ye, Tao Jin, Zhou Zhao
2025 J jnl
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback.
CoRR
Zehan Wang, Ke Lei, Chen Zhu, Jiawei Huang, Sashuai Zhou, Luping Liu, Xize Cheng, Shengpeng Ji, Zhenhui Ye, Tao Jin, Zhou Zhao
2024 A* conf
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head.
AAAI
Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Yuexian Zou, Zhou Zhao, Shinji Watanabe
2024 A* conf
Extending Multi-modal Contrastive Representations.
NeurIPS
Ziang Zhang, Zehan Wang, Luping Liu, Rongjie Huang, Xize Cheng, Zhenhui Ye, Wang Lin, Huadai Liu, Haifeng Huang, Yang Zhao, Tao Jin, Siqi Zheng, Zhou Zhao
2024 A* conf
FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion.
ICML
Zehan Wang, Ziang Zhang, Xize Cheng, Rongjie Huang, Luping Liu, Zhenhui Ye, Haifeng Huang, Yang Zhao, Tao Jin, Peng Gao, Zhou Zhao
2024 J jnl
FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion.
CoRR
Zehan Wang, Ziang Zhang, Xize Cheng, Rongjie Huang, Luping Liu, Zhenhui Ye, Haifeng Huang, Yang Zhao, Tao Jin, Peng Gao, Zhou Zhao
2024 A* conf
InstructSpeech: Following Speech Editing Instructions via Large Language Models.
ICML
Rongjie Huang, Ruofan Hu, Yongqi Wang, Zehan Wang, Xize Cheng, Ziyue Jiang, Zhenhui Ye, Dongchao Yang, Luping Liu, Peng Gao, Zhou Zhao
2024 — conf
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners.
ACL (1)
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu
2024 A* conf
Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis.
ICLR
Ziyue Jiang, Jinglin Liu, Yi Ren, Jinzheng He, Zhenhui Ye, Shengpeng Ji, Qian Yang, Chen Zhang, Pengfei Wei, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao
2024 A* conf
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes.
NeurIPS
Zhenhui Ye, Tianyun Zhong, Yi Ren, Ziyue Jiang, Jiawei Huang, Rongjie Huang, Jinglin Liu, Jinzheng He, Chen Zhang, Zehan Wang, Xize Cheng, Xiang Yin, Zhou Zhao
2024 J jnl
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes.
CoRR
Zhenhui Ye, Tianyun Zhong, Yi Ren, Ziyue Jiang, Jiawei Huang, Rongjie Huang, Jinglin Liu, Jinzheng He, Chen Zhang, Zehan Wang, Xize Chen, Xiang Yin, Zhou Zhao
2024 J jnl
MulliVC: Multi-lingual Voice Conversion With Cycle Consistency.
CoRR
Jiawei Huang, Chen Zhang, Yi Ren, Ziyue Jiang, Zhenhui Ye, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao
2024 A* conf
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis.
ICLR
Zhenhui Ye, Tianyun Zhong, Yi Ren, Jiaqi Yang, Weichuang Li, Jiawei Huang, Ziyue Jiang, Jinzheng He, Rongjie Huang, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao
2024 J jnl
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis.
CoRR
Zhenhui Ye, Tianyun Zhong, Yi Ren, Jiaqi Yang, Weichuang Li, Jiawei Huang, Ziyue Jiang, Jinzheng He, Rongjie Huang, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao
2024 A* conf
VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation.
ACM Multimedia
Rongjie Huang, Yongqi Wang, Ruofan Hu, Xiaoshan Xu, Zhiqing Hong, Dongchao Yang, Xize Cheng, Zehan Wang, Ziyue Jiang, Zhenhui Ye, Luping Liu, Siqi Zheng, Zhou Zhao
2023 — conf
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation.
ACL (1)
Rongjie Huang, Huadai Liu, Xize Cheng, Yi Ren, Linjun Li, Zhenhui Ye, Jinzheng He, Lichao Zhang, Jinglin Liu, Xiang Yin, Zhou Zhao
2023 J jnl
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation.
CoRR
Rongjie Huang, Huadai Liu, Xize Cheng, Yi Ren, Linjun Li, Zhenhui Ye, Jinzheng He, Lichao Zhang, Jinglin Liu, Xiang Yin, Zhou Zhao
2023 J jnl
Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis.
CoRR
Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao
2023 J jnl
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head.
CoRR
Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Zhou Zhao, Shinji Watanabe
2023 — conf
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training.
ACL (1)
Zhenhui Ye, Rongjie Huang, Yi Ren, Ziyue Jiang, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao
2023 J jnl
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-training.
CoRR
Zhenhui Ye, Rongjie Huang, Yi Ren, Ziyue Jiang, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao
2023 — conf
DopplerBAS: Binaural Audio Synthesis Addressing Doppler Effect.
ACL (Findings)
Jinglin Liu, Zhenhui Ye, Qian Chen, Siqi Zheng, Wen Wang, Qinglin Zhang, Zhou Zhao
2023 J jnl
Erratum to: Soft-HGRNs: soft hierarchical graph recurrent networks for multi-agent partially observable environments.
Frontiers Inf. Technol. Electron. Eng.
Yixiang Ren, Zhenhui Ye, Yining Chen, Xiaohong Jiang, Guanghua Song
2023 — conf
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models.
ACL (Findings)
Ziyue Jiang, Qian Yang, Jialong Zuo, Zhenhui Ye, Rongjie Huang, Yi Ren, Zhou Zhao
2023 J jnl
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models.
CoRR
Ziyue Jiang, Qian Yang, Jialong Zuo, Zhenhui Ye, Rongjie Huang, Yi Ren, Zhou Zhao
2023 J jnl
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation.
CoRR
Zhenhui Ye, Jinzheng He, Ziyue Jiang, Rongjie Huang, Jiawei Huang, Jinglin Liu, Yi Ren, Xiang Yin, Zejun Ma, Zhou Zhao
2023 A* conf
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis.
ICLR
Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Jinzheng He, Zhou Zhao
2023 J jnl
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis.
CoRR
Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Jinzheng He, Zhou Zhao
2023 J jnl
Make-A-Voice: Unified Voice Synthesis With Discrete Representation.
CoRR
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Luping Liu, Zhenhui Ye, Ziyue Jiang, Chao Weng, Zhou Zhao, Dong Yu
2023 J jnl
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation.
CoRR
Jiawei Huang, Yi Ren, Rongjie Huang, Dongchao Yang, Zhenhui Ye, Chen Zhang, Jinglin Liu, Xiang Yin, Zejun Ma, Zhou Zhao
2023 A* conf
Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models.
ICML
Rongjie Huang, Jiawei Huang, Dongchao Yang, Yi Ren, Luping Liu, Mingze Li, Zhenhui Ye, Jinglin Liu, Xiang Yin, Zhou Zhao
2023 J jnl
Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models.
CoRR
Rongjie Huang, Jiawei Huang, Dongchao Yang, Yi Ren, Luping Liu, Mingze Li, Zhenhui Ye, Jinglin Liu, Xiang Yin, Zhou Zhao
2023 J jnl
Mega-TTS 2: Zero-Shot Text-to-Speech with Arbitrary Length Speech Prompts.
CoRR
Ziyue Jiang, Jinglin Liu, Yi Ren, Jinzheng He, Chen Zhang, Zhenhui Ye, Pengfei Wei, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao
2023 J jnl
Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias.
CoRR
Ziyue Jiang, Yi Ren, Zhenhui Ye, Jinglin Liu, Chen Zhang, Qian Yang, Shengpeng Ji, Rongjie Huang, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao
2023 J jnl
Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning.
IEEE Trans. Mob. Comput.
Zhenhui Ye, Ke Wang, Yining Chen, Xiaohong Jiang, Guanghua Song
2023 — conf
RMSSinger: Realistic-Music-Score based Singing Voice Synthesis.
ACL (Findings)
Jinzheng He, Jinglin Liu, Zhenhui Ye, Rongjie Huang, Chenye Cui, Huadai Liu, Zhou Zhao
2023 J jnl
RMSSinger: Realistic-Music-Score based Singing Voice Synthesis.
CoRR
Jinzheng He, Jinglin Liu, Zhenhui Ye, Rongjie Huang, Chenye Cui, Huadai Liu, Zhou Zhao
2023 J jnl
Soft-HGRNs: soft hierarchical graph recurrent networks for multi-agent partially observable environments.
Frontiers Inf. Technol. Electron. Eng.
Yixiang Ren, Zhenhui Ye, Yining Chen, Xiaohong Jiang, Guanghua Song
2022 A* conf
Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech.
NeurIPS
Ziyue Jiang, Su Zhe, Zhou Zhao, Qian Yang, Yi Ren, Jinglin Liu, Zhenhui Ye
2022 J jnl
Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech.
CoRR
Ziyue Jiang, Su Zhe, Zhou Zhao, Qian Yang, Yi Ren, Jinglin Liu, Zhenhui Ye
2022 J jnl
Improving sample efficiency in Multi-Agent Actor-Critic methods.
Appl. Intell.
Zhenhui Ye, Yining Chen, Xiaohong Jiang, Guanghua Song, Bowei Yang, Sheng Fan
2022 J jnl
Multi-Agent Deep Reinforcement Learning for Voltage Control With Coordinated Active and Reactive Power Optimization.
IEEE Trans. Smart Grid
Daner Hu, Zhenhui Ye, Yuanqi Gao, Zuzhao Ye, Yonggang Peng, Nanpeng Yu
2022 J jnl
Scalable and Transferable Reinforcement Learning for Multi-Agent Mixed Cooperative-Competitive Environments Based on Hierarchical Graph Attention.
Entropy
Yining Chen, Guanghua Song, Zhenhui Ye, Xiaohong Jiang
2022 J jnl
Space-Air-Ground Integrated Mobile Crowdsensing for Partially Observable Data Collection by Multi-Scale Convolutional Graph Reinforcement Learning.
Entropy
Yixiang Ren, Zhenhui Ye, Guanghua Song, Xiaohong Jiang
2022 A* conf
SyntaSpeech: Syntax-Aware Generative Adversarial Text-to-Speech.
IJCAI
Zhenhui Ye, Zhou Zhao, Yi Ren, Fei Wu
2022 J jnl
SyntaSpeech: Syntax-Aware Generative Adversarial Text-to-Speech.
CoRR
Zhenhui Ye, Zhou Zhao, Yi Ren, Fei Wu
2021 J jnl
Soft Hierarchical Graph Recurrent Networks for Many-Agent Partially Observable Environments.
CoRR
Zhenhui Ye, Xiaohong Jiang, Guanghua Song, Bowei Yang
2020 J jnl
Experience Augmentation: Boosting and Accelerating Off-Policy Multi-Agent Reinforcement Learning.
CoRR
Zhenhui Ye, Yining Chen, Guanghua Song, Bowei Yang, Sheng Fan