Sheng Zhao - RankMe

140 papers A* 23A 17C 2Misc 13Journal 77Unranked 8

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	A Unified Neural Codec Language Model for Selective Editable Text to Speech Generation. CoRR Hanchen Pei, Shujie Liu, Yanqing Liu, Jianwei Yu, Yuanhang Qian, Gongping Huang, Sheng Zhao, Yan Lu
2025	—	`conf`	Autoregressive Speech Synthesis without Vector Quantization. ACL (1) Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen M. Meng, Furu Wei
2025	J	`jnl`	CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching. CoRR Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
2025	J	`jnl`	CosyAudio: Improving Audio Generation with Confidence Scores and Synthetic Captions. CoRR Xinfa Zhu, Wenjie Tian, Xinsheng Wang, Lei He, Xi Wang, Sheng Zhao, Lei Xie
2025	C	`conf`	Efficient Speech Watermarking for Speech Synthesis via Progressive Knowledge Distillation. ASRU Yang Cui, Peter Pan, Lei He, Sheng Zhao
2025	J	`jnl`	Efficient Speech Watermarking for Speech Synthesis via Progressive Knowledge Distillation. CoRR Yang Cui, Peter Pan, Lei He, Sheng Zhao
2025	J	`jnl`	Exploring the Potential of Large Multimodal Models as Effective Alternatives for Pronunciation Assessment. CoRR Ke Wang, Lei He, Kun Liu, Yan Deng, Wenning Wei, Sheng Zhao
2025	J	`jnl`	Fine-Tuning Large Multimodal Models for Automatic Pronunciation Assessment. CoRR Ke Wang, Wenning Wei, Yan Deng, Lei He, Sheng Zhao
2025	J	`jnl`	FlexiCodec: A Dynamic Neural Audio Codec for Low Frame Rates. CoRR Jiaqi Li, Yao Qian, Yuxuan Hu, Leying Zhang, Xiaofei Wang, Heng Lu, Manthan Thakker, Jinyu Li, Sheng Zhao, Zhizheng Wu
2025	Misc	`conf`	LIMMITS'25: Multilingual Streaming TTS With Neural Codecs for Indian Languages. ICASSP Philipp Olbrich, Hema A. Murthy, Pranaw Kumar, Shinji Watanabe, Sheng Zhao, Mark Hasegawa-Johnson
2025	J	`jnl`	Next Tokens Denoising for Speech Synthesis. CoRR Yanqing Liu, Ruiqing Xue, Chong Zhang, Yufei Liu, Gang Wang, Bohan Li, Yao Qian, Lei He, Shujie Liu, Sheng Zhao
2025	Misc	`conf`	ZSVC: Zero-shot Style Voice Conversion with Disentangled Latent Diffusion Models and Adversarial Training. ICASSP Xinfa Zhu, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
2025	J	`jnl`	ZSVC: Zero-shot Style Voice Conversion with Disentangled Latent Diffusion Models and Adversarial Training. CoRR Xinfa Zhu, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
2025	J	`jnl`	Zero-Shot Streaming Text to Speech Synthesis with Transducer and Auto-Regressive Modeling. CoRR Haiyang Sun, Shujie Hu, Shujie Liu, Lingwei Meng, Hui Wang, Bing Han, Yifan Yang, Yanqing Liu, Sheng Zhao, Yan Lu, Yanmin Qian
2024	A	`conf`	An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS. INTERSPEECH Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024	J	`jnl`	An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS. CoRR Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024	J	`jnl`	Autoregressive Speech Synthesis without Vector Quantization. CoRR Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
2024	A*	`conf`	CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations. NeurIPS Leying Zhang, Yao Qian, Long Zhou, Shujie Liu, Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
2024	J	`jnl`	CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations. CoRR Leying Zhang, Yao Qian, Long Zhou, Shujie Liu, Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
2024	J	`jnl`	Continuous Speech Tokens Makes LLMs Robust Multi-Modality Learners. CoRR Ze Yuan, Yanqing Liu, Shujie Liu, Sheng Zhao
2024	A*	`conf`	Contrastive Context-Speech Pretraining for Expressive Text-to-Speech Synthesis. ACM Multimedia Yujia Xiao, Xi Wang, Xu Tan, Lei He, Xinfa Zhu, Sheng Zhao, Tan Lee
2024	—	`conf`	E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS. SLT Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Xu Tan, Yanqing Liu, Sheng Zhao, Naoyuki Kanda
2024	J	`jnl`	E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS. CoRR Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Xu Tan, Yanqing Liu, Sheng Zhao, Naoyuki Kanda
2024	A*	`conf`	GAIA: Zero-shot Talking Avatar Generation. ICLR Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, Han Hu, HsiangTao Wu, Sheng Zhao, Jiang Bian
2024	—	`conf`	Investigating Neural Audio Codecs For Speech Language Model-Based Speech Generation. SLT Jiaqi Li, Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Jun-Kun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu, Michael Zeng
2024	J	`jnl`	Investigating Neural Audio Codecs for Speech Language Model-Based Speech Generation. CoRR Jiaqi Li, Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Jun-Kun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu, Michael Zeng
2024	—	`conf`	Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-To-Speech. SLT Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024	J	`jnl`	Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech. CoRR Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024	J	`jnl`	Making Flow-Matching-Based Zero-Shot Text-to-Speech Laugh as You Like. CoRR Naoyuki Kanda, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Yufei Xia, Jinzhu Li, Yanqing Liu, Sheng Zhao, Michael Zeng
2024	J	`jnl`	Memories are One-to-Many Mapping Alleviators in Talking Face Generation. IEEE Trans. Pattern Anal. Mach. Intell. Anni Tang, Tianyu He, Xu Tan, Jun Ling, Runnan Li, Sheng Zhao, Jiang Bian, Li Song
2024	A*	`conf`	NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers. ICLR Kai Shen, Zeqian Ju, Xu Tan, Eric Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
2024	A*	`conf`	NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models. ICML Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Eric Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiangyang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
2024	J	`jnl`	NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models. CoRR Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
2024	J	`jnl`	NaturalSpeech: End-to-End Text-to-Speech Synthesis With Human-Level Quality. IEEE Trans. Pattern Anal. Mach. Intell. Xu Tan, Jiawei Chen, Haohe Liu, Jian Cong, Chen Zhang, Yanqing Liu, Xi Wang, Yichong Leng, Yuanhao Yi, Lei He, Sheng Zhao, Tao Qin, Frank K. Soong, Tie-Yan Liu
2024	A*	`conf`	PromptTTS 2: Describing and Generating Voices with Text Prompt. ICLR Yichong Leng, Zhifang Guo, Kai Shen, Zeqian Ju, Xu Tan, Eric Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiangyang Li, Sheng Zhao, Tao Qin, Jiang Bian
2024	J	`jnl`	RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis. CoRR Detai Xin, Xu Tan, Kai Shen, Zeqian Ju, Dongchao Yang, Yuancheng Wang, Shinnosuke Takamichi, Hiroshi Saruwatari, Shujie Liu, Jinyu Li, Sheng Zhao
2024	A	`conf`	Total-Duration-Aware Duration Modeling for Text-to-Speech Systems. INTERSPEECH Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
2024	A*	`conf`	TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation. NeurIPS Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
2024	J	`jnl`	TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation. CoRR Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
2024	A*	`conf`	UniAudio: Towards Universal Audio Generation with Large Language Models. ICML Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Haohan Guo, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Zhou Zhao, Xixin Wu, Helen M. Meng
2024	A*	`conf`	UniStyle: Unified Style Modeling for Speaking Style Captioning and Stylistic Speech Synthesis. ACM Multimedia Xinfa Zhu, Wenjie Tian, Xinsheng Wang, Lei He, Yujia Xiao, Xi Wang, Xu Tan, Sheng Zhao, Lei Xie
2024	J	`jnl`	VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers. CoRR Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
2024	J	`jnl`	VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment. CoRR Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
2023	A*	`conf`	AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models. NeurIPS Yuancheng Wang, Zeqian Ju, Xu Tan, Lei He, Zhizheng Wu, Jiang Bian, Sheng Zhao
2023	J	`jnl`	AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models. CoRR Yuancheng Wang, Zeqian Ju, Xu Tan, Lei He, Zhizheng Wu, Jiang Bian, Sheng Zhao
2023	A	`conf`	ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading. INTERSPEECH Yujia Xiao, Shaofei Zhang, Xi Wang, Xu Tan, Lei He, Sheng Zhao, Frank K. Soong, Tan Lee
2023	J	`jnl`	ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading. CoRR Yujia Xiao, Shaofei Zhang, Xi Wang, Xu Tan, Lei He, Sheng Zhao, Frank K. Soong, Tan Lee
2023	A*	`conf`	DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder. ACM Multimedia Chenpeng Du, Qi Chen, Tianyu He, Xu Tan, Xie Chen, Kai Yu, Sheng Zhao, Jiang Bian
2023	J	`jnl`	DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder. CoRR Chenpeng Du, Qi Chen, Tianyu He, Xu Tan, Xie Chen, Kai Yu, Sheng Zhao, Jiang Bian
2023	J	`jnl`	FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model. CoRR Ruiqing Xue, Yanqing Liu, Lei He, Xu Tan, Linquan Liu, Edward Lin, Sheng Zhao
2023	J	`jnl`	GAIA: Zero-shot Talking Avatar Generation. CoRR Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, Han Hu, HsiangTao Wu, Sheng Zhao, Jiang Bian
2023	A*	`conf`	HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details. ICCV Zenghao Chai, Tianke Zhang, Tianyu He, Xu Tan, Tadas Baltrusaitis, HsiangTao Wu, Runnan Li, Sheng Zhao, Chun Yuan, Jiang Bian
2023	J	`jnl`	HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Details. CoRR Zenghao Chai, Tianke Zhang, Tianyu He, Xu Tan, Tadas Baltrusaitis, HsiangTao Wu, Runnan Li, Sheng Zhao, Chun Yuan, Jiang Bian
2023	Misc	`conf`	Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation. ICASSP Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng Zhao
2023	J	`jnl`	Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation. CoRR Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng Zhao
2023	A	`conf`	Large-Scale Automatic Audiobook Creation. INTERSPEECH Brendan Walsh, Mark Hamilton, Greg Newby, Xi Wang, Serena Ruan, Sheng Zhao, Lei He, Shaofei Zhang, Eric Dettinger, William T. Freeman, Markus Weimer
2023	J	`jnl`	Large-Scale Automatic Audiobook Creation. CoRR Brendan Walsh, Mark Hamilton, Greg Newby, Xi Wang, Serena Ruan, Sheng Zhao, Lei He, Shaofei Zhang, Eric Dettinger, William T. Freeman, Markus Weimer
2023	Misc	`conf`	LeanSpeech: The Microsoft Lightweight Speech Synthesis System for Limmits Challenge 2023. ICASSP Chen Zhang, Shubham Bansal, Aakash Lakhera, Jinzhu Li, Gang Wang, Sandeepkumar Satpal, Sheng Zhao, Lei He
2023	—	`conf`	MuLanTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2023. Blizzard Challenge Zhihang Xu, Shaofei Zhang, Xi Wang, Jiajun Zhang, Wenning Wei, Lei He, Sheng Zhao
2023	J	`jnl`	MuLanTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2023. CoRR Zhihang Xu, Shaofei Zhang, Xi Wang, Jiajun Zhang, Wenning Wei, Lei He, Sheng Zhao
2023	J	`jnl`	NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers. CoRR Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
2023	J	`jnl`	Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers. CoRR Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
2023	J	`jnl`	PromptTTS 2: Describing and Generating Voices with Text Prompt. CoRR Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian
2023	Misc	`conf`	Prompttts: Controllable Text-To-Speech With Text Descriptions. ICASSP Zhifang Guo, Yichong Leng, Yihan Wu, Sheng Zhao, Xu Tan
2023	J	`jnl`	Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling. CoRR Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
2023	J	`jnl`	StableFace: Analyzing and Improving Motion Stability for Talking Face Generation. IEEE J. Sel. Top. Signal Process. Jun Ling, Xu Tan, Liyang Chen, Runnan Li, Yuchao Zhang, Sheng Zhao, Li Song
2023	J	`jnl`	UniAudio: An Audio Foundation Model Toward Universal Audio Generation. CoRR Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Shinji Watanabe, Helen Meng
2023	—	`conf`	VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer. ICCV (Workshops) Liyang Chen, Zhiyong Wu, Runnan Li, Weihong Bao, Jun Ling, Xu Tan, Sheng Zhao
2023	J	`jnl`	VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer. CoRR Liyang Chen, Zhiyong Wu, Runnan Li, Weihong Bao, Jun Ling, Xu Tan, Sheng Zhao
2023	A*	`conf`	VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing. AAAI Yihan Wu, Junliang Guo, Xu Tan, Chen Zhang, Bohan Li, Ruihua Song, Lei He, Sheng Zhao, Arul Menezes, Jiang Bian
2022	Misc	`conf`	A Study on the Efficacy of Model Pre-Training In Developing Neural Text-to-Speech System. ICASSP Guangyan Zhang, Yichong Leng, Daxin Tan, Ying Qin, Kaitao Song, Xu Tan, Sheng Zhao, Tan Lee
2022	A	`conf`	AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios. INTERSPEECH Yihan Wu, Xu Tan, Bohan Li, Lei He, Sheng Zhao, Ruihua Song, Tao Qin, Tie-Yan Liu
2022	J	`jnl`	AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios. CoRR Yihan Wu, Xu Tan, Bohan Li, Lei He, Sheng Zhao, Ruihua Song, Tao Qin, Tie-Yan Liu
2022	A*	`conf`	BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis. NeurIPS Yichong Leng, Zehua Chen, Junliang Guo, Haohe Liu, Jiawei Chen, Xu Tan, Danilo P. Mandic, Lei He, Xiangyang Li, Tao Qin, Sheng Zhao, Tie-Yan Liu
2022	J	`jnl`	BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis. CoRR Yichong Leng, Zehua Chen, Junliang Guo, Haohe Liu, Jiawei Chen, Xu Tan, Danilo P. Mandic, Lei He, Xiang-Yang Li, Tao Qin, Sheng Zhao, Tie-Yan Liu
2022	A	`conf`	DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders. INTERSPEECH Yanqing Liu, Ruiqing Xue, Lei He, Xu Tan, Sheng Zhao
2022	J	`jnl`	DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders. CoRR Yanqing Liu, Ruiqing Xue, Lei He, Xu Tan, Sheng Zhao
2022	J	`jnl`	InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Training. CoRR Zehua Chen, Xu Tan, Ke Wang, Shifeng Pan, Danilo P. Mandic, Lei He, Sheng Zhao
2022	Misc	`conf`	Infergrad: Improving Diffusion Models for Vocoder by Considering Inference in Training. ICASSP Zehua Chen, Xu Tan, Ke Wang, Shifeng Pan, Danilo P. Mandic, Lei He, Sheng Zhao
2022	—	`conf`	MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks. ISMIR Peiling Lu, Xu Tan, Botao Yu, Tao Qin, Sheng Zhao, Tie-Yan Liu
2022	J	`jnl`	MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks. CoRR Peiling Lu, Xu Tan, Botao Yu, Tao Qin, Sheng Zhao, Tie-Yan Liu
2022	J	`jnl`	Memories are One-to-Many Mapping Alleviators in Talking Face Generation. CoRR Anni Tang, Tianyu He, Xu Tan, Jun Ling, Runnan Li, Sheng Zhao, Li Song, Jiang Bian
2022	A	`conf`	Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech. INTERSPEECH Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao
2022	J	`jnl`	Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech. CoRR Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao
2022	J	`jnl`	NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality. CoRR Xu Tan, Jiawei Chen, Haohe Liu, Jian Cong, Chen Zhang, Yanqing Liu, Xi Wang, Yichong Leng, Yuanhao Yi, Lei He, Frank K. Soong, Tao Qin, Sheng Zhao, Tie-Yan Liu
2022	J	`jnl`	PromptTTS: Controllable Text-to-Speech with Text Descriptions. CoRR Zhifang Guo, Yichong Leng, Yihan Wu, Sheng Zhao, Xu Tan
2022	J	`jnl`	ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speech. CoRR Zehua Chen, Yihan Wu, Yichong Leng, Jiawei Chen, Haohe Liu, Xu Tan, Yang Cui, Ke Wang, Lei He, Sheng Zhao, Jiang Bian, Danilo P. Mandic
2022	A	`conf`	RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion. INTERSPEECH Dacheng Yin, Chuanxin Tang, Yanqing Liu, Xiaoqiang Wang, Zhiyuan Zhao, Yucheng Zhao, Zhiwei Xiong, Sheng Zhao, Chong Luo
2022	J	`jnl`	RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion. CoRR Dacheng Yin, Chuanxin Tang, Yanqing Liu, Xiaoqiang Wang, Zhiyuan Zhao, Yucheng Zhao, Zhiwei Xiong, Sheng Zhao, Chong Luo
2022	J	`jnl`	StableFace: Analyzing and Improving Motion Stability for Talking Face Generation. CoRR Jun Ling, Xu Tan, Liyang Chen, Runnan Li, Yuchao Zhang, Sheng Zhao, Li Song
2022	J	`jnl`	Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems. IEEE ACM Trans. Audio Speech Lang. Process. Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
2022	J	`jnl`	Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systems. CoRR Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
2022	Misc	`conf`	Transformer-S2A: Robust and Efficient Speech-to-Animation. ICASSP Liyang Chen, Zhiyong Wu, Jun Ling, Runnan Li, Xu Tan, Sheng Zhao
2022	J	`jnl`	VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing. CoRR Yihan Wu, Junliang Guo, Xu Tan, Chen Zhang, Bohan Li, Ruihua Song, Lei He, Sheng Zhao, Arul Menezes, Jiang Bian
2021	A	`conf`	A Light-Weight Contextual Spelling Correction Model for Customizing Transducer-Based Speech Recognition Systems. Interspeech Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
2021	J	`jnl`	A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systems. CoRR Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
2021	J	`jnl`	A study on the efficacy of model pre-training in developing neural text-to-speech system. CoRR Guangyan Zhang, Yichong Leng, Daxin Tan, Ying Qin, Kaitao Song, Xu Tan, Sheng Zhao, Tan Lee
2021	J	`jnl`	AdaSpeech 2: Adaptive Text to Speech with Untranscribed Data. CoRR Yuzi Yan, Xu Tan, Bohan Li, Tao Qin, Sheng Zhao, Yuan Shen, Tie-Yan Liu
2021	J	`jnl`	AdaSpeech 3: Adaptive Text to Speech for Spontaneous Style. CoRR Yuzi Yan, Xu Tan, Bohan Li, Guangyan Zhang, Tao Qin, Sheng Zhao, Yuan Shen, Wei-Qiang Zhang, Tie-Yan Liu
2021	A*	`conf`	AdaSpeech: Adaptive Text to Speech for Custom Voice. ICLR Mingjian Chen, Xu Tan, Bohan Li, Yanqing Liu, Tao Qin, Sheng Zhao, Tie-Yan Liu
2021	J	`jnl`	AdaSpeech: Adaptive Text to Speech for Custom Voice. CoRR Mingjian Chen, Xu Tan, Bohan Li, Yanqing Liu, Tao Qin, Sheng Zhao, Tie-Yan Liu
2021	A	`conf`	Adaptive Text to Speech for Spontaneous Style. Interspeech Yuzi Yan, Xu Tan, Bohan Li, Guangyan Zhang, Tao Qin, Sheng Zhao, Yuan Shen, Wei-Qiang Zhang, Tie-Yan Liu
2021	Misc	`conf`	Adaspeech 2: Adaptive Text to Speech with Untranscribed Data. ICASSP Yuzi Yan, Xu Tan, Bohan Li, Tao Qin, Sheng Zhao, Yuan Shen, Tie-Yan Liu
2021	—	`conf`	DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021. Blizzard Challenge Yanqing Liu, Zhihang Xu, Gang Wang, Kuan Chen, Bohan Li, Xu Tan, Jinzhu Li, Lei He, Sheng Zhao
2021	J	`jnl`	DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021. CoRR Yanqing Liu, Zhihang Xu, Gang Wang, Kuan Chen, Bohan Li, Xu Tan, Jinzhu Li, Lei He, Sheng Zhao
2021	Misc	`conf`	Denoispeech: Denoising Text to Speech with Frame-Level Noise Modeling. ICASSP Chen Zhang, Yi Ren, Xu Tan, Jinglin Liu, Kejun Zhang, Tao Qin, Sheng Zhao, Tie-Yan Liu
2021	A*	`conf`	FastSpeech 2: Fast and High-Quality End-to-End Text to Speech. ICLR Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2021	J	`jnl`	LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search. CoRR Renqian Luo, Xu Tan, Rui Wang, Tao Qin, Jinzhu Li, Sheng Zhao, Enhong Chen, Tie-Yan Liu
2021	Misc	`conf`	Lightspeech: Lightweight and Fast Text to Speech with Neural Architecture Search. ICASSP Renqian Luo, Xu Tan, Rui Wang, Tao Qin, Jinzhu Li, Sheng Zhao, Enhong Chen, Tie-Yan Liu
2021	Misc	`conf`	MBNET: MOS Prediction for Synthesized Speech with Mean-Bias Network. ICASSP Yichong Leng, Xu Tan, Sheng Zhao, Frank K. Soong, Xiang-Yang Li, Tao Qin
2021	J	`jnl`	MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Network. CoRR Yichong Leng, Xu Tan, Sheng Zhao, Frank K. Soong, Xiangyang Li, Tao Qin
2021	J	`jnl`	Transformer-S2A: Robust and Efficient Speech-to-Animation. CoRR Liyang Chen, Zhiyong Wu, Jun Ling, Runnan Li, Xu Tan, Sheng Zhao
2020	A*	`conf`	A Study of Non-autoregressive Model for Sequence Generation. ACL Yi Ren, Jinglin Liu, Xu Tan, Zhou Zhao, Sheng Zhao, Tie-Yan Liu
2020	J	`jnl`	A Study of Non-autoregressive Model for Sequence Generation. CoRR Yi Ren, Jinglin Liu, Xu Tan, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2020	J	`jnl`	DenoiSpeech: Denoising Text to Speech with Frame-Level Noise Modeling. CoRR Chen Zhang, Yi Ren, Xu Tan, Jinglin Liu, Kejun Zhang, Tao Qin, Sheng Zhao, Tie-Yan Liu
2020	A	`conf`	Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability. INTERSPEECH Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
2020	J	`jnl`	Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability. CoRR Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
2020	A	`conf`	Enhancing Monotonicity for Robust Autoregressive Transformer TTS. INTERSPEECH Xiangyu Liang, Zhiyong Wu, Runnan Li, Yanqing Liu, Sheng Zhao, Helen Meng
2020	J	`jnl`	FastSpeech 2: Fast and High-Quality End-to-End Text to Speech. CoRR Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2020	A*	`conf`	LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition. KDD Jin Xu, Xu Tan, Yi Ren, Tao Qin, Jian Li, Sheng Zhao, Tie-Yan Liu
2020	J	`jnl`	LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition. CoRR Jin Xu, Xu Tan, Yi Ren, Tao Qin, Jian Li, Sheng Zhao, Tie-Yan Liu
2020	A	`conf`	MoBoAligner: A Neural Alignment Model for Non-Autoregressive TTS with Monotonic Boundary Search. INTERSPEECH Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, Ming Liu, Ming Zhou
2020	J	`jnl`	MoBoAligner: a Neural Alignment Model for Non-autoregressive TTS with Monotonic Boundary Search. CoRR Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, Ming Liu, Ming Zhou
2020	A	`conf`	MultiSpeech: Multi-Speaker Text to Speech with Transformer. INTERSPEECH Mingjian Chen, Xu Tan, Yi Ren, Jin Xu, Hao Sun, Sheng Zhao, Tao Qin
2020	J	`jnl`	MultiSpeech: Multi-Speaker Text to Speech with Transformer. CoRR Mingjian Chen, Xu Tan, Yi Ren, Jin Xu, Hao Sun, Sheng Zhao, Tao Qin
2020	A*	`conf`	RobuTrans: A Robust Transformer-Based Text-to-Speech Model. AAAI Naihan Li, Yanqing Liu, Yu Wu, Shujie Liu, Sheng Zhao, Ming Liu
2020	A	`conf`	Semantic Mask for Transformer Based End-to-End Speech Recognition. INTERSPEECH Chengyi Wang, Yu Wu, Yujiao Du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
2019	A*	`conf`	Almost Unsupervised Text to Speech and Automatic Speech Recognition. ICML Yi Ren, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2019	J	`jnl`	Almost Unsupervised Text to Speech and Automatic Speech Recognition. CoRR Yi Ren, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2019	Misc	`conf`	Dilated Residual Network with Multi-head Self-attention for Speech Emotion Recognition. ICASSP Runnan Li, Zhiyong Wu, Jia Jia, Sheng Zhao, Helen Meng
2019	A*	`conf`	FastSpeech: Fast, Robust and Controllable Text to Speech. NeurIPS Yi Ren, Yangjun Ruan, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2019	J	`jnl`	FastSpeech: Fast, Robust and Controllable Text to Speech. CoRR Yi Ren, Yangjun Ruan, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
2019	C	`conf`	Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation. ASRU Hao Sun, Xu Tan, Jun-Wei Gan, Sheng Zhao, Dongxu Han, Hongzhi Liu, Tao Qin, Tie-Yan Liu
2019	A*	`conf`	Neural Speech Synthesis with Transformer Network. AAAI Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, Ming Liu
2019	J	`jnl`	Semantic Mask for Transformer based End-to-End Speech Recognition. CoRR Chengyi Wang, Yu Wu, Yujiao Du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
2019	A	`conf`	Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion. INTERSPEECH Hao Sun, Xu Tan, Jun-Wei Gan, Hongzhi Liu, Sheng Zhao, Tao Qin, Tie-Yan Liu
2019	J	`jnl`	Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion. CoRR Hao Sun, Xu Tan, Jun-Wei Gan, Hongzhi Liu, Sheng Zhao, Tao Qin, Tie-Yan Liu
2019	A*	`conf`	Towards Discriminative Representation Learning for Speech Emotion Recognition. IJCAI Runnan Li, Zhiyong Wu, Jia Jia, Yaohua Bu, Sheng Zhao, Helen Meng
2018	J	`jnl`	Close to Human Quality TTS with Transformer. CoRR Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, Ming Liu, Ming Zhou
2012	A	`conf`	Turning a Monolingual Speaker into Multilingual for a Mixed-language TTS. INTERSPEECH Ji He, Yao Qian, Frank K. Soong, Sheng Zhao