Zhisheng Zheng

38 papers A* 4A 4B 1C 2Misc 4Journal 21Unranked 2

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processing. CoRR Ziyang Ma, Guanrou Yang, Wenxi Chen, Zhifu Gao, Yexing Du, Xiquan Li, Zhisheng Zheng, Haina Zhu, Jianheng Zhuo, Zheshu Song, Ruiyang Xu, Tiranrui Wang, Yifan Yang, Yanqiao Zhu, Zhikang Niu, Liumeng Xue, Yinghao Ma, Ruibin Yuan, Shiliang Zhang, Kai Yu, Eng Siong Chng, Xie Chen
2026	J	`jnl`	SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processing. IEEE J. Sel. Top. Signal Process. Ziyang Ma, Guanrou Yang, Wenxi Chen, Zhifu Gao, Yexing Du, Xiquan Li, Zhisheng Zheng, Haina Zhu, Jianheng Zhuo, Zheshu Song, Ruiyang Xu, Tiranrui Wang, Yifan Yang, Yanqiao Zhu, Zhikang Niu, Liumeng Xue, Yinghao Ma, Ruibin Yuan, Shiliang Zhang, Kai Yu, Eng Siong Chng, Xie Chen
2025	B	`conf`	Compositional Neural Distance Field with Latent Code Embedding for Dynamic Objects. ICTAI Xiang Gao, Zhisheng Zheng, Alois Knoll
2025	Misc	`conf`	DRCap: Decoding CLAP Latents with Retrieval-Augmented Generation for Zero-shot Audio Captioning. ICASSP Xiquan Li, Wenxi Chen, Ziyang Ma, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Qiuqiang Kong, Xie Chen
2025	J	`jnl`	MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix. CoRR Ziyang Ma, Yinghao Ma, Yanqiao Zhu, Chen Yang, Yi-Wen Chao, Ruiyang Xu, Wenxi Chen, Yuanzhe Chen, Zhuo Chen, Jian Cong, Kai Li, Keliang Li, Siyou Li, Xinfeng Li, Xiquan Li, Zheng Lian, Yuzhe Liang, Minghao Liu, Zhikang Niu, Tianrui Wang, Yuping Wang, Yuxuan Wang, Yihao Wu, Guanrou Yang, Jianwei Yu, Ruibin Yuan, Zhisheng Zheng, Ziya Zhou, Haina Zhu, Wei Xue, Emmanouil Benetos, Kai Yu, Chng Eng Siong, Xie Chen
2025	J	`jnl`	RosettaSpeech: Zero-Shot Speech-to-Speech Translation from Monolingual Data. CoRR Zhisheng Zheng, Xiaohang Sun, Tuan Dinh, Abhishek Yanamandra, Abhinav Jain, Zhu Liu, Sunil Hadap, Vimal Bhat, Manoj Aggarwal, Gérard G. Medioni, David Harwath
2025	Misc	`conf`	SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs. ICASSP Wenxi Chen, Ziyang Ma, Xiquan Li, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Kai Yu, Xie Chen
2025	J	`jnl`	STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence. CoRR Zihan Liu, Zhikang Niu, Qiuyang Xiao, Zhisheng Zheng, Ruoqi Yuan, Yuhang Zang, Yuhang Cao, Xiaoyi Dong, Jianze Liang, Xie Chen, Leilei Sun, Dahua Lin, Jiaqi Wang
2025	A*	`conf`	Scaling Rich Style-Prompted Text-to-Speech Datasets. EMNLP Anuj Diwan, Zhisheng Zheng, David Harwath, Eunsol Choi
2025	J	`jnl`	Scaling Rich Style-Prompted Text-to-Speech Datasets. CoRR Anuj Diwan, Zhisheng Zheng, David Harwath, Eunsol Choi
2025	A*	`conf`	VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing. EMNLP Zhisheng Zheng, Puyuan Peng, Anuj Diwan, Cong Phuoc Huynh, Xiaohang Sun, Zhu Liu, Vimal Bhat, David Harwath
2025	J	`jnl`	VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing. CoRR Zhisheng Zheng, Puyuan Peng, Anuj Diwan, Cong Phuoc Huynh, Xiaohang Sun, Zhu Liu, Vimal Bhat, David Harwath
2024	A*	`conf`	BAT: Learning to Reason about Spatial Sounds with Large Language Models. ICML Zhisheng Zheng, Puyuan Peng, Ziyang Ma, Xie Chen, Eunsol Choi, David Harwath
2024	J	`jnl`	BAT: Learning to Reason about Spatial Sounds with Large Language Models. CoRR Zhisheng Zheng, Puyuan Peng, Ziyang Ma, Xie Chen, Eunsol Choi, David Harwath
2024	J	`jnl`	DRCap: Decoding CLAP Latents with Retrieval-augmented Generation for Zero-shot Audio Captioning. CoRR Xiquan Li, Wenxi Chen, Ziyang Ma, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Qiuqiang Kong, Xie Chen
2024	A*	`conf`	EAT: Self-Supervised Pre-Training with Efficient Audio Transformer. IJCAI Wenxi Chen, Yuzhe Liang, Ziyang Ma, Zhisheng Zheng, Xie Chen
2024	J	`jnl`	EAT: Self-Supervised Pre-Training with Efficient Audio Transformer. CoRR Wenxi Chen, Yuzhe Liang, Ziyang Ma, Zhisheng Zheng, Xie Chen
2024	A	`conf`	EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark. INTERSPEECH Ziyang Ma, Mingjie Chen, Hezhao Zhang, Zhisheng Zheng, Wenxi Chen, Xiquan Li, Jiaxin Ye, Xie Chen, Thomas Hain
2024	J	`jnl`	EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark. CoRR Ziyang Ma, Mingjie Chen, Hezhao Zhang, Zhisheng Zheng, Wenxi Chen, Xiquan Li, Jiaxin Ye, Xie Chen, Thomas Hain
2024	—	`conf`	Improving Emotion Recognition with Pre-Trained Models, Multimodality, and Contextual Information. ISCSLP Zhengshun Xia, Ziyang Ma, Zhisheng Zheng, Xie Chen
2024	Misc	`conf`	Leveraging Speech PTM, Text LLM, And Emotional TTS For Speech Emotion Recognition. ICASSP Ziyang Ma, Wen Wu, Zhisheng Zheng, Yiwei Guo, Qian Chen, Shiliang Zhang, Xie Chen
2024	J	`jnl`	SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs. CoRR Wenxi Chen, Ziyang Ma, Xiquan Li, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Kai Yu, Xie Chen
2024	—	`conf`	emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation. ACL (Findings) Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li, Zhifu Gao, Shiliang Zhang, Xie Chen
2023	C	`conf`	Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition. ASRU Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang
2023	J	`jnl`	Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning. CoRR Guanrou Yang, Ziyang Ma, Zhisheng Zheng, Yakun Song, Zhikang Niu, Xie Chen
2023	C	`conf`	Fast-Hubert: an Efficient Training Framework for Self-Supervised Speech Representation Learning. ASRU Guanrou Yang, Ziyang Ma, Zhisheng Zheng, Yakun Song, Zhikang Niu, Xie Chen
2023	Misc	`conf`	Front-End Adapter: Adapting Front-End Input of Speech Based Self-Supervised Learning for Speech Recognition. ICASSP Xie Chen, Ziyang Ma, Changli Tang, Yujin Wang, Zhisheng Zheng
2023	J	`jnl`	Front-End Adapter: Adapting Front-End Input of Speech based Self-Supervised Learning for Speech Recognition. CoRR Xie Chen, Ziyang Ma, Changli Tang, Yujin Wang, Zhisheng Zheng
2023	J	`jnl`	Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognition. CoRR Ziyang Ma, Wen Wu, Zhisheng Zheng, Yiwei Guo, Qian Chen, Shiliang Zhang, Xie Chen
2023	A	`conf`	MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets. INTERSPEECH Ziyang Ma, Zhisheng Zheng, Changli Tang, Yujin Wang, Xie Chen
2023	A	`conf`	Pushing the Limits of Unsupervised Unit Discovery for SSL Speech Representation. INTERSPEECH Ziyang Ma, Zhisheng Zheng, Guanrou Yang, Yu Wang, Chao Zhang, Xie Chen
2023	J	`jnl`	Pushing the Limits of Unsupervised Unit Discovery for SSL Speech Representation. CoRR Ziyang Ma, Zhisheng Zheng, Guanrou Yang, Yu Wang, Chao Zhang, Xie Chen
2023	A	`conf`	Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition. INTERSPEECH Zhisheng Zheng, Ziyang Ma, Yu Wang, Xie Chen
2023	J	`jnl`	Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition. CoRR Zhisheng Zheng, Ziyang Ma, Yu Wang, Xie Chen
2023	J	`jnl`	emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation. CoRR Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li, Zhifu Gao, Shiliang Zhang, Xie Chen
2022	J	`jnl`	Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition. CoRR Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang
2022	J	`jnl`	MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets. CoRR Ziyang Ma, Zhisheng Zheng, Changli Tang, Yujin Wang, Xie Chen
2022	J	`jnl`	Noniterative f -x-y Streaming Prediction Filtering for Random Noise Attenuation on Seismic Data. IEEE Trans. Geosci. Remote. Sens. Yang Liu, Zhisheng Zheng