Haiyang Sun

38 papers A* 6A 2Journal 24Unranked 6
YearRankTypeTitle / Venue / Authors
2026 J jnl
DeepASMR: LLM-Based Zero-Shot ASMR Speech Generation for Anyone of Any Voice.
CoRR
Leying Zhang, Tingxiao Zhou, Haiyang Sun, Mengxiao Bi, Yanmin Qian
2026 J jnl
MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition.
IEEE Trans. Pattern Anal. Mach. Intell.
Zheng Lian, Licai Sun, Yong Ren, Hao Gu, Haiyang Sun, Lan Chen, Bin Liu, Jianhua Tao
2026 J jnl
OV-InstructTTS: Towards Open-Vocabulary Instruct Text-to-Speech.
CoRR
Yong Ren, Jiangyan Yi, Jianhua Tao, Haiyang Sun, Zhengqi Wen, Hao Gu, Le Xu, Ye Bai
2025 A* conf
AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models.
ICML
Zheng Lian, Haoyu Chen, Lan Chen, Haiyang Sun, Licai Sun, Yong Ren, Zebang Cheng, Bin Liu, Rui Liu, Xiaojiang Peng, Jiangyan Yi, Jianhua Tao
2025 J jnl
AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models.
CoRR
Zheng Lian, Haoyu Chen, Lan Chen, Haiyang Sun, Licai Sun, Yong Ren, Zebang Cheng, Bin Liu, Rui Liu, Xiaojiang Peng, Jiangyan Yi, Jianhua Tao
2025 A* conf
FELLE: Autoregressive Speech Synthesis with Token-Wise Coarse-to-Fine Flow Matching.
ACM Multimedia
Hui Wang, Shujie Liu, Lingwei Meng, Jinyu Li, Yifan Yang, Shiwan Zhao, Haiyang Sun, Yanqing Liu, Haoqin Sun, Jiaming Zhou, Yan Lu, Yong Qin
2025 J jnl
FELLE: Autoregressive Speech Synthesis with Token-Wise Coarse-to-Fine Flow Matching.
CoRR
Hui Wang, Shujie Liu, Lingwei Meng, Jinyu Li, Yifan Yang, Shiwan Zhao, Haiyang Sun, Yanqing Liu, Haoqin Sun, Jiaming Zhou, Yan Lu, Yong Qin
2025 A* conf
OV-MER: Towards Open-Vocabulary Multimodal Emotion Recognition.
ICML
Zheng Lian, Haiyang Sun, Licai Sun, Haoyu Chen, Lan Chen, Hao Gu, Zhuofan Wen, Shun Chen, Siyuan Zhang, Hailiang Yao, Bin Liu, Rui Liu, Shan Liang, Ya Li, Jiangyan Yi, Jianhua Tao
2025 A* conf
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis.
ACM Multimedia
Yifan Yang, Shujie Liu, Jinyu Li, Yuxuan Hu, Haibin Wu, Hui Wang, Jianwei Yu, Lingwei Meng, Haiyang Sun, Yanqing Liu, Yan Lu, Kai Yu, Xie Chen
2025 J jnl
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis.
CoRR
Yifan Yang, Shujie Liu, Jinyu Li, Yuxuan Hu, Haibin Wu, Hui Wang, Jianwei Yu, Lingwei Meng, Haiyang Sun, Yanqing Liu, Yan Lu, Kai Yu, Xie Chen
2025 J jnl
SVFAP: Self-Supervised Video Facial Affect Perceiver.
IEEE Trans. Affect. Comput.
Licai Sun, Zheng Lian, Kexin Wang, Yu He, Mingyu Xu, Haiyang Sun, Bin Liu, Jianhua Tao
2025 J jnl
Zero-Shot Streaming Text to Speech Synthesis with Transducer and Auto-Regressive Modeling.
CoRR
Haiyang Sun, Shujie Hu, Shujie Liu, Lingwei Meng, Hui Wang, Bing Han, Yifan Yang, Yanqing Liu, Sheng Zhao, Yan Lu, Yanmin Qian
2024 J jnl
AffectGPT: Dataset and Framework for Explainable Multimodal Emotion Recognition.
CoRR
Zheng Lian, Haiyang Sun, Licai Sun, Jiangyan Yi, Bin Liu, Jianhua Tao
2024 J jnl
Can Deception Detection Go Deeper? Dataset, Evaluation, and Benchmark for Deception Reasoning.
CoRR
Kang Chen, Zheng Lian, Haiyang Sun, Bin Liu, Jianhua Tao
2024 — conf
DPP: A Dual-Phase Processing Method for Cross-Cultural Humor Detection.
MuSe@ACM Multimedia
Shun Chen, Hailiang Yao, Mingyu Xu, Zhuofan Wen, Haiyang Sun, Licai Sun, Zheng Lian, Bin Liu, Fengyu Zhang, Siyuan Zhang, Jianhua Tao
2024 J jnl
GPT-4V with emotion: A zero-shot benchmark for Generalized Emotion Recognition.
Inf. Fusion
Zheng Lian, Licai Sun, Haiyang Sun, Kang Chen, Zhuofan Wen, Hao Gu, Bin Liu, Jianhua Tao
2024 — conf
MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition.
MRAC@MM
Zheng Lian, Haiyang Sun, Licai Sun, Zhuofan Wen, Siyuan Zhang, Shun Chen, Hao Gu, Jinming Zhao, Ziyang Ma, Xie Chen, Jiangyan Yi, Rui Liu, Kele Xu, Bin Liu, Erik Cambria, Guoying Zhao, Björn W. Schuller, Jianhua Tao
2024 J jnl
MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition.
CoRR
Zheng Lian, Haiyang Sun, Licai Sun, Zhuofan Wen, Siyuan Zhang, Shun Chen, Hao Gu, Jinming Zhao, Ziyang Ma, Xie Chen, Jiangyan Yi, Rui Liu, Kele Xu, Bin Liu, Erik Cambria, Guoying Zhao, Björn W. Schuller, Jianhua Tao
2024 J jnl
MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition.
CoRR
Zheng Lian, Licai Sun, Yong Ren, Hao Gu, Haiyang Sun, Lan Chen, Bin Liu, Jianhua Tao
2024 A conf
MFSN: Multi-perspective Fusion Search Network For Pre-training Knowledge in Speech Emotion Recognition.
INTERSPEECH
Haiyang Sun, Fulin Zhang, Yingying Gao, Shilei Zhang, Zheng Lian, Junlan Feng
2024 J jnl
Multimodal Fusion with Pre-Trained Model Features in Affective Behaviour Analysis In-the-wild.
CoRR
Zhuofan Wen, Fengyu Zhang, Siyuan Zhang, Haiyang Sun, Mingyu Xu, Licai Sun, Zheng Lian, Bin Liu, Jianhua Tao
2024 J jnl
Open-vocabulary Multimodal Emotion Recognition: Dataset, Metric, and Benchmark.
CoRR
Zheng Lian, Haiyang Sun, Licai Sun, Lan Chen, Haoyu Chen, Hao Gu, Zhuofan Wen, Shun Chen, Siyuan Zhang, Hailiang Yao, Mingyu Xu, Kang Chen, Bin Liu, Rui Liu, Shan Liang, Ya Li, Jiangyan Yi, Jianhua Tao
2024 J jnl
SVFAP: Self-supervised Video Facial Affect Perceiver.
CoRR
Licai Sun, Zheng Lian, Kexin Wang, Yu He, Mingyu Xu, Haiyang Sun, Bin Liu, Jianhua Tao
2024 — conf
Social Perception Prediction for MuSe 2024: Joint Learning of Multiple Perceptions.
MuSe@ACM Multimedia
Zhuofan Wen, Hailiang Yao, Shun Chen, Haiyang Sun, Mingyu Xu, Licai Sun, Zheng Lian, Bin Liu, Fengyu Zhang, Siyuan Zhang, Jianhua Tao
2023 A conf
EmotionNAS: Two-stream Neural Architecture Search for Speech Emotion Recognition.
INTERSPEECH
Haiyang Sun, Zheng Lian, Bin Liu, Ying Li, Jianhua Tao, Licai Sun, Cong Cai, Meng Wang, Yuan Cheng
2023 — conf
Exclusive Modeling for MuSe-Personalisation Challenge.
MuSe@ACM Multimedia
Haiyang Sun, Zhuofan Wen, Mingyu Xu, Zheng Lian, Licai Sun, Bin Liu, Jianhua Tao
2023 J jnl
Explainable Multimodal Emotion Reasoning.
CoRR
Zheng Lian, Licai Sun, Mingyu Xu, Haiyang Sun, Ke Xu, Zhuofan Wen, Shun Chen, Bin Liu, Jianhua Tao
2023 J jnl
GPT-4V with Emotion: A Zero-shot Benchmark for Multimodal Emotion Understanding.
CoRR
Zheng Lian, Licai Sun, Haiyang Sun, Kang Chen, Zhuofan Wen, Hao Gu, Shun Chen, Bin Liu, Jianhua Tao
2023 A* conf
Integrating VideoMAE based model and Optical Flow for Micro- and Macro-expression Spotting.
ACM Multimedia
Ke Xu, Kang Chen, Licai Sun, Zheng Lian, Bin Liu, Gong Chen, Haiyang Sun, Mingyu Xu, Jianhua Tao
2023 A* conf
MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learning.
ACM Multimedia
Zheng Lian, Haiyang Sun, Licai Sun, Kang Chen, Mingyu Xu, Kexin Wang, Ke Xu, Yu He, Ying Li, Jinming Zhao, Ye Liu, Bin Liu, Jiangyan Yi, Meng Wang, Erik Cambria, Guoying Zhao, Björn W. Schuller, Jianhua Tao
2023 J jnl
MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learning.
CoRR
Zheng Lian, Haiyang Sun, Licai Sun, Jinming Zhao, Ye Liu, Bin Liu, Jiangyan Yi, Meng Wang, Erik Cambria, Guoying Zhao, Björn W. Schuller, Jianhua Tao
2023 J jnl
MFAS: Emotion Recognition through Multiple Perspectives Fusion Architecture Search Emulating Human Cognition.
CoRR
Haiyang Sun, Fulin Zhang, Zheng Lian, Yingying Guo, Shilei Zhang
2023 J jnl
RMNAS: A Multimodal Neural Architecture Search Framework For Robust Multimodal Sentiment Analysis.
CoRR
Haiyang Sun, Zheng Lian, Licai Sun, Bin Liu, Jianhua Tao
2022 J jnl
EmotionNAS: Two-stream Architecture Search for Speech Emotion Recognition.
CoRR
Haiyang Sun, Zheng Lian, Bin Liu, Ying Li, Licai Sun, Cong Cai, Jianhua Tao, Meng Wang, Yuan Cheng
2022 — conf
Fully Automated End-to-End Fake Audio Detection.
DDAM@MM
Chenglong Wang, Jiangyan Yi, Jianhua Tao, Haiyang Sun, Xun Chen, Zhengkun Tian, Haoxin Ma, Cunhang Fan, Ruibo Fu
2022 J jnl
Fully Automated End-to-End Fake Audio Detection.
CoRR
Chenglong Wang, Jiangyan Yi, Jianhua Tao, Haiyang Sun, Xun Chen, Zhengkun Tian, Haoxin Ma, Cunhang Fan, Ruibo Fu
2022 J jnl
Two-Aspect Information Fusion Model For ABAW4 Multi-task Challenge.
CoRR
Haiyang Sun, Zheng Lian, Bin Liu, Jianhua Tao, Licai Sun, Cong Cai
2022 — conf
Two-Aspect Information Interaction Model for ABAW4 Multi-task Challenge.
ECCV Workshops (6)
Haiyang Sun, Zheng Lian, Bin Liu, Jianhua Tao, Licai Sun, Cong Cai, Yu He