Xuankai Chang

137 papers A* 4A 23C 6Misc 17Journal 76Unranked 10
YearRankTypeTitle / Venue / Authors
2026 J jnl
An end-to-end integration of speech separation and recognition with self-supervised learning representation.
Comput. Speech Lang.
Yoshiki Masuyama, Xuankai Chang, Wangyou Zhang, Samuele Cornell, Zhong-Qiu Wang, Nobutaka Ono, Yanmin Qian, Shinji Watanabe
2026 J jnl
Recent trends in distant conversational speech recognition: A review of CHiME-7 and 8 DASR challenges.
Comput. Speech Lang.
Samuele Cornell, Christoph Boeddeker, Taejin Park, He Huang, Desh Raj, Matthew Wiesner, Yoshiki Masuyama, Xuankai Chang, Zhongqiu Wang, Stefano Squartini, Paola García, Shinji Watanabe
2026 J jnl
TMT: Tri-Modal Translation Between Speech, Image, and Text by Processing Different Modalities as Different Languages.
IEEE Trans. Multim.
Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
2025 J jnl
Data-Centric Lessons To Improve Speech-Language Pretraining.
CoRR
Vishaal Udandarao, Zhiyun Lu, Xuankai Chang, Yongqiang Wang, Violet Z. Yao, Albin Madapally Jose, Fartash Faghri, Josh Gardner, Chung-Cheng Chiu
2025 J jnl
Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challenges.
CoRR
Samuele Cornell, Christoph Boeddeker, Taejin Park, He Huang, Desh Raj, Matthew Wiesner, Yoshiki Masuyama, Xuankai Chang, Zhongqiu Wang, Stefano Squartini, Paola García, Shinji Watanabe
2024 J jnl
A Large-Scale Evaluation of Speech Foundation Models.
CoRR
Shu-Wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
2024 J jnl
A Large-Scale Evaluation of Speech Foundation Models.
IEEE ACM Trans. Audio Speech Lang. Process.
Shu-Wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
2024 A* conf
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head.
AAAI
Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Yuexian Zou, Zhou Zhao, Shinji Watanabe
2024 Misc conf
Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing.
ICASSP
Brian Yan, Xuankai Chang, Antonios Anastasopoulos, Yuya Fujita, Shinji Watanabe
2024 — —
Everyday Conversation Speech Recognition with End-to-End Neural Networks
Xuankai Chang
2024 Misc conf
Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study.
ICASSP
Xuankai Chang, Brian Yan, Kwanghee Choi, Jee-weon Jung, Yichen Lu, Soumi Maiti, Roshan S. Sharma, Jiatong Shi, Jinchuan Tian, Shinji Watanabe, Yuya Fujita, Takashi Maekaku, Pengcheng Guo, Yao-Fei Cheng, Pavel Denisov, Kohei Saijo, Hsiu-Hsuan Wang
2024 Misc conf
Hubertopic: Enhancing Semantic Representation of Hubert Through Self-Supervision Utilizing Topic Model.
ICASSP
Takashi Maekaku, Jiatong Shi, Xuankai Chang, Yuya Fujita, Shinji Watanabe
2024 Misc conf
Improving Audio Captioning Models with Fine-Grained Audio Features, Text Embedding Supervision, and LLM Mix-Up Augmentation.
ICASSP
Shih-Lun Wu, Xuankai Chang, Gordon Wichern, Jee-weon Jung, François G. Germain, Jonathan Le Roux, Shinji Watanabe
2024 J jnl
MC-Whisper: Extending Speech Foundation Models to Multichannel Distant Speech Recognition.
IEEE Signal Process. Lett.
Xuankai Chang, Pengcheng Guo, Yuya Fujita, Takashi Maekaku, Shinji Watanabe
2024 A conf
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets.
INTERSPEECH
Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
2024 J jnl
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets.
CoRR
Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
2024 — conf
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners.
ACL (1)
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu
2024 J jnl
Module-Based End-to-End Distant Speech Processing: A case study of far-field automatic speech recognition [Special Issue On Model-Based and Data-Driven Audio Signal Processing].
IEEE Signal Process. Mag.
Xuankai Chang, Shinji Watanabe, Marc Delcroix, Tsubasa Ochiai, Wangyou Zhang, Yanmin Qian
2024 A conf
OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer.
INTERSPEECH
Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi, Xuankai Chang, Jee-weon Jung, Shinji Watanabe
2024 J jnl
OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer.
CoRR
Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi, Xuankai Chang, Jee-weon Jung, Shinji Watanabe
2024 — conf
Robust Audiovisual Speech Recognition Models with Mixture-of-Experts.
SLT
Yihan Wu, Yifan Peng, Yichen Lu, Xuankai Chang, Ruihua Song, Shinji Watanabe
2024 J jnl
Robust Audiovisual Speech Recognition Models with Mixture-of-Experts.
CoRR
Yihan Wu, Yifan Peng, Yichen Lu, Xuankai Chang, Ruihua Song, Shinji Watanabe
2024 J jnl
SQ-Whisper: Speaker-Querying based Whisper Model for Target-Speaker ASR.
CoRR
Pengcheng Guo, Xuankai Chang, Hang Lv, Shinji Watanabe, Lei Xie
2024 J jnl
SynesLM: A Unified Approach for Audio-visual Speech Recognition and Translation via Language Model and Synthetic Data.
CoRR
Yichen Lu, Jiaqi Song, Xuankai Chang, Hengwei Bian, Soumi Maiti, Shinji Watanabe
2024 J jnl
TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages.
CoRR
Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
2024 J jnl
The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization.
CoRR
Samuele Cornell, Taejin Park, Steve Huang, Christoph Böddeker, Xuankai Chang, Matthew Maciejewski, Matthew Wiesner, Paola García, Shinji Watanabe
2024 A conf
The Interspeech 2024 Challenge on Speech Processing Using Discrete Units.
INTERSPEECH
Xuankai Chang, Jiatong Shi, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin
2024 J jnl
The Interspeech 2024 Challenge on Speech Processing Using Discrete Units.
CoRR
Xuankai Chang, Jiatong Shi, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin
2024 A* conf
Towards Robust Speech Representation Learning for Thousands of Languages.
EMNLP
William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
2024 J jnl
Towards Robust Speech Representation Learning for Thousands of Languages.
CoRR
William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
2024 A* conf
UniAudio: Towards Universal Audio Generation with Large Language Models.
ICML
Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Haohan Guo, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Zhou Zhao, Xixin Wu, Helen M. Meng
2024 Misc conf
VoxtLM: Unified Decoder-Only Models for Consolidating Speech Recognition, Synthesis and Speech, Text Continuation Tasks.
ICASSP
Soumi Maiti, Yifan Peng, Shukjae Choi, Jee-weon Jung, Xuankai Chang, Shinji Watanabe
2023 A conf
A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning.
INTERSPEECH
Jiyang Tang, William Chen, Xuankai Chang, Shinji Watanabe, Brian MacWhinney
2023 J jnl
A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning.
CoRR
Jiyang Tang, William Chen, Xuankai Chang, Shinji Watanabe, Brian MacWhinney
2023 J jnl
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head.
CoRR
Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Zhou Zhao, Shinji Watanabe
2023 J jnl
Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing.
CoRR
Brian Yan, Xuankai Chang, Antonios Anastasopoulos, Yuya Fujita, Shinji Watanabe
2023 A conf
Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning.
INTERSPEECH
Xuankai Chang, Brian Yan, Yuya Fujita, Takashi Maekaku, Shinji Watanabe
2023 J jnl
Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning.
CoRR
Xuankai Chang, Brian Yan, Yuya Fujita, Takashi Maekaku, Shinji Watanabe
2023 J jnl
Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study.
CoRR
Xuankai Chang, Brian Yan, Kwanghee Choi, Jee-weon Jung, Yichen Lu, Soumi Maiti, Roshan S. Sharma, Jiatong Shi, Jinchuan Tian, Shinji Watanabe, Yuya Fujita, Takashi Maekaku, Pengcheng Guo, Yao-Fei Cheng, Pavel Denisov, Kohei Saijo, Hsiu-Hsuan Wang
2023 — conf
Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation.
WASPAA
Yoshiki Masuyama, Xuankai Chang, Wangyou Zhang, Samuele Cornell, Zhong-Qiu Wang, Nobutaka Ono, Yanmin Qian, Shinji Watanabe
2023 J jnl
Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation.
CoRR
Yoshiki Masuyama, Xuankai Chang, Wangyou Zhang, Samuele Cornell, Zhong-Qiu Wang, Nobutaka Ono, Yanmin Qian, Shinji Watanabe
2023 Misc conf
FindAdaptNet: Find and Insert Adapters by Learned Layer Importance.
ICASSP
Junwei Huang, Karthik Ganesan, Soumi Maiti, Young Min Kim, Xuankai Chang, Paul Liang, Shinji Watanabe
2023 J jnl
Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond.
CoRR
Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chung, Xuankai Chang, Yuxun Tang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 C conf
Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond.
ASRU
Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chuang, Xuankai Chang, Yuxun Tang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 Misc conf
Fully Unsupervised Topic Clustering of Unlabelled Spoken Audio Using Self-Supervised Representation Learning and Topic Model.
ICASSP
Takashi Maekaku, Yuya Fujita, Xuankai Chang, Shinji Watanabe
2023 J jnl
HuBERTopic: Enhancing Semantic Representation of HuBERT through Self-supervision Utilizing Topic Model.
CoRR
Takashi Maekaku, Jiatong Shi, Xuankai Chang, Yuya Fujita, Shinji Watanabe
2023 J jnl
Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Supervision, and LLM Mix-up Augmentation.
CoRR
Shih-Lun Wu, Xuankai Chang, Gordon Wichern, Jee-weon Jung, François G. Germain, Jonathan Le Roux, Shinji Watanabe
2023 J jnl
Improving Perceptual Quality, Intelligibility, and Acoustics on VoIP Platforms.
CoRR
Joseph Konan, Ojas Bhargave, Shikhar Agnihotri, Hojeong Lee, Ankit Shah, Shuo Han, Yunyang Zeng, Amanda Shu, Haohui Liu, Xuankai Chang, Hamza Khalid, Minseon Gwak, Kawon Lee, Minjeong Kim, Bhiksha Raj
2023 C conf
Joint Prediction and Denoising for Large-Scale Multilingual Self-Supervised Learning.
ASRU
William Chen, Jiatong Shi, Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, Shinji Watanabe
2023 J jnl
Joint Prediction and Denoising for Large-scale Multilingual Self-supervised Learning.
CoRR
William Chen, Jiatong Shi, Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, Shinji Watanabe
2023 C conf
LV-CTC: Non-Autoregressive ASR With CTC and Latent Variable Models.
ASRU
Yuya Fujita, Shinji Watanabe, Xuankai Chang, Takashi Maekaku
2023 A conf
ML-SUPERB: Multilingual Speech Universal PERformance Benchmark.
INTERSPEECH
Jiatong Shi, Dan Berrebbi, William Chen, En-Pei Hu, Wei-Ping Huang, Ho-Lam Chung, Xuankai Chang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 J jnl
ML-SUPERB: Multilingual Speech Universal PERformance Benchmark.
CoRR
Jiatong Shi, Dan Berrebbi, William Chen, Ho-Lam Chung, En-Pei Hu, Wei-Ping Huang, Xuankai Chang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 A conf
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute.
INTERSPEECH
William Chen, Xuankai Chang, Yifan Peng, Zhaoheng Ni, Soumi Maiti, Shinji Watanabe
2023 J jnl
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute.
CoRR
William Chen, Xuankai Chang, Yifan Peng, Zhaoheng Ni, Soumi Maiti, Shinji Watanabe
2023 C conf
Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data.
ASRU
Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi, Siddhant Arora, William Chen, Roshan S. Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-weon Jung, Soumi Maiti, Shinji Watanabe
2023 J jnl
Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Data.
CoRR
Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi, Siddhant Arora, William Chen, Roshan S. Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-weon Jung, Soumi Maiti, Shinji Watanabe
2023 J jnl
Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing.
J. Open Source Softw.
Yen-Ju Lu, Xuankai Chang, Chenda Li, Wangyou Zhang, Samuele Cornell, Zhaoheng Ni, Yoshiki Masuyama, Brian Yan, Robin Scheibler, Zhong-Qiu Wang, Yu Tsao, Yanmin Qian, Shinji Watanabe
2023 J jnl
The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios.
CoRR
Samuele Cornell, Matthew Wiesner, Shinji Watanabe, Desh Raj, Xuankai Chang, Paola García, Yoshiki Masuyama, Zhong-Qiu Wang, Stefano Squartini, Sanjeev Khudanpur
2023 A conf
TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition.
INTERSPEECH
Hakan Erdogan, Scott Wisdom, Xuankai Chang, Zalán Borsos, Marco Tagliasacchi, Neil Zeghidour, John R. Hershey
2023 J jnl
TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition.
CoRR
Hakan Erdogan, Scott Wisdom, Xuankai Chang, Zalán Borsos, Marco Tagliasacchi, Neil Zeghidour, John R. Hershey
2023 J jnl
UniAudio: An Audio Foundation Model Toward Universal Audio Generation.
CoRR
Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Shinji Watanabe, Helen Meng
2023 J jnl
Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks.
CoRR
Soumi Maiti, Yifan Peng, Shukjae Choi, Jee-weon Jung, Xuankai Chang, Shinji Watanabe
2022 — conf
A Study on the Integration of Pre-Trained SSL, ASR, LM and SLU Models for Spoken Language Understanding.
SLT
Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
2022 J jnl
A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understanding.
CoRR
Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
2022 Misc conf
An Exploration of Hubert with Large Number of Cluster Units and Model Assessment Using Bayesian Information Criterion.
ICASSP
Takashi Maekaku, Xuankai Chang, Yuya Fujita, Shinji Watanabe
2022 A conf
ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding.
INTERSPEECH
Yen-Ju Lu, Xuankai Chang, Chenda Li, Wangyou Zhang, Samuele Cornell, Zhaoheng Ni, Yoshiki Masuyama, Brian Yan, Robin Scheibler, Zhong-Qiu Wang, Yu Tsao, Yanmin Qian, Shinji Watanabe
2022 J jnl
ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding.
CoRR
Yen-Ju Lu, Xuankai Chang, Chenda Li, Wangyou Zhang, Samuele Cornell, Zhaoheng Ni, Yoshiki Masuyama, Brian Yan, Robin Scheibler, Zhong-Qiu Wang, Yu Tsao, Yanmin Qian, Shinji Watanabe
2022 Misc conf
ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet.
ICASSP
Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
2022 J jnl
End-to-End Dereverberation, Beamforming, and Speech Recognition in a Cocktail Party.
IEEE ACM Trans. Audio Speech Lang. Process.
Wangyou Zhang, Xuankai Chang, Christoph Böddeker, Tomohiro Nakatani, Shinji Watanabe, Yanmin Qian
2022 — conf
End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representation.
SLT
Yoshiki Masuyama, Xuankai Chang, Samuele Cornell, Shinji Watanabe, Nobutaka Ono
2022 J jnl
End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representation.
CoRR
Yoshiki Masuyama, Xuankai Chang, Samuele Cornell, Shinji Watanabe, Nobutaka Ono
2022 A conf
End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation.
INTERSPEECH
Xuankai Chang, Takashi Maekaku, Yuya Fujita, Shinji Watanabe
2022 J jnl
End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation.
CoRR
Xuankai Chang, Takashi Maekaku, Yuya Fujita, Shinji Watanabe
2022 — conf
End-to-End Multi-Speaker ASR with Independent Vector Analysis.
SLT
Robin Scheibler, Wangyou Zhang, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2022 J jnl
End-to-End Multi-speaker ASR with Independent Vector Analysis.
CoRR
Robin Scheibler, Wangyou Zhang, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2022 Misc conf
Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR.
ICASSP
Xuankai Chang, Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux
2022 J jnl
Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR.
CoRR
Xuankai Chang, Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux
2022 Misc conf
Joint Speech Recognition and Audio Captioning.
ICASSP
Chaitanya Narisetty, Emiru Tsunoo, Xuankai Chang, Yosuke Kashiwagi, Michael Hentschel, Shinji Watanabe
2022 J jnl
Joint Speech Recognition and Audio Captioning.
CoRR
Chaitanya Narisetty, Emiru Tsunoo, Xuankai Chang, Yosuke Kashiwagi, Michael Hentschel, Shinji Watanabe
2022 J jnl
Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis.
CoRR
Jiatong Shi, Shuai Guo, Tao Qian, Nan Huo, Tomoki Hayashi, Yuning Wu, Frank Xu, Xuankai Chang, Huazhe Li, Peter Wu, Shinji Watanabe, Qin Jin
2022 A conf
Muskits: an End-to-end Music Processing Toolkit for Singing Voice Synthesis.
INTERSPEECH
Jiatong Shi, Shuai Guo, Tao Qian, Tomoki Hayashi, Yuning Wu, Fangzheng Xu, Xuankai Chang, Huazhe Li, Peter Wu, Shinji Watanabe, Qin Jin
2022 J jnl
SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning.
CoRR
Tzu-hsun Feng, Shuyan Annie Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-wen Li, Hung-yi Lee
2022 — conf
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities.
ACL (1)
Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2022 J jnl
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities.
CoRR
Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Jeff Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2022 — conf
Superb @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning.
SLT
Tzu-hsun Feng, Shuyan Annie Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-wen Li, Hung-yi Lee
2022 Misc conf
Towards Low-Distortion Multi-Channel Speech Enhancement: The ESPNET-Se Submission to the L3DAS22 Challenge.
ICASSP
Yen-Ju Lu, Samuele Cornell, Xuankai Chang, Wangyou Zhang, Chenda Li, Zhaoheng Ni, Zhong-Qiu Wang, Shinji Watanabe
2022 J jnl
Towards Low-distortion Multi-channel Speech Enhancement: The ESPNet-SE Submission to The L3DAS22 Challenge.
CoRR
Yen-Ju Lu, Samuele Cornell, Xuankai Chang, Wangyou Zhang, Chenda Li, Zhaoheng Ni, Zhong-Qiu Wang, Shinji Watanabe
2022 J jnl
Train from scratch: Single-stage joint training of speech separation and recognition.
Comput. Speech Lang.
Jing Shi, Xuankai Chang, Shinji Watanabe, Bo Xu
2022 A conf
Two-Pass Low Latency End-to-End Spoken Language Understanding.
INTERSPEECH
Siddhant Arora, Siddharth Dalmia, Xuankai Chang, Brian Yan, Alan W. Black, Shinji Watanabe
2022 J jnl
Two-Pass Low Latency End-to-End Spoken Language Understanding.
CoRR
Siddhant Arora, Siddharth Dalmia, Xuankai Chang, Brian Yan, Alan W. Black, Shinji Watanabe
2021 C conf
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition.
ASRU
Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-Wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe
2021 J jnl
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition.
CoRR
Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-Wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe
2021 J jnl
Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem.
CoRR
Jing Shi, Xuankai Chang, Tomoki Hayashi, Yen-Ju Lu, Shinji Watanabe, Bo Xu
2021 — conf
ESPnet-SE: End-To-End Speech Enhancement and Separation Toolkit Designed for ASR Integration.
SLT
Chenda Li, Jing Shi, Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Naoyuki Kamo, Moto Hira, Tomoki Hayashi, Christoph Böddeker, Zhuo Chen, Shinji Watanabe
2021 J jnl
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet.
CoRR
Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
2021 Misc conf
Hypothesis Stitcher for End-to-End Speaker-Attributed ASR on Long-Form Multi-Talker Recordings.
ICASSP
Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
2021 J jnl
Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings.
CoRR
Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
2021 — conf
Investigation of End-to-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings.
SLT
Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
2021 A conf
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain.
Interspeech
Pengcheng Guo, Xuankai Chang, Shinji Watanabe, Lei Xie
2021 J jnl
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain.
CoRR
Pengcheng Guo, Xuankai Chang, Shinji Watanabe, Lei Xie
2021 Misc conf
Recent Developments on Espnet Toolkit Boosted By Conformer.
ICASSP
Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang
2021 A conf
SUPERB: Speech Processing Universal PERformance Benchmark.
Interspeech
Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2021 J jnl
SUPERB: Speech processing Universal PERformance Benchmark.
CoRR
Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2021 A conf
Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021.
Interspeech
Takashi Maekaku, Xuankai Chang, Yuya Fujita, Li-Wei Chen, Shinji Watanabe, Alexander I. Rudnicky
2021 J jnl
Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021.
CoRR
Takashi Maekaku, Xuankai Chang, Yuya Fujita, Li-Wei Chen, Shinji Watanabe, Alexander I. Rudnicky
2021 A conf
Streaming End-to-End ASR Based on Blockwise Non-Autoregressive Models.
Interspeech
Tianzi Wang, Yuya Fujita, Xuankai Chang, Shinji Watanabe
2021 J jnl
Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models.
CoRR
Tianzi Wang, Yuya Fujita, Xuankai Chang, Shinji Watanabe
2020 J jnl
ESPnet-se: end-to-end speech enhancement and separation toolkit designed for asr integration.
CoRR
Chenda Li, Jing Shi, Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Naoyuki Kamo, Moto Hira, Tomoki Hayashi, Christoph Böddeker, Zhuo Chen, Shinji Watanabe
2020 Misc conf
End-To-End Multi-Speaker Speech Recognition With Transformer.
ICASSP
Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2020 A conf
End-to-End ASR with Adaptive Span Self-Attention.
INTERSPEECH
Xuankai Chang, Aswin Shanmugam Subramanian, Pengcheng Guo, Shinji Watanabe, Yuya Fujita, Motoi Omachi
2020 A conf
End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming.
INTERSPEECH
Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2020 J jnl
End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming.
CoRR
Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2020 J jnl
End-to-End Multi-speaker Speech Recognition with Transformer.
CoRR
Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2020 J jnl
Improving End-to-End Single-Channel Multi-Talker Speech Recognition.
IEEE ACM Trans. Audio Speech Lang. Process.
Wangyou Zhang, Xuankai Chang, Yanmin Qian, Shinji Watanabe
2020 A conf
Insertion-Based Modeling for End-to-End Automatic Speech Recognition.
INTERSPEECH
Yuya Fujita, Shinji Watanabe, Motoi Omachi, Xuankai Chang
2020 J jnl
Insertion-Based Modeling for End-to-End Automatic Speech Recognition.
CoRR
Yuya Fujita, Shinji Watanabe, Motoi Omachi, Xuankai Chang
2020 J jnl
Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings.
CoRR
Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
2020 J jnl
Recent Developments on ESPnet Toolkit Boosted by Conformer.
CoRR
Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang
2020 A* conf
Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals.
NeurIPS
Jing Shi, Xuankai Chang, Pengcheng Guo, Shinji Watanabe, Yusuke Fujita, Jiaming Xu, Bo Xu, Lei Xie
2020 J jnl
Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals.
CoRR
Jing Shi, Xuankai Chang, Pengcheng Guo, Shinji Watanabe, Yusuke Fujita, Jiaming Xu, Bo Xu, Lei Xie
2020 J jnl
The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans.
CoRR
Shinji Watanabe, Florian Boyer, Xuankai Chang, Pengcheng Guo, Tomoki Hayashi, Yosuke Higuchi, Takaaki Hori, Wen-Chin Huang, Hirofumi Inaguma, Naoyuki Kamo, Shigeki Karita, Chenda Li, Jing Shi, Aswin Shanmugam Subramanian, Wangyou Zhang
2019 Misc conf
End-to-end Monaural Multi-speaker ASR System without Pretraining.
ICASSP
Xuankai Chang, Yanmin Qian, Kai Yu, Shinji Watanabe
2019 J jnl
Erratum to: Past review, current progress, and challenges ahead on the cocktail party problem.
Frontiers Inf. Technol. Electron. Eng.
Yanmin Qian, Chao Weng, Xuankai Chang, Shuai Wang, Dong Yu
2019 A conf
Knowledge Distillation for End-to-End Monaural Multi-Talker ASR System.
INTERSPEECH
Wangyou Zhang, Xuankai Chang, Yanmin Qian
2019 J jnl
MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition.
CoRR
Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2019 C conf
MIMO-Speech: End-to-End Multi-Channel Multi-Speaker Speech Recognition.
ASRU
Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2018 Misc conf
Adaptive Permutation Invariant Training with Auxiliary Information for Monaural Multi-Talker Speech Recognition.
ICASSP
Xuankai Chang, Yanmin Qian, Dong Yu
2018 J jnl
End-to-End Monaural Multi-speaker ASR System without Pretraining.
CoRR
Xuankai Chang, Yanmin Qian, Kai Yu, Shinji Watanabe
2018 J jnl
Erratum to: Past review, current progress, and challenges ahead on the cocktail party problem.
Frontiers Inf. Technol. Electron. Eng.
Yanmin Qian, Chao Weng, Xuankai Chang, Shuai Wang, Dong Yu
2018 A conf
Monaural Multi-Talker Speech Recognition with Attention Mechanism and Gated Convolutional Networks.
INTERSPEECH
Xuankai Chang, Yanmin Qian, Dong Yu
2018 J jnl
Past review, current progress, and challenges ahead on the cocktail party problem.
Frontiers Inf. Technol. Electron. Eng.
Yanmin Qian, Chao Weng, Xuankai Chang, Shuai Wang, Dong Yu
2018 J jnl
Single-channel multi-talker speech recognition with permutation invariant training.
Speech Commun.
Yanmin Qian, Xuankai Chang, Dong Yu
2017 A conf
Recognizing Multi-Talker Speech with Permutation Invariant Training.
INTERSPEECH
Dong Yu, Xuankai Chang, Yanmin Qian
2017 J jnl
Recognizing Multi-talker Speech with Permutation Invariant Training.
CoRR
Dong Yu, Xuankai Chang, Yanmin Qian
2017 J jnl
Single-Channel Multi-talker Speech Recognition with Permutation Invariant Training.
CoRR
Yanmin Qian, Xuankai Chang, Dong Yu
2016 A conf
Unrestricted Vocabulary Keyword Spotting Using LSTM-CTC.
INTERSPEECH
Yimeng Zhuang, Xuankai Chang, Yanmin Qian, Kai Yu