Shinji Watanabe

1003 papers A* 19A 170B 3C 51Misc 162Journal 477Unranked 109

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	ADEPT: RL-Aligned Agentic Decoding of Emotion via Evidence Probing Tools - From Consensus Learning to Ambiguity-Driven Emotion Reasoning. CoRR Esther Sun, Bo-Hao Su, Abinay Reddy Naini, Shinji Watanabe, Carlos Busso
2026	J	`jnl`	An Empirical Recipe for Universal Phone Recognition. CoRR Shikhar Bharadwaj, Chin-Jou Li, Kwanghee Choi, Eunjung Yeo, William Chen, Shinji Watanabe, David R. Mortensen
2026	J	`jnl`	An end-to-end integration of speech separation and recognition with self-supervised learning representation. Comput. Speech Lang. Yoshiki Masuyama, Xuankai Chang, Wangyou Zhang, Samuele Cornell, Zhong-Qiu Wang, Nobutaka Ono, Yanmin Qian, Shinji Watanabe
2026	J	`jnl`	AudioChat: Unified Audio Storytelling, Editing, and Understanding with Transfusion Forcing. CoRR William Chen, Prem Seetharaman, Rithesh Kumar, Oriol Nieto, Shinji Watanabe, Justin Salamon, Zeyu Jin
2026	—	`conf`	BSCodec: A Band-Split Neural Codec for High-Quality Universal Audio Reconstruction. EACL (Findings) Haoran Wang, Jiatong Shi, Jinchuan Tian, Bohan Li, Kai Yu, Shinji Watanabe
2026	J	`jnl`	Bagpiper: Solving Open-Ended Audio Tasks via Rich Captions. CoRR Jinchuan Tian, Haoran Wang, Bo-Hao Su, Chien-yu Huang, Qingzheng Wang, Jiatong Shi, William Chen, Xun Gong, Siddhant Arora, Chin-Jou Li, Masao Someki, Takashi Maekaku, Keita Goto, Yusuke Shinohara, Jin Sakuma, Chao-Han Huck Yang, Shinji Watanabe
2026	J	`jnl`	CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASR. CoRR Muhammad Shakeel, Yosuke Fukumoto, Chikara Maeda, Chyi-Jiunn Lin, Shinji Watanabe
2026	—	`conf`	CSPB: Conversational Speech Processing Benchmark for Self-supervised Speech Models. EACL (Volume 1: Long Papers) Zili Huang, Matthew Maciejewski, Leibny Paola García-Perera, Shinji Watanabe, Sanjeev Khudanpur
2026	J	`jnl`	Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Tasks. CoRR Shih-Heng Wang, Jiatong Shi, Jinchuan Tian, Haibin Wu, Shinji Watanabe
2026	J	`jnl`	ICASSP 2026 URGENT Speech Enhancement Challenge. CoRR Chenda Li, Wei Wang, Marvin Sach, Wangyou Zhang, Kohei Saijo, Samuele Cornell, Yihui Fu, Zhaoheng Ni, Tim Fingscheidt, Shinji Watanabe, Yanmin Qian
2026	J	`jnl`	LALM-as-a-Judge: Benchmarking Large Audio-Language Models for Safety Evaluation in Multi-Turn Spoken Dialogues. CoRR Amir Ivry, Shinji Watanabe
2026	J	`jnl`	Online Register for Dual-Mode Self-Supervised Speech Models: Mitigating The Lack of Future Context. CoRR Keita Goto, Takashi Maekaku, Jin Sakuma, Jinchuan Tian, Yusuke Shinohara, Shinji Watanabe
2026	J	`jnl`	Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedback. CoRR Siddhant Arora, Jinchuan Tian, Jiatong Shi, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2026	J	`jnl`	PRiSM: Benchmarking Phone Realization in Speech Models. CoRR Shikhar Bharadwaj, Chin-Jou Li, Yoonjae Kim, Kwanghee Choi, Eunjung Yeo, Ryan Soh-Eun Shim, Hanyu Zhou, Brendon Boldt, Karen Rosero Jacome, Kalvin Chang, Darsh Agrawal, Keer Xu, Chao-Han Huck Yang, Jian Zhu, Shinji Watanabe, David R. Mortensen
2026	J	`jnl`	Phonological Tokenizer: Prosody-Aware Phonetic Token via Multi-Objective Fine-Tuning with Differentiable K-Means. CoRR Kentaro Onda, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2026	J	`jnl`	Recent trends in distant conversational speech recognition: A review of CHiME-7 and 8 DASR challenges. Comput. Speech Lang. Samuele Cornell, Christoph Boeddeker, Taejin Park, He Huang, Desh Raj, Matthew Wiesner, Yoshiki Masuyama, Xuankai Chang, Zhongqiu Wang, Stefano Squartini, Paola García, Shinji Watanabe
2026	J	`jnl`	SSVD-O: Parameter-Efficient Fine-Tuning with Structured SVD for Speech Recognition. CoRR Pu Wang, Shinji Watanabe, Hugo Van hamme
2026	J	`jnl`	Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception. CoRR Zhen Wan, Chao-Han Huck Yang, Jinchuan Tian, Hanrong Ye, Ankita Pasad, Szu-Wei Fu, Arushi Goel, Ryo Hachiuma, Shizhe Diao, Kunal Dhawan, Sreyan Ghosh, Yusuke Hirota, Zhehuai Chen, Rafael Valle, Ehsan Hosseini-Asl, Chenhui Chu, Shinji Watanabe, Yu-Chiang Frank Wang, Boris Ginsburg
2026	J	`jnl`	TMT: Tri-Modal Translation Between Speech, Image, and Text by Processing Different Modalities as Different Languages. IEEE Trans. Multim. Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
2026	J	`jnl`	The CMU-AIST submission for the ICME 2025 Audio Encoder Challenge. CoRR Shikhar Bharadwaj, Samuele Cornell, Kwanghee Choi, Hye-jin Shim, Soham Deshmukh, Satoru Fukayama, Shinji Watanabe
2026	J	`jnl`	UrgentMOS: Unified Multi-Metric and Preference Learning for Robust Speech Quality Assessment. CoRR Wei Wang, Wangyou Zhang, Chenda Li, Jiahe Wang, Samuele Cornell, Marvin Sach, Kohei Saijo, Yihui Fu, Zhaoheng Ni, Bing Han, Xun Gong, Mengxiao Bi, Tim Fingscheidt, Shinji Watanabe, Yanmin Qian
2026	J	`jnl`	Which Data Matter? Embedding-Based Data Selection for Speech Recognition. CoRR Zakaria Aldeneh, Skyler Seto, Maureen de Seyssel, Jie Chi, Zijin Gu, Takuya Higuchi, Jee-weon Jung, Shinji Watanabe, David Grangier, Barry-John Theobald, Tatiana Likhomanenko
2026	J	`jnl`	Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metrics. CoRR Naohiro Tawara, Samuele Cornell, Alexander Polok, Marc Delcroix, Lukás Burget, Shinji Watanabe
2025	J	`jnl`	ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation. CoRR Jiatong Shi, Yifan Cheng, Bo-Hao Su, Hye-jin Shim, Jinchuan Tian, Samuele Cornell, Yiwen Zhao, Siddhant Arora, Shinji Watanabe
2025	C	`conf`	AURA: Agent for Understanding, Reasoning, and Automated Tool Use in Voice-Driven Tasks. ASRU Leander Melroy Maben, Gayathri Ganesh Lakshmy, Srijith Radhakrishnan, Siddhant Arora, Shinji Watanabe
2025	J	`jnl`	AURA: Agent for Understanding, Reasoning, and Automated Tool Use in Voice-Driven Tasks. CoRR Leander Melroy Maben, Gayathri Ganesh Lakshmy, Srijith Radhakrishnan, Siddhant Arora, Shinji Watanabe
2025	J	`jnl`	Adapting Speech Language Model to Singing Voice Synthesis. CoRR Yiwen Zhao, Jiatong Shi, Jinchuan Tian, Yuxun Tang, Jiarui Hai, Jionghao Han, Shinji Watanabe
2025	—	`conf`	Aligning Text-to-Music Evaluation with Human Preferences. ISMIR Yichen Huang, Zachary Novack, Koichi Saito, Jiatong Shi, Shinji Watanabe, Yuki Mitsufuji, John Thickstun, Chris Donahue
2025	J	`jnl`	Aligning Text-to-Music Evaluation with Human Preferences. CoRR Yichen Huang, Zachary Novack, Koichi Saito, Jiatong Shi, Shinji Watanabe, Yuki Mitsufuji, John Thickstun, Chris Donahue
2025	J	`jnl`	BLAB: Brutally Long Audio Bench. CoRR Orevaoghene Ahia, Martijn Bartelds, Kabir Ahuja, Hila Gonen, Valentin Hofmann, Siddhant Arora, Shuyue Stella Li, Vishal Puttagunta, Mofetoluwa Adeyemi, Charishma Buchireddy, Ben Walls, Noah Bennett, Shinji Watanabe, Noah A. Smith, Yulia Tsvetkov, Sachin Kumar
2025	J	`jnl`	Benchmarking Training Paradigms, Dataset Composition, and Model Scaling for Child ASR in ESPnet. CoRR Anyu Ying, Natarajan Balaji Shankar, Chyi-Jiunn Lin, Mohan Shi, Pu Wang, Hye-jin Shim, Siddhant Arora, Hugo Van hamme, Abeer Alwan, Shinji Watanabe
2025	Misc	`conf`	Bridging Speech and Text Foundation Models with ReShape Attention. ICASSP Takatomo Kano, Atsunori Ogawa, Marc Delcroix, William Chen, Ryo Fukuda, Kohei Matsuura, Takanori Ashihara, Shinji Watanabe
2025	A	`conf`	CS-FLEURS: A Massively Multilingual and Code-Switched Speech Dataset. INTERSPEECH Brian Yan, Injy Hamed, Shuichiro Shimizu, Vasista Sai Lodagala, William Chen, Olga Iakovenko, Bashar Talafha, Amir Hussein, Alexander Polok, Kalvin Chang, Dominik Klement, Sara Althubaiti, Puyuan Peng, Matthew Wiesner, Thamar Solorio, Ahmed Ali, Sanjeev Khudanpur, Shinji Watanabe
2025	J	`jnl`	CS-FLEURS: A Massively Multilingual and Code-Switched Speech Dataset. CoRR Brian Yan, Injy Hamed, Shuichiro Shimizu, Vasista Sai Lodagala, William Chen, Olga Iakovenko, Bashar Talafha, Amir Hussein, Alexander Polok, Kalvin Chang, Dominik Klement, Sara Althubaiti, Puyuan Peng, Matthew Wiesner, Thamar Solorio, Ahmed Ali, Sanjeev Khudanpur, Shinji Watanabe, Chih-Chen Chen, Zhen Wu, Karim Benharrak, Anuj Diwan, Samuele Cornell, Eunjung Yeo, Kwanghee Choi, Carlos Carvalho, Karen Rosero
2025	J	`jnl`	CartoonSing: Unifying Human and Nonhuman Timbres in Singing Generation. CoRR Jionghao Han, Jiatong Shi, Zhuoyan Tao, Yuxun Tang, Yiwen Zhao, Gus Xia, Shinji Watanabe
2025	J	`jnl`	Chain-of-Thought Reasoning in Streaming Full-Duplex End-to-End Spoken Dialogue Systems. CoRR Siddhant Arora, Jinchuan Tian, Hayato Futami, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025	A	`conf`	Chain-of-Thought Training for Open E2E Spoken Dialogue Systems. INTERSPEECH Siddhant Arora, Jinchuan Tian, Hayato Futami, Jee-weon Jung, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025	J	`jnl`	Chain-of-Thought Training for Open E2E Spoken Dialogue Systems. CoRR Siddhant Arora, Jinchuan Tian, Hayato Futami, Jee-weon Jung, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025	A	`conf`	Context-Driven Dynamic Pruning for Large Speech Foundation Models. INTERSPEECH Masao Someki, Shikhar Bharadwaj, Atharva Anand Joshi, Chyi-Jiunn Lin, Jinchuan Tian, Jee-weon Jung, Markus Müller, Nathan Susanj, Jing Liu, Shinji Watanabe
2025	A*	`conf`	Context-aware Dynamic Pruning for Speech Foundation Models. ICLR Masao Someki, Yifan Peng, Siddhant Arora, Markus Müller, Athanasios Mouchtaris, Grant P. Strimel, Jing Liu, Shinji Watanabe
2025	C	`conf`	Continual Pre-training for Codec-Based Speech LLMs: Balancing Understanding and Generation. ASRU Jiatong Shi, Chunlei Zhang, Jinchuan Tian, Junrui Ni, Hao Zhang, Shinji Watanabe, Dong Yu
2025	J	`jnl`	DYNAC: Dynamic Vocabulary based Non-Autoregressive Contextualization for Speech Recognition. CoRR Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025	A	`conf`	DYNAC: Dynamic Vocabulary-based Non-Autoregressive Contextualization for Speech Recognition. INTERSPEECH Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025	A	`conf`	DiceHuBERT: Distilling HuBERT with a Self-Supervised Learning Objective. INTERSPEECH Hyung-Gun Chi, Zakaria Aldeneh, Tatiana Likhomanenko, Oggi Rudovic, Takuya Higuchi, Li-Wei Chen, Shinji Watanabe, Ahmed Hussen Abdelaziz
2025	J	`jnl`	DiceHuBERT: Distilling HuBERT with a Self-Supervised Learning Objective. CoRR Hyung-Gun Chi, Zakaria Aldeneh, Tatiana Likhomanenko, Oggi Rudovic, Takuya Higuchi, Li-Wei Chen, Shinji Watanabe, Ahmed Hussen Abdelaziz
2025	A	`conf`	Differentiable K-means for Fully-optimized Discrete Token-based ASR. INTERSPEECH Kentaro Onda, Yosuke Kashiwagi, Emiru Tsunoo, Hayato Futami, Shinji Watanabe
2025	J	`jnl`	Differentiable K-means for Fully-optimized Discrete Token-based ASR. CoRR Kentaro Onda, Yosuke Kashiwagi, Emiru Tsunoo, Hayato Futami, Shinji Watanabe
2025	J	`jnl`	Discrete Audio Tokens: More Than a Survey! CoRR Pooneh Mousavi, Gallil Maimon, Adel Moumen, Darius Petermann, Jiatong Shi, Haibin Wu, Haici Yang, Anastasia Kuznetsova, Artem Ploujnikov, Ricard Marxer, Bhuvana Ramabhadran, Benjamin Elizalde, Loren Lugosch, Jinyu Li, Cem Subakan, Philip C. Woodland, Minje Kim, Hung-yi Lee, Shinji Watanabe, Yossi Adi, Mirco Ravanelli
2025	J	`jnl`	Discrete Audio Tokens: More Than a Survey! Trans. Mach. Learn. Res. Pooneh Mousavi, Gallil Maimon, Adel Moumen, Darius Petermann, Jiatong Shi, Haibin Wu, Haici Yang, Anastasia Kuznetsova, Artem Ploujnikov, Ricard Marxer, Bhuvana Ramabhadran, Benjamin Elizalde, Loren Lugosch, Jinyu Li, Cem Subakan, Philip C. Woodland, Minje Kim, Hung-yi Lee, Shinji Watanabe, Yossi Adi, Mirco Ravanelli
2025	—	`conf`	Discrete Speech Unit Extraction via Independent Component Analysis. ICASSP Workshops Tomohiko Nakamura, Kwanghee Choi, Keigo Hojo, Yoshiaki Bando, Satoru Fukayama, Shinji Watanabe
2025	J	`jnl`	Discrete Speech Unit Extraction via Independent Component Analysis. CoRR Tomohiko Nakamura, Kwanghee Choi, Keigo Hojo, Yoshiaki Bando, Satoru Fukayama, Shinji Watanabe
2025	—	`conf`	ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems. NAACL (System Demonstrations) Siddhant Arora, Yifan Peng, Jiatong Shi, Jinchuan Tian, William Chen, Shikhar Bharadwaj, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shuichiro Shimizu, Vaibhav Srivastav, Shinji Watanabe
2025	J	`jnl`	ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems. CoRR Siddhant Arora, Yifan Peng, Jiatong Shi, Jinchuan Tian, William Chen, Shikhar Bharadwaj, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shuichiro Shimizu, Vaibhav Srivastav, Shinji Watanabe
2025	—	`conf`	ESPnet-SpeechLM: An Open Speech Language Model Toolkit. NAACL (System Demonstrations) Jinchuan Tian, Jiatong Shi, William Chen, Siddhant Arora, Yoshiki Masuyama, Takashi Maekaku, Yihan Wu, Junyi Peng, Shikhar Bharadwaj, Yiwen Zhao, Samuele Cornell, Yifan Peng, Xiang Yue, Chao-Han Huck Yang, Graham Neubig, Shinji Watanabe
2025	J	`jnl`	ESPnet-SpeechLM: An Open Speech Language Model Toolkit. CoRR Jinchuan Tian, Jiatong Shi, William Chen, Siddhant Arora, Yoshiki Masuyama, Takashi Maekaku, Yihan Wu, Junyi Peng, Shikhar Bharadwaj, Yiwen Zhao, Samuele Cornell, Yifan Peng, Xiang Yue, Chao-Han Huck Yang, Graham Neubig, Shinji Watanabe
2025	—	`conf`	Enabling Internationalization of Affective Speech Technology Using LLMs. APSIPA Bo-Hao Su, Shinji Watanabe, Chi-Chun Lee
2025	A*	`conf`	Enhancing Audiovisual Speech Recognition Through Bifocal Preference Optimization. AAAI Yihan Wu, Yichen Lu, Yifan Peng, Xihua Wang, Ruihua Song, Shinji Watanabe
2025	C	`conf`	Evaluating Self-Supervised Speech Models Via Text-Based LLMs. ASRU Takashi Maekaku, Keita Goto, Jinchuan Tian, Yusuke Shinohara, Shinji Watanabe
2025	J	`jnl`	Evaluating Self-Supervised Speech Models via Text-Based LLMS. CoRR Takashi Maekaku, Keita Goto, Jinchuan Tian, Yusuke Shinohara, Shinji Watanabe
2025	A	`conf`	Explainable Depression Detection using Masked Hard Instance Mining. INTERSPEECH Patawee Prakrankamanant, Shinji Watanabe, Ekapol Chuangsuwanich
2025	J	`jnl`	Explainable Depression Detection using Masked Hard Instance Mining. CoRR Patawee Prakrankamanant, Shinji Watanabe, Ekapol Chuangsuwanich
2025	A	`conf`	Exploring Linear Variant Transformers and k-NN Memory Inference for Long-Form ASR. INTERSPEECH Carlos Carvalho, Jinchuan Tian, William Chen, Yifan Peng, Alberto Abad, Shinji Watanabe
2025	Misc	`conf`	Exploring Prediction Targets in Masked Pre-Training for Speech Foundation Models. ICASSP Li-Wei Chen, Takuya Higuchi, He Bai, Ahmed Hussen Abdelaziz, Shinji Watanabe, Alexander Rudnicky, Tatiana Likhomanenko, Barry-John Theobald, Zakaria Aldeneh
2025	A	`conf`	GALAXY: A Large-Scale Open-Domain Dataset for Multimodal Learning. INTERSPEECH Yihan Wu, Yichen Lu, Yijing Chen, Jiaqi Song, William Chen, Ruihua Song, Shinji Watanabe
2025	C	`conf`	Geolocation-Aware Robust Spoken Language Identification. ASRU Qingzheng Wang, Hye-jin Shim, Jiancheng Sun, Shinji Watanabe
2025	J	`jnl`	Geolocation-Aware Robust Spoken Language Identification. CoRR Qingzheng Wang, Hye-jin Shim, Jiancheng Sun, Shinji Watanabe
2025	J	`jnl`	Guest Editorial: IEEE JSTSP Special Issue on Deep Multimodal Speech Enhancement and Separation (DEMSES). IEEE J. Sel. Top. Signal Process. Amir Hussain, Yu Tsao, John H. L. Hansen, Naomi Harte, Shinji Watanabe, Isabel Trancoso, Shixiong Zhang
2025	Misc	`conf`	Hypothesis Clustering and Merging: Novel MultiTalker Speech Recognition with Speaker Tokens. ICASSP Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2025	Misc	`conf`	Improving Multilingual ASR in the Wild Using Simple N-best Re-ranking. ICASSP Brian Yan, Vineel Pratap, Shinji Watanabe, Michael Auli
2025	A	`conf`	Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC. INTERSPEECH Qingzheng Wang, Jiancheng Sun, Yifan Peng, Shinji Watanabe
2025	J	`jnl`	Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC. CoRR Qingzheng Wang, Jiancheng Sun, Yifan Peng, Shinji Watanabe
2025	C	`conf`	Improving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment. ASRU Wei Wang, Wangyou Zhang, Chenda Li, Jaitong Shi, Shinji Watanabe, Yanmin Qian
2025	J	`jnl`	Improving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment. CoRR Wei Wang, Wangyou Zhang, Chenda Li, Jiatong Shi, Shinji Watanabe, Yanmin Qian
2025	A	`conf`	Interspeech 2025 URGENT Speech Enhancement Challenge. INTERSPEECH Kohei Saijo, Wangyou Zhang, Samuele Cornell, Robin Scheibler, Chenda Li, Zhaoheng Ni, Anurag Kumar, Marvin Sach, Yihui Fu, Wei Wang, Tim Fingscheidt, Shinji Watanabe
2025	Misc	`conf`	Investigation of Spatial Self-Supervised Learning and Its Application to Target Speaker Speech Recognition. ICASSP Yoshiaki Bando, Samuele Cornell, Satoru Fukayama, Shinji Watanabe
2025	Misc	`conf`	LIMMITS'25: Multilingual Streaming TTS With Neural Codecs for Indian Languages. ICASSP Philipp Olbrich, Hema A. Murthy, Pranaw Kumar, Shinji Watanabe, Sheng Zhao, Mark Hasegawa-Johnson
2025	—	`conf`	Learning Robust Spatial Representations from Binaural Audio through Feature Distillation. WASPAA Holger Severin Bovbjerg, Jan Østergaard, Jesper Jensen, Shinji Watanabe, Zheng-Hua Tan
2025	J	`jnl`	Learning Robust Spatial Representations from Binaural Audio through Feature Distillation. CoRR Holger Severin Bovbjerg, Jan Østergaard, Jesper Jensen, Shinji Watanabe, Zheng-Hua Tan
2025	C	`conf`	Less is More: Data Curation Matters in Scaling Speech Enhancement. ASRU Chenda Li, Wangyou Zhang, Wei Wang, Robin Scheibler, Kohei Saijo, Samuele Cornell, Yihui Fu, Marvin Sach, Zhaoheng Ni, Anurag Kumar, Tim Fingscheidt, Shinji Watanabe, Yanmin Qian
2025	J	`jnl`	Less is More: Data Curation Matters in Scaling Speech Enhancement. CoRR Chenda Li, Wangyou Zhang, Wei Wang, Robin Scheibler, Kohei Saijo, Samuele Cornell, Yihui Fu, Marvin Sach, Zhaoheng Ni, Anurag Kumar, Tim Fingscheidt, Shinji Watanabe, Yanmin Qian
2025	A	`conf`	Lessons Learned from the URGENT 2024 Speech Enhancement Challenge. INTERSPEECH Wangyou Zhang, Kohei Saijo, Samuele Cornell, Robin Scheibler, Chenda Li, Zhaoheng Ni, Anurag Kumar, Marvin Sach, Wei Wang, Yihui Fu, Shinji Watanabe, Tim Fingscheidt, Yanmin Qian
2025	J	`jnl`	Lessons Learned from the URGENT 2024 Speech Enhancement Challenge. CoRR Wangyou Zhang, Kohei Saijo, Samuele Cornell, Robin Scheibler, Chenda Li, Zhaoheng Ni, Anurag Kumar, Marvin Sach, Wei Wang, Yihui Fu, Shinji Watanabe, Tim Fingscheidt, Yanmin Qian
2025	—	`conf`	Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessment. NAACL (Long Papers) Kwanghee Choi, Eunjung Yeo, Kalvin Chang, Shinji Watanabe, David R. Mortensen
2025	J	`jnl`	Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessment. CoRR Kwanghee Choi, Eunjung Yeo, Kalvin Chang, Shinji Watanabe, David R. Mortensen
2025	J	`jnl`	Low-Resource Audio Codec (LRAC): 2025 Challenge Description. CoRR Kamil Wójcicki, Yusuf Ziya Isik, Laura Lechler, Mansur Yesilbursa, Ivana Balic, Wolfgang Mack, Rafal Laganowski, Guoqing Zhang, Yossi Adi, Minje Kim, Shinji Watanabe
2025	J	`jnl`	MAPSS: Manifold-based Assessment of Perceptual Source Separation. CoRR Amir Ivry, Samuele Cornell, Shinji Watanabe
2025	J	`jnl`	Music Arena: Live Evaluation for Text-to-Music. CoRR Yonghyun Kim, Wayne Chi, Anastasios N. Angelopoulos, Wei-Lin Chiang, Koichi Saito, Shinji Watanabe, Yuki Mitsufuji, Chris Donahue
2025	A*	`conf`	OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models. ICML William Chen, Jinchuan Tian, Yifan Peng, Brian Yan, Chao-Han Huck Yang, Shinji Watanabe
2025	J	`jnl`	OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models. CoRR William Chen, Jinchuan Tian, Yifan Peng, Brian Yan, Chao-Han Huck Yang, Shinji Watanabe
2025	A	`conf`	OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning. INTERSPEECH Yifan Peng, Muhammad Shakeel, Yui Sudo, William Chen, Jinchuan Tian, Chyi-Jiunn Lin, Shinji Watanabe
2025	J	`jnl`	OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning. CoRR Yifan Peng, Muhammad Shakeel, Yui Sudo, William Chen, Jinchuan Tian, Chyi-Jiunn Lin, Shinji Watanabe
2025	J	`jnl`	On The Landscape of Spoken Language Models: A Comprehensive Survey. CoRR Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien, Yifan Peng, Haibin Wu, Yossi Adi, Emmanuel Dupoux, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025	J	`jnl`	On The Landscape of Spoken Language Models: A Comprehensive Survey. Trans. Mach. Learn. Res. Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien, Yifan Peng, Haibin Wu, Yossi Adi, Emmanuel Dupoux, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025	A	`conf`	On-device Streaming Discrete Speech Units. INTERSPEECH Kwanghee Choi, Masao Someki, Emma Strubell, Shinji Watanabe
2025	J	`jnl`	On-device Streaming Discrete Speech Units. CoRR Kwanghee Choi, Masao Someki, Emma Strubell, Shinji Watanabe
2025	—	`conf`	OpenBEATs: A Fully Open-Source General-Purpose Audio Encoder. WASPAA Shikhar Bharadwaj, Samuele Cornell, Kwanghee Choi, Satoru Fukayama, Hye-jin Shim, Soham Deshmukh, Shinji Watanabe
2025	J	`jnl`	OpenBEATs: A Fully Open-Source General-Purpose Audio Encoder. CoRR Shikhar Bharadwaj, Samuele Cornell, Kwanghee Choi, Satoru Fukayama, Hye-jin Shim, Soham Deshmukh, Shinji Watanabe
2025	A	`conf`	OpusLM: A Family of Open Unified Speech Language Models. INTERSPEECH Jinchuan Tian, William Chen, Yifan Peng, Jiatong Shi, Siddhant Arora, Shikhar Bharadwaj, Takashi Maekaku, Yusuke Shinohara, Keita Goto, Xiang Yue, Huck Yang, Shinji Watanabe
2025	J	`jnl`	OpusLM: A Family of Open Unified Speech Language Models. CoRR Jinchuan Tian, William Chen, Yifan Peng, Jiatong Shi, Siddhant Arora, Shikhar Bharadwaj, Takashi Maekaku, Yusuke Shinohara, Keita Goto, Xiang Yue, Huck Yang, Shinji Watanabe
2025	J	`jnl`	POWSM: A Phonetic Open Whisper-Style Speech Foundation Model. CoRR Chin-Jou Li, Kalvin Chang, Shikhar Bharadwaj, Eunjung Yeo, Kwanghee Choi, Jian Zhu, David R. Mortensen, Shinji Watanabe
2025	C	`conf`	PURE Codec: Progressive Unfolding of Residual Entropy for Speech Codec Learning. ASRU Jiatong Shi, Haoran Wang, William Chen, Chenda Li, Wangyou Zhang, Jinchuan Tian, Shinji Watanabe
2025	J	`jnl`	PURE Codec: Progressive Unfolding of Residual Entropy for Speech Codec Learning. CoRR Jiatong Shi, Haoran Wang, William Chen, Chenda Li, Wangyou Zhang, Jinchuan Tian, Shinji Watanabe
2025	—	`conf`	Phoneme-Grapheme Dictionary-Based Prompting for Robust Proper Noun Recognition in Japanese ASR. APSIPA Ryuga Sugano, Hiroaki Sato, Asahi Sakuma, Tadashi Kumano, Yoshihiko Kawai, Shinji Watanabe
2025	A	`conf`	Pick and Summarize: Integrating Extractive and Abstractive Speech Summarization. INTERSPEECH Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Ryo Fukuda, William Chen, Shinji Watanabe
2025	Misc	`conf`	Preference Alignment Improves Language Model-Based TTS. ICASSP Jinchuan Tian, Chunlei Zhang, Jiatong Shi, Hao Zhang, Jianwei Yu, Shinji Watanabe, Dong Yu
2025	J	`jnl`	Recent Trends in Distant Conversational Speech Recognition: A Review of CHiME-7 and 8 DASR Challenges. CoRR Samuele Cornell, Christoph Boeddeker, Taejin Park, He Huang, Desh Raj, Matthew Wiesner, Yoshiki Masuyama, Xuankai Chang, Zhongqiu Wang, Stefano Squartini, Paola García, Shinji Watanabe
2025	C	`conf`	Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty. ASRU Yiwen Zhao, Jiatong Shi, Yuxun Tang, William Chen, Shinji Watanabe
2025	J	`jnl`	Robust Training of Singing Voice Synthesis Using Prior and Posterior Uncertainty. CoRR Yiwen Zhao, Jiatong Shi, Yuxun Tang, William Chen, Shinji Watanabe
2025	C	`conf`	SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASR. ASRU Pu Wang, Shinji Watanabe, Hugo Van hamme
2025	J	`jnl`	SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASR. CoRR Pu Wang, Shinji Watanabe, Hugo Van hamme
2025	A	`conf`	Scalable Spontaneous Speech Dataset (SSSD): Crowdsourcing Data Collection to Promote Dialogue Research. INTERSPEECH Zaid Sheikh, Shuichiro Shimizu, Siddhant Arora, Jiatong Shi, Samuele Cornell, Xinjian Li, Shinji Watanabe
2025	A	`conf`	Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs. INTERSPEECH Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Yuki Ito, Hassan Shahmohammadi, Siddhant Arora, Shinji Watanabe
2025	J	`jnl`	Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs. CoRR Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Yuki Ito, Hassan Shahmohammadi, Siddhant Arora, Shinji Watanabe
2025	J	`jnl`	SingingSDS: A Singing-Capable Spoken Dialogue System for Conversational Roleplay Applications. CoRR Jionghao Han, Jiatong Shi, Masao Someki, Yuxun Tang, Lan Liu, Yiwen Zhao, Wenhao Feng, Shinji Watanabe
2025	Misc	`conf`	Speaker-IPL: Unsupervised Learning of Speaker Characteristics with i-Vector based Pseudo-Labels. ICASSP Zakaria Aldeneh, Takuya Higuchi, Jee-weon Jung, Li-Wei Chen, Stephen Shum, Ahmed Hussen Abdelaziz, Shinji Watanabe, Tatiana Likhomanenko, Barry-John Theobald
2025	J	`jnl`	Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play. CoRR Jiatong Shi, Jionghao Han, Yichen Lu, Santiago Pascual, Pengfei Wu, Chenye Cui, Shinji Watanabe, Chao Weng, Cong Zhou
2025	J	`jnl`	SpeechIQ: Speech Intelligence Quotient Across Cognitive Levels in Voice Understanding Large Language Models. CoRR Zhen Wan, Chao-Han Huck Yang, Yahan Yu, Jinchuan Tian, Sheng Li, Ke Hu, Zhehuai Chen, Shinji Watanabe, Fei Cheng, Chenhui Chu, Sadao Kurohashi
2025	—	`conf`	SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models. ACL (1) Zhen Wan, Chao-Han Huck Yang, Yahan Yu, Jinchuan Tian, Sheng Li, Ke Hu, Zhehuai Chen, Shinji Watanabe, Fei Cheng, Chenhui Chu, Sadao Kurohashi
2025	C	`conf`	Spiralformer: Low Latency Encoder for Streaming Speech Recognition with Circular Layer Skipping and Early Exiting. ASRU Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2025	J	`jnl`	Spiralformer: Low Latency Encoder for Streaming Speech Recognition with Circular Layer Skipping and Early Exiting. CoRR Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2025	J	`jnl`	Stream RAG: Instant and Accurate Spoken Dialogue Systems with Streaming Tool Usage. CoRR Siddhant Arora, Haidar Khan, Kai Sun, Xin Luna Dong, Sajal Choudhary, Seungwhan Moon, Xinyuan Zhang, Adithya Sagar, Surya Teja Appini, Kaushik Patnaik, Sanat Sharma, Shinji Watanabe, Anuj Kumar, Ahmed Aly, Yue Liu, Florian Metze, Zhaojiang Lin
2025	C	`conf`	Streaming Endpointer for Spoken Dialogue using Neural Audio Codecs and Label-Delayed Training. ASRU Sathvik Udupa, Shinji Watanabe, Petr Schwarz, Jan Cernocký
2025	J	`jnl`	Streaming Endpointer for Spoken Dialogue using Neural Audio Codecs and Label-Delayed Training. CoRR Sathvik Udupa, Shinji Watanabe, Petr Schwarz, Jan Cernocký
2025	A*	`conf`	Summarizing Speech: A Comprehensive Survey. EMNLP Fabian Retkowski, Maike Züfle, Andreas Sudmann, Dinah Pfau, Shinji Watanabe, Jan Niehues, Alexander Waibel
2025	J	`jnl`	TAVID: Text-Driven Audio-Visual Interactive Dialogue Generation. CoRR Ji-Hoon Kim, Junseok Ahn, Doyeop Kwak, Joon Son Chung, Shinji Watanabe
2025	A*	`conf`	Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics. ICLR Siddhant Arora, Zhiyun Lu, Chung-Cheng Chiu, Ruoming Pang, Shinji Watanabe
2025	J	`jnl`	Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics. CoRR Siddhant Arora, Zhiyun Lu, Chung-Cheng Chiu, Ruoming Pang, Shinji Watanabe
2025	A	`conf`	The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties. INTERSPEECH William Chen, Chutong Meng, Jiatong Shi, Martijn Bartelds, Shih-Heng Wang, Hsiu-Hsuan Wang, Rafael Mosquera, Sara Hincapie, Dan Jurafsky, Antonis Anastasopoulos, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025	J	`jnl`	The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties. CoRR William Chen, Chutong Meng, Jiatong Shi, Martijn Bartelds, Shih-Heng Wang, Hsiu-Hsuan Wang, Rafael Mosquera, Sara Hincapie, Dan Jurafsky, Antonis Anastasopoulos, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025	A	`conf`	The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition. INTERSPEECH Ming Gao, Shilong Wu, Hang Chen, Jun Du, Chin-Hui Lee, Shinji Watanabe, Jingdong Chen, Sabato Marco Siniscalchi, Odette Scharenborg
2025	J	`jnl`	The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition. CoRR Ming Gao, Shilong Wu, Hang Chen, Jun Du, Chin-Hui Lee, Shinji Watanabe, Jingdong Chen, Sabato Marco Siniscalchi, Odette Scharenborg
2025	A	`conf`	The Text-to-speech in the Wild (TITW) Database. INTERSPEECH Jee-weon Jung, Wangyou Zhang, Soumi Maiti, Yihan Wu, Xin Wang, Ji-Hoon Kim, Yuta Matsunaga, Seyun Um, Jinchuan Tian, Hye-jin Shim, Nicholas W. D. Evans, Joon Son Chung, Shinnosuke Takamichi, Shinji Watanabe
2025	J	`jnl`	UALM: Unified Audio Language Model for Understanding, Generation and Reasoning. CoRR Jinchuan Tian, Sang-gil Lee, Zhifeng Kong, Sreyan Ghosh, Arushi Goel, Chao-Han Huck Yang, Wenliang Dai, Zihan Liu, Hanrong Ye, Shinji Watanabe, Mohammad Shoeybi, Bryan Catanzaro, Rafael Valle, Wei Ping
2025	C	`conf`	URGENT-PK: Perceptually-Aligned Ranking Model Designed for Speech Enhancement Competition. ASRU Jiahe Wang, Chenda Li, Wei Wang, Wangyou Zhang, Samuele Cornell, Marvin Sach, Robin Scheibler, Kohei Saijo, Yihui Fu, Zhaoheng Ni, Anurag Kumar, Tim Fingscheidt, Shinji Watanabe, Yanmin Qian
2025	J	`jnl`	URGENT-PK: Perceptually-Aligned Ranking Model Designed for Speech Enhancement Competition. CoRR Jiahe Wang, Chenda Li, Wei Wang, Wangyou Zhang, Samuele Cornell, Marvin Sach, Robin Scheibler, Kohei Saijo, Yihui Fu, Zhaoheng Ni, Anurag Kumar, Tim Fingscheidt, Shinji Watanabe, Yanmin Qian
2025	A	`conf`	Uni-VERSA: Versatile Speech Assessment with a Unified Network. INTERSPEECH Jiatong Shi, Hye-jin Shim, Shinji Watanabe
2025	J	`jnl`	Uni-VERSA: Versatile Speech Assessment with a Unified Network. CoRR Jiatong Shi, Hye-jin Shim, Shinji Watanabe
2025	C	`conf`	Unifying Diarization, Separation, and ASR with Multi-Speaker Encoder. ASRU Muhammad Shakeel, Yui Sudo, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025	J	`jnl`	Unifying Diarization, Separation, and ASR with Multi-Speaker Encoder. CoRR Muhammad Shakeel, Yui Sudo, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025	C	`conf`	VERSA-v2: A Modular and Scalable Toolkit for Speech and Audio Evaluation with Expanded Metrics, Visualization, and LLM Integration. ASRU Jiatong Shi, Bo-Hao Su, Shikhar Bharadwaj, Yiwen Zhao, Shih-Heng Wang, Jionghao Hang, Haoran Wang, Wei Wang, Wenhao Feng, Yuxun Tang, Nezih Topaloglu, Siddhant Arora, Jinchuan Tian, William Chen, Hye-jin Shim, Wangyou Zhang, Wen-Chin Huang, Shinji Watanabe
2025	—	`conf`	VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music. NAACL (System Demonstrations) Jiatong Shi, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, Shinji Watanabe
2025	—	`conf`	VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning. NAACL (Long Papers) Yifan Peng, Krishna C. Puvvada, Zhehuai Chen, Piotr Zelasko, He Huang, Kunal Dhawan, Ke Hu, Shinji Watanabe, Jagadeesh Balam, Boris Ginsburg
2024	J	`jnl`	4D ASR: Joint Beam Search Integrating CTC, Attention, Transducer, and Mask Predict Decoders. CoRR Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Brian Yan, Jiatong Shi, Yifan Peng, Shinji Watanabe
2024	J	`jnl`	A Large-Scale Evaluation of Speech Foundation Models. CoRR Shu-Wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
2024	J	`jnl`	A Large-Scale Evaluation of Speech Foundation Models. IEEE ACM Trans. Audio Speech Lang. Process. Shu-Wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
2024	A*	`conf`	AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. AAAI Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Yuexian Zou, Zhou Zhao, Shinji Watanabe
2024	Misc	`conf`	AugSumm: Towards Generalizable Speech Summarization Using Synthetic Labels from Large Language Models. ICASSP Jee-weon Jung, Roshan S. Sharma, William Chen, Bhiksha Raj, Shinji Watanabe
2024	J	`jnl`	AugSumm: towards generalizable speech summarization using synthetic labels from large language model. CoRR Jee-weon Jung, Roshan S. Sharma, William Chen, Bhiksha Raj, Shinji Watanabe
2024	A	`conf`	Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement. INTERSPEECH Wangyou Zhang, Kohei Saijo, Jee-weon Jung, Chenda Li, Shinji Watanabe, Yanmin Qian
2024	J	`jnl`	Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement. CoRR Wangyou Zhang, Kohei Saijo, Jee-weon Jung, Chenda Li, Shinji Watanabe, Yanmin Qian
2024	J	`jnl`	Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofing. CoRR Hye-jin Shim, Md. Sahidullah, Jee-weon Jung, Shinji Watanabe, Tomi Kinnunen
2024	Misc	`conf`	Boosting Unknown-Number Speaker Separation with Transformer Decoder-Based Attractor. ICASSP Younglo Lee, Shukjae Choi, Byeong-Yeol Kim, Zhongqiu Wang, Shinji Watanabe
2024	J	`jnl`	Boosting Unknown-number Speaker Separation with Transformer Decoder-based Attractor. CoRR Younglo Lee, Shukjae Choi, Byeong-Yeol Kim, Zhong-Qiu Wang, Shinji Watanabe
2024	J	`jnl`	CMU's IWSLT 2024 Simultaneous Speech Translation System. CoRR Xi Xu, Siqi Ouyang, Brian Yan, Patrick Fernandes, William Chen, Lei Li, Graham Neubig, Shinji Watanabe
2024	A	`conf`	Can you Remove the Downstream Model for Speaker Recognition with Self-Supervised Speech Features? INTERSPEECH Zakaria Aldeneh, Takuya Higuchi, Jee-weon Jung, Skyler Seto, Tatiana Likhomanenko, Stephen Shum, Ahmed Hussen Abdelaziz, Shinji Watanabe, Barry-John Theobald
2024	J	`jnl`	Can you Remove the Downstream Model for Speaker Recognition with Self-Supervised Speech Features? CoRR Zakaria Aldeneh, Takuya Higuchi, Jee-weon Jung, Skyler Seto, Tatiana Likhomanenko, Stephen Shum, Ahmed Hussen Abdelaziz, Shinji Watanabe, Barry-John Theobald
2024	J	`jnl`	Codec-SUPERB @ SLT 2024: A lightweight benchmark for neural audio codec models. CoRR Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-Wei Chang, Jiawei Du, Ke-Han Lu, Alexander H. Liu, Ho-Lam Chung, Yuan-Kuei Wu, Dongchao Yang, Songxiang Liu, Yi-Chiao Wu, Xu Tan, James R. Glass, Shinji Watanabe, Hung-yi Lee
2024	—	`conf`	Codec-Superb @ SLT 2024: A Lightweight Benchmark For Neural Audio Codec Models. SLT Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-Wei Chang, Jiawei Du, Ke-Han Lu, Alexander H. Liu, Ho-Lam Chung, Yuan-Kuei Wu, Dongchao Yang, Songxiang Liu, Yi-Chiao Wu, Xu Tan, James R. Glass, Shinji Watanabe, Hung-yi Lee
2024	Misc	`conf`	Contextualized Automatic Speech Recognition With Attention-Based Bias Phrase Boosted Beam Search. ICASSP Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Yifan Peng, Shinji Watanabe
2024	—	`conf`	Contextualized Automatic Speech Recognition With Dynamic Vocabulary. SLT Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Shinji Watanabe
2024	J	`jnl`	Contextualized Automatic Speech Recognition with Attention-Based Bias Phrase Boosted Beam Search. CoRR Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Yifan Peng, Shinji Watanabe
2024	J	`jnl`	Contextualized Automatic Speech Recognition with Dynamic Vocabulary. CoRR Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Shinji Watanabe
2024	A	`conf`	Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss. INTERSPEECH Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024	J	`jnl`	Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss. CoRR Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024	A	`conf`	Convolution-Augmented Parameter-Efficient Fine-Tuning for Speech Recognition. INTERSPEECH Kwangyoun Kim, Suwon Shon, Yi-Te Hsu, Prashant Sridhar, Karen Livescu, Shinji Watanabe
2024	Misc	`conf`	Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing. ICASSP Brian Yan, Xuankai Chang, Antonios Anastasopoulos, Yuya Fujita, Shinji Watanabe
2024	A*	`conf`	Cross-Talk Reduction. IJCAI Zhong-Qiu Wang, Anurag Kumar, Shinji Watanabe
2024	J	`jnl`	Cross-Talk Reduction. CoRR Zhong-Qiu Wang, Anurag Kumar, Shinji Watanabe
2024	A	`conf`	Decoder-only Architecture for Streaming End-to-end Speech Recognition. INTERSPEECH Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2024	J	`jnl`	Decoder-only Architecture for Streaming End-to-end Speech Recognition. CoRR Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2024	J	`jnl`	Deep Speech Synthesis from Multimodal Articulatory Representations. CoRR Peter Wu, Bohan Yu, Kevin Scheck, Alan W. Black, Aditi S. Krishnapriyan, Irene Y. Chen, Tanja Schultz, Shinji Watanabe, Gopala Krishna Anumanchipalli
2024	—	`conf`	Diffusion-Based Generative Modeling With Discriminative Guidance for Streamable Speech Enhancement. SLT Chenda Li, Samuele Cornell, Shinji Watanabe, Yanmin Qian
2024	J	`jnl`	Diffusion-based Generative Modeling with Discriminative Guidance for Streamable Speech Enhancement. CoRR Chenda Li, Samuele Cornell, Shinji Watanabe, Yanmin Qian
2024	A	`conf`	DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding. INTERSPEECH Suwon Shon, Kwangyoun Kim, Yi-Te Hsu, Prashant Sridhar, Shinji Watanabe, Karen Livescu
2024	J	`jnl`	DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding. CoRR Suwon Shon, Kwangyoun Kim, Yi-Te Hsu, Prashant Sridhar, Shinji Watanabe, Karen Livescu
2024	J	`jnl`	Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. CoRR Chien-yu Huang, Wei-Chih Chen, Shu-Wen Yang, Andy T. Liu, Chen-An Li, Yu-Xiang Lin, Wei-Cheng Tseng, Anuj Diwan, Yi-Jen Shih, Jiatong Shi, William Chen, Xuanjun Chen, Chi-Yuan Hsiao, Puyuan Peng, Shih-Heng Wang, Chun-Yi Kuan, Ke-Han Lu, Kai-Wei Chang, Chih-Kai Yang, Fabian Ritter Gutierrez, Ming To Chuang, Kuan-Po Huang, Siddhant Arora, You-Kuan Lin, Eunjung Yeo, Kalvin Chang, Chung-Ming Chien, Kwanghee Choi, Cheng-Hsiu Hsieh, Yi-Cheng Lin, Chee-En Yu, I-Hsiang Chiu, Heitor R. Guimarães, Jionghao Han, Tzu-Quan Lin, Tzu-Yuan Lin, Homu Chang, Ting-Wu Chang, Chun Wei Chen, Shou-Jen Chen, Yu-Hua Chen, Hsi-Chun Cheng, Kunal Dhawan, Jia-Lin Fang, Shi-Xin Fang, Kuan-Yu Fang Chiang, Chi An Fu, Hsien-Fu Hsiao, Ching Yu Hsu, Shao-Syuan Huang, Lee Chen Wei, Hsi-Che Lin, Hsuan-Hao Lin, Hsuan-Ting Lin, Jian-Ren Lin, Ting-Chun Liu, Li-Chun Lu, Tsung-Min Pai, Ankita Pasad, Shih-Yun Shan Kuan, Suwon Shon, Yuxun Tang, Yun-Shao Tsai, Jui-Chiang Wei, Tzu-Chieh Wei, Chengxi Wu, Dien-Ruei Wu, Chao-Han Huck Yang, Chieh-Chi Yang, Jia Qi Yip, Shao-Xiang Yuan, Vahid Noroozi, Zhehuai Chen, Haibin Wu, Karen Livescu, David Harwath, Shinji Watanabe, Hung-yi Lee
2024	Misc	`conf`	Dynamic-Superb: Towards a Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark For Speech. ICASSP Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
2024	A	`conf`	EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation. INTERSPEECH Julius Richter, Yi-Chiao Wu, Steven Krenn, Simon Welker, Bunlong Lay, Shinji Watanabe, Alexander Richard, Timo Gerkmann
2024	J	`jnl`	EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation. CoRR Julius Richter, Yi-Chiao Wu, Steven Krenn, Simon Welker, Bunlong Lay, Shinji Watanabe, Alexander Richard, Timo Gerkmann
2024	A	`conf`	EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios. INTERSPEECH Tejes Srivastava, Jiatong Shi, William Chen, Shinji Watanabe
2024	—	`conf`	ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs For Audio, Music, and Speech. SLT Jiatong Shi, Jinchuan Tian, Yihan Wu, Jee-weon Jung, Jia Qi Yip, Yoshiki Masuyama, William Chen, Yuning Wu, Yuxun Tang, Massa Baali, Dareen Alharthi, Dong Zhang, Ruifan Deng, Tejes Srivastava, Haibin Wu, Alexander H. Liu, Bhiksha Raj, Qin Jin, Ruihua Song, Shinji Watanabe
2024	J	`jnl`	ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speech. CoRR Jiatong Shi, Jinchuan Tian, Yihan Wu, Jee-weon Jung, Jia Qi Yip, Yoshiki Masuyama, William Chen, Yuning Wu, Yuxun Tang, Massa Baali, Dareen Alharthi, Dong Zhang, Ruifan Deng, Tejes Srivastava, Haibin Wu, Alexander H. Liu, Bhiksha Raj, Qin Jin, Ruihua Song, Shinji Watanabe
2024	—	`conf`	ESPnet-EZ: Python-Only ESPnet For Easy Fine-Tuning And Integration. SLT Masao Someki, Kwanghee Choi, Siddhant Arora, William Chen, Samuele Cornell, Jionghao Han, Yifan Peng, Jiatong Shi, Vaibhav Srivastav, Shinji Watanabe
2024	J	`jnl`	ESPnet-EZ: Python-only ESPnet for Easy Fine-tuning and Integration. CoRR Masao Someki, Kwanghee Choi, Siddhant Arora, William Chen, Samuele Cornell, Jionghao Han, Yifan Peng, Jiatong Shi, Vaibhav Srivastav, Shinji Watanabe
2024	A	`conf`	ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models. INTERSPEECH Jee-weon Jung, Wangyou Zhang, Jiatong Shi, Zakaria Aldeneh, Takuya Higuchi, Alex Gichamba, Barry-John Theobald, Ahmed Hussen Abdelaziz, Shinji Watanabe
2024	J	`jnl`	ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models. CoRR Jee-weon Jung, Wangyou Zhang, Jiatong Shi, Zakaria Aldeneh, Takuya Higuchi, Barry-John Theobald, Ahmed Hussen Abdelaziz, Shinji Watanabe
2024	J	`jnl`	End-to-End Speech Recognition: A Survey. IEEE ACM Trans. Audio Speech Lang. Process. Rohit Prabhavalkar, Takaaki Hori, Tara N. Sainath, Ralf Schlüter, Shinji Watanabe
2024	J	`jnl`	Enhancing Audiovisual Speech Recognition through Bifocal Preference Optimization. CoRR Yihan Wu, Yichen Lu, Yifan Peng, Xihua Wang, Ruihua Song, Shinji Watanabe
2024	Misc	`conf`	Enhancing End-to-End Conversational Speech Translation Through Target Language Context Utilization. ICASSP Amir Hussein, Brian Yan, Antonios Anastasopoulos, Shinji Watanabe, Sanjeev Khudanpur
2024	J	`jnl`	Evaluating and Improving Continual Learning in Spoken Language Understanding. CoRR Muqiao Yang, Xiang Li, Umberto Cappellazzo, Shinji Watanabe, Bhiksha Raj
2024	J	`jnl`	Exploring Prediction Targets in Masked Pre-Training for Speech Foundation Models. CoRR Li-Wei Chen, Takuya Higuchi, He Bai, Ahmed Hussen Abdelaziz, Alexander Rudnicky, Shinji Watanabe, Tatiana Likhomanenko, Barry-John Theobald, Zakaria Aldeneh
2024	Misc	`conf`	Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study. ICASSP Xuankai Chang, Brian Yan, Kwanghee Choi, Jee-weon Jung, Yichen Lu, Soumi Maiti, Roshan S. Sharma, Jiatong Shi, Jinchuan Tian, Shinji Watanabe, Yuya Fujita, Takashi Maekaku, Pengcheng Guo, Yao-Fei Cheng, Pavel Denisov, Kohei Saijo, Hsiu-Hsuan Wang
2024	—	`conf`	FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model. EMNLP (Industry Track) Yichen Lu, Jiaqi Song, Chao-Han Huck Yang, Shinji Watanabe
2024	J	`jnl`	FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model. CoRR Yichen Lu, Jiaqi Song, Chao-Han Huck Yang, Shinji Watanabe
2024	A	`conf`	Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model. INTERSPEECH Hayato Futami, Siddhant Arora, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2024	J	`jnl`	Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model. CoRR Hayato Futami, Siddhant Arora, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2024	J	`jnl`	Findings of the IWSLT 2024 Evaluation Campaign. CoRR Ibrahim Said Ahmad, Antonios Anastasopoulos, Ondrej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, William Chen, Qianqian Dong, Marcello Federico, Barry Haddow, Dávid Javorský, Mateusz Krubinski, Tsz Kin Lam, Xutai Ma, Prashant Mathur, Evgeny Matusov, Chandresh Maurya, John P. McCrae, Kenton Murray, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, Atul Kr. Ojha, John E. Ortega, Sara Papi, Peter Polák, Adam Pospísil, Pavel Pecina, Elizabeth Salesky, Nivedita Sethiya, Balaram Sarkar, Jiatong Shi, Claytone Sikasote, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Brian Thompson, Marco Turchi, Alex Waibel, Shinji Watanabe, Patrick Wilken, Petr Zemánek, Rodolfo Zevallos
2024	—	`conf`	Floras 50: A Massively Multilingual Multitask Benchmark for Long-Form Conversational Speech. SLT William Chen, Brian Yan, Chih-Chen Chen, Shinji Watanabe
2024	—	`conf`	Fusion Of Discrete Representations and Self-Augmented Representations for Multilingual Automatic Speech Recognition. SLT Shih-Heng Wang, Jiatong Shi, Chien-yu Huang, Shinji Watanabe, Hung-yi Lee
2024	J	`jnl`	Fusion of Discrete Representations and Self-Augmented Representations for Multilingual Automatic Speech Recognition. CoRR Shih-Heng Wang, Jiatong Shi, Chien-yu Huang, Shinji Watanabe, Hung-yi Lee
2024	J	`jnl`	Generating Data with Text-to-Speech and Large-Language Models for Conversational Speech Recognition. CoRR Samuele Cornell, Jordan Darefsky, Zhiyao Duan, Shinji Watanabe
2024	Misc	`conf`	Generative Context-Aware Fine-Tuning of Self-Supervised Speech Models. ICASSP Suwon Shon, Kwangyoun Kim, Prashant Sridhar, Yi-Te Hsu, Shinji Watanabe, Karen Livescu
2024	Misc	`conf`	Hubertopic: Enhancing Semantic Representation of Hubert Through Self-Supervision Utilizing Topic Model. ICASSP Takashi Maekaku, Jiatong Shi, Xuankai Chang, Yuya Fujita, Shinji Watanabe
2024	J	`jnl`	Hypothesis Clustering and Merging: Novel MultiTalker Speech Recognition with Speaker Tokens. CoRR Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2024	J	`jnl`	Improving ASR Contextual Biasing with Guided Attention. CoRR Jiyang Tang, Kwangyoun Kim, Suwon Shon, Felix Wu, Prashant Sridhar, Shinji Watanabe
2024	Misc	`conf`	Improving Audio Captioning Models with Fine-Grained Audio Features, Text Embedding Supervision, and LLM Mix-Up Augmentation. ICASSP Shih-Lun Wu, Xuankai Chang, Gordon Wichern, Jee-weon Jung, François G. Germain, Jonathan Le Roux, Shinji Watanabe
2024	J	`jnl`	Improving Design of Input Condition Invariant Speech Enhancement. CoRR Wangyou Zhang, Jee-weon Jung, Shinji Watanabe, Yanmin Qian
2024	J	`jnl`	Improving Multilingual ASR in the Wild Using Simple N-best Re-ranking. CoRR Brian Yan, Vineel Pratap, Shinji Watanabe, Michael Auli
2024	—	`conf`	Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation. ICASSP Workshops Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024	J	`jnl`	Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation. CoRR Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024	—	`conf`	Large Language Model Based Generative Error Correction: A Challenge and Baselines For Speech Recognition, Speaker Tagging, and Emotion Recognition. SLT Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li, Zhehuai Chen, Yen-Ting Lin, Chen Chen, Yuchen Hu, Kunal Dhawan, Piotr Zelasko, Chao Zhang, Yun-Nung Chen, Yu Tsao, Jagadeesh Balam, Boris Ginsburg, Sabato Marco Siniscalchi, Eng Siong Chng, Peter Bell, Catherine Lai, Shinji Watanabe, Andreas Stolcke
2024	J	`jnl`	Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition. CoRR Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li, Zhehuai Chen, Yen-Ting Lin, Chen Chen, Yuchen Hu, Kunal Dhawan, Piotr Zelasko, Chao Zhang, Yun-Nung Chen, Yu Tsao, Jagadeesh Balam, Boris Ginsburg, Sabato Marco Siniscalchi, Eng Siong Chng, Peter Bell, Catherine Lai, Shinji Watanabe, Andreas Stolcke
2024	Misc	`conf`	Less Peaky and More Accurate CTC Forced Alignment by Label Priors. ICASSP Ruizhe Huang, Xiaohui Zhang, Zhaoheng Ni, Li Sun, Moto Hira, Jeff Hwang, Vimal Manohar, Vineel Pratap, Matthew Wiesner, Shinji Watanabe, Daniel Povey, Sanjeev Khudanpur
2024	J	`jnl`	Less Peaky and More Accurate CTC Forced Alignment by Label Priors. CoRR Ruizhe Huang, Xiaohui Zhang, Zhaoheng Ni, Li Sun, Moto Hira, Jeff Hwang, Vimal Manohar, Vineel Pratap, Matthew Wiesner, Shinji Watanabe, Daniel Povey, Sanjeev Khudanpur
2024	J	`jnl`	MC-Whisper: Extending Speech Foundation Models to Multichannel Distant Speech Recognition. IEEE Signal Process. Lett. Xuankai Chang, Pengcheng Guo, Yuya Fujita, Takashi Maekaku, Shinji Watanabe
2024	A	`conf`	ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets. INTERSPEECH Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
2024	J	`jnl`	ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets. CoRR Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
2024	A	`conf`	MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model. INTERSPEECH Jiatong Shi, Xutai Ma, Hirofumi Inaguma, Anna Sun, Shinji Watanabe
2024	J	`jnl`	MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model. CoRR Jiatong Shi, Xutai Ma, Hirofumi Inaguma, Anna Y. Sun, Shinji Watanabe
2024	A	`conf`	MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels. INTERSPEECH Darshan Prabhu, Yifan Peng, Preethi Jyothi, Shinji Watanabe
2024	J	`jnl`	Module-Based End-to-End Distant Speech Processing: A case study of far-field automatic speech recognition [Special Issue On Model-Based and Data-Driven Audio Signal Processing]. IEEE Signal Process. Mag. Xuankai Chang, Shinji Watanabe, Marc Delcroix, Tsubasa Ochiai, Wangyou Zhang, Yanmin Qian
2024	J	`jnl`	Multi-Convformer: Extending Conformer with Multiple Convolution Kernels. CoRR Darshan Prabhu, Yifan Peng, Preethi Jyothi, Shinji Watanabe
2024	J	`jnl`	Music ControlNet: Multiple Time-Varying Controls for Music Generation. IEEE ACM Trans. Audio Speech Lang. Process. Shih-Lun Wu, Chris Donahue, Shinji Watanabe, Nicholas J. Bryan
2024	A*	`conf`	Muskits-ESPnet: A Comprehensive Toolkit for Singing Voice Synthesis in New Paradigm. ACM Multimedia Yuning Wu, Jiatong Shi, Yifeng Yu, Yuxun Tang, Tao Qian, Yueqian Lin, Jionghao Han, Xinyi Bai, Shinji Watanabe, Qin Jin
2024	J	`jnl`	Muskits-ESPnet: A Comprehensive Toolkit for Singing Voice Synthesis in New Paradigm. CoRR Yuning Wu, Jiatong Shi, Yifeng Yu, Yuxun Tang, Tao Qian, Yueqian Lin, Jionghao Han, Xinyi Bai, Shinji Watanabe, Qin Jin
2024	A	`conf`	Neural Blind Source Separation and Diarization for Distant Speech Recognition. INTERSPEECH Yoshiaki Bando, Tomohiko Nakamura, Shinji Watanabe
2024	J	`jnl`	Neural Blind Source Separation and Diarization for Distant Speech Recognition. CoRR Yoshiaki Bando, Tomohiko Nakamura, Shinji Watanabe
2024	A	`conf`	OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer. INTERSPEECH Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi, Xuankai Chang, Jee-weon Jung, Shinji Watanabe
2024	J	`jnl`	OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer. CoRR Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi, Xuankai Chang, Jee-weon Jung, Shinji Watanabe
2024	—	`conf`	OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification. ACL (1) Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2024	J	`jnl`	OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification. CoRR Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2024	A	`conf`	On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models. INTERSPEECH Jinchuan Tian, Yifan Peng, William Chen, Kwanghee Choi, Karen Livescu, Shinji Watanabe
2024	J	`jnl`	On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models. CoRR Jinchuan Tian, Yifan Peng, William Chen, Kwanghee Choi, Karen Livescu, Shinji Watanabe
2024	—	`conf`	On the Evaluation of Speech Foundation Models for Spoken Language Understanding. ACL (Findings) Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan S. Sharma, Jee-weon Jung, Hira Dhamyal, William Chen, Suwon Shon, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2024	J	`jnl`	On the Evaluation of Speech Foundation Models for Spoken Language Understanding. CoRR Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan S. Sharma, Jee-weon Jung, Hira Dhamyal, William Chen, Suwon Shon, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2024	Misc	`conf`	One Model to Rule Them All ? Towards End-to-End Joint Speaker Diarization and Speech Recognition. ICASSP Samuele Cornell, Jee-weon Jung, Shinji Watanabe, Stefano Squartini
2024	Misc	`conf`	PhISANet: Phonetically Informed Speech Animation Network. ICASSP Salvador Medina, Sarah L. Taylor, Carsten Stoll, Gareth Edwards, Alex Hauptmann, Shinji Watanabe, Iain A. Matthews
2024	Misc	`conf`	Phoneme-Aware Encoding for Prefix-Tree-Based Contextual ASR. ICASSP Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Hiroaki Ogawa, Siddhant Arora, Shinji Watanabe
2024	J	`jnl`	Preference Alignment Improves Language Model-Based TTS. CoRR Jinchuan Tian, Chunlei Zhang, Jiatong Shi, Hao Zhang, Jianwei Yu, Shinji Watanabe, Dong Yu
2024	A	`conf`	Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting. INTERSPEECH Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2024	J	`jnl`	Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting. CoRR Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2024	—	`conf`	Robust Audiovisual Speech Recognition Models with Mixture-of-Experts. SLT Yihan Wu, Yifan Peng, Yichen Lu, Xuankai Chang, Ruihua Song, Shinji Watanabe
2024	J	`jnl`	Robust Audiovisual Speech Recognition Models with Mixture-of-Experts. CoRR Yihan Wu, Yifan Peng, Yichen Lu, Xuankai Chang, Ruihua Song, Shinji Watanabe
2024	J	`jnl`	SQ-Whisper: Speaker-Querying based Whisper Model for Target-Speaker ASR. CoRR Pengcheng Guo, Xuankai Chang, Hang Lv, Shinji Watanabe, Lei Xie
2024	A	`conf`	Self-Supervised Speech Representations are More Phonetic than Semantic. INTERSPEECH Kwanghee Choi, Ankita Pasad, Tomohiko Nakamura, Satoru Fukayama, Karen Livescu, Shinji Watanabe
2024	J	`jnl`	Self-Supervised Speech Representations are More Phonetic than Semantic. CoRR Kwanghee Choi, Ankita Pasad, Tomohiko Nakamura, Satoru Fukayama, Karen Livescu, Shinji Watanabe
2024	A	`conf`	Self-training ASR Guided by Unsupervised ASR Teacher. INTERSPEECH Hyung Yong Kim, Byeong-Yeol Kim, Yunkyu Lim, Jihwan Park, Shukjae Choi, Yooncheol Ju, Jinseok Park, Youshin Lim, Seung Woo Yu, Hanbin Lee, Shinji Watanabe
2024	Misc	`conf`	Semi-Autoregressive Streaming ASR with Label Context. ICASSP Siddhant Arora, George Saon, Shinji Watanabe, Brian Kingsbury
2024	A	`conf`	Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSing. INTERSPEECH Jiatong Shi, Yueqian Lin, Xinyi Bai, Keyi Zhang, Yuning Wu, Yuxun Tang, Yifeng Yu, Qin Jin, Shinji Watanabe
2024	J	`jnl`	Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and KiSing-v2. CoRR Jiatong Shi, Yueqian Lin, Xinyi Bai, Keyi Zhang, Yuning Wu, Yuxun Tang, Yifeng Yu, Qin Jin, Shinji Watanabe
2024	J	`jnl`	Speaker-IPL: Unsupervised Learning of Speaker Characteristics with i-Vector based Pseudo-Labels. CoRR Zakaria Aldeneh, Takuya Higuchi, Jee-weon Jung, Li-Wei Chen, Stephen Shum, Ahmed Hussen Abdelaziz, Shinji Watanabe, Tatiana Likhomanenko, Barry-John Theobald
2024	Misc	`conf`	Speech Collage: Code-Switched Audio Generation by Collaging Monolingual Corpora. ICASSP Amir Hussein, Dorsa Zeinali, Ondrej Klejch, Matthew Wiesner, Brian Yan, Shammur Absar Chowdhury, Ahmed Ali, Shinji Watanabe, Sanjeev Khudanpur
2024	A	`conf`	SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics. INTERSPEECH Takaaki Saeki, Soumi Maiti, Shinnosuke Takamichi, Shinji Watanabe, Hiroshi Saruwatari
2024	J	`jnl`	SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics. CoRR Takaaki Saeki, Soumi Maiti, Shinnosuke Takamichi, Shinji Watanabe, Hiroshi Saruwatari
2024	J	`jnl`	SpeechComposer: Unifying Multiple Speech Tasks with Prompt Composition. CoRR Yihan Wu, Soumi Maiti, Yifan Peng, Wangyou Zhang, Chenda Li, Yuyue Wang, Xihua Wang, Shinji Watanabe, Ruihua Song
2024	J	`jnl`	SpoofCeleb: Speech Deepfake Detection and SASV In The Wild. CoRR Jee-weon Jung, Yihan Wu, Xin Wang, Ji-Hoon Kim, Soumi Maiti, Yuta Matsunaga, Hye-jin Shim, Jinchuan Tian, Nicholas W. D. Evans, Joon Son Chung, Wangyou Zhang, Seyun Um, Shinnosuke Takamichi, Shinji Watanabe
2024	—	`conf`	Summary on the Multimodal Information-Based Speech Processing (MISP) 2023 Challenge. ICASSP Workshops Hang Chen, Shilong Wu, Chenxi Wang, Jun Du, Chin-Hui Lee, Sabato Marco Siniscalchi, Shinji Watanabe, Jingdong Chen, Odette Scharenborg, Zhong-Qiu Wang, Bao-Cai Yin, Jia Pan
2024	J	`jnl`	SynesLM: A Unified Approach for Audio-visual Speech Recognition and Translation via Language Model and Synthetic Data. CoRR Yichen Lu, Jiaqi Song, Xuankai Chang, Hengwei Bian, Soumi Maiti, Shinji Watanabe
2024	J	`jnl`	TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages. CoRR Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
2024	J	`jnl`	Task Arithmetic for Language Expansion in Speech Translation. CoRR Yao-Fei Cheng, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Wen Shen Teo, Siddhant Arora, Shinji Watanabe
2024	J	`jnl`	Text-Inductive Graphone-Based Language Adaptation for Low-Resource Speech Synthesis. IEEE ACM Trans. Audio Speech Lang. Process. Takaaki Saeki, Soumi Maiti, Xinjian Li, Shinji Watanabe, Shinnosuke Takamichi, Hiroshi Saruwatari
2024	J	`jnl`	Text-To-Speech Synthesis In The Wild. CoRR Jee-weon Jung, Wangyou Zhang, Soumi Maiti, Yihan Wu, Xin Wang, Ji-Hoon Kim, Yuta Matsunaga, Seyun Um, Jinchuan Tian, Hye-jin Shim, Nicholas W. D. Evans, Joon Son Chung, Shinnosuke Takamichi, Shinji Watanabe
2024	J	`jnl`	The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization. CoRR Samuele Cornell, Taejin Park, Steve Huang, Christoph Böddeker, Xuankai Chang, Matthew Maciejewski, Matthew Wiesner, Paola García, Shinji Watanabe
2024	A	`conf`	The Interspeech 2024 Challenge on Speech Processing Using Discrete Units. INTERSPEECH Xuankai Chang, Jiatong Shi, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin
2024	J	`jnl`	The Interspeech 2024 Challenge on Speech Processing Using Discrete Units. CoRR Xuankai Chang, Jiatong Shi, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin
2024	A	`conf`	To what extent can ASV systems naturally defend against spoofing attacks? INTERSPEECH Jee-weon Jung, Xin Wang, Nicholas W. D. Evans, Shinji Watanabe, Hye-jin Shim, Hemlata Tak, Siddhant Arora, Junichi Yamagishi, Joon Son Chung
2024	J	`jnl`	To what extent can ASV systems naturally defend against spoofing attacks? CoRR Jee-weon Jung, Xin Wang, Nicholas W. D. Evans, Shinji Watanabe, Hye-jin Shim, Hemlata Tak, Sidhhant Arora, Junichi Yamagishi, Joon Son Chung
2024	Misc	`conf`	Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-Training and Multi-Modal Tokens. ICASSP Minsu Kim, Jeongsoo Choi, Soumi Maiti, Jeong Hun Yeo, Shinji Watanabe, Yong Man Ro
2024	A*	`conf`	Towards Robust Speech Representation Learning for Thousands of Languages. EMNLP William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
2024	J	`jnl`	Towards Robust Speech Representation Learning for Thousands of Languages. CoRR William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
2024	Misc	`conf`	Train Long and Test Long: Leveraging Full Document Contexts in Speech Processing. ICASSP William Chen, Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Shinji Watanabe
2024	A	`conf`	URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement. INTERSPEECH Wangyou Zhang, Robin Scheibler, Kohei Saijo, Samuele Cornell, Chenda Li, Zhaoheng Ni, Jan Pirklbauer, Marvin Sach, Shinji Watanabe, Tim Fingscheidt, Yanmin Qian
2024	J	`jnl`	URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement. CoRR Wangyou Zhang, Robin Scheibler, Kohei Saijo, Samuele Cornell, Chenda Li, Zhaoheng Ni, Anurag Kumar, Jan Pirklbauer, Marvin Sach, Shinji Watanabe, Tim Fingscheidt, Yanmin Qian
2024	Misc	`conf`	Understanding Probe Behaviors Through Variational Bounds of Mutual Information. ICASSP Kwanghee Choi, Jee-weon Jung, Shinji Watanabe
2024	—	`conf`	UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions. NAACL-HLT Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan S. Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Karen Livescu, Shinji Watanabe
2024	J	`jnl`	VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music. CoRR Jiatong Shi, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, Shinji Watanabe
2024	J	`jnl`	VISinger2+: End-to-End Singing Voice Synthesis Augmented by Self-Supervised Learning Representation. CoRR Yifeng Yu, Jiatong Shi, Yuning Wu, Shinji Watanabe
2024	—	`conf`	Visinger2+: End-to-End Singing Voice Synthesis Augmented by Self-Supervised Learning Representation. SLT Yifeng Yu, Jiatong Shi, Yuning Wu, Yuxun Tang, Shinji Watanabe
2024	Misc	`conf`	Visual Speech Recognition for Languages with Limited Labeled Data Using Automatic Labels from Whisper. ICASSP Jeong Hun Yeo, Minsu Kim, Shinji Watanabe, Yong Man Ro
2024	J	`jnl`	VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning. CoRR Yifan Peng, Krishna C. Puvvada, Zhehuai Chen, Piotr Zelasko, He Huang, Kunal Dhawan, Ke Hu, Shinji Watanabe, Jagadeesh Balam, Boris Ginsburg
2024	Misc	`conf`	VoxMM: Rich Transcription of Conversations in the Wild. ICASSP Doyeop Kwak, Jaemin Jung, Kihyun Nam, Youngjoon Jang, Jee-weon Jung, Shinji Watanabe, Joon Son Chung
2024	Misc	`conf`	VoxtLM: Unified Decoder-Only Models for Consolidating Speech Recognition, Synthesis and Speech, Text Continuation Tasks. ICASSP Soumi Maiti, Yifan Peng, Shukjae Choi, Jee-weon Jung, Xuankai Chang, Shinji Watanabe
2024	—	`conf`	Wav2Gloss: Generating Interlinear Glossed Text from Speech. ACL (1) Taiqi He, Kwanghee Choi, Lindia Tjuatja, Nathaniel R. Robinson, Jiatong Shi, Shinji Watanabe, Graham Neubig, David R. Mortensen, Lori S. Levin
2024	J	`jnl`	Wav2Gloss: Generating Interlinear Glossed Text from Speech. CoRR Taiqi He, Kwanghee Choi, Lindia Tjuatja, Nathaniel R. Robinson, Jiatong Shi, Shinji Watanabe, Graham Neubig, David R. Mortensen, Lori S. Levin
2024	J	`jnl`	YODAS: Youtube-Oriented Dataset for Audio and Speech. CoRR Xinjian Li, Shinnosuke Takamichi, Takaaki Saeki, William Chen, Sayaka Shiota, Shinji Watanabe
2023	A	`conf`	4D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoders. INTERSPEECH Yui Sudo, Muhammad Shakeel, Brian Yan, Jiatong Shi, Shinji Watanabe
2023	A	`conf`	A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks. INTERSPEECH Yifan Peng, Kwangyoun Kim, Felix Wu, Brian Yan, Siddhant Arora, William Chen, Jiyang Tang, Suwon Shon, Prashant Sridhar, Shinji Watanabe
2023	J	`jnl`	A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks. CoRR Yifan Peng, Kwangyoun Kim, Felix Wu, Brian Yan, Siddhant Arora, William Chen, Jiyang Tang, Suwon Shon, Prashant Sridhar, Shinji Watanabe
2023	A	`conf`	A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning. INTERSPEECH Jiyang Tang, William Chen, Xuankai Chang, Shinji Watanabe, Brian MacWhinney
2023	J	`jnl`	A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning. CoRR Jiyang Tang, William Chen, Xuankai Chang, Shinji Watanabe, Brian MacWhinney
2023	C	`conf`	A Single Speech Enhancement Model Unifying Dereverberation, Denoising, Speaker Counting, Separation, And Extraction. ASRU Kohei Saijo, Wangyou Zhang, Zhong-Qiu Wang, Shinji Watanabe, Tetsunori Kobayashi, Tetsuji Ogawa
2023	J	`jnl`	A Single Speech Enhancement Model Unifying Dereverberation, Denoising, Speaker Counting, Separation, and Extraction. CoRR Kohei Saijo, Wangyou Zhang, Zhong-Qiu Wang, Shinji Watanabe, Tetsunori Kobayashi, Tetsuji Ogawa
2023	Misc	`conf`	A Study on the Integration of Pipeline and E2E SLU Systems for Spoken Semantic Parsing Toward Stop Quality Challenge. ICASSP Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023	J	`jnl`	A Study on the Integration of Pipeline and E2E SLU systems for Spoken Semantic Parsing toward STOP Quality Challenge. CoRR Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023	Misc	`conf`	A Unified One-Shot Prosody and Speaker Conversion System with Self-Supervised Discrete Speech Units. ICASSP Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky
2023	A*	`conf`	A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speech. AAAI Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky
2023	J	`jnl`	A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speech. CoRR Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky
2023	J	`jnl`	A dilemma of ground truth in noisy speech separation and an approach to lessen the impact of imperfect training data. Comput. Speech Lang. Matthew Maciejewski, Jing Shi, Shinji Watanabe, Sanjeev Khudanpur
2023	J	`jnl`	AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. CoRR Yuan Tseng, Layne Berry, Yi-Ting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Po-Yao Huang, Chun-Mao Lai, Shang-wen Li, David Harwath, Yu Tsao, Shinji Watanabe, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee
2023	Misc	`conf`	Align, Write, Re-Order: Explainable End-to-End Speech Translation via Operation Sequence Generation. ICASSP Motoi Omachi, Brian Yan, Siddharth Dalmia, Yuya Fujita, Shinji Watanabe
2023	Misc	`conf`	Articulatory Representation Learning via Joint Factor Analysis and Neural Matrix Factorization. ICASSP Jiachen Lian, Alan W. Black, Yijing Lu, Louis Goldstein, Shinji Watanabe, Gopala Krishna Anumanchipalli
2023	J	`jnl`	AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. CoRR Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Zhou Zhao, Shinji Watanabe
2023	Misc	`conf`	Avoid Overthinking in Self-Supervised Models for Speech Recognition. ICASSP Dan Berrebbi, Brian Yan, Shinji Watanabe
2023	A	`conf`	BASS: Block-wise Adaptation for Speech Summarization. INTERSPEECH Roshan Sharma, Siddhant Arora, Kenneth Zheng, Shinji Watanabe, Rita Singh, Bhiksha Raj
2023	J	`jnl`	BASS: Block-wise Adaptation for Speech Summarization. CoRR Roshan S. Sharma, Kenneth Zheng, Siddhant Arora, Shinji Watanabe, Rita Singh, Bhiksha Raj
2023	Misc	`conf`	BECTRA: Transducer-Based End-To-End ASR with Bert-Enhanced Encoder. ICASSP Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
2023	A*	`conf`	Bayes Risk CTC: Controllable CTC Alignment in Sequence-to-Sequence Tasks. ICLR Jinchuan Tian, Brian Yan, Jianwei Yu, Chao Weng, Dong Yu, Shinji Watanabe
2023	A	`conf`	Bayes Risk Transducer: Transducer with Controllable Alignment Prediction. INTERSPEECH Jinchuan Tian, Jianwei Yu, Hangting Chen, Brian Yan, Chao Weng, Dong Yu, Shinji Watanabe
2023	J	`jnl`	Bayes Risk Transducer: Transducer with Controllable Alignment Prediction. CoRR Jinchuan Tian, Jianwei Yu, Hangting Chen, Brian Yan, Chao Weng, Dong Yu, Shinji Watanabe
2023	Misc	`conf`	Bridging Speech and Textual Pre-Trained Models With Unsupervised ASR. ICASSP Jiatong Shi, Chan-Jan Hsu, Ho-Lam Chung, Dongji Gao, Paola García, Shinji Watanabe, Ann Lee, Hung-yi Lee
2023	—	`conf`	CMU's IWSLT 2023 Simultaneous Speech Translation System. IWSLT@ACL Brian Yan, Jiatong Shi, Soumi Maiti, William Chen, Xinjian Li, Yifan Peng, Siddhant Arora, Shinji Watanabe
2023	A	`conf`	CTC Alignments Improve Autoregressive Translation. EACL Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W. Black, Shinji Watanabe
2023	Misc	`conf`	Context-Aware Fine-Tuning of Self-Supervised Speech Models. ICASSP Suwon Shon, Felix Wu, Kwangyoun Kim, Prashant Sridhar, Karen Livescu, Shinji Watanabe
2023	J	`jnl`	Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing. CoRR Brian Yan, Xuankai Chang, Antonios Anastasopoulos, Yuya Fujita, Shinji Watanabe
2023	A	`conf`	DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models. INTERSPEECH Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2023	J	`jnl`	DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models. CoRR Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2023	J	`jnl`	Decoder-only Architecture for Speech Recognition with CTC Prompts and Text Data Augmentation. CoRR Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2023	A	`conf`	Deep Speech Synthesis from MRI-Based Articulatory Representations. INTERSPEECH Peter Wu, Tingle Li, Yijing Lu, Yubin Zhang, Jiachen Lian, Alan W. Black, Louis Goldstein, Shinji Watanabe, Gopala Krishna Anumanchipalli
2023	C	`conf`	Domain Adaptation by Data Distribution Matching Via Submodularity For Speech Recognition. ASRU Yusuke Shinohara, Shinji Watanabe
2023	J	`jnl`	Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech. CoRR Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
2023	Misc	`conf`	E-Branchformer-Based E2E SLU Toward Stop on-Device Challenge. ICASSP Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023	J	`jnl`	EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Multilingual and Low Resource Scenarios. CoRR Tejes Srivastava, Jiatong Shi, William Chen, Shinji Watanabe
2023	—	`conf`	ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. ACL (demo) Brian Yan, Jiatong Shi, Yun Tang, Hirofumi Inaguma, Yifan Peng, Siddharth Dalmia, Peter Polak, Patrick Fernandes, Dan Berrebbi, Tomoki Hayashi, Xiaohui Zhang, Zhaoheng Ni, Moto Hira, Soumi Maiti, Juan Pino, Shinji Watanabe
2023	A*	`conf`	Efficient Sequence Transduction by Jointly Predicting Tokens and Durations. ICML Hainan Xu, Fei Jia, Somshubra Majumdar, He Huang, Shinji Watanabe, Boris Ginsburg
2023	J	`jnl`	Efficient Sequence Transduction by Jointly Predicting Tokens and Durations. CoRR Hainan Xu, Fei Jia, Somshubra Majumdar, He Huang, Shinji Watanabe, Boris Ginsburg
2023	J	`jnl`	End-to-End Speech Recognition: A Survey. CoRR Rohit Prabhavalkar, Takaaki Hori, Tara N. Sainath, Ralf Schlüter, Shinji Watanabe
2023	J	`jnl`	Enhancing End-to-End Conversational Speech Translation Through Target Language Context Utilization. CoRR Amir Hussein, Brian Yan, Antonios Anastasopoulos, Shinji Watanabe, Sanjeev Khudanpur
2023	Misc	`conf`	Enhancing Speech-To-Speech Translation with Multiple TTS Targets. ICASSP Jiatong Shi, Yun Tang, Ann Lee, Hirofumi Inaguma, Changhan Wang, Juan Pino, Shinji Watanabe
2023	J	`jnl`	Enhancing Speech-to-Speech Translation with Multiple TTS Targets. CoRR Jiatong Shi, Yun Tang, Ann Lee, Hirofumi Inaguma, Changhan Wang, Juan Pino, Shinji Watanabe
2023	C	`conf`	Espnet-Summ: Introducing a Novel Large Dataset, Toolkit, and a Cross-Corpora Evaluation of Speech Summarization Systems. ASRU Roshan S. Sharma, William Chen, Takatomo Kano, Ruchira Sharma, Siddhant Arora, Shinji Watanabe, Atsunori Ogawa, Marc Delcroix, Rita Singh, Bhiksha Raj
2023	Misc	`conf`	Euro: Espnet Unsupervised ASR Open-Source Toolkit. ICASSP Dongji Gao, Jiatong Shi, Shun-Po Chuang, Leibny Paola García, Hung-yi Lee, Shinji Watanabe, Sanjeev Khudanpur
2023	A	`conf`	Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning. INTERSPEECH Xuankai Chang, Brian Yan, Yuya Fujita, Takashi Maekaku, Shinji Watanabe
2023	J	`jnl`	Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning. CoRR Xuankai Chang, Brian Yan, Yuya Fujita, Takashi Maekaku, Shinji Watanabe
2023	A	`conf`	Exploration on HuBERT with Multiple Resolution. INTERSPEECH Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, Shinji Watanabe
2023	J	`jnl`	Exploration on HuBERT with Multiple Resolutions. CoRR Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, Shinji Watanabe
2023	J	`jnl`	Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study. CoRR Xuankai Chang, Brian Yan, Kwanghee Choi, Jee-weon Jung, Yichen Lu, Soumi Maiti, Roshan S. Sharma, Jiatong Shi, Jinchuan Tian, Shinji Watanabe, Yuya Fujita, Takashi Maekaku, Pengcheng Guo, Yao-Fei Cheng, Pavel Denisov, Kohei Saijo, Hsiu-Hsuan Wang
2023	—	`conf`	Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation. WASPAA Yoshiki Masuyama, Xuankai Chang, Wangyou Zhang, Samuele Cornell, Zhong-Qiu Wang, Nobutaka Ono, Yanmin Qian, Shinji Watanabe
2023	J	`jnl`	Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation. CoRR Yoshiki Masuyama, Xuankai Chang, Wangyou Zhang, Samuele Cornell, Zhong-Qiu Wang, Nobutaka Ono, Yanmin Qian, Shinji Watanabe
2023	Misc	`conf`	FNeural Speech Enhancement with Very Low Algorithmic Latency and Complexity via Integrated full- and sub-band Modeling. ICASSP Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe
2023	Misc	`conf`	FindAdaptNet: Find and Insert Adapters by Learned Layer Importance. ICASSP Junwei Huang, Karthik Ganesan, Soumi Maiti, Young Min Kim, Xuankai Chang, Paul Liang, Shinji Watanabe
2023	J	`jnl`	Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond. CoRR Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chung, Xuankai Chang, Yuxun Tang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023	C	`conf`	Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond. ASRU Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chuang, Xuankai Chang, Yuxun Tang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023	—	`conf`	Findings of the IWSLT 2023 Evaluation Campaign. IWSLT@ACL Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondrej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, William Chen, Khalid Choukri, Alexandra Chronopoulou, Anna Currey, Thierry Declerck, Qianqian Dong, Kevin Duh, Yannick Estève, Marcello Federico, Souhir Gahbiche, Barry Haddow, Benjamin Hsu, Phu Mon Htut, Hirofumi Inaguma, Dávid Javorský, John Judge, Yasumasa Kano, Tom Ko, Rishu Kumar, Pengwei Li, Xutai Ma, Prashant Mathur, Evgeny Matusov, Paul McNamee, John P. McCrae, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Ha Nguyen, Jan Niehues, Xing Niu, Atul Kr. Ojha, John E. Ortega, Proyag Pal, Juan Pino, Lonneke van der Plas, Peter Polák, Elijah Rippeth, Elizabeth Salesky, Jiatong Shi, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Yun Tang, Brian Thompson, Kevin Tran, Marco Turchi, Alex Waibel, Mingxuan Wang, Shinji Watanabe, Rodolfo Zevallos
2023	Misc	`conf`	Fully Unsupervised Topic Clustering of Unlabelled Spoken Audio Using Self-Supervised Representation Learning and Topic Model. ICASSP Takashi Maekaku, Yuya Fujita, Xuankai Chang, Shinji Watanabe
2023	J	`jnl`	Generative Context-aware Fine-tuning of Self-supervised Speech Models. CoRR Suwon Shon, Kwangyoun Kim, Prashant Sridhar, Yi-Te Hsu, Shinji Watanabe, Karen Livescu
2023	J	`jnl`	HuBERTopic: Enhancing Semantic Representation of HuBERT through Self-supervision Utilizing Topic Model. CoRR Takashi Maekaku, Jiatong Shi, Xuankai Chang, Yuya Fujita, Shinji Watanabe
2023	Misc	`conf`	I3D: Transformer Architectures with Input-Dependent Dynamic Depth for Speech Recognition. ICASSP Yifan Peng, Jaesong Lee, Shinji Watanabe
2023	J	`jnl`	I3D: Transformer architectures with input-dependent dynamic depth for speech recognition. CoRR Yifan Peng, Jaesong Lee, Shinji Watanabe
2023	J	`jnl`	Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Supervision, and LLM Mix-up Augmentation. CoRR Shih-Lun Wu, Xuankai Chang, Gordon Wichern, Jee-weon Jung, François G. Germain, Jonathan Le Roux, Shinji Watanabe
2023	J	`jnl`	Improving Cascaded Unsupervised Speech Translation with Denoising Back-translation. CoRR Yu-Kuan Fu, Liang-Hsuan Tseng, Jiatong Shi, Chen-An Li, Tsu-Yuan Hsu, Shinji Watanabe, Hung-yi Lee
2023	J	`jnl`	Improving Massively Multilingual ASR With Auxiliary CTC Objectives. CoRR William Chen, Brian Yan, Jiatong Shi, Yifan Peng, Soumi Maiti, Shinji Watanabe
2023	Misc	`conf`	Improving Massively Multilingual ASR with Auxiliary CTC Objectives. ICASSP William Chen, Brian Yan, Jiatong Shi, Yifan Peng, Soumi Maiti, Shinji Watanabe
2023	J	`jnl`	Improving Speech Enhancement Performance by Leveraging Contextual Broad Phonetic Class Information. IEEE ACM Trans. Audio Speech Lang. Process. Yen-Ju Lu, Chia-Yu Chang, Cheng Yu, Ching-Feng Liu, Jeih-weih Hung, Shinji Watanabe, Yu Tsao
2023	Misc	`conf`	In Search of Strong Embedding Extractors for Speaker Diarisation. ICASSP Jee-weon Jung, Hee-Soo Heo, Bong-Jin Lee, Jaesung Huh, Andrew Brown, Youngki Kwon, Shinji Watanabe, Joon Son Chung
2023	A	`conf`	Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff. INTERSPEECH Peter Polák, Brian Yan, Shinji Watanabe, Alex Waibel, Ondrej Bojar
2023	J	`jnl`	Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff. CoRR Peter Polák, Brian Yan, Shinji Watanabe, Alex Waibel, Ondrej Bojar
2023	A	`conf`	Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding. INTERSPEECH Siddhant Arora, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023	J	`jnl`	Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding. CoRR Siddhant Arora, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023	A	`conf`	Integration of Frame- and Label-synchronous Beam Search for Streaming Encoder-decoder Speech Recognition. INTERSPEECH Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2023	J	`jnl`	Integration of Frame- and Label-synchronous Beam Search for Streaming Encoder-decoder Speech Recognition. CoRR Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2023	Misc	`conf`	Intermpl: Momentum Pseudo-Labeling With Intermediate CTC Loss. ICASSP Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
2023	Misc	`conf`	Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History. ICASSP Siddhant Arora, Hayato Futami, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023	J	`jnl`	Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History. CoRR Siddhant Arora, Hayato Futami, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023	C	`conf`	Joint Prediction and Denoising for Large-Scale Multilingual Self-Supervised Learning. ASRU William Chen, Jiatong Shi, Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, Shinji Watanabe
2023	J	`jnl`	Joint Prediction and Denoising for Large-scale Multilingual Self-supervised Learning. CoRR William Chen, Jiatong Shi, Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, Shinji Watanabe
2023	C	`conf`	LV-CTC: Non-Autoregressive ASR With CTC and Latent Variable Models. ASRU Yuya Fujita, Shinji Watanabe, Xuankai Chang, Takashi Maekaku
2023	A*	`conf`	Learning to Speak from Text: Zero-Shot Multilingual Text-to-Speech with Unsupervised Text Pretraining. IJCAI Takaaki Saeki, Soumi Maiti, Xinjian Li, Shinji Watanabe, Shinnosuke Takamichi, Hiroshi Saruwatari
2023	J	`jnl`	Learning to Speak from Text: Zero-Shot Multilingual Text-to-Speech with Unsupervised Text Pretraining. CoRR Takaaki Saeki, Soumi Maiti, Xinjian Li, Shinji Watanabe, Shinnosuke Takamichi, Hiroshi Saruwatari
2023	J	`jnl`	LegoNN: Building Modular Encoder-Decoder Models. IEEE ACM Trans. Audio Speech Lang. Process. Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
2023	A	`conf`	ML-SUPERB: Multilingual Speech Universal PERformance Benchmark. INTERSPEECH Jiatong Shi, Dan Berrebbi, William Chen, En-Pei Hu, Wei-Ping Huang, Ho-Lam Chung, Xuankai Chang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023	J	`jnl`	ML-SUPERB: Multilingual Speech Universal PERformance Benchmark. CoRR Jiatong Shi, Dan Berrebbi, William Chen, Ho-Lam Chung, En-Pei Hu, Wei-Ping Huang, Xuankai Chang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023	Misc	`conf`	Multi-Blank Transducers for Speech Recognition. ICASSP Hainan Xu, Fei Jia, Somshubra Majumdar, Shinji Watanabe, Boris Ginsburg
2023	Misc	`conf`	Multi-Channel Speaker Extraction with Adversarial Training: The Wavlab Submission to The Clarity ICASSP 2023 Grand Challenge. ICASSP Samuele Cornell, Zhong-Qiu Wang, Yoshiki Masuyama, Shinji Watanabe, Manuel Pariente, Nobutaka Ono, Stefano Squartini
2023	J	`jnl`	Multi-Channel Target Speaker Extraction with Refinement: The WavLab Submission to the Second Clarity Enhancement Challenge. CoRR Samuele Cornell, Zhong-Qiu Wang, Yoshiki Masuyama, Shinji Watanabe, Manuel Pariente, Nobutaka Ono
2023	—	`conf`	Multilingual TTS Accent Impressions for Accented ASR. TSD Georgios Karakasidis, Nathaniel R. Robinson, Yaroslav Getman, Atieno Ogayo, Ragheb Al-Ghezi, Ananya Ayasi, Shinji Watanabe, David R. Mortensen, Mikko Kurimo
2023	J	`jnl`	Music ControlNet: Multiple Time-varying Controls for Music Generation. CoRR Shih-Lun Wu, Chris Donahue, Shinji Watanabe, Nicholas J. Bryan
2023	J	`jnl`	Neural Speech Enhancement with Very Low Algorithmic Latency and Complexity via Integrated Full- and Sub-Band Modeling. CoRR Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe
2023	J	`jnl`	One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognition. CoRR Samuele Cornell, Jee-weon Jung, Shinji Watanabe, Stefano Squartini
2023	J	`jnl`	Online Neural Diarization of Unlimited Numbers of Speakers Using Global and Local Attractors. IEEE ACM Trans. Audio Speech Lang. Process. Shota Horiguchi, Shinji Watanabe, Paola García, Yuki Takashima, Yohei Kawaguchi
2023	J	`jnl`	PAAPLoss: A Phonetic-Aligned Acoustic Parameter Loss for Speech Enhancement. CoRR Muqiao Yang, Joseph Konan, David Bick, Yunyang Zeng, Shuo Han, Anurag Kumar, Shinji Watanabe, Bhiksha Raj
2023	Misc	`conf`	Paaploss: A Phonetic-Aligned Acoustic Parameter Loss for Speech Enhancement. ICASSP Muqiao Yang, Joseph Konan, David Bick, Yunyang Zeng, Shuo Han, Anurag Kumar, Shinji Watanabe, Bhiksha Raj
2023	J	`jnl`	Phoneme-aware Encoding for Prefix-tree-based Contextual ASR. CoRR Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Hiroaki Ogawa, Siddhant Arora, Shinji Watanabe
2023	A	`conf`	Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization. INTERSPEECH Puyuan Peng, Brian Yan, Shinji Watanabe, David Harwath
2023	J	`jnl`	Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization. CoRR Puyuan Peng, Brian Yan, Shinji Watanabe, David Harwath
2023	A	`conf`	Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute. INTERSPEECH William Chen, Xuankai Chang, Yifan Peng, Zhaoheng Ni, Soumi Maiti, Shinji Watanabe
2023	J	`jnl`	Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute. CoRR William Chen, Xuankai Chang, Yifan Peng, Zhaoheng Ni, Soumi Maiti, Shinji Watanabe
2023	C	`conf`	Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data. ASRU Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi, Siddhant Arora, William Chen, Roshan S. Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-weon Jung, Soumi Maiti, Shinji Watanabe
2023	J	`jnl`	Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Data. CoRR Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi, Siddhant Arora, William Chen, Roshan S. Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-weon Jung, Soumi Maiti, Shinji Watanabe
2023	—	`conf`	SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks. ACL (1) Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan S. Sharma, Wei-Lun Wu, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2023	J	`jnl`	STFT-Domain Neural Speech Enhancement With Very Low Algorithmic Latency. IEEE ACM Trans. Audio Speech Lang. Process. Zhong-Qiu Wang, Gordon Wichern, Shinji Watanabe, Jonathan Le Roux
2023	C	`conf`	Segment-Level Vectorized Beam Search Based on Partially Autoregressive Inference. ASRU Masao Someki, Nicholas Eng, Yosuke Higuchi, Shinji Watanabe
2023	J	`jnl`	Segment-Level Vectorized Beam Search Based on Partially Autoregressive Inference. CoRR Masao Someki, Nicholas Eng, Yosuke Higuchi, Shinji Watanabe
2023	J	`jnl`	Semi-Autoregressive Streaming ASR With Label Context. CoRR Siddhant Arora, George Saon, Shinji Watanabe, Brian Kingsbury
2023	—	`conf`	SigMoreFun Submission to the SIGMORPHON Shared Task on Interlinear Glossing. SIGMORPHON Taiqi He, Lindia Tjuatja, Nathaniel R. Robinson, Shinji Watanabe, David R. Mortensen, Graham Neubig, Lori S. Levin
2023	J	`jnl`	Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing. J. Open Source Softw. Yen-Ju Lu, Xuankai Chang, Chenda Li, Wangyou Zhang, Samuele Cornell, Zhaoheng Ni, Yoshiki Masuyama, Brian Yan, Robin Scheibler, Zhong-Qiu Wang, Yu Tsao, Yanmin Qian, Shinji Watanabe
2023	Misc	`conf`	Speaker-Independent Acoustic-to-Articulatory Speech Inversion. ICASSP Peter Wu, Li-Wei Chen, Cheol Jun Cho, Shinji Watanabe, Louis Goldstein, Alan W. Black, Gopala Krishna Anumanchipalli
2023	J	`jnl`	Speaker-Independent Acoustic-to-Articulatory Speech Inversion. CoRR Peter Wu, Li-Wei Chen, Cheol Jun Cho, Shinji Watanabe, Louis Goldstein, Alan W. Black, Gopala Krishna Anumanchipalli
2023	Misc	`conf`	Speech Summarization of Long Spoken Document: Improving Memory Efficiency of Speech/Text Encoders. ICASSP Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Roshan S. Sharma, Kohei Matsuura, Shinji Watanabe
2023	J	`jnl`	Speech collage: code-switched audio generation by collaging monolingual corpora. CoRR Amir Hussein, Dorsa Zeinali, Ondrej Klejch, Matthew Wiesner, Brian Yan, Shammur Absar Chowdhury, Ahmed M. Ali, Shinji Watanabe, Sanjeev Khudanpur
2023	Misc	`conf`	Speechlmscore: Evaluating Speech Generation Using Speech Language Model. ICASSP Soumi Maiti, Yifan Peng, Takaaki Saeki, Shinji Watanabe
2023	Misc	`conf`	Streaming Joint Speech Recognition and Disfluency Detection. ICASSP Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe
2023	Misc	`conf`	Structured Pruning of Self-Supervised Pre-Trained Models for Speech Recognition and Understanding. ICASSP Yifan Peng, Kwangyoun Kim, Felix Wu, Prashant Sridhar, Shinji Watanabe
2023	J	`jnl`	Structured Pruning of Self-Supervised Pre-trained Models for Speech Recognition and Understanding. CoRR Yifan Peng, Kwangyoun Kim, Felix Wu, Prashant Sridhar, Shinji Watanabe
2023	C	`conf`	Summarize While Translating: Universal Model With Parallel Decoding for Summarization and Translation. ASRU Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Kohei Matsuura, Takanori Ashihara, William Chen, Shinji Watanabe
2023	Misc	`conf`	Summary on the Multimodal Information Based Speech Processing (MISP) 2022 Challenge. ICASSP Hang Chen, Shilong Wu, Yusheng Dai, Zhe Wang, Jun Du, Chin-Hui Lee, Jingdong Chen, Shinji Watanabe, Sabato Marco Siniscalchi, Odette Scharenborg, Diyuan Liu, Bao-Cai Yin, Jia Pan, Jianqing Gao, Cong Liu
2023	—	`conf`	Synthetic Data Augmentation for ASR with Domain Filtering. APSIPA ASC Tuan Vu Ho, Shota Horiguchi, Shinji Watanabe, Paola García, Takashi Sumiyoshi
2023	Misc	`conf`	TAPLoss: A Temporal Acoustic Parameter Loss for Speech Enhancement. ICASSP Yunyang Zeng, Joseph Konan, Shuo Han, David Bick, Muqiao Yang, Anurag Kumar, Shinji Watanabe, Bhiksha Raj
2023	J	`jnl`	TAPLoss: A Temporal Acoustic Parameter Loss for Speech Enhancement. CoRR Yunyang Zeng, Joseph Konan, Shuo Han, David Bick, Muqiao Yang, Anurag Kumar, Shinji Watanabe, Bhiksha Raj
2023	Misc	`conf`	TF-GRIDNET: Making Time-Frequency Domain Models Great Again for Monaural Speaker Separation. ICASSP Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe
2023	J	`jnl`	TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separation. IEEE ACM Trans. Audio Speech Lang. Process. Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe
2023	A	`conf`	Tensor decomposition for minimization of E2E SLU model toward on-device processing. INTERSPEECH Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023	J	`jnl`	The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios. CoRR Samuele Cornell, Matthew Wiesner, Shinji Watanabe, Desh Raj, Xuankai Chang, Paola García, Yoshiki Masuyama, Zhong-Qiu Wang, Stefano Squartini, Sanjeev Khudanpur
2023	J	`jnl`	The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction. CoRR Shilong Wu, Chenxi Wang, Hang Chen, Yusheng Dai, Chenyue Zhang, Ruoyu Wang, Hongbo Lan, Jun Du, Chin-Hui Lee, Jingdong Chen, Shinji Watanabe, Sabato Marco Siniscalchi, Odette Scharenborg, Zhong-Qiu Wang, Jia Pan, Jianqing Gao
2023	Misc	`conf`	The Multimodal Information Based Speech Processing (Misp) 2022 Challenge: Audio-Visual Diarization And Recognition. ICASSP Zhe Wang, Shilong Wu, Hang Chen, Mao-Kui He, Jun Du, Chin-Hui Lee, Jingdong Chen, Shinji Watanabe, Sabato Marco Siniscalchi, Odette Scharenborg, Diyuan Liu, Baocai Yin, Jia Pan, Jianqing Gao, Cong Liu
2023	J	`jnl`	The Multimodal Information based Speech Processing (MISP) 2022 Challenge: Audio-Visual Diarization and Recognition. CoRR Zhe Wang, Shilong Wu, Hang Chen, Mao-Kui He, Jun Du, Chin-Hui Lee, Jingdong Chen, Shinji Watanabe, Sabato Marco Siniscalchi, Odette Scharenborg, Diyuan Liu, Baocai Yin, Jia Pan, Jianqing Gao, Cong Liu
2023	J	`jnl`	The Pipeline System of ASR and NLU with MLM-based Data Augmentation toward STOP Low-resource Challenge. CoRR Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023	Misc	`conf`	The Pipeline System of ASR and NLU with MLM-based data Augmentation Toward Stop Low-Resource Challenge. ICASSP Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023	A	`conf`	Time-synchronous one-pass Beam Search for Parallel Online and Offline Transducers with Dynamic Block Training. INTERSPEECH Yui Sudo, Muhammad Shakeel, Yifan Peng, Shinji Watanabe
2023	C	`conf`	TorchAudio 2.1: Advancing Speech Recognition, Self-Supervised Learning, and Audio Processing Components for Pytorch. ASRU Jeff Hwang, Moto Hira, Caroline Chen, Xiaohui Zhang, Zhaoheng Ni, Guangzhi Sun, Pingchuan Ma, Ruizhe Huang, Vineel Pratap, Yuekai Zhang, Anurag Kumar, Chin-Yun Yu, Chuang Zhu, Chunxi Liu, Jacob Kahn, Mirco Ravanelli, Peng Sun, Shinji Watanabe, Yangyang Shi, Yumeng Tao
2023	J	`jnl`	TorchAudio 2.1: Advancing speech recognition, self-supervised learning, and audio processing components for PyTorch. CoRR Jeff Hwang, Moto Hira, Caroline Chen, Xiaohui Zhang, Zhaoheng Ni, Guangzhi Sun, Pingchuan Ma, Ruizhe Huang, Vineel Pratap, Yuekai Zhang, Anurag Kumar, Chin-Yun Yu, Chuang Zhu, Chunxi Liu, Jacob Kahn, Mirco Ravanelli, Peng Sun, Shinji Watanabe, Yangyang Shi, Yumeng Tao, Robin Scheibler, Samuele Cornell, Sean Kim, Stavros Petridis
2023	C	`conf`	Toward Universal Speech Enhancement For Diverse Input Conditions. ASRU Wangyou Zhang, Kohei Saijo, Zhong-Qiu Wang, Shinji Watanabe, Yanmin Qian
2023	J	`jnl`	Toward Universal Speech Enhancement for Diverse Input Conditions. CoRR Wangyou Zhang, Kohei Saijo, Zhong-Qiu Wang, Shinji Watanabe, Yanmin Qian
2023	J	`jnl`	Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal Tokens. CoRR Minsu Kim, Jeongsoo Choi, Soumi Maiti, Jeong Hun Yeo, Shinji Watanabe, Yong Man Ro
2023	Misc	`conf`	Towards Zero-Shot Code-Switched Speech Recognition. ICASSP Brian Yan, Matthew Wiesner, Ondrej Klejch, Preethi Jyothi, Shinji Watanabe
2023	A*	`conf`	UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixtures. NeurIPS Zhong-Qiu Wang, Shinji Watanabe
2023	J	`jnl`	UNSSOR: Unsupervised Neural Speech Separation by Leveraging Over-determined Training Mixtures. CoRR Zhong-Qiu Wang, Shinji Watanabe
2023	J	`jnl`	Understanding Probe Behaviors through Variational Bounds of Mutual Information. CoRR Kwanghee Choi, Jee-weon Jung, Shinji Watanabe
2023	J	`jnl`	UniAudio: An Audio Foundation Model Toward Universal Audio Generation. CoRR Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Shinji Watanabe, Helen Meng
2023	—	`conf`	UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units. ACL (1) Hirofumi Inaguma, Sravya Popuri, Ilia Kulikov, Peng-Jen Chen, Changhan Wang, Yu-An Chung, Yun Tang, Ann Lee, Shinji Watanabe, Juan Pino
2023	J	`jnl`	UniverSLU: Universal Spoken Language Understanding for Diverse Classification and Sequence Generation Tasks with a Single Network. CoRR Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan S. Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2023	J	`jnl`	Unsupervised Data Selection for TTS: Using Arabic Broadcast News as a Case Study. CoRR Massa Baali, Tomoki Hayashi, Hamdy Mubarak, Soumi Maiti, Shinji Watanabe, Wassim El-Hajj, Ahmed Ali
2023	J	`jnl`	Visual Speech Recognition for Low-resource Languages with Automatic Labels From Whisper Model. CoRR Jeong Hun Yeo, Minsu Kim, Shinji Watanabe, Yong Man Ro
2023	J	`jnl`	Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks. CoRR Soumi Maiti, Yifan Peng, Shukjae Choi, Jee-weon Jung, Xuankai Chang, Shinji Watanabe
2023	Misc	`conf`	Wav2Seq: Pre-Training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages. ICASSP Felix Wu, Kwangyoun Kim, Shinji Watanabe, Kyu Jeong Han, Ryan McDonald, Kilian Q. Weinberger, Yoav Artzi
2023	C	`conf`	Yodas: Youtube-Oriented Dataset for Audio and Speech. ASRU Xinjian Li, Shinnosuke Takamichi, Takaaki Saeki, William Chen, Sayaka Shiota, Shinji Watanabe
2022	J	`jnl`	4D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoders. CoRR Yui Sudo, Muhammad Shakeel, Brian Yan, Jiatong Shi, Shinji Watanabe
2022	J	`jnl`	A Study of Transducer based End-to-End ASR with ESPnet: Architecture, Auxiliary Loss and Decoding Strategies. CoRR Florian Boyer, Yusuke Shinohara, Takaaki Ishii, Hirofumi Inaguma, Shinji Watanabe
2022	—	`conf`	A Study on the Integration of Pre-Trained SSL, ASR, LM and SLU Models for Spoken Language Understanding. SLT Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
2022	J	`jnl`	A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understanding. CoRR Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
2022	J	`jnl`	A review of speaker diarization: Recent advances with deep learning. Comput. Speech Lang. Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu Jeong Han, Shinji Watanabe, Shrikanth Narayanan
2022	J	`jnl`	A unified one-shot prosody and speaker conversion system with self-supervised discrete speech units. CoRR Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky
2022	A	`conf`	ASR2K: Speech Recognition for Around 2000 Languages without Audio. INTERSPEECH Xinjian Li, Florian Metze, David R. Mortensen, Alan W. Black, Shinji Watanabe
2022	J	`jnl`	ASR2K: Speech Recognition for Around 2000 Languages without Audio. CoRR Xinjian Li, Florian Metze, David R. Mortensen, Alan W. Black, Shinji Watanabe
2022	J	`jnl`	Acoustic Event Detection with Classifier Chains. CoRR Tatsuya Komatsu, Shinji Watanabe, Koichi Miyazaki, Tomoki Hayashi
2022	J	`jnl`	Align, Write, Re-order: Explainable End-to-End Speech Translation via Operation Sequence Generation. CoRR Motoi Omachi, Brian Yan, Siddharth Dalmia, Yuya Fujita, Shinji Watanabe
2022	Misc	`conf`	An Exploration of Hubert with Large Number of Cluster Units and Model Assessment Using Bayesian Information Criterion. ICASSP Takashi Maekaku, Xuankai Chang, Yuya Fujita, Shinji Watanabe
2022	J	`jnl`	An investigation of neural uncertainty estimation for target speaker extraction equipped RNN transducer. Comput. Speech Lang. Jiatong Shi, Chunlei Zhang, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu
2022	J	`jnl`	Arabic speech recognition by end-to-end, modular systems and human. Comput. Speech Lang. Amir Hussein, Shinji Watanabe, Ahmed Ali
2022	J	`jnl`	Articulatory Representation Learning Via Joint Factor Analysis and Neural Matrix Factorization. CoRR Jiachen Lian, Alan W. Black, Yijing Lu, Louis Goldstein, Shinji Watanabe, Gopala Krishna Anumanchipalli
2022	A	`conf`	Attention Weight Smoothing Using Prior Distributions for Transformer-Based End-to-End ASR. INTERSPEECH Takashi Maekaku, Yuya Fujita, Yifan Peng, Shinji Watanabe
2022	A	`conf`	Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysis. INTERSPEECH Hang Chen, Jun Du, Yusheng Dai, Chin-Hui Lee, Sabato Marco Siniscalchi, Shinji Watanabe, Odette Scharenborg, Jingdong Chen, Baocai Yin, Jia Pan
2022	A	`conf`	Audio-Visual Wake Word Spotting in MISP2021 Challenge: Dataset Release and Deep Analysis. INTERSPEECH Hengshun Zhou, Jun Du, Gongzhen Zou, Zhaoxu Nian, Chin-Hui Lee, Sabato Marco Siniscalchi, Shinji Watanabe, Odette Scharenborg, Jingdong Chen, Shifu Xiong, Jianqing Gao
2022	J	`jnl`	Avoid Overthinking in Self-Supervised Models for Speech Recognition. CoRR Dan Berrebbi, Brian Yan, Shinji Watanabe
2022	J	`jnl`	BECTRA: Transducer-based End-to-End ASR with BERT-Enhanced Encoder. CoRR Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
2022	—	`conf`	BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model. EMNLP (Findings) Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
2022	J	`jnl`	BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model. CoRR Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
2022	J	`jnl`	Bayes risk CTC: Controllable CTC alignment in Sequence-to-Sequence tasks. CoRR Jinchuan Tian, Brian Yan, Jianwei Yu, Chao Weng, Dong Yu, Shinji Watanabe
2022	A	`conf`	Better Intermediates Improve CTC Inference. INTERSPEECH Tatsuya Komatsu, Yusuke Fujita, Jaesong Lee, Lukas Lee, Shinji Watanabe, Yusuke Kida
2022	J	`jnl`	Better Intermediates Improve CTC Inference. CoRR Tatsuya Komatsu, Yusuke Fujita, Jaesong Lee, Lukas Lee, Shinji Watanabe, Yusuke Kida
2022	A	`conf`	Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation. INTERSPEECH Keqi Deng, Shinji Watanabe, Jiatong Shi, Siddhant Arora
2022	J	`jnl`	Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation. CoRR Keqi Deng, Shinji Watanabe, Jiatong Shi, Siddhant Arora
2022	A*	`conf`	Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding. ICML Yifan Peng, Siddharth Dalmia, Ian R. Lane, Shinji Watanabe
2022	J	`jnl`	Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding. CoRR Yifan Peng, Siddharth Dalmia, Ian R. Lane, Shinji Watanabe
2022	J	`jnl`	Bridging Speech and Textual Pre-trained Models with Unsupervised ASR. CoRR Jiatong Shi, Chan-Jan Hsu, Ho-Lam Chung, Dongji Gao, Paola García, Shinji Watanabe, Ann Lee, Hung-yi Lee
2022	—	`conf`	CMU's IWSLT 2022 Dialect Speech Translation System. IWSLT@ACL Brian Yan, Patrick Fernandes, Siddharth Dalmia, Jiatong Shi, Yifan Peng, Dan Berrebbi, Xinyi Wang, Graham Neubig, Shinji Watanabe
2022	J	`jnl`	CTC Alignments Improve Autoregressive Translation. CoRR Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W. Black, Shinji Watanabe
2022	A	`conf`	Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation. INTERSPEECH Dan Berrebbi, Jiatong Shi, Brian Yan, Osbel López-Francisco, Jonathan D. Amith, Shinji Watanabe
2022	J	`jnl`	Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation. CoRR Dan Berrebbi, Jiatong Shi, Brian Yan, Osbel López-Francisco, Jonathan D. Amith, Shinji Watanabe
2022	Misc	`conf`	Conditional Diffusion Probabilistic Model for Speech Enhancement. ICASSP Yen-Ju Lu, Zhong-Qiu Wang, Shinji Watanabe, Alexander Richard, Cheng Yu, Yu Tsao
2022	J	`jnl`	Conditional Diffusion Probabilistic Model for Speech Enhancement. CoRR Yen-Ju Lu, Zhong-Qiu Wang, Shinji Watanabe, Alexander Richard, Cheng Yu, Yu Tsao
2022	J	`jnl`	Context-aware Fine-tuning of Self-supervised Speech Models. CoRR Suwon Shon, Felix Wu, Kwangyoun Kim, Prashant Sridhar, Karen Livescu, Shinji Watanabe
2022	A	`conf`	Deep Speech Synthesis from Articulatory Representations. INTERSPEECH Peter Wu, Shinji Watanabe, Louis Goldstein, Alan W. Black, Gopala Krishna Anumanchipalli
2022	J	`jnl`	Deep Speech Synthesis from Articulatory Representations. CoRR Peter Wu, Shinji Watanabe, Louis Goldstein, Alan W. Black, Gopala Krishna Anumanchipalli
2022	J	`jnl`	Deep learning based multi-source localization with source splitting and its effectiveness in multi-talker speech recognition. Comput. Speech Lang. Aswin Shanmugam Subramanian, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu
2022	—	`conf`	E-Branchformer: Branchformer with Enhanced Merging for Speech Recognition. SLT Kwangyoun Kim, Felix Wu, Yifan Peng, Jing Pan, Prashant Sridhar, Kyu Jeong Han, Shinji Watanabe
2022	J	`jnl`	E-Branchformer: Branchformer with Enhanced merging for speech recognition. CoRR Kwangyoun Kim, Felix Wu, Yifan Peng, Jing Pan, Prashant Sridhar, Kyu Jeong Han, Shinji Watanabe
2022	—	`conf`	EEND-SS: Joint End-to-End Neural Speaker Diarization and Speech Separation for Flexible Number of Speakers. SLT Soumi Maiti, Yushi Ueda, Shinji Watanabe, Chunlei Zhang, Meng Yu, Shi-Xiong Zhang, Yong Xu
2022	J	`jnl`	EEND-SS: Joint End-to-End Neural Speaker Diarization and Speech Separation for Flexible Number of Speakers. CoRR Yushi Ueda, Soumi Maiti, Shinji Watanabe, Chunlei Zhang, Meng Yu, Shi-Xiong Zhang, Yong Xu
2022	A	`conf`	ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding. INTERSPEECH Yen-Ju Lu, Xuankai Chang, Chenda Li, Wangyou Zhang, Samuele Cornell, Zhaoheng Ni, Yoshiki Masuyama, Brian Yan, Robin Scheibler, Zhong-Qiu Wang, Yu Tsao, Yanmin Qian, Shinji Watanabe
2022	J	`jnl`	ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding. CoRR Yen-Ju Lu, Xuankai Chang, Chenda Li, Wangyou Zhang, Samuele Cornell, Zhaoheng Ni, Yoshiki Masuyama, Brian Yan, Robin Scheibler, Zhong-Qiu Wang, Yu Tsao, Yanmin Qian, Shinji Watanabe
2022	Misc	`conf`	ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet. ICASSP Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
2022	J	`jnl`	EURO: ESPnet Unsupervised ASR Open-source Toolkit. CoRR Dongji Gao, Jiatong Shi, Shun-Po Chuang, Leibny Paola García, Hung-yi Lee, Shinji Watanabe, Sanjeev Khudanpur
2022	J	`jnl`	Editorial Editorial of Special Issue on Self-Supervised Learning for Speech and Audio Processing. IEEE J. Sel. Top. Signal Process. Hung-yi Lee, Shinji Watanabe, Karen Livescu, Abdelrahman Mohamed, Tara N. Sainath
2022	J	`jnl`	Encoder-Decoder Based Attractors for End-to-End Neural Diarization. IEEE ACM Trans. Audio Speech Lang. Process. Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Yawen Xue, Paola García
2022	J	`jnl`	End-to-End Dereverberation, Beamforming, and Speech Recognition in a Cocktail Party. IEEE ACM Trans. Audio Speech Lang. Process. Wangyou Zhang, Xuankai Chang, Christoph Böddeker, Tomohiro Nakatani, Shinji Watanabe, Yanmin Qian
2022	—	`conf`	End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representation. SLT Yoshiki Masuyama, Xuankai Chang, Samuele Cornell, Shinji Watanabe, Nobutaka Ono
2022	J	`jnl`	End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representation. CoRR Yoshiki Masuyama, Xuankai Chang, Samuele Cornell, Shinji Watanabe, Nobutaka Ono
2022	A	`conf`	End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation. INTERSPEECH Xuankai Chang, Takashi Maekaku, Yuya Fujita, Shinji Watanabe
2022	J	`jnl`	End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation. CoRR Xuankai Chang, Takashi Maekaku, Yuya Fujita, Shinji Watanabe
2022	—	`conf`	End-to-End Multi-Speaker ASR with Independent Vector Analysis. SLT Robin Scheibler, Wangyou Zhang, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2022	J	`jnl`	End-to-End Multi-speaker ASR with Independent Vector Analysis. CoRR Robin Scheibler, Wangyou Zhang, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2022	Misc	`conf`	Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR. ICASSP Xuankai Chang, Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux
2022	J	`jnl`	Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR. CoRR Xuankai Chang, Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux
2022	—	`conf`	Findings of the IWSLT 2022 Evaluation Campaign. IWSLT@ACL Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, Marcely Zanon Boito, Ondrej Bojar, Roldano Cattoni, Anna Currey, Georgiana Dinu, Kevin Duh, Maha Elbayad, Clara Emmanuel, Yannick Estève, Marcello Federico, Christian Federmann, Souhir Gahbiche, Hongyu Gong, Roman Grundkiewicz, Barry Haddow, Benjamin Hsu, Dávid Javorský, Vera Kloudová, Surafel Melaku Lakew, Xutai Ma, Prashant Mathur, Paul McNamee, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, John Ortega, Juan Miguel Pino, Elizabeth Salesky, Jiatong Shi, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Marco Turchi, Yogesh Virkar, Alexander Waibel, Changhan Wang, Shinji Watanabe
2022	J	`jnl`	HEAR 2021: Holistic Evaluation of Audio Representations. CoRR Joseph Turian, Jordie Shier, Humair Raj Khan, Bhiksha Raj, Björn W. Schuller, Christian J. Steinmetz, Colin Malloy, George Tzanetakis, Gissel Velarde, Kirk McNally, Max Henry, Nicolas Pinto, Camille Noufi, Christian Clough, Dorien Herremans, Eduardo Fonseca, Jesse H. Engel, Justin Salamon, Philippe Esling, Pranay Manocha, Shinji Watanabe, Zeyu Jin, Yonatan Bisk
2022	J	`jnl`	Improving Frame-Online Neural Speech Enhancement With Overlapped-Frame Prediction. IEEE Signal Process. Lett. Zhong-Qiu Wang, Shinji Watanabe
2022	J	`jnl`	Improving Frame-Online Neural Speech Enhancement with Overlapped-Frame Prediction. CoRR Zhong-Qiu Wang, Shinji Watanabe
2022	Misc	`conf`	Improving Non-Autoregressive End-to-End Speech Recognition with Pre-Trained Acoustic and Language Models. ICASSP Keqi Deng, Zehui Yang, Shinji Watanabe, Yosuke Higuchi, Gaofeng Cheng, Pengyuan Zhang
2022	A	`conf`	Improving Speech Enhancement through Fine-Grained Speech Characteristics. INTERSPEECH Muqiao Yang, Joseph Konan, David Bick, Anurag Kumar, Shinji Watanabe, Bhiksha Raj
2022	J	`jnl`	Improving Speech Enhancement through Fine-Grained Speech Characteristics. CoRR Muqiao Yang, Joseph Konan, David Bick, Anurag Kumar, Shinji Watanabe, Bhiksha Raj
2022	J	`jnl`	Improving non-autoregressive end-to-end speech recognition with pre-trained acoustic and language models. CoRR Keqi Deng, Zehui Yang, Shinji Watanabe, Yosuke Higuchi, Gaofeng Cheng, Pengyuan Zhang
2022	J	`jnl`	In search of strong embedding extractors for speaker diarisation. CoRR Jee-weon Jung, Hee-Soo Heo, Bong-Jin Lee, Jaesung Huh, Andrew Brown, Youngki Kwon, Shinji Watanabe, Joon Son Chung
2022	Misc	`conf`	Integrating Multiple ASR Systems into NLP Backend with Attention Fusion. ICASSP Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Shinji Watanabe
2022	J	`jnl`	InterMPL: Momentum Pseudo-Labeling with Intermediate CTC Loss. CoRR Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
2022	Misc	`conf`	Investigating Self-Supervised Learning for Speech Enhancement and Separation. ICASSP Zili Huang, Shinji Watanabe, Shu-Wen Yang, Paola García, Sanjeev Khudanpur
2022	Misc	`conf`	Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization. ICASSP Brian Yan, Chunlei Zhang, Meng Yu, Shi-Xiong Zhang, Siddharth Dalmia, Dan Berrebbi, Chao Weng, Shinji Watanabe, Dong Yu
2022	Misc	`conf`	Joint Speech Recognition and Audio Captioning. ICASSP Chaitanya Narisetty, Emiru Tsunoo, Xuankai Chang, Yosuke Kashiwagi, Michael Hentschel, Shinji Watanabe
2022	J	`jnl`	Joint Speech Recognition and Audio Captioning. CoRR Chaitanya Narisetty, Emiru Tsunoo, Xuankai Chang, Yosuke Kashiwagi, Michael Hentschel, Shinji Watanabe
2022	J	`jnl`	Joint speaker diarization and speech recognition based on region proposal networks. Comput. Speech Lang. Zili Huang, Marc Delcroix, Leibny Paola García-Perera, Shinji Watanabe, Desh Raj, Sanjeev Khudanpur
2022	J	`jnl`	Large-scale learning of generalised representations for speaker recognition. CoRR Jee-weon Jung, Hee-Soo Heo, Bong-Jin Lee, Jaesong Lee, Hye-jin Shim, Youngki Kwon, Joon Son Chung, Shinji Watanabe
2022	J	`jnl`	LegoNN: Building Modular Encoder-Decoder Models. CoRR Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
2022	A	`conf`	Memory-Efficient Training of RNN-Transducer with Sampled Softmax. INTERSPEECH Jaesong Lee, Lukas Lee, Shinji Watanabe
2022	J	`jnl`	Memory-Efficient Training of RNN-Transducer with Sampled Softmax. CoRR Jaesong Lee, Lukas Lee, Shinji Watanabe
2022	J	`jnl`	Minimum Latency Training of Sequence Transducers for Streaming End-to-End Speech Recognition. CoRR Yusuke Shinohara, Shinji Watanabe
2022	A	`conf`	Minimum latency training of sequence transducers for streaming end-to-end speech recognition. INTERSPEECH Yusuke Shinohara, Shinji Watanabe
2022	Misc	`conf`	Multi-Channel End-To-End Neural Diarization with Distributed Microphones. ICASSP Shota Horiguchi, Yuki Takashima, Paola García, Shinji Watanabe, Yohei Kawaguchi
2022	J	`jnl`	Multi-blank Transducers for Speech Recognition. CoRR Hainan Xu, Fei Jia, Somshubra Majumdar, Shinji Watanabe, Boris Ginsburg
2022	J	`jnl`	Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis. CoRR Jiatong Shi, Shuai Guo, Tao Qian, Nan Huo, Tomoki Hayashi, Yuning Wu, Frank Xu, Xuankai Chang, Huazhe Li, Peter Wu, Shinji Watanabe, Qin Jin
2022	A	`conf`	Muskits: an End-to-end Music Processing Toolkit for Singing Voice Synthesis. INTERSPEECH Jiatong Shi, Shuai Guo, Tao Qian, Tomoki Hayashi, Yuning Wu, Fangzheng Xu, Xuankai Chang, Huazhe Li, Peter Wu, Shinji Watanabe, Qin Jin
2022	—	`conf`	Mutual Learning of Single- and Multi-Channel End-to-End Neural Diarization. SLT Shota Horiguchi, Yuki Takashima, Shinji Watanabe, Paola García
2022	J	`jnl`	Mutual Learning of Single- and Multi-Channel End-to-End Neural Diarization. CoRR Shota Horiguchi, Yuki Takashima, Shinji Watanabe, Paola García
2022	Misc	`conf`	Non-Autoregressive End-To-End Automatic Speech Recognition Incorporating Downstream Natural Language Processing. ICASSP Motoi Omachi, Yuya Fujita, Shinji Watanabe, Tianzi Wang
2022	—	`conf`	On Compressing Sequences for Self-Supervised Speech Models. SLT Yen Meng, Hsuan-Jui Chen, Jiatong Shi, Shinji Watanabe, Paola García, Hung-yi Lee, Hao Tang
2022	J	`jnl`	On Compressing Sequences for Self-Supervised Speech Models. CoRR Yen Meng, Hsuan-Jui Chen, Jiatong Shi, Shinji Watanabe, Paola García, Hung-yi Lee, Hao Tang
2022	A	`conf`	Online Continual Learning of End-to-End Speech Recognition Models. INTERSPEECH Muqiao Yang, Ian R. Lane, Shinji Watanabe
2022	J	`jnl`	Online Continual Learning of End-to-End Speech Recognition Models. CoRR Muqiao Yang, Ian R. Lane, Shinji Watanabe
2022	J	`jnl`	Online Neural Diarization of Unlimited Numbers of Speakers. CoRR Shota Horiguchi, Shinji Watanabe, Paola García, Yuki Takashima, Yohei Kawaguchi
2022	B	`conf`	Phone Inventories and Recognition for Every Language. LREC Xinjian Li, Florian Metze, David R. Mortensen, Alan W. Black, Shinji Watanabe
2022	A	`conf`	Residual Language Model for End-to-end Speech Recognition. INTERSPEECH Emiru Tsunoo, Yosuke Kashiwagi, Chaitanya Prasad Narisetty, Shinji Watanabe
2022	J	`jnl`	Residual Language Model for End-to-end Speech Recognition. CoRR Emiru Tsunoo, Yosuke Kashiwagi, Chaitanya Narisetty, Shinji Watanabe
2022	Misc	`conf`	Run-and-Back Stitch Search: Novel Block Synchronous Decoding For Streaming Encoder-Decoder ASR. ICASSP Emiru Tsunoo, Chaitanya Narisetty, Michael Hentschel, Yosuke Kashiwagi, Shinji Watanabe
2022	J	`jnl`	Run-and-back stitch search: novel block synchronous decoding for streaming encoder-decoder ASR. CoRR Emiru Tsunoo, Chaitanya Narisetty, Michael Hentschel, Yosuke Kashiwagi, Shinji Watanabe
2022	Misc	`conf`	S3PRL-VC: Open-Source Voice Conversion Framework with Self-Supervised Speech Representations. ICASSP Wen-Chin Huang, Shu-Wen Yang, Tomoki Hayashi, Hung-yi Lee, Shinji Watanabe, Tomoki Toda
2022	J	`jnl`	SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks. CoRR Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan S. Sharma, Wei-Lun Wu, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2022	Misc	`conf`	SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition. ICASSP Jing Pan, Tao Lei, Kwangyoun Kim, Kyu Jeong Han, Shinji Watanabe
2022	J	`jnl`	STFT-Domain Neural Speech Enhancement with Very Low Algorithmic Latency. CoRR Zhong-Qiu Wang, Gordon Wichern, Shinji Watanabe, Jonathan Le Roux
2022	J	`jnl`	SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning. CoRR Tzu-hsun Feng, Shuyan Annie Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-wen Li, Hung-yi Lee
2022	—	`conf`	SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities. ACL (1) Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2022	J	`jnl`	SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities. CoRR Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Jeff Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2022	J	`jnl`	Self-Supervised Speech Representation Learning: A Review. CoRR Abdelrahman Mohamed, Hung-yi Lee, Lasse Borgholt, Jakob D. Havtorn, Joakim Edin, Christian Igel, Katrin Kirchhoff, Shang-wen Li, Karen Livescu, Lars Maaløe, Tara N. Sainath, Shinji Watanabe
2022	J	`jnl`	Self-Supervised Speech Representation Learning: A Review. IEEE J. Sel. Top. Signal Process. Abdelrahman Mohamed, Hung-yi Lee, Lasse Borgholt, Jakob D. Havtorn, Joakim Edin, Christian Igel, Katrin Kirchhoff, Shang-wen Li, Karen Livescu, Lars Maaløe, Tara N. Sainath, Shinji Watanabe
2022	Misc	`conf`	Sequence Transduction with Graph-Based Supervision. ICASSP Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux
2022	A	`conf`	SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategy. INTERSPEECH Shuai Guo, Jiatong Shi, Tao Qian, Shinji Watanabe, Qin Jin
2022	J	`jnl`	SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategy. CoRR Shuai Guo, Jiatong Shi, Tao Qian, Shinji Watanabe, Qin Jin
2022	J	`jnl`	SpeechLMScore: Evaluating speech generation using speech language model. CoRR Soumi Maiti, Yifan Peng, Takaaki Saeki, Shinji Watanabe
2022	A	`conf`	Streaming Automatic Speech Recognition with Re-blocking Processing Based on Integrated Voice Activity Detection. INTERSPEECH Yui Sudo, Muhammad Shakeel, Kazuhiro Nakadai, Jiatong Shi, Shinji Watanabe
2022	J	`jnl`	Streaming Joint Speech Recognition and Disfluency Detection. CoRR Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe
2022	—	`conf`	Superb @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning. SLT Tzu-hsun Feng, Shuyan Annie Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-wen Li, Hung-yi Lee
2022	J	`jnl`	TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separation. CoRR Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe
2022	J	`jnl`	TF-GridNet: Making Time-Frequency Domain Models Great Again for Monaural Speaker Separation. CoRR Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe
2022	Misc	`conf`	The First Multimodal Information Based Speech Processing (Misp) Challenge: Data, Tasks, Baselines And Results. ICASSP Hang Chen, Hengshun Zhou, Jun Du, Chin-Hui Lee, Jingdong Chen, Shinji Watanabe, Sabato Marco Siniscalchi, Odette Scharenborg, Diyuan Liu, Bao-Cai Yin, Jia Pan, Jianqing Gao, Cong Liu
2022	—	`conf`	Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. EMNLP (Findings) Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W. Black, Shinji Watanabe
2022	J	`jnl`	Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. CoRR Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W. Black, Shinji Watanabe
2022	Misc	`conf`	Torchaudio: Building Blocks for Audio and Speech Processing. ICASSP Yao-Yuan Yang, Moto Hira, Zhaoheng Ni, Artyom Astafurov, Caroline Chen, Christian Puhrsch, David Pollack, Dmitriy Genzel, Donny Greenberg, Edward Z. Yang, Jason Lian, Jeff Hwang, Ji Chen, Peter Goldsborough, Sean Narenthiran, Shinji Watanabe, Soumith Chintala, Vincent Quenneville-Bélair
2022	Misc	`conf`	Towards Low-Distortion Multi-Channel Speech Enhancement: The ESPNET-Se Submission to the L3DAS22 Challenge. ICASSP Yen-Ju Lu, Samuele Cornell, Xuankai Chang, Wangyou Zhang, Chenda Li, Zhaoheng Ni, Zhong-Qiu Wang, Shinji Watanabe
2022	J	`jnl`	Towards Low-distortion Multi-channel Speech Enhancement: The ESPNet-SE Submission to The L3DAS22 Challenge. CoRR Yen-Ju Lu, Samuele Cornell, Xuankai Chang, Wangyou Zhang, Chenda Li, Zhaoheng Ni, Zhong-Qiu Wang, Shinji Watanabe
2022	J	`jnl`	Towards Zero-Shot Code-Switched Speech Recognition. CoRR Brian Yan, Matthew Wiesner, Ondrej Klejch, Preethi Jyothi, Shinji Watanabe
2022	J	`jnl`	Train from scratch: Single-stage joint training of speech separation and recognition. Comput. Speech Lang. Jing Shi, Xuankai Chang, Shinji Watanabe, Bo Xu
2022	A	`conf`	TriniTTS: Pitch-controllable End-to-end TTS without External Aligner. INTERSPEECH Yooncheol Ju, Ilhwan Kim, Hongsun Yang, Ji-Hoon Kim, Byeongyeol Kim, Soumi Maiti, Shinji Watanabe
2022	A	`conf`	Two-Pass Low Latency End-to-End Spoken Language Understanding. INTERSPEECH Siddhant Arora, Siddharth Dalmia, Xuankai Chang, Brian Yan, Alan W. Black, Shinji Watanabe
2022	J	`jnl`	Two-Pass Low Latency End-to-End Spoken Language Understanding. CoRR Siddhant Arora, Siddharth Dalmia, Xuankai Chang, Brian Yan, Alan W. Black, Shinji Watanabe
2022	J	`jnl`	UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units. CoRR Hirofumi Inaguma, Sravya Popuri, Ilia Kulikov, Peng-Jen Chen, Changhan Wang, Yu-An Chung, Yun Tang, Ann Lee, Shinji Watanabe, Juan Pino
2022	A	`conf`	Updating Only Encoders Prevents Catastrophic Forgetting of End-to-End ASR Models. INTERSPEECH Yuki Takashima, Shota Horiguchi, Shinji Watanabe, Leibny Paola García-Perera, Yohei Kawaguchi
2022	A	`conf`	VQ-T: RNN Transducers using Vector-Quantized Prediction Network States. INTERSPEECH Jiatong Shi, George Saon, David Haws, Shinji Watanabe, Brian Kingsbury
2022	J	`jnl`	VQ-T: RNN Transducers using Vector-Quantized Prediction Network States. CoRR Jiatong Shi, George Saon, David Haws, Shinji Watanabe, Brian Kingsbury
2022	J	`jnl`	Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages. CoRR Felix Wu, Kwangyoun Kim, Shinji Watanabe, Kyu Jeong Han, Ryan McDonald, Kilian Q. Weinberger, Yoav Artzi
2022	A	`conf`	When Is TTS Augmentation Through a Pivot Language Useful? INTERSPEECH Nathaniel Romney Robinson, Perez Ogayo, Swetha R. Gangu, David R. Mortensen, Shinji Watanabe
2022	J	`jnl`	When Is TTS Augmentation Through a Pivot Language Useful? CoRR Nathaniel R. Robinson, Perez Ogayo, Swetha R. Gangu, David R. Mortensen, Shinji Watanabe
2022	—	`conf`	Zero-shot Learning for Grapheme to Phoneme Conversion with Language Ensemble. ACL (Findings) Xinjian Li, Florian Metze, David R. Mortensen, Shinji Watanabe, Alan W. Black
2021	C	`conf`	A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generation. ASRU Yosuke Higuchi, Nanxin Chen, Yuya Fujita, Hirofumi Inaguma, Tatsuya Komatsu, Jaesong Lee, Jumon Nozaki, Tianzi Wang, Shinji Watanabe
2021	J	`jnl`	A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generation. CoRR Yosuke Higuchi, Nanxin Chen, Yuya Fujita, Hirofumi Inaguma, Tatsuya Komatsu, Jaesong Lee, Jumon Nozaki, Tianzi Wang, Shinji Watanabe
2021	J	`jnl`	A Review of Speaker Diarization: Recent Advances with Deep Learning. CoRR Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu Jeong Han, Shinji Watanabe, Shrikanth Narayanan
2021	C	`conf`	A Study of Transducer Based End-to-End ASR with ESPnet: Architecture, Auxiliary Loss and Decoding Strategies. ASRU Florian Boyer, Yusuke Shinohara, Takaaki Ishii, Hirofumi Inaguma, Shinji Watanabe
2021	—	`conf`	A Study on Speech Enhancement Based on Diffusion Probabilistic Model. APSIPA ASC Yen-Ju Lu, Yu Tsao, Shinji Watanabe
2021	J	`jnl`	A Study on Speech Enhancement Based on Diffusion Probabilistic Model. CoRR Yen-Ju Lu, Yu Tsao, Shinji Watanabe
2021	A	`conf`	Acoustic Event Detection with Classifier Chains. Interspeech Tatsuya Komatsu, Shinji Watanabe, Koichi Miyazaki, Tomoki Hayashi
2021	C	`conf`	An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition. ASRU Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-Wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe
2021	J	`jnl`	An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition. CoRR Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-Wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe
2021	J	`jnl`	Arabic Speech Recognition by End-to-End, Modular Systems and Human. CoRR Amir Hussein, Shinji Watanabe, Ahmed Ali
2021	C	`conf`	Attention-Based Multi-Hypothesis Fusion for Speech Summarization. ASRU Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Shinji Watanabe
2021	J	`jnl`	Attention-based Multi-hypothesis Fusion for Speech Summarization. CoRR Takatomo Kano, Atsunori Ogawa, Marc Delcroix, Shinji Watanabe
2021	A	`conf`	Auxiliary Loss Function for Target Speech Extraction and Recognition with Weak Supervision Based on Speaker Characteristics. Interspeech Katerina Zmolíková, Marc Delcroix, Desh Raj, Shinji Watanabe, Jan Cernocký
2021	—	`conf`	Closing the Gap Between Time-Domain Multi-Channel Speech Enhancement on Real and Simulation Conditions. WASPAA Wangyou Zhang, Jing Shi, Chenda Li, Shinji Watanabe, Yanmin Qian
2021	J	`jnl`	Closing the Gap Between Time-Domain Multi-Channel Speech Enhancement on Real and Simulation Conditions. CoRR Wangyou Zhang, Jing Shi, Chenda Li, Shinji Watanabe, Yanmin Qian
2021	C	`conf`	Conferencingspeech Challenge: Towards Far-Field Multi-Channel Speech Enhancement for Video Conferencing. ASRU Wei Rao, Yihui Fu, Yanxin Hu, Xin Xu, Yvkai Jv, Jiangyu Han, Zhongjie Jiang, Lei Xie, Yannan Wang, Shinji Watanabe, Zheng-Hua Tan, Hui Bu, Tao Yu, Shidong Shang
2021	A	`conf`	Continuous Speech Separation Using Speaker Inventory for Long Recording. Interspeech Cong Han, Yi Luo, Chenda Li, Tianyan Zhou, Keisuke Kinoshita, Shinji Watanabe, Marc Delcroix, Hakan Erdogan, John R. Hershey, Nima Mesgarani, Zhuo Chen
2021	C	`conf`	Cross-Lingual Transfer for Speech Processing Using Acoustic Language Similarity. ASRU Peter Wu, Jiatong Shi, Yifan Zhong, Shinji Watanabe, Alan W. Black
2021	J	`jnl`	Cross-lingual Transfer for Speech Processing using Acoustic Language Similarity. CoRR Peter Wu, Jiatong Shi, Yifan Zhong, Shinji Watanabe, Alan W. Black
2021	—	`conf`	DOVER-Lap: A Method for Combining Overlap-Aware Diarization Outputs. SLT Desh Raj, Leibny Paola García-Perera, Zili Huang, Shinji Watanabe, Daniel Povey, Andreas Stolcke, Sanjeev Khudanpur
2021	A	`conf`	Data Augmentation Methods for End-to-End Speech Recognition on Distant-Talk Scenarios. Interspeech Emiru Tsunoo, Kentaro Shibata, Chaitanya Narisetty, Yosuke Kashiwagi, Shinji Watanabe
2021	J	`jnl`	Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios. CoRR Emiru Tsunoo, Kentaro Shibata, Chaitanya Narisetty, Yosuke Kashiwagi, Shinji Watanabe
2021	J	`jnl`	Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition. CoRR Aswin Shanmugam Subramanian, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu
2021	A	`conf`	Differentiable Allophone Graphs for Language-Universal Speech Recognition. Interspeech Brian Yan, Siddharth Dalmia, David R. Mortensen, Florian Metze, Shinji Watanabe
2021	J	`jnl`	Differentiable Allophone Graphs for Language-Universal Speech Recognition. CoRR Brian Yan, Siddharth Dalmia, David R. Mortensen, Florian Metze, Shinji Watanabe
2021	Misc	`conf`	Directional ASR: A New Paradigm for E2E Multi-Speaker Speech Recognition with Source Localization. ICASSP Aswin Shanmugam Subramanian, Chao Weng, Shinji Watanabe, Meng Yu, Yong Xu, Shi-Xiong Zhang, Dong Yu
2021	J	`jnl`	Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem. CoRR Jing Shi, Xuankai Chang, Tomoki Hayashi, Yen-Ju Lu, Shinji Watanabe, Bo Xu
2021	Misc	`conf`	Dual-Path Modeling for Long Recording Speech Separation in Meetings. ICASSP Chenda Li, Zhuo Chen, Yi Luo, Cong Han, Tianyan Zhou, Keisuke Kinoshita, Marc Delcroix, Shinji Watanabe, Yanmin Qian
2021	J	`jnl`	Dual-Path Modeling for Long Recording Speech Separation in Meetings. CoRR Chenda Li, Zhuo Chen, Yi Luo, Cong Han, Tianyan Zhou, Keisuke Kinoshita, Marc Delcroix, Shinji Watanabe, Yanmin Qian
2021	—	`conf`	Dual-Path RNN for Long Recording Speech Separation. SLT Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Böddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
2021	J	`jnl`	EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition. CoRR Murali Karthick Baskar, Lukás Burget, Shinji Watanabe, Ramón Fernandez Astudillo, Jan Honza Cernocký
2021	—	`conf`	ESPnet-SE: End-To-End Speech Enhancement and Separation Toolkit Designed for ASR Integration. SLT Chenda Li, Jing Shi, Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Naoyuki Kamo, Moto Hira, Tomoki Hayashi, Christoph Böddeker, Zhuo Chen, Shinji Watanabe
2021	J	`jnl`	ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet. CoRR Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
2021	—	`conf`	ESPnet-ST IWSLT 2021 Offline Speech Translation System. IWSLT Hirofumi Inaguma, Brian Yan, Siddharth Dalmia, Pengcheng Guo, Jiatong Shi, Kevin Duh, Shinji Watanabe
2021	J	`jnl`	ESPnet-ST IWSLT 2021 Offline Speech Translation System. CoRR Hirofumi Inaguma, Brian Yan, Siddharth Dalmia, Pengcheng Guo, Jiatong Shi, Kevin Duh, Shinji Watanabe
2021	J	`jnl`	ESPnet2-TTS: Extending the Edge of TTS Research. CoRR Tomoki Hayashi, Ryuichi Yamamoto, Takenori Yoshimura, Peter Wu, Jiatong Shi, Takaaki Saeki, Yooncheol Ju, Yusuke Yasuda, Shinnosuke Takamichi, Shinji Watanabe
2021	Misc	`conf`	Eat: Enhanced ASR-TTS for Self-Supervised Speech Recognition. ICASSP Murali Karthick Baskar, Lukás Burget, Shinji Watanabe, Ramón Fernandez Astudillo, Jan Honza Cernocký
2021	J	`jnl`	Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization. CoRR Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Yawen Xue, Paola García
2021	Misc	`conf`	End-To-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings. ICASSP Soumi Maiti, Hakan Erdogan, Kevin W. Wilson, Scott Wisdom, Shinji Watanabe, John R. Hershey
2021	Misc	`conf`	End-To-End Speaker Diarization as Post-Processing. ICASSP Shota Horiguchi, Paola García, Yusuke Fujita, Shinji Watanabe, Kenji Nagamatsu
2021	Misc	`conf`	End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend. ICASSP Wangyou Zhang, Christoph Böddeker, Shinji Watanabe, Tomohiro Nakatani, Marc Delcroix, Keisuke Kinoshita, Tsubasa Ochiai, Naoyuki Kamo, Reinhold Haeb-Umbach, Yanmin Qian
2021	J	`jnl`	End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend. CoRR Wangyou Zhang, Christoph Böddeker, Shinji Watanabe, Tomohiro Nakatani, Marc Delcroix, Keisuke Kinoshita, Tsubasa Ochiai, Naoyuki Kamo, Reinhold Haeb-Umbach, Yanmin Qian
2021	J	`jnl`	End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings. CoRR Soumi Maiti, Hakan Erdogan, Kevin W. Wilson, Scott Wisdom, Shinji Watanabe, John R. Hershey
2021	—	`conf`	End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection. SLT Yuki Takashima, Yusuke Fujita, Shinji Watanabe, Shota Horiguchi, Paola García, Kenji Nagamatsu
2021	J	`jnl`	End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection. CoRR Yuki Takashima, Yusuke Fujita, Shinji Watanabe, Shota Horiguchi, Paola García, Kenji Nagamatsu
2021	—	`conf`	End-to-end ASR to jointly predict transcriptions and linguistic annotations. NAACL-HLT Motoi Omachi, Yuya Fujita, Shinji Watanabe, Matthew Wiesner
2021	J	`jnl`	Far-Field Automatic Speech Recognition. Proc. IEEE Reinhold Haeb-Umbach, Jahn Heymann, Lukas Drude, Shinji Watanabe, Marc Delcroix, Tomohiro Nakatani
2021	C	`conf`	Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates. ASRU Hirofumi Inaguma, Siddharth Dalmia, Brian Yan, Shinji Watanabe
2021	J	`jnl`	Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates. CoRR Hirofumi Inaguma, Siddharth Dalmia, Brian Yan, Shinji Watanabe
2021	J	`jnl`	Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition. CoRR Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2021	Misc	`conf`	Gaussian Kernelized Self-Attention for Long Sequence Data and its Application to CTC-Based Speech Recognition. ICASSP Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2021	A	`conf`	GigaSpeech: An Evolving, Multi-Domain ASR Corpus with 10, 000 Hours of Transcribed Audio. Interspeech Guoguo Chen, Shuzhou Chai, Guan-Bo Wang, Jiayu Du, Wei-Qiang Zhang, Chao Weng, Dan Su, Daniel Povey, Jan Trmal, Junbo Zhang, Mingjie Jin, Sanjeev Khudanpur, Shinji Watanabe, Shuaijiang Zhao, Wei Zou, Xiangang Li, Xuchen Yao, Yongqing Wang, Zhao You, Zhiyong Yan
2021	J	`jnl`	GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10, 000 Hours of Transcribed Audio. CoRR Guoguo Chen, Shuzhou Chai, Guanbo Wang, Jiayu Du, Wei-Qiang Zhang, Chao Weng, Dan Su, Daniel Povey, Jan Trmal, Junbo Zhang, Mingjie Jin, Sanjeev Khudanpur, Shinji Watanabe, Shuaijiang Zhao, Wei Zou, Xiangang Li, Xuchen Yao, Yongqing Wang, Yujun Wang, Zhao You, Zhiyong Yan
2021	—	`conf`	HEAR: Holistic Evaluation of Audio Representations. NeurIPS (Competition and Demos) Joseph Turian, Jordie Shier, Humair Raj Khan, Bhiksha Raj, Björn W. Schuller, Christian J. Steinmetz, Colin Malloy, George Tzanetakis, Gissel Velarde, Kirk McNally, Max Henry, Nicolas Pinto, Camille Noufi, Christian Clough, Dorien Herremans, Eduardo Fonseca, Jesse H. Engel, Justin Salamon, Philippe Esling, Pranay Manocha, Shinji Watanabe, Zeyu Jin, Yonatan Bisk
2021	J	`jnl`	INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing. CoRR Wei Rao, Yihui Fu, Yanxin Hu, Xin Xu, Yvkai Jv, Jiangyu Han, Zhongjie Jiang, Lei Xie, Yannan Wang, Shinji Watanabe, Zheng-Hua Tan, Hui Bu, Tao Yu, Shidong Shang
2021	Misc	`conf`	Improved Mask-CTC for Non-Autoregressive End-to-End ASR. ICASSP Yosuke Higuchi, Hirofumi Inaguma, Shinji Watanabe, Tetsuji Ogawa, Tetsunori Kobayashi
2021	Misc	`conf`	Improving RNN Transducer with Target Speaker Extraction and Neural Uncertainty Estimation. ICASSP Jiatong Shi, Chunlei Zhang, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu
2021	—	`conf`	Integration of Speech Separation, Diarization, and Recognition for Multi-Speaker Meetings: System Description, Comparison, and Analysis. SLT Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
2021	Misc	`conf`	Intermediate Loss Regularization for CTC-Based Speech Recognition. ICASSP Jaesong Lee, Shinji Watanabe
2021	J	`jnl`	Intermediate Loss Regularization for CTC-based Speech Recognition. CoRR Jaesong Lee, Shinji Watanabe
2021	J	`jnl`	JTubeSpeech: corpus of Japanese speech collected from YouTube for speech recognition and speaker verification. CoRR Shinnosuke Takamichi, Ludwig Kürzinger, Takaaki Saeki, Sayaka Shiota, Shinji Watanabe
2021	J	`jnl`	Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization. CoRR Brian Yan, Chunlei Zhang, Meng Yu, Shi-Xiong Zhang, Siddharth Dalmia, Dan Berrebbi, Chao Weng, Shinji Watanabe, Dong Yu
2021	A	`conf`	Layer Pruning on Demand with Intermediate CTC. Interspeech Jaesong Lee, Jingu Kang, Shinji Watanabe
2021	J	`jnl`	Layer Pruning on Demand with Intermediate CTC. CoRR Jaesong Lee, Jingu Kang, Shinji Watanabe
2021	J	`jnl`	Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yoloxóchitl Mixtec. CoRR Jiatong Shi, Jonathan D. Amith, Rey Castillo García, Esteban Guadalupe Sierra, Kevin Duh, Shinji Watanabe
2021	A	`conf`	Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yolóxochitl Mixtec. EACL Jiatong Shi, Jonathan D. Amith, Rey Castillo García, Esteban Guadalupe Sierra, Kevin Duh, Shinji Watanabe
2021	A	`conf`	Leveraging Pre-Trained Language Model for Speech Sentiment Analysis. Interspeech Suwon Shon, Pablo Brusco, Jing Pan, Kyu Jeong Han, Shinji Watanabe
2021	J	`jnl`	Leveraging Pre-trained Language Model for Speech Sentiment Analysis. CoRR Suwon Shon, Pablo Brusco, Jing Pan, Kyu Jeong Han, Shinji Watanabe
2021	—	`conf`	Leveraging State-of-the-art ASR Techniques to Audio Captioning. DCASE Chaitanya Prasad Narisetty, Tomoki Hayashi, Ryunosuke Ishizaki, Shinji Watanabe, Kazuya Takeda
2021	J	`jnl`	Multi-Channel End-to-End Neural Diarization with Distributed Microphones. CoRR Shota Horiguchi, Yuki Takashima, Paola García, Shinji Watanabe, Yohei Kawaguchi
2021	A	`conf`	Multi-Mode Transformer Transducer with Stochastic Future Context. Interspeech Kwangyoun Kim, Felix Wu, Prashant Sridhar, Kyu Jeong Han, Shinji Watanabe
2021	A	`conf`	Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain. Interspeech Pengcheng Guo, Xuankai Chang, Shinji Watanabe, Lei Xie
2021	J	`jnl`	Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain. CoRR Pengcheng Guo, Xuankai Chang, Shinji Watanabe, Lei Xie
2021	J	`jnl`	Multi-mode Transformer Transducer with Stochastic Future Context. CoRR Kwangyoun Kim, Felix Wu, Prashant Sridhar, Kyu Jeong Han, Shinji Watanabe
2021	J	`jnl`	Non-Autoregressive Transformer for Speech Recognition. IEEE Signal Process. Lett. Nanxin Chen, Shinji Watanabe, Jesús Villalba, Piotr Zelasko, Najim Dehak
2021	J	`jnl`	Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring. CoRR Hirofumi Inaguma, Yosuke Higuchi, Kevin Duh, Tatsuya Kawahara, Shinji Watanabe
2021	Misc	`conf`	ORTHROS: non-autoregressive end-to-end speech translation With dual-decoder. ICASSP Hirofumi Inaguma, Yosuke Higuchi, Kevin Duh, Tatsuya Kawahara, Shinji Watanabe
2021	C	`conf`	On Prosody Modeling for ASR+TTS Based Voice Conversion. ASRU Wen-Chin Huang, Tomoki Hayashi, Xinjian Li, Shinji Watanabe, Tomoki Toda
2021	J	`jnl`	On Prosody Modeling for ASR+TTS based Voice Conversion. CoRR Wen-Chin Huang, Tomoki Hayashi, Xinjian Li, Shinji Watanabe, Tomoki Toda
2021	—	`conf`	Online End-To-End Neural Diarization with Speaker-Tracing Buffer. SLT Yawen Xue, Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Paola García, Kenji Nagamatsu
2021	J	`jnl`	Online End-to-End Neural Diarization Handling Overlapping Speech and Flexible Numbers of Speakers. CoRR Yawen Xue, Shota Horiguchi, Yusuke Fujita, Yuki Takashima, Shinji Watanabe, Paola García, Kenji Nagamatsu
2021	A	`conf`	Online Streaming End-to-End Neural Diarization Handling Overlapping Speech and Flexible Numbers of Speakers. Interspeech Yawen Xue, Shota Horiguchi, Yusuke Fujita, Yuki Takashima, Shinji Watanabe, Leibny Paola García-Perera, Kenji Nagamatsu
2021	Misc	`conf`	Recent Developments on Espnet Toolkit Boosted By Conformer. ICASSP Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang
2021	A	`conf`	Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding. Interspeech Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W. Black
2021	J	`jnl`	Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding. CoRR Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W. Black
2021	J	`jnl`	S3PRL-VC: Open-source Voice Conversion Framework with Self-supervised Speech Representations. CoRR Wen-Chin Huang, Shu-Wen Yang, Tomoki Hayashi, Hung-yi Lee, Shinji Watanabe, Tomoki Toda
2021	A	`conf`	SPGISpeech: 5, 000 Hours of Transcribed Financial Audio for Fully Formatted End-to-End Speech Recognition. Interspeech Patrick K. O'Neill, Vitaly Lavrukhin, Somshubra Majumdar, Vahid Noroozi, Yuekai Zhang, Oleksii Kuchaiev, Jagadeesh Balam, Yuliya Dovzhenko, Keenan Freyberg, Michael D. Shulman, Boris Ginsburg, Shinji Watanabe, Georg Kucsko
2021	J	`jnl`	SPGISpeech: 5, 000 hours of transcribed financial audio for fully formatted end-to-end speech recognition. CoRR Patrick K. O'Neill, Vitaly Lavrukhin, Somshubra Majumdar, Vahid Noroozi, Yuekai Zhang, Oleksii Kuchaiev, Jagadeesh Balam, Yuliya Dovzhenko, Keenan Freyberg, Michael D. Shulman, Boris Ginsburg, Shinji Watanabe, Georg Kucsko
2021	J	`jnl`	SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition. CoRR Jing Pan, Tao Lei, Kwangyoun Kim, Kyu Jeong Han, Shinji Watanabe
2021	A	`conf`	SUPERB: Speech Processing Universal PERformance Benchmark. Interspeech Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2021	J	`jnl`	SUPERB: Speech processing Universal PERformance Benchmark. CoRR Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2021	—	`conf`	Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. NAACL-HLT Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe
2021	J	`jnl`	Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. CoRR Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe
2021	—	`conf`	Self-Guided Curriculum Learning for Neural Machine Translation. IWSLT Lei Zhou, Liang Ding, Kevin Duh, Shinji Watanabe, Ryohei Sasano, Koichi Takeda
2021	J	`jnl`	Self-Guided Curriculum Learning for Neural Machine Translation. CoRR Lei Zhou, Liang Ding, Kevin Duh, Shinji Watanabe, Ryohei Sasano, Koichi Takeda
2021	A	`conf`	Semi-Supervised Training with Pseudo-Labeling for End-To-End Neural Diarization. Interspeech Yuki Takashima, Yusuke Fujita, Shota Horiguchi, Shinji Watanabe, Leibny Paola García-Perera, Kenji Nagamatsu
2021	J	`jnl`	Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization. CoRR Yuki Takashima, Yusuke Fujita, Shota Horiguchi, Shinji Watanabe, Paola García, Kenji Nagamatsu
2021	J	`jnl`	Sequence Transduction with Graph-based Supervision. CoRR Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux
2021	—	`conf`	Sequential Multi-Frame Neural Beamforming for Speech Separation and Enhancement. SLT Zhong-Qiu Wang, Hakan Erdogan, Scott Wisdom, Kevin W. Wilson, Desh Raj, Shinji Watanabe, Zhuo Chen, John R. Hershey
2021	—	`conf`	Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation. NAACL-HLT Hirofumi Inaguma, Tatsuya Kawahara, Shinji Watanabe
2021	J	`jnl`	Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation. CoRR Hirofumi Inaguma, Tatsuya Kawahara, Shinji Watanabe
2021	A	`conf`	Speaker Verification-Based Evaluation of Single-Channel Speech Separation. Interspeech Matthew Maciejewski, Shinji Watanabe, Sanjeev Khudanpur
2021	A	`conf`	Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021. Interspeech Takashi Maekaku, Xuankai Chang, Yuya Fujita, Li-Wei Chen, Shinji Watanabe, Alexander I. Rudnicky
2021	J	`jnl`	Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021. CoRR Takashi Maekaku, Xuankai Chang, Yuya Fujita, Li-Wei Chen, Shinji Watanabe, Alexander I. Rudnicky
2021	A	`conf`	Streaming End-to-End ASR Based on Blockwise Non-Autoregressive Models. Interspeech Tianzi Wang, Yuya Fujita, Xuankai Chang, Shinji Watanabe
2021	J	`jnl`	Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models. CoRR Tianzi Wang, Yuya Fujita, Xuankai Chang, Shinji Watanabe
2021	—	`conf`	Streaming Transformer Asr With Blockwise Synchronous Beam Search. SLT Emiru Tsunoo, Yosuke Kashiwagi, Shinji Watanabe
2021	A	`conf`	Target-Speaker Voice Activity Detection with Improved i-Vector Estimation for Unknown Number of Speaker. Interspeech Maokui He, Desh Raj, Zili Huang, Jun Du, Zhuo Chen, Shinji Watanabe
2021	J	`jnl`	The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap. CoRR Shota Horiguchi, Nelson Yalta, Paola García, Yuki Takashima, Yawen Xue, Desh Raj, Zili Huang, Yusuke Fujita, Shinji Watanabe, Sanjeev Khudanpur
2021	J	`jnl`	TorchAudio: Building Blocks for Audio and Speech Processing. CoRR Yao-Yuan Yang, Moto Hira, Zhaoheng Ni, Anjali Chourdia, Artyom Astafurov, Caroline Chen, Ching-Feng Yeh, Christian Puhrsch, David Pollack, Dmitriy Genzel, Donny Greenberg, Edward Z. Yang, Jason Lian, Jay Mahadeokar, Jeff Hwang, Ji Chen, Peter Goldsborough, Prabhat Roy, Sean Narenthiran, Shinji Watanabe, Soumith Chintala, Vincent Quenneville-Bélair, Yangyang Shi
2021	A	`conf`	Toward Streaming ASR with Non-Autoregressive Insertion-Based Model. Interspeech Yuya Fujita, Tianzi Wang, Shinji Watanabe, Motoi Omachi
2021	C	`conf`	Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors. ASRU Shota Horiguchi, Shinji Watanabe, Paola García, Yawen Xue, Yuki Takashima, Yohei Kawaguchi
2021	J	`jnl`	Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors. CoRR Shota Horiguchi, Shinji Watanabe, Paola García, Yawen Xue, Yuki Takashima, Yohei Kawaguchi
2021	Misc	`conf`	Training Noisy Single-Channel Speech Separation with Noisy Oracle Sources: A Large Gap and a Small Step. ICASSP Matthew Maciejewski, Jing Shi, Shinji Watanabe, Sanjeev Khudanpur
2021	—	`conf`	Understanding the Tradeoffs in Client-side Privacy for Downstream Speech Tasks. APSIPA ASC Peter Wu, Paul Pu Liang, Jiatong Shi, Ruslan Salakhutdinov, Shinji Watanabe, Louis-Philippe Morency
2020	Misc	`conf`	A Practical Two-Stage Training Strategy for Multi-Stream End-to-End Speech Recognition. ICASSP Ruizhi Li, Gregory Sell, Xiaofei Wang, Shinji Watanabe, Hynek Hermansky
2020	Misc	`conf`	Attention-Based ASR with Lightweight and Dynamic Convolutions. ICASSP Yuya Fujita, Aswin Shanmugam Subramanian, Motoi Omachi, Shinji Watanabe
2020	J	`jnl`	Augmentation adversarial training for unsupervised speaker recognition. CoRR Jaesung Huh, Hee Soo Heo, Jingu Kang, Shinji Watanabe, Joon Son Chung
2020	—	`ch.`	Automated Development of DNN Based Spoken Language Systems Using Evolutionary Algorithms. Deep Neural Evolution Takahiro Shinozaki, Shinji Watanabe, Kevin Duh
2020	J	`jnl`	CHiME-6 Challenge: Tackling Multispeaker Speech Recognition for Unsegmented Recordings. CoRR Shinji Watanabe, Michael I. Mandel, Jon Barker, Emmanuel Vincent
2020	—	`conf`	Conformer-Based Sound Event Detection with Semi-Supervised Learning and Data Augmentation. DCASE Koichi Miyazaki, Tatsuya Komatsu, Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda
2020	J	`jnl`	Continuous Speech Separation Using Speaker Inventory for Long Multi-talker Recording. CoRR Cong Han, Yi Luo, Chenda Li, Tianyan Zhou, Keisuke Kinoshita, Shinji Watanabe, Marc Delcroix, Hakan Erdogan, John R. Hershey, Nima Mesgarani, Zhuo Chen
2020	J	`jnl`	Convolutive Transfer Function Invariant SDR training criteria for Multi-Channel Reverberant Speech Separation. CoRR Christoph Böddeker, Wangyou Zhang, Tomohiro Nakatani, Keisuke Kinoshita, Tsubasa Ochiai, Marc Delcroix, Naoyuki Kamo, Yanmin Qian, Shinji Watanabe, Reinhold Haeb-Umbach
2020	J	`jnl`	DOVER-Lap: A Method for Combining Overlap-aware Diarization Outputs. CoRR Desh Raj, Leibny Paola García-Perera, Zili Huang, Shinji Watanabe, Daniel Povey, Andreas Stolcke, Sanjeev Khudanpur
2020	J	`jnl`	Directional ASR: A New Paradigm for E2E Multi-Speaker Speech Recognition with Source Localization. CoRR Aswin Shanmugam Subramanian, Chao Weng, Shinji Watanabe, Meng Yu, Yong Xu, Shi-Xiong Zhang, Dong Yu
2020	J	`jnl`	DiscreTalk: Text-to-Speech as a Machine Translation Problem. CoRR Tomoki Hayashi, Shinji Watanabe
2020	—	`conf`	ESPnet-ST: All-in-One Speech Translation Toolkit. ACL (demo) Hirofumi Inaguma, Shun Kiyono, Kevin Duh, Shigeki Karita, Nelson Yalta, Tomoki Hayashi, Shinji Watanabe
2020	J	`jnl`	ESPnet-ST: All-in-One Speech Translation Toolkit. CoRR Hirofumi Inaguma, Shun Kiyono, Kevin Duh, Shigeki Karita, Nelson Enrique Yalta Soplin, Tomoki Hayashi, Shinji Watanabe
2020	J	`jnl`	ESPnet-se: end-to-end speech enhancement and separation toolkit designed for asr integration. CoRR Chenda Li, Jing Shi, Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Naoyuki Kamo, Moto Hira, Tomoki Hayashi, Christoph Böddeker, Zhuo Chen, Shinji Watanabe
2020	Misc	`conf`	End-To-End Multi-Speaker Speech Recognition With Transformer. ICASSP Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2020	A	`conf`	End-to-End ASR with Adaptive Span Self-Attention. INTERSPEECH Xuankai Chang, Aswin Shanmugam Subramanian, Pengcheng Guo, Shinji Watanabe, Yuya Fujita, Motoi Omachi
2020	J	`jnl`	End-to-End Automatic Speech Recognition Integrated With CTC-Based Voice Activity Detection. CoRR Takenori Yoshimura, Tomoki Hayashi, Kazuya Takeda, Shinji Watanabe
2020	Misc	`conf`	End-to-End Automatic Speech Recognition Integrated with CTC-Based Voice Activity Detection. ICASSP Takenori Yoshimura, Tomoki Hayashi, Kazuya Takeda, Shinji Watanabe
2020	A	`conf`	End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming. INTERSPEECH Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2020	J	`jnl`	End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming. CoRR Wangyou Zhang, Aswin Shanmugam Subramanian, Xuankai Chang, Shinji Watanabe, Yanmin Qian
2020	J	`jnl`	End-to-End Multi-speaker Speech Recognition with Transformer. CoRR Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2020	J	`jnl`	End-to-End Neural Diarization: Reformulating Speaker Diarization as Simple Multi-label Classification. CoRR Yusuke Fujita, Shinji Watanabe, Shota Horiguchi, Yawen Xue, Kenji Nagamatsu
2020	J	`jnl`	End-to-End Speaker Diarization as Post-Processing. CoRR Shota Horiguchi, Paola García, Yusuke Fujita, Shinji Watanabe, Kenji Nagamatsu
2020	A	`conf`	End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractors. INTERSPEECH Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Yawen Xue, Kenji Nagamatsu
2020	J	`jnl`	End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractors. CoRR Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Yawen Xue, Kenji Nagamatsu
2020	Misc	`conf`	Espnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit. ICASSP Tomoki Hayashi, Ryuichi Yamamoto, Katsuki Inoue, Takenori Yoshimura, Shinji Watanabe, Tomoki Toda, Kazuya Takeda, Yu Zhang, Xu Tan
2020	Misc	`conf`	Far-Field Location Guided Target Speech Extraction Using End-to-End Speech Recognition Objectives. ICASSP Aswin Shanmugam Subramanian, Chao Weng, Meng Yu, Shi-Xiong Zhang, Yong Xu, Shinji Watanabe, Dong Yu
2020	J	`jnl`	Improved Mask-CTC for Non-Autoregressive End-to-End ASR. CoRR Yosuke Higuchi, Hirofumi Inaguma, Shinji Watanabe, Tetsuji Ogawa, Tetsunori Kobayashi
2020	J	`jnl`	Improving End-to-End Single-Channel Multi-Talker Speech Recognition. IEEE ACM Trans. Audio Speech Lang. Process. Wangyou Zhang, Xuankai Chang, Yanmin Qian, Shinji Watanabe
2020	J	`jnl`	Improving RNN Transducer With Target Speaker Extraction and Neural Uncertainty Estimation. CoRR Jiatong Shi, Chunlei Zhang, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu
2020	A	`conf`	Insertion-Based Modeling for End-to-End Automatic Speech Recognition. INTERSPEECH Yuya Fujita, Shinji Watanabe, Motoi Omachi, Xuankai Chang
2020	J	`jnl`	Insertion-Based Modeling for End-to-End Automatic Speech Recognition. CoRR Yuya Fujita, Shinji Watanabe, Motoi Omachi, Xuankai Chang
2020	J	`jnl`	Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis. CoRR Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Mao-Kui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
2020	A	`conf`	Learning Speaker Embedding from Text-to-Speech. INTERSPEECH Jaejin Cho, Piotr Zelasko, Jesús Villalba, Shinji Watanabe, Najim Dehak
2020	J	`jnl`	Learning Speaker Embedding from Text-to-Speech. CoRR Jaejin Cho, Piotr Zelasko, Jesús Villalba, Shinji Watanabe, Najim Dehak
2020	A	`conf`	Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict. INTERSPEECH Yosuke Higuchi, Shinji Watanabe, Nanxin Chen, Tetsuji Ogawa, Tetsunori Kobayashi
2020	J	`jnl`	Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict. CoRR Yosuke Higuchi, Shinji Watanabe, Nanxin Chen, Tetsuji Ogawa, Tetsunori Kobayashi
2020	J	`jnl`	Multi-Stream End-to-End Speech Recognition. IEEE ACM Trans. Audio Speech Lang. Process. Ruizhi Li, Xiaofei Wang, Sri Harish Mallidi, Shinji Watanabe, Takaaki Hori, Hynek Hermansky
2020	J	`jnl`	Neural Speaker Diarization with Speaker-Wise Chain Rule. CoRR Yusuke Fujita, Shinji Watanabe, Shota Horiguchi, Yawen Xue, Jing Shi, Kenji Nagamatsu
2020	J	`jnl`	Online End-to-End Neural Diarization with Speaker-Tracing Buffer. CoRR Yawen Xue, Shota Horiguchi, Yusuke Fujita, Shinji Watanabe, Kenji Nagamatsu
2020	J	`jnl`	Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoder. CoRR Hirofumi Inaguma, Yosuke Higuchi, Kevin Duh, Tatsuya Kawahara, Shinji Watanabe
2020	J	`jnl`	Recent Developments on ESPnet Toolkit Boosted by Conformer. CoRR Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang
2020	Misc	`conf`	Semi-Supervised Speaker Adaptation for End-to-End Speech Synthesis with Pretrained Models. ICASSP Katsuki Inoue, Sunao Hara, Masanobu Abe, Tomoki Hayashi, Ryuichi Yamamoto, Shinji Watanabe
2020	A*	`conf`	Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals. NeurIPS Jing Shi, Xuankai Chang, Pengcheng Guo, Shinji Watanabe, Yusuke Fujita, Jiaming Xu, Bo Xu, Lei Xie
2020	J	`jnl`	Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals. CoRR Jing Shi, Xuankai Chang, Pengcheng Guo, Shinji Watanabe, Yusuke Fujita, Jiaming Xu, Bo Xu, Lei Xie
2020	Misc	`conf`	Speaker Diarization with Region Proposal Network. ICASSP Zili Huang, Shinji Watanabe, Yusuke Fujita, Paola García, Yiwen Shao, Daniel Povey, Sanjeev Khudanpur
2020	J	`jnl`	Speaker Diarization with Region Proposal Network. CoRR Zili Huang, Shinji Watanabe, Yusuke Fujita, Paola García, Yiwen Shao, Daniel Povey, Sanjeev Khudanpur
2020	A	`conf`	Speaker-Conditional Chain Model for Speech Separation and Extraction. INTERSPEECH Jing Shi, Jiaming Xu, Yusuke Fujita, Shinji Watanabe, Bo Xu
2020	J	`jnl`	Speaker-Conditional Chain Model for Speech Separation and Extraction. CoRR Jing Shi, Jiaming Xu, Yusuke Fujita, Shinji Watanabe, Bo Xu
2020	J	`jnl`	Streaming Transformer ASR with Blockwise Synchronous Inference. CoRR Emiru Tsunoo, Yosuke Kashiwagi, Shinji Watanabe
2020	J	`jnl`	The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans. CoRR Shinji Watanabe, Florian Boyer, Xuankai Chang, Pengcheng Guo, Tomoki Hayashi, Yosuke Higuchi, Takaaki Hori, Wen-Chin Huang, Hirofumi Inaguma, Naoyuki Kamo, Shigeki Karita, Chenda Li, Jing Shi, Aswin Shanmugam Subramanian, Wangyou Zhang
2020	J	`jnl`	The JHU Multi-Microphone Multi-Speaker ASR System for the CHiME-6 Challenge. CoRR Ashish Arora, Desh Raj, Aswin Shanmugam Subramanian, Ke Li, Bar Ben-Yair, Matthew Maciejewski, Piotr Zelasko, Paola García, Shinji Watanabe, Sanjeev Khudanpur
2020	—	`conf`	The Sequence-to-Sequence Baseline for the Voice Conversion Challenge 2020: Cascading ASR and TTS. Blizzard Challenge / Voice Conversion Challenge Wen-Chin Huang, Tomoki Hayashi, Shinji Watanabe, Tomoki Toda
2020	J	`jnl`	The Sequence-to-Sequence Baseline for the Voice Conversion Challenge 2020: Cascading ASR and TTS. CoRR Wen-Chin Huang, Tomoki Hayashi, Shinji Watanabe, Tomoki Toda
2020	J	`jnl`	Training Noisy Single-Channel Speech Separation With Noisy Oracle Sources: A Large Gap and A Small Step. CoRR Matthew Maciejewski, Jing Shi, Shinji Watanabe, Sanjeev Khudanpur
2020	Misc	`conf`	Weakly-Supervised Sound Event Detection with Self-Attention. ICASSP Koichi Miyazaki, Tatsuya Komatsu, Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda
2019	C	`conf`	A Comparative Study on Transformer vs RNN in Speech Applications. ASRU Shigeki Karita, Xiaofei Wang, Shinji Watanabe, Takenori Yoshimura, Wangyou Zhang, Nanxin Chen, Tomoki Hayashi, Takaaki Hori, Hirofumi Inaguma, Ziyan Jiang, Masao Someki, Nelson Enrique Yalta Soplin, Ryuichi Yamamoto
2019	J	`jnl`	A Comparative Study on Transformer vs RNN in Speech Applications. CoRR Shigeki Karita, Nanxin Chen, Tomoki Hayashi, Takaaki Hori, Hirofumi Inaguma, Ziyan Jiang, Masao Someki, Nelson Enrique Yalta Soplin, Ryuichi Yamamoto, Xiaofei Wang, Shinji Watanabe, Takenori Yoshimura, Wangyou Zhang
2019	J	`jnl`	A practical two-stage training strategy for multi-stream end-to-end speech recognition. CoRR Ruizhi Li, Gregory Sell, Xiaofei Wang, Shinji Watanabe, Hynek Hermansky
2019	Misc	`conf`	Acoustic Modeling for Distant Multi-talker Speech Recognition with Single- and Multi-channel Branches. ICASSP Naoyuki Kanda, Yusuke Fujita, Shota Horiguchi, Rintaro Ikeshita, Kenji Nagamatsu, Shinji Watanabe
2019	Misc	`conf`	Acoustic Modeling for Overlapping Speech Recognition: Jhu Chime-5 Challenge System. ICASSP Vimal Manohar, Szu-Jui Chen, Zhiqi Wang, Yusuke Fujita, Shinji Watanabe, Sanjeev Khudanpur
2019	A	`conf`	Analysis of Multilingual Sequence-to-Sequence Speech Recognition Systems. INTERSPEECH Martin Karafiát, Murali Karthick Baskar, Shinji Watanabe, Takaaki Hori, Matthew Wiesner, Jan Cernocký
2019	—	`conf`	Analysis of Robustness of Deep Single-Channel Speech Separation Using Corpora Constructed From Multiple Domains. WASPAA Matthew Maciejewski, Gregory Sell, Yusuke Fujita, Leibny Paola García-Perera, Shinji Watanabe, Sanjeev Khudanpur
2019	A	`conf`	Auxiliary Interference Speaker Loss for Target-Speaker Speech Recognition. INTERSPEECH Naoyuki Kanda, Shota Horiguchi, Ryoichi Takashima, Yusuke Fujita, Kenji Nagamatsu, Shinji Watanabe
2019	J	`jnl`	Auxiliary Interference Speaker Loss for Target-Speaker Speech Recognition. CoRR Naoyuki Kanda, Shota Horiguchi, Ryoichi Takashima, Yusuke Fujita, Kenji Nagamatsu, Shinji Watanabe
2019	—	`conf`	CNN-based Multichannel End-to-End Speech Recognition for Everyday Home Environments EUSIPCO Nelson Yalta, Shinji Watanabe, Takaaki Hori, Kazuhiro Nakadai, Tetsuya Ogata
2019	Misc	`conf`	Cycle-consistency Training for End-to-end Speech Recognition. ICASSP Takaaki Hori, Ramón Fernandez Astudillo, Tomoki Hayashi, Yu Zhang, Shinji Watanabe, Jonathan Le Roux
2019	J	`jnl`	Dry, Focus, and Transcribe: End-to-End Integration of Dereverberation, Beamforming, and ASR. CoRR Aswin Shanmugam Subramanian, Xiaofei Wang, Shinji Watanabe, Toru Taniguchi, Dung T. Tran, Yuya Fujita
2019	—	`conf`	ESPnet How2 Speech Translation System for IWSLT 2019: Pre-training, Knowledge Distillation, and Going Deeper. IWSLT Hirofumi Inaguma, Shun Kiyono, Nelson Enrique Yalta Soplin, Jun Suzuki, Kevin Duh, Shinji Watanabe
2019	J	`jnl`	ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit. CoRR Tomoki Hayashi, Ryuichi Yamamoto, Katsuki Inoue, Takenori Yoshimura, Shinji Watanabe, Tomoki Toda, Kazuya Takeda, Yu Zhang, Xu Tan
2019	A	`conf`	End-to-End Multilingual Multi-Speaker Speech Recognition. INTERSPEECH Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2019	A	`conf`	End-to-End Neural Speaker Diarization with Permutation-Free Objectives. INTERSPEECH Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi, Kenji Nagamatsu, Shinji Watanabe
2019	J	`jnl`	End-to-End Neural Speaker Diarization with Permutation-Free Objectives. CoRR Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi, Kenji Nagamatsu, Shinji Watanabe
2019	C	`conf`	End-to-End Neural Speaker Diarization with Self-Attention. ASRU Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi, Yawen Xue, Kenji Nagamatsu, Shinji Watanabe
2019	J	`jnl`	End-to-End Neural Speaker Diarization with Self-attention. CoRR Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi, Yawen Xue, Kenji Nagamatsu, Shinji Watanabe
2019	A	`conf`	End-to-End SpeakerBeam for Single Channel Target Speech Recognition. INTERSPEECH Marc Delcroix, Shinji Watanabe, Tsubasa Ochiai, Keisuke Kinoshita, Shigeki Karita, Atsunori Ogawa, Tomohiro Nakatani
2019	Misc	`conf`	End-to-end Monaural Multi-speaker ASR System without Pretraining. ICASSP Xuankai Chang, Yanmin Qian, Kai Yu, Shinji Watanabe
2019	C	`conf`	Espresso: A Fast End-to-End Neural Speech Recognition Toolkit. ASRU Yiming Wang, Sanjeev Khudanpur, Tongfei Chen, Hainan Xu, Shuoyang Ding, Hang Lv, Yiwen Shao, Nanyun Peng, Lei Xie, Shinji Watanabe
2019	J	`jnl`	Espresso: A Fast End-to-end Neural Speech Recognition Toolkit. CoRR Yiming Wang, Tongfei Chen, Hainan Xu, Shuoyang Ding, Hang Lv, Yiwen Shao, Nanyun Peng, Lei Xie, Shinji Watanabe, Sanjeev Khudanpur
2019	J	`jnl`	Evolution-Strategy-Based Automation of System Development for High-Performance Speech Recognition. IEEE ACM Trans. Audio Speech Lang. Process. Takafumi Moriya, Tomohiro Tanaka, Takahiro Shinozaki, Shinji Watanabe, Kevin Duh
2019	—	`conf`	Generalized Weighted-Prediction-Error Dereverberation with Varying Source Priors For Reverberant Speech Recognition. WASPAA Toru Taniguchi, Aswin Shanmugam Subramanian, Xiaofei Wang, Dung T. Tran, Yuya Fujita, Shinji Watanabe
2019	Misc	`conf`	Improving End-to-end Speech Recognition with Pronunciation-assisted Sub-word Modeling. ICASSP Hainan Xu, Shuoyang Ding, Shinji Watanabe
2019	A	`conf`	Improving Transformer-Based End-to-End Speech Recognition with Connectionist Temporal Classification and Language Model Integration. INTERSPEECH Shigeki Karita, Nelson Enrique Yalta Soplin, Shinji Watanabe, Marc Delcroix, Atsunori Ogawa, Tomohiro Nakatani
2019	J	`jnl`	Introduction to the Issue on Far-Field Speech Processing in the Era of Deep Learning: Speech Enhancement, Separation, and Recognition. IEEE J. Sel. Top. Signal Process. Shinji Watanabe, Shoko Araki, Michiel Bacchiani, Reinhold Haeb-Umbach, Michael L. Seltzer
2019	Misc	`conf`	Joint Acoustic and Class Inference for Weakly Supervised Sound Event Detection. ICASSP Sandeep Kothinti, Keisuke Imoto, Debmalya Chakrabarty, Gregory Sell, Shinji Watanabe, Mounya Elhilali
2019	Misc	`conf`	Language Model Integration Based on Memory Control for Sequence to Sequence Speech Recognition. ICASSP Jaejin Cho, Shinji Watanabe, Takaaki Hori, Murali Karthick Baskar, Hirofumi Inaguma, Jesús Villalba, Najim Dehak
2019	J	`jnl`	Listen and Fill in the Missing Letters: Non-Autoregressive Transformer for Speech Recognition. CoRR Nanxin Chen, Shinji Watanabe, Jesús Villalba, Najim Dehak
2019	J	`jnl`	MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition. CoRR Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2019	C	`conf`	MIMO-Speech: End-to-End Multi-Channel Multi-Speaker Speech Recognition. ASRU Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe
2019	—	`conf`	Massively Multilingual Adversarial Speech Recognition. NAACL-HLT (1) Oliver Adams, Matthew Wiesner, Shinji Watanabe, David Yarowsky
2019	J	`jnl`	Massively Multilingual Adversarial Speech Recognition. CoRR Oliver Adams, Matthew Wiesner, Shinji Watanabe, David Yarowsky
2019	J	`jnl`	Multi-Stream End-to-End Speech Recognition. CoRR Ruizhi Li, Xiaofei Wang, Sri Harish Mallidi, Shinji Watanabe, Takaaki Hori, Hynek Hermansky
2019	C	`conf`	Multilingual End-to-End Speech Translation. ASRU Hirofumi Inaguma, Kevin Duh, Tatsuya Kawahara, Shinji Watanabe
2019	J	`jnl`	Multilingual End-to-End Speech Translation. CoRR Hirofumi Inaguma, Kevin Duh, Tatsuya Kawahara, Shinji Watanabe
2019	J	`jnl`	Phasebook and Friends: Leveraging Discrete Representations for Source Separation. IEEE J. Sel. Top. Signal Process. Jonathan Le Roux, Gordon Wichern, Shinji Watanabe, Andy M. Sarroff, John R. Hershey
2019	A	`conf`	Pre-Trained Text Embeddings for Enhanced Text-to-Speech Synthesis. INTERSPEECH Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda, Shubham Toshniwal, Karen Livescu
2019	A	`conf`	Pretraining by Backtranslation for End-to-End ASR in Low-Resource Settings. INTERSPEECH Matthew Wiesner, Adithya Renduchintala, Shinji Watanabe, Chunxi Liu, Najim Dehak, Sanjeev Khudanpur
2019	Misc	`conf`	Promising Accurate Prefix Boosting for Sequence-to-sequence ASR. ICASSP Murali Karthick Baskar, Lukás Burget, Shinji Watanabe, Martin Karafiát, Takaaki Hori, Jan Honza Cernocký
2019	J	`jnl`	Self-supervised Sequence-to-sequence ASR using Unpaired Speech and Text. CoRR Murali Karthick Baskar, Shinji Watanabe, Ramón Fernandez Astudillo, Takaaki Hori, Lukás Burget, Jan Cernocký
2019	A	`conf`	Semi-Supervised Sequence-to-Sequence ASR Using Unpaired Speech and Text. INTERSPEECH Murali Karthick Baskar, Shinji Watanabe, Ramón Fernandez Astudillo, Takaaki Hori, Lukás Burget, Jan Cernocký
2019	Misc	`conf`	Semi-supervised End-to-end Speech Recognition Using Text-to-speech and Autoencoders. ICASSP Shigeki Karita, Shinji Watanabe, Tomoharu Iwata, Marc Delcroix, Atsunori Ogawa, Tomohiro Nakatani
2019	C	`conf`	Simultaneous Speech Recognition and Speaker Diarization for Monaural Dialogue Recordings with Target-Speaker Acoustic Models. ASRU Naoyuki Kanda, Shota Horiguchi, Yusuke Fujita, Yawen Xue, Kenji Nagamatsu, Shinji Watanabe
2019	J	`jnl`	Simultaneous Speech Recognition and Speaker Diarization for Monaural Dialogue Recordings with Target-Speaker Acoustic Models. CoRR Naoyuki Kanda, Shota Horiguchi, Yusuke Fujita, Yawen Xue, Kenji Nagamatsu, Shinji Watanabe
2019	A	`conf`	Speaker Recognition Benchmark Using the CHiME-5 Corpus. INTERSPEECH Daniel Garcia-Romero, David Snyder, Shinji Watanabe, Gregory Sell, Alan McCree, Daniel Povey, Sanjeev Khudanpur
2019	—	`conf`	Speech Enhancement Using End-to-End Speech Recognition Objectives. WASPAA Aswin Shanmugam Subramanian, Xiaofei Wang, Murali Karthick Baskar, Shinji Watanabe, Toru Taniguchi, Dung T. Tran, Yuya Fujita
2019	J	`jnl`	Speech Processing for Digital Home Assistants: Combining signal processing with deep-learning techniques. IEEE Signal Process. Mag. Reinhold Haeb-Umbach, Shinji Watanabe, Tomohiro Nakatani, Michiel Bacchiani, Björn Hoffmeister, Michael L. Seltzer, Heiga Zen, Mehrez Souden
2019	Misc	`conf`	Stream Attention-based Multi-array End-to-end Speech Recognition. ICASSP Xiaofei Wang, Ruizhi Li, Sri Harish Mallidi, Takaaki Hori, Shinji Watanabe, Hynek Hermansky
2019	A	`conf`	Study of the Performance of Automatic Speech Recognition Systems in Speakers with Parkinson's Disease. INTERSPEECH Laureano Moro-Velázquez, Jaejin Cho, Shinji Watanabe, Mark A. Hasegawa-Johnson, Odette Scharenborg, Heejin Kim, Najim Dehak
2019	Misc	`conf`	The Phasebook: Building Complex Masks via Discrete Representations for Source Separation. ICASSP Jonathan Le Roux, Gordon Wichern, Shinji Watanabe, Andy M. Sarroff, John R. Hershey
2019	J	`jnl`	Towards Online End-to-end Transformer Automatic Speech Recognition. CoRR Emiru Tsunoo, Yosuke Kashiwagi, Toshiyuki Kumakura, Shinji Watanabe
2019	Misc	`conf`	Transfer Learning of Language-independent End-to-end ASR with Language Model Fusion. ICASSP Hirofumi Inaguma, Jaejin Cho, Murali Karthick Baskar, Tatsuya Kawahara, Shinji Watanabe
2019	C	`conf`	Transformer ASR with Contextual Block Processing. ASRU Emiru Tsunoo, Yosuke Kashiwagi, Toshiyuki Kumakura, Shinji Watanabe
2019	J	`jnl`	Transformer ASR with Contextual Block Processing. CoRR Emiru Tsunoo, Yosuke Kashiwagi, Toshiyuki Kumakura, Shinji Watanabe
2019	A	`conf`	Using ASR Methods for OCR. ICDAR Ashish Arora, Paola García, Shinji Watanabe, Vimal Manohar, Yiwen Shao, Sanjeev Khudanpur, Chun-Chieh Chang, Babak Rekabdar, Bagher BabaAli, Daniel Povey, David Etter, Desh Raj, Hossein Hadian, Jan Trmal
2019	A	`conf`	Vectorized Beam Search for CTC-Attention-Based Speech Recognition. INTERSPEECH Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Niko Moritz, Jonathan Le Roux
2019	B	`conf`	Weakly-Supervised Deep Recurrent Neural Networks for Basic Dance Step Generation. IJCNN Nelson Yalta, Shinji Watanabe, Kazuhiro Nakadai, Tetsuya Ogata
2018	—	`conf`	A Purely End-to-End System for Multi-speaker Speech Recognition. ACL (1) Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2018	J	`jnl`	A Purely End-to-end System for Multi-speaker Speech Recognition. CoRR Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2018	Misc	`conf`	An End-to-End Language-Tracking Speech Recognizer for Mixed-Language Speech. ICASSP Hiroshi Seki, Shinji Watanabe, Takaaki Hori, Jonathan Le Roux, John R. Hershey
2018	J	`jnl`	Analysis of Multilingual Sequence-to-Sequence speech recognition systems. CoRR Martin Karafiát, Murali Karthick Baskar, Shinji Watanabe, Takaaki Hori, Matthew Wiesner, Jan Honza Cernocký
2018	A	`conf`	Auxiliary Feature Based Adaptation of End-to-end ASR Systems. INTERSPEECH Marc Delcroix, Shinji Watanabe, Atsunori Ogawa, Shigeki Karita, Tomohiro Nakatani
2018	J	`jnl`	Back-Translation-Style Data Augmentation for End-to-End ASR. CoRR Tomoki Hayashi, Shinji Watanabe, Yu Zhang, Tomoki Toda, Takaaki Hori, Ramón Fernandez Astudillo, Kazuya Takeda
2018	—	`conf`	Back-Translation-Style Data Augmentation for end-to-end ASR. SLT Tomoki Hayashi, Shinji Watanabe, Yu Zhang, Tomoki Toda, Takaaki Hori, Ramón Fernandez Astudillo, Kazuya Takeda
2018	J	`jnl`	Building Corpora for Single-Channel Speech Separation Across Multiple Domains. CoRR Matthew Maciejewski, Gregory Sell, Leibny Paola García-Perera, Shinji Watanabe, Sanjeev Khudanpur
2018	A	`conf`	Building State-of-the-art Distant Speech Recognition Using the CHiME-4 Challenge with a Setup of Speech Enhancement Baseline. INTERSPEECH Szu-Jui Chen, Aswin Shanmugam Subramanian, Hainan Xu, Shinji Watanabe
2018	J	`jnl`	Building state-of-the-art distant speech recognition using the CHiME-4 challenge with a setup of speech enhancement baseline. CoRR Szu-Jui Chen, Aswin Shanmugam Subramanian, Hainan Xu, Shinji Watanabe
2018	J	`jnl`	CNN-based MultiChannel End-to-End Speech Recognition for everyday home environments. CoRR Nelson Yalta, Shinji Watanabe, Takaaki Hori, Kazuhiro Nakadai, Tetsuya Ogata
2018	J	`jnl`	Cycle-consistency training for end-to-end speech recognition. CoRR Takaaki Hori, Ramón Fernandez Astudillo, Tomoki Hayashi, Yu Zhang, Shinji Watanabe, Jonathan Le Roux
2018	A	`conf`	Diarization is Hard: Some Experiences and Lessons Learned for the JHU Team in the Inaugural DIHARD Challenge. INTERSPEECH Gregory Sell, David Snyder, Alan McCree, Daniel Garcia-Romero, Jesús Villalba, Matthew Maciejewski, Vimal Manohar, Najim Dehak, Daniel Povey, Shinji Watanabe, Sanjeev Khudanpur
2018	A	`conf`	ESPnet: End-to-End Speech Processing Toolkit. INTERSPEECH Shinji Watanabe, Takaaki Hori, Shigeki Karita, Tomoki Hayashi, Jiro Nishitoba, Yuya Unno, Nelson Enrique Yalta Soplin, Jahn Heymann, Matthew Wiesner, Nanxin Chen, Adithya Renduchintala, Tsubasa Ochiai
2018	J	`jnl`	ESPnet: End-to-End Speech Processing Toolkit. CoRR Shinji Watanabe, Takaaki Hori, Shigeki Karita, Tomoki Hayashi, Jiro Nishitoba, Yuya Unno, Nelson Enrique Yalta Soplin, Jahn Heymann, Matthew Wiesner, Nanxin Chen, Adithya Renduchintala, Tsubasa Ochiai
2018	A	`conf`	Effectiveness of Single-Channel BLSTM Enhancement for Language Identification. INTERSPEECH Peter Sibbern Frederiksen, Jesús Villalba, Shinji Watanabe, Zheng-Hua Tan, Najim Dehak
2018	J	`jnl`	End-to-End Monaural Multi-speaker ASR System without Pretraining. CoRR Xuankai Chang, Yanmin Qian, Kai Yu, Shinji Watanabe
2018	Misc	`conf`	End-to-End Multi-Speaker Speech Recognition. ICASSP Shane Settle, Jonathan Le Roux, Takaaki Hori, Shinji Watanabe, John R. Hershey
2018	—	`conf`	End-to-end Speech Recognition With Word-Based Rnn Language Models. SLT Takaaki Hori, Jaejin Cho, Shinji Watanabe
2018	J	`jnl`	End-to-end Speech Recognition with Word-based RNN Language Models. CoRR Takaaki Hori, Jaejin Cho, Shinji Watanabe
2018	J	`jnl`	Improving End-to-end Speech Recognition with Pronunciation-assisted Sub-word Modeling. CoRR Hainan Xu, Shuoyang Ding, Shinji Watanabe
2018	J	`jnl`	Joint Acoustic and Class Inference for Weakly Supervised Sound Event Detection. CoRR Sandeep Kothinti, Keisuke Imoto, Debmalya Chakrabarty, Gregory Sell, Shinji Watanabe, Mounya Elhilali
2018	J	`jnl`	Language model integration based on memory control for sequence to sequence speech recognition. CoRR Jaejin Cho, Shinji Watanabe, Takaaki Hori, Murali Karthick Baskar, Hirofumi Inaguma, Jesús Villalba, Najim Dehak
2018	J	`jnl`	Low Resource Multi-modal Data Augmentation for End-to-end ASR. CoRR Matthew Wiesner, Adithya Renduchintala, Shinji Watanabe, Chunxi Liu, Najim Dehak, Sanjeev Khudanpur
2018	—	`conf`	Low-Resource Contextual Topic Identification on Speech. SLT Chunxi Liu, Matthew Wiesner, Shinji Watanabe, Craig Harman, Jan Trmal, Najim Dehak, Sanjeev Khudanpur
2018	J	`jnl`	Low-Resource Contextual Topic Identification on Speech. CoRR Chunxi Liu, Matthew Wiesner, Shinji Watanabe, Craig Harman, Jan Trmal, Najim Dehak, Sanjeev Khudanpur
2018	A	`conf`	Multi-Head Decoder for End-to-End Speech Recognition. INTERSPEECH Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda
2018	J	`jnl`	Multi-Head Decoder for End-to-End Speech Recognition. CoRR Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Kazuya Takeda
2018	A	`conf`	Multi-Modal Data Augmentation for End-to-end ASR. INTERSPEECH Adithya Renduchintala, Shuoyang Ding, Matthew Wiesner, Shinji Watanabe
2018	J	`jnl`	Multi-Modal Data Augmentation for End-to-end ASR. CoRR Adithya Renduchintala, Shuoyang Ding, Matthew Wiesner, Shinji Watanabe
2018	J	`jnl`	Multi-encoder multi-resolution framework for end-to-end speech recognition. CoRR Ruizhi Li, Xiaofei Wang, Sri Harish Reddy Mallidi, Takaaki Hori, Shinji Watanabe, Hynek Hermansky
2018	—	`conf`	Multilingual Sequence-to-Sequence Speech Recognition: Architecture, Transfer Learning, and Language Modeling. SLT Jaejin Cho, Murali Karthick Baskar, Ruizhi Li, Matthew Wiesner, Sri Harish Mallidi, Nelson Yalta, Martin Karafiát, Shinji Watanabe, Takaaki Hori
2018	J	`jnl`	Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modeling. CoRR Jaejin Cho, Murali Karthick Baskar, Ruizhi Li, Matthew Wiesner, Sri Harish Reddy Mallidi, Nelson Yalta, Martin Karafiát, Shinji Watanabe, Takaaki Hori
2018	J	`jnl`	Phasebook and Friends: Leveraging Discrete Representations for Source Separation. CoRR Jonathan Le Roux, Gordon Wichern, Shinji Watanabe, Andy M. Sarroff, John R. Hershey
2018	J	`jnl`	Promising Accurate Prefix Boosting for sequence-to-sequence ASR. CoRR Murali Karthick Baskar, Lukás Burget, Shinji Watanabe, Martin Karafiát, Takaaki Hori, Jan Honza Cernocký
2018	A	`conf`	Semi-Supervised End-to-End Speech Recognition. INTERSPEECH Shigeki Karita, Shinji Watanabe, Tomoharu Iwata, Atsunori Ogawa, Marc Delcroix
2018	Misc	`conf`	Speaker Adaptation for Multichannel End-to-End Speech Recognition. ICASSP Tsubasa Ochiai, Shinji Watanabe, Shigeru Katagiri, Takaaki Hori, John R. Hershey
2018	J	`jnl`	Stream attention-based multi-array end-to-end speech recognition. CoRR Xiaofei Wang, Ruizhi Li, Sri Harish Mallidi, Takaaki Hori, Shinji Watanabe, Hynek Hermansky
2018	A	`conf`	Student-Teacher Learning for BLSTM Mask-based Speech Enhancement. INTERSPEECH Aswin Shanmugam Subramanian, Szu-Jui Chen, Shinji Watanabe
2018	J	`jnl`	Student-Teacher Learning for BLSTM Mask-based Speech Enhancement. CoRR Aswin Shanmugam Subramanian, Szu-Jui Chen, Shinji Watanabe
2018	A	`conf`	The Fifth 'CHiME' Speech Separation and Recognition Challenge: Dataset, Task and Baselines. INTERSPEECH Jon Barker, Shinji Watanabe, Emmanuel Vincent, Jan Trmal
2018	—	`conf`	The JHU/KyotoU Speech Translation System for IWSLT 2018. IWSLT Hirofumi Inaguma, Xuan Zhang, Zhiqi Wang, Adithya Renduchintala, Shinji Watanabe, Kevin Duh
2018	J	`jnl`	The fifth 'CHiME' Speech Separation and Recognition Challenge: Dataset, task and baselines. CoRR Jon Barker, Shinji Watanabe, Emmanuel Vincent, Jan Trmal
2018	J	`jnl`	Transfer learning of language-independent end-to-end ASR with language model fusion. CoRR Hirofumi Inaguma, Jaejin Cho, Murali Karthick Baskar, Tatsuya Kawahara, Shinji Watanabe
2018	J	`jnl`	Vectorization of hypotheses and speech for faster beam search in encoder decoder-based speech recognition. CoRR Hiroshi Seki, Takaaki Hori, Shinji Watanabe
2018	J	`jnl`	Weakly Supervised Deep Recurrent Neural Networks for Basic Dance Step Generation. CoRR Nelson Yalta, Shinji Watanabe, Kazuhiro Nakadai, Tetsuya Ogata
2017	—	`ed.`	27th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2017, Tokyo, Japan, September 25-28, 2017 MLSP Naonori Ueda, Shinji Watanabe, Tomoko Matsui, Jen-Tzung Chien, Jan Larsen
2017	A	`conf`	Advances in Joint CTC-Attention Based End-to-End Speech Recognition with a Deep CNN Encoder and RNN-LM. INTERSPEECH Takaaki Hori, Shinji Watanabe, Yu Zhang, William Chan
2017	J	`jnl`	Advances in Joint CTC-Attention based End-to-End Speech Recognition with a Deep CNN Encoder and RNN-LM. CoRR Takaaki Hori, Shinji Watanabe, Yu Zhang, William Chan
2017	J	`jnl`	An analysis of environment, microphone and data simulation mismatches in robust speech recognition. Comput. Speech Lang. Emmanuel Vincent, Shinji Watanabe, Aditya Arie Nugraha, Jon Barker, Ricard Marxer
2017	Misc	`conf`	BLSTM-HMM hybrid system combined with sound activity detection network for polyphonic Sound Event Detection. ICASSP Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Takaaki Hori, Jonathan Le Roux, Kazuya Takeda
2017	C	`conf`	Composite embedding systems for ZeroSpeech2017 Track1. ASRU Hayato Shibata, Taku Kato, Takahiro Shinozaki, Shinji Watanabe
2017	A	`conf`	Coupled Initialization of Multi-Channel Non-Negative Matrix Factorization Based on Spatial and Spectral Information. INTERSPEECH Yuuki Tachioka, Tomohiro Narita, Iori Miura, Takanobu Uramoto, Natsuki Monta, Shingo Uenohara, Ken'ichi Furuya, Shinji Watanabe, Jonathan Le Roux
2017	J	`jnl`	Deep Long Short-Term Memory Adaptive Beamforming Networks For Multichannel Robust Speech Recognition. CoRR Zhong Meng, Shinji Watanabe, John R. Hershey, Hakan Erdogan
2017	—	`ch.`	Deep Recurrent Networks for Separation and Recognition of Single-Channel Speech in Nonstationary Background Audio. New Era for Robust Speech Recognition, Exploiting Deep Learning Hakan Erdogan, John R. Hershey, Shinji Watanabe, Jonathan Le Roux
2017	Misc	`conf`	Deep long short-term memory adaptive beamforming networks for multichannel robust speech recognition. ICASSP Zhong Meng, Shinji Watanabe, John R. Hershey, Hakan Erdogan
2017	—	`ch.`	Discriminative Beamforming with Phase-Aware Neural Networks for Speech Enhancement and Recognition. New Era for Robust Speech Recognition, Exploiting Deep Learning Xiong Xiao, Shinji Watanabe, Hakan Erdogan, Michael I. Mandel, Liang Lu, John R. Hershey, Michael L. Seltzer, Guoguo Chen, Yu Zhang, Dong Yu
2017	—	`conf`	Does speech enhancement work with end-to-end ASR objectives?: Experimental analysis of multichannel end-to-end ASR. MLSP Tsubasa Ochiai, Shinji Watanabe, Shigeru Katagiri
2017	J	`jnl`	Duration-Controlled LSTM for Polyphonic Sound Event Detection. IEEE ACM Trans. Audio Speech Lang. Process. Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Takaaki Hori, Jonathan Le Roux, Kazuya Takeda
2017	J	`jnl`	Hybrid CTC/Attention Architecture for End-to-End Speech Recognition. IEEE J. Sel. Top. Signal Process. Shinji Watanabe, Takaaki Hori, Suyoun Kim, John R. Hershey, Tomoki Hayashi
2017	Misc	`conf`	Joint CTC-attention based end-to-end speech recognition using multi-task learning. ICASSP Suyoun Kim, Takaaki Hori, Shinji Watanabe
2017	—	`conf`	Joint CTC/attention decoding for end-to-end speech recognition. ACL (1) Takaaki Hori, Shinji Watanabe, John R. Hershey
2017	C	`conf`	Language independent end-to-end architecture for joint language identification and speech recognition. ASRU Shinji Watanabe, Takaaki Hori, John R. Hershey
2017	C	`conf`	Multi-level language modeling and decoding for open vocabulary end-to-end speech recognition. ASRU Takaaki Hori, Shinji Watanabe, John R. Hershey
2017	J	`jnl`	Multi-microphone speech recognition in everyday environments. Comput. Speech Lang. Jon Barker, Ricard Marxer, Emmanuel Vincent, Shinji Watanabe
2017	J	`jnl`	Multi-microphone speech recognition integrating beamforming, robust feature extraction, and advanced DNN/RNN backend. Comput. Speech Lang. Takaaki Hori, Zhuo Chen, Hakan Erdogan, John R. Hershey, Jonathan Le Roux, Vikramjit Mitra, Shinji Watanabe
2017	A*	`conf`	Multichannel End-to-end Speech Recognition. ICML Tsubasa Ochiai, Shinji Watanabe, Takaaki Hori, John R. Hershey
2017	J	`jnl`	Multichannel End-to-end Speech Recognition. CoRR Tsubasa Ochiai, Shinji Watanabe, Takaaki Hori, John R. Hershey
2017	—	`book`	New Era for Robust Speech Recognition, Exploiting Deep Learning. Shinji Watanabe, Marc Delcroix, Florian Metze, John R. Hershey
2017	—	`ch.`	Novel Deep Architectures in Speech Processing. New Era for Robust Speech Recognition, Exploiting Deep Learning John R. Hershey, Jonathan Le Roux, Shinji Watanabe, Scott Wisdom, Zhuo Chen, Yusuf Ziya Isik
2017	—	`ch.`	Preliminaries. New Era for Robust Speech Recognition, Exploiting Deep Learning Shinji Watanabe, Marc Delcroix, Florian Metze, John R. Hershey
2017	J	`jnl`	Prior-based Binary Masking and Discriminative Methods for Reverberant and Noisy Speech Recognition Using Distant Stereo Microphones. J. Inf. Process. Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2017	A	`conf`	Semi-Supervised Learning of a Pronunciation Dictionary from Disjoint Phonemic Transcripts and Text. INTERSPEECH Takahiro Shinozaki, Shinji Watanabe, Daichi Mochihashi, Graham Neubig
2017	Misc	`conf`	Student-teacher network learning with enhanced features. ICASSP Shinji Watanabe, Takaaki Hori, Jonathan Le Roux, John R. Hershey
2017	—	`ch.`	The CHiME Challenges: Robust Speech Recognition in Everyday Environments. New Era for Robust Speech Recognition, Exploiting Deep Learning Jon P. Barker, Ricard Marxer, Emmanuel Vincent, Shinji Watanabe
2017	J	`jnl`	The third 'CHiME' speech separation and recognition challenge: Analysis and outcomes. Comput. Speech Lang. Jon Barker, Ricard Marxer, Emmanuel Vincent, Shinji Watanabe
2017	—	`ch.`	Toolkits for Robust Speech Processing. New Era for Robust Speech Recognition, Exploiting Deep Learning Shinji Watanabe, Takaaki Hori, Yajie Miao, Marc Delcroix, Florian Metze, John R. Hershey
2017	—	`ch.`	Training Data Augmentation and Data Selection. New Era for Robust Speech Recognition, Exploiting Deep Learning Martin Karafiát, Karel Veselý, Katerina Zmolíková, Marc Delcroix, Shinji Watanabe, Lukás Burget, Jan Honza Cernocký, Igor Szöke
2017	J	`jnl`	Unified Architecture for Multichannel End-to-End Speech Recognition With Neural Beamforming. IEEE J. Sel. Top. Signal Process. Tsubasa Ochiai, Shinji Watanabe, Takaaki Hori, John R. Hershey, Xiong Xiao
2016	—	`conf`	Automated structure discovery and parameter tuning of neural network language model based on evolution strategy. SLT Tomohiro Tanaka, Takafumi Moriya, Takahiro Shinozaki, Shinji Watanabe, Takaaki Hori, Kevin Duh
2016	—	`conf`	Beamforming networks using spatial covariance features for far-field speech recognition. APSIPA Xiong Xiao, Shinji Watanabe, Eng Siong Chng, Haizhou Li
2016	—	`conf`	Bidirectional LSTM-HMM Hybrid System for Polyphonic Sound Event Detection. DCASE Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Takaaki Hori, Jonathan Le Roux, Kazuya Takeda
2016	A	`conf`	Context-Sensitive and Role-Dependent Spoken Language Understanding Using Bidirectional and Attention LSTMs. INTERSPEECH Chiori Hori, Takaaki Hori, Shinji Watanabe, John R. Hershey
2016	A	`conf`	Data Selection by Sequence Summarizing Neural Network in Mismatch Condition Training. INTERSPEECH Katerina Zmolíková, Martin Karafiát, Karel Veselý, Marc Delcroix, Shinji Watanabe, Lukás Burget, Jan Cernocký
2016	Misc	`conf`	Deep beamforming networks for multi-channel speech recognition. ICASSP Xiong Xiao, Shinji Watanabe, Hakan Erdogan, Liang Lu, John R. Hershey, Michael L. Seltzer, Guoguo Chen, Yu Zhang, Michael I. Mandel, Dong Yu
2016	Misc	`conf`	Deep clustering: Discriminative embeddings for segmentation and separation. ICASSP John R. Hershey, Zhuo Chen, Jonathan Le Roux, Shinji Watanabe
2016	Misc	`conf`	Deep unfolding for multichannel source separation. ICASSP Scott Wisdom, John R. Hershey, Jonathan Le Roux, Shinji Watanabe
2016	—	`conf`	Dialog state tracking with attention-based sequence-to-sequence learning. SLT Takaaki Hori, Hai Wang, Chiori Hori, Shinji Watanabe, Bret Harsham, Jonathan Le Roux, John R. Hershey, Yusuke Koji, Yi Jing, Zhaocheng Zhu, Takeyuki Aikawa
2016	A	`conf`	Driver confusion status detection using recurrent neural networks. ICME Chiori Hori, Shinji Watanabe, Takaaki Hori, Bret A. Harsham, John R. Hershey, Yusuke Koji, Youichi Fujii, Yuki Furumoto
2016	—	`conf`	High-accuracy user identification using EEG biometrics. EMBC Toshiaki Koike-Akino, Ruhi Mahajan, Tim K. Marks, Ye Wang, Shinji Watanabe, Oncel Tuzel, Philip V. Orlik
2016	A	`conf`	Improved MVDR Beamforming Using Single-Channel Mask Prediction Networks. INTERSPEECH Hakan Erdogan, John R. Hershey, Shinji Watanabe, Michael I. Mandel, Jonathan Le Roux
2016	J	`jnl`	Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learning. CoRR Suyoun Kim, Takaaki Hori, Shinji Watanabe
2016	Misc	`conf`	Minimum word error training of long short-term memory recurrent neural network language models for speech recognition. ICASSP Takaaki Hori, Chiori Hori, Shinji Watanabe, John R. Hershey
2016	Misc	`conf`	Sequence summarizing neural network for speaker adaptation. ICASSP Karel Veselý, Shinji Watanabe, Katerina Zmolíková, Martin Karafiát, Lukás Burget, Jan Honza Cernocký
2016	A	`conf`	Single-Channel Multi-Speaker Separation Using Deep Clustering. INTERSPEECH Yusuf Ziya Isik, Jonathan Le Roux, Zhuo Chen, Shinji Watanabe, John R. Hershey
2016	J	`jnl`	Single-Channel Multi-Speaker Separation using Deep Clustering. CoRR Yusuf Ziya Isik, Jonathan Le Roux, Zhuo Chen, Shinji Watanabe, John R. Hershey
2015	C	`conf`	Automation of system building for state-of-the-art large vocabulary speech recognition using evolution strategy. ASRU Takafumi Moriya, Tomohiro Tanaka, Takahiro Shinozaki, Shinji Watanabe, Kevin Duh
2015	—	`book`	Bayesian Speech and Language Processing Shinji Watanabe, Jen-Tzung Chien
2015	J	`jnl`	Deep clustering: Discriminative embeddings for segmentation and separation. CoRR John R. Hershey, Zhuo Chen, Jonathan Le Roux, Shinji Watanabe
2015	Misc	`conf`	Discriminative method for recurrent neural network language models. ICASSP Yuuki Tachioka, Shinji Watanabe
2015	J	`jnl`	Effectiveness of dereverberation, feature transformation, discriminative training methods, and system combination approach for various reverberant environments. EURASIP J. Adv. Signal Process. Yuuki Tachioka, Tomohiro Narita, Shinji Watanabe
2015	A	`conf`	Efficient learning for spoken language understanding tasks with word embedding based pre-training. INTERSPEECH Yi Luan, Shinji Watanabe, Bret Harsham
2015	—	`conf`	Feature-space structural MAPLR with regression tree-based multiple transformation matrices for DNN. APSIPA Hiroki Kanagawa, Yuuki Tachioka, Shinji Watanabe, Jun Ishii
2015	Misc	`conf`	Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks. ICASSP Hakan Erdogan, John R. Hershey, Shinji Watanabe, Jonathan Le Roux
2015	A	`conf`	Robust speech processing using observation uncertainty and uncertainty propagation: session and paper overview. INTERSPEECH Ramón Fernandez Astudillo, Shinji Watanabe, Ahmed Hussen Abdelaziz, Dorothea Kolossa
2015	C	`conf`	Robust speech recognition in unknown reverberant and noisy conditions. ASRU Roger Hsiao, Jeff Z. Ma, William Hartmann, Martin Karafiát, Frantisek Grézl, Lukás Burget, Igor Szöke, Jan Cernocký, Shinji Watanabe, Zhuo Chen, Sri Harish Reddy Mallidi, Hynek Hermansky, Stavros Tsakalidis, Richard M. Schwartz
2015	—	`conf`	Speech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR. LVA/ICA Felix Weninger, Hakan Erdogan, Shinji Watanabe, Emmanuel Vincent, Jonathan Le Roux, John R. Hershey, Björn W. Schuller
2015	A	`conf`	Speech enhancement and recognition using multi-task learning of long short-term memory recurrent neural networks. INTERSPEECH Zhuo Chen, Shinji Watanabe, Hakan Erdogan, John R. Hershey
2015	Misc	`conf`	Structure discovery of deep neural network based on evolutionary algorithms. ICASSP Takahiro Shinozaki, Shinji Watanabe
2015	C	`conf`	The MERL/SRI system for the 3RD CHiME challenge using beamforming, robust feature extraction, and advanced speech recognition. ASRU Takaaki Hori, Zhuo Chen, Hakan Erdogan, John R. Hershey, Jonathan Le Roux, Vikramjit Mitra, Shinji Watanabe
2015	C	`conf`	The third 'CHiME' speech separation and recognition challenge: Dataset, task and baselines. ASRU Jon Barker, Ricard Marxer, Emmanuel Vincent, Shinji Watanabe
2015	A	`conf`	Uncertainty propagation through deep neural networks. INTERSPEECH Ahmed Hussen Abdelaziz, Shinji Watanabe, John R. Hershey, Emmanuel Vincent, Dorothea Kolossa
2015	A	`conf`	Uncertainty training and decoding methods of deep neural networks based on stochastic representation of enhanced features. INTERSPEECH Yuuki Tachioka, Shinji Watanabe
2014	Misc	`conf`	Black box optimization for automatic speech recognition. ICASSP Shinji Watanabe, Jonathan Le Roux
2014	A	`conf`	Cost-level integration of statistical and rule-based dialog managers. INTERSPEECH Shinji Watanabe, John R. Hershey, Tim K. Marks, Youichi Fujii, Yusuke Koji
2014	Misc	`conf`	Deep recurrent de-noising auto-encoder and blind de-reverberation for reverberated speech recognition. ICASSP Felix Weninger, Shinji Watanabe, Yuuki Tachioka, Björn W. Schuller
2014	A	`conf`	Discriminative NMF and its application to single-channel source separation. INTERSPEECH Felix Weninger, Jonathan Le Roux, John R. Hershey, Shinji Watanabe
2014	—	`conf`	Ensemble integration of calibrated speaker localization and statistical speech detection in domestic environments. HSCMA Yuuki Tachioka, Tomohiro Narita, Shinji Watanabe, Jonathan Le Roux
2014	Misc	`conf`	Log-linear dialog manager. ICASSP Hao Tang, Shinji Watanabe, Tim K. Marks, John R. Hershey
2014	Misc	`conf`	Recurrent deep neural networks for robust speech recognition. ICASSP Chao Weng, Dong Yu, Shinji Watanabe, Biing-Hwang Fred Juang
2014	—	`conf`	Sequence discriminative training for low-rank deep neural networks. GlobalSIP Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2014	A	`conf`	Sequential maximum mutual information linear discriminant analysis for speech recognition. INTERSPEECH Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2014	J	`jnl`	Structural Bayesian Linear Regression for Hidden Markov Models. J. Signal Process. Syst. Shinji Watanabe, Atsushi Nakamura, Biing-Hwang Fred Juang
2013	C	`conf`	A generalized discriminative training framework for system combination. ASRU Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2013	—	`conf`	Blocked Gibbs sampling based multi-scale mixture model for speaker clustering on noisy data. MLSP Naohiro Tawara, Tetsuji Ogawa, Shinji Watanabe, Atsushi Nakamura, Tetsunori Kobayashi
2013	J	`jnl`	Cluster-based dynamic variance adaptation for interconnecting speech enhancement pre-processor and speech recognizer. Comput. Speech Lang. Marc Delcroix, Shinji Watanabe, Tomohiro Nakatani, Atsushi Nakamura
2013	A	`conf`	Discriminative training of acoustic models for system combination. INTERSPEECH Yuuki Tachioka, Shinji Watanabe
2013	Misc	`conf`	Effectiveness of discriminative training and feature transformation for reverberated and noisy speech. ICASSP Yuuki Tachioka, Shinji Watanabe, John R. Hershey
2013	—	`conf`	Ensemble learning for speech enhancement. WASPAA Jonathan Le Roux, Shinji Watanabe, John R. Hershey
2013	J	`jnl`	Feature Enhancement With Joint Use of Consecutive Corrupted and Noise Feature Vectors With Discriminative Region Weighting. IEEE Trans. Speech Audio Process. Masayuki Suzuki, Takuya Yoshioka, Shinji Watanabe, Nobuaki Minematsu, Keikichi Hirose
2013	J	`jnl`	Influence relation estimation based on lexical entrainment in conversation. Speech Commun. Tomoharu Iwata, Shinji Watanabe
2013	J	`jnl`	Prior-shared feature and model space speaker adaptation by consistently employing map estimation. Speech Commun. Seong-Jun Hahm, Shinji Watanabe, Atsunori Ogawa, Masakiyo Fujimoto, Takaaki Hori, Atsushi Nakamura
2013	J	`jnl`	Speech recognition in living rooms: Integrated speech enhancement and recognition system based on spatial, spectral and temporal modeling of sounds. Comput. Speech Lang. Marc Delcroix, Keisuke Kinoshita, Tomohiro Nakatani, Shoko Araki, Atsunori Ogawa, Takaaki Hori, Shinji Watanabe, Masakiyo Fujimoto, Takuya Yoshioka, Takanobu Oba, Yotaro Kubo, Mehrez Souden, Seong-Jun Hahm, Atsushi Nakamura
2013	B	`conf`	Statistical Dialogue Management using Intention Dependency Graph. IJCNLP Koichiro Yoshino, Shinji Watanabe, Jonathan Le Roux, John R. Hershey
2013	Misc	`conf`	Stereo-based feature enhancement using dictionary learning. ICASSP Shinji Watanabe, John R. Hershey
2013	C	`conf`	The second 'CHiME' speech separation and recognition challenge: An overview of challenge systems and outcomes. ASRU Emmanuel Vincent, Jon Barker, Shinji Watanabe, Jonathan Le Roux, Francesco Nesta, Marco Matassoni
2013	Misc	`conf`	The second 'chime' speech separation and recognition challenge: Datasets, tasks and baselines. ICASSP Emmanuel Vincent, Jon Barker, Shinji Watanabe, Jonathan Le Roux, Francesco Nesta, Marco Matassoni
2013	J	`jnl`	Training data selection with user's physical characteristics data for acceleration-based activity modeling. Pers. Ubiquitous Comput. Takuya Maekawa, Shinji Watanabe
2012	Misc	`conf`	Bag Of ARCS: New representation of speech segment features based on finite state machines. ICASSP Shinji Watanabe, Yotaro Kubo, Takanobu Oba, Takaaki Hori, Atsushi Nakamura
2012	Misc	`conf`	Basis vector orthogonalization for an improved kernel gradient matching pursuit method. ICASSP Yotaro Kubo, Shinji Watanabe, Atsushi Nakamura, Simon Wiesler, Ralf Schlüter, Hermann Ney
2012	Misc	`conf`	Decoding network optimization using minimum transition error training. ICASSP Yotaro Kubo, Shinji Watanabe, Atsushi Nakamura
2012	Misc	`conf`	Discriminative feature transforms using differenced maximum mutual information. ICASSP Marc Delcroix, Atsunori Ogawa, Shinji Watanabe, Tomohiro Nakatani, Atsushi Nakamura
2012	Misc	`conf`	Effect of dialog acts on word use in polylogue. ICASSP Roland Roller, Shinji Watanabe, Tomoharu Iwata
2012	J	`jnl`	Frame-wise model re-estimation method based on Gaussian pruning with weight normalization for noise robust voice activity detection. Speech Commun. Masakiyo Fujimoto, Shinji Watanabe, Tomohiro Nakatani
2012	Misc	`conf`	Fully Bayesian inference of multi-mixture Gaussian model and its evaluation using speaker clustering. ICASSP Naohiro Tawara, Tetsuji Ogawa, Shinji Watanabe, Tetsunori Kobayashi
2012	A	`conf`	Fully Bayesian speaker clustering based on hierarchically structured utterance-oriented Dirichlet process mixture model. INTERSPEECH Naohiro Tawara, Tetsuji Ogawa, Shinji Watanabe, Atsushi Nakamura, Tetsunori Kobayashi
2012	Misc	`conf`	Handling uncertain observations in unsupervised topic-mixture language model adaptation. ICASSP Ekapol Chuangsuwanich, Shinji Watanabe, Takaaki Hori, Tomoharu Iwata, James R. Glass
2012	J	`jnl`	Low-Latency Real-Time Meeting Recognition and Understanding Using Distant Microphones and Omni-Directional Camera. IEEE Trans. Speech Audio Process. Takaaki Hori, Shoko Araki, Takuya Yoshioka, Masakiyo Fujimoto, Shinji Watanabe, Takanobu Oba, Atsunori Ogawa, Kazuhiro Otsuka, Dan Mikami, Keisuke Kinoshita, Tomohiro Nakatani, Atsushi Nakamura, Junji Yamato
2012	Misc	`conf`	MFCC enhancement using joint corrupted and noise feature space for highly non-stationary noise environments. ICASSP Masayuki Suzuki, Takuya Yoshioka, Shinji Watanabe, Nobuaki Minematsu, Keikichi Hirose
2012	Misc	`conf`	Noise suppression with unsupervised joint speaker adaptation and noise mixture model estimation. ICASSP Masakiyo Fujimoto, Shinji Watanabe, Tomohiro Nakatani
2012	J	`jnl`	Statistical Voice Conversion Based on Noisy Channel Model. IEEE Trans. Speech Audio Process. Daisuke Saito, Shinji Watanabe, Atsushi Nakamura, Nobuaki Minematsu
2012	J	`jnl`	Structural Classification Methods Based on Weighted Finite-State Transducers for Automatic Speech Recognition. IEEE Trans. Speech Audio Process. Yotaro Kubo, Shinji Watanabe, Takaaki Hori, Atsushi Nakamura
2011	A	`conf`	A Robust Estimation Method of Noise Mixture Model for Noise Suppression. INTERSPEECH Masakiyo Fujimoto, Shinji Watanabe, Tomohiro Nakatani
2011	—	`conf`	Bayesian linear regression for Hidden Markov Model based on optimizing variational bounds. MLSP Shinji Watanabe, Atsushi Nakamura, Biing-Hwang Juang
2011	A*	`conf`	Fashion Coordinates Recommender System Using Photographs from Fashion Magazines. IJCAI Tomoharu Iwata, Shinji Watanabe, Hiroshi Sawada
2011	Misc	`conf`	Gibbs sampling based Multi-scale Mixture Model for speaker clustering. ICASSP Shinji Watanabe, Daichi Mochihashi, Takaaki Hori, Atsushi Nakamura
2011	Misc	`conf`	High accurate model-integration-based voice conversion using dynamic features and model structure optimization. ICASSP Daisuke Saito, Shinji Watanabe, Atsushi Nakamura, Nobuaki Minematsu
2011	A	`conf`	Learning Influences from Word Use in Polylogue. INTERSPEECH Tomoharu Iwata, Shinji Watanabe
2011	A	`conf`	Model Adaptation for Automatic Speech Recognition Based on Multiple Time Scale Evolution. INTERSPEECH Shinji Watanabe, Atsushi Nakamura, Biing-Hwang Juang
2011	Misc	`conf`	Non-stationary noise estimation method based on bias-residual component decomposition for robust speech recognition. ICASSP Masakiyo Fujimoto, Shinji Watanabe, Tomohiro Nakatani
2011	A	`conf`	Speaker Clustering Based on Utterance-Oriented Dirichlet Process Mixture Model. INTERSPEECH Naohiro Tawara, Shinji Watanabe, Tetsuji Ogawa, Tetsunori Kobayashi
2011	Misc	`conf`	Subspace pursuit method for kernel-log-linear models. ICASSP Yotaro Kubo, Simon Wiesler, Ralf Schlüter, Hermann Ney, Shinji Watanabe, Atsushi Nakamura, Tetsunori Kobayashi
2011	J	`jnl`	Topic tracking language model for speech recognition. Comput. Speech Lang. Shinji Watanabe, Tomoharu Iwata, Takaaki Hori, Atsushi Sako, Yasuo Ariki
2011	Misc	`conf`	Unsupervised Activity Recognition with User's Physical Characteristics Data. ISWC Takuya Maekawa, Shinji Watanabe
2011	—	`ch.`	Variance Compensation for Recognition of Reverberant Speech with Dereverberation Preprocessing. Robust Speech Recognition of Uncertain or Missing Data Marc Delcroix, Shinji Watanabe, Tomohiro Nakatani
2010	J	`jnl`	A Sequential Pattern Classifier Based on Hidden Markov Kernel Machine and Its Application to Phoneme Classification. IEEE J. Sel. Top. Signal Process. Yotaro Kubo, Shinji Watanabe, Atsushi Nakamura, Erik McDermott, Tetsunori Kobayashi
2010	Misc	`conf`	A discriminative model for continuous speech recognition based on Weighted Finite State Transducers. ICASSP Shinji Watanabe, Takaaki Hori, Erik McDermott, Atsushi Nakamura
2010	A	`conf`	A regularized discriminative training method of acoustic models derived by minimum relative entropy discrimination. INTERSPEECH Yotaro Kubo, Shinji Watanabe, Atsushi Nakamura, Tetsunori Kobayashi
2010	—	`conf`	Application of topic tracking model to language model adaptation and meeting analysis. SLT Shinji Watanabe, Tomoharu Iwata, Takaaki Hori, Atsushi Sako, Yasuo Ariki
2010	Misc	`conf`	Discriminative training based on an integrated view of MPE and MMI in margin and error space. ICASSP Erik McDermott, Shinji Watanabe, Atsushi Nakamura
2010	Misc	`conf`	Fast similarity search on a large speech data set with neighborhood graph indexing. ICASSP Kazuo Aoyama, Shinji Watanabe, Hiroshi Sawada, Yasuhiro Minami, Naonori Ueda, Kazumi Saito
2010	A	`conf`	Improvements of search error risk minimization in viterbi beam search for speech recognition. INTERSPEECH Takaaki Hori, Shinji Watanabe, Atsushi Nakamura
2010	A	`conf`	Large vocabulary continuous speech recognition using WFST-based linear classifier for structured data. INTERSPEECH Shinji Watanabe, Takaaki Hori, Atsushi Nakamura
2010	Misc	`conf`	Minimum Error Classification with geometric margin control. ICASSP Hideyuki Watanabe, Shigeru Katagiri, Kouta Yamada, Erik McDermott, Atsushi Nakamura, Shinji Watanabe, Miho Ohsaki
2010	J	`jnl`	Online Unsupervised Classification With Model Comparison in the Variational Bayes Framework for Voice Activity Detection. IEEE J. Sel. Top. Signal Process. David Cournapeau, Shinji Watanabe, Atsushi Nakamura, Tatsuya Kawahara
2010	J	`jnl`	Predictor-Corrector Adaptation by Using Time Evolution System With Macroscopic Time Scale. IEEE Trans. Speech Audio Process. Shinji Watanabe, Atsushi Nakamura
2010	A	`conf`	Probabilistic integration of joint density model and speaker model for voice conversion. INTERSPEECH Daisuke Saito, Shinji Watanabe, Atsushi Nakamura, Nobuaki Minematsu
2010	—	`conf`	Real-time meeting recognition and understanding using distant microphones and omni-directional camera. SLT Takaaki Hori, Shoko Araki, Takuya Yoshioka, Masakiyo Fujimoto, Shinji Watanabe, Takanobu Oba, Atsunori Ogawa, Kazuhiro Otsuka, Dan Mikami, Keisuke Kinoshita, Tomohiro Nakatani, Atsushi Nakamura, Junji Yamato
2010	Misc	`conf`	Search error risk minimization in Viterbi beam search for speech recognition. ICASSP Takaaki Hori, Shinji Watanabe, Atsushi Nakamura
2010	Misc	`conf`	Using online model comparison in the Variational Bayes framework for online unsupervised Voice Activity Detection. ICASSP David Cournapeau, Shinji Watanabe, Atsushi Nakamura, Tatsuya Kawahara
2010	A	`conf`	Voice activity detection using frame-wise model re-estimation method based on Gaussian pruning with weight normalization. INTERSPEECH Masakiyo Fujimoto, Shinji Watanabe, Tomohiro Nakatani
2009	Misc	`conf`	A unified view for discriminative objective functions based on negative exponential of difference measure between strings. ICASSP Atsushi Nakamura, Erik McDermott, Shinji Watanabe, Shigeru Katagiri
2009	A	`conf`	Margin-space integration of MPE loss via differencing of MMI functionals for generalized error-weighted discriminative training. INTERSPEECH Erik McDermott, Shinji Watanabe, Atsushi Nakamura
2009	Misc	`conf`	On-line adaptation and Bayesian detection of environmental changes based on a macroscopic time evolution system. ICASSP Shinji Watanabe, Atsushi Nakamura
2009	J	`jnl`	Static and Dynamic Variance Compensation for Recognition of Reverberant Speech With Dereverberation Preprocessing. IEEE Trans. Speech Audio Process. Marc Delcroix, Tomohiro Nakatani, Shinji Watanabe
2009	A	`conf`	Stereo-input speech recognition using sparseness-based time-frequency masking in a reverberant environment. INTERSPEECH Yosuke Izumi, Kenta Nishiki, Shinji Watanabe, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama
2009	A*	`conf`	Topic Tracking Model for Analyzing Consumer Purchase Behavior. IJCAI Tomoharu Iwata, Shinji Watanabe, Takeshi Yamada, Naonori Ueda
2008	Misc	`conf`	A unified interpretation of adaptation approaches based on a macroscopic time evolution system and indirect/direct adaptation approaches. ICASSP Shinji Watanabe, Atsushi Nakamura
2008	Misc	`conf`	Combined static and dynamic variance adaptation for efficient interconnection of speech enhancement pre-processor with speech recognizer. ICASSP Marc Delcroix, Tomohiro Nakatani, Shinji Watanabe
2007	—	`conf`	Incremental Adaptation Based on a Macroscopic Time Evolution System. ICASSP (4) Shinji Watanabe, Atsushi Nakamura
2006	—	`conf`	Acoustic Model Adaptation Based on Coarse/Fine Training of Transfer Vectors Using Directional Statistics. ICASSP (1) Shinji Watanabe, Atsushi Nakamura
2006	J	`jnl`	Advanced computational models and learning theories for spoken language processing. IEEE Comput. Intell. Mag. Atsushi Nakamura, Shinji Watanabe, Takaaki Hori, Erik McDermott, Shigeru Katagiri
2006	J	`jnl`	Automatic determination of acoustic model topology using variational Bayesian estimation and clustering for large vocabulary continuous speech recognition. IEEE Trans. Speech Audio Process. Shinji Watanabe, Atsushi Sako, Atsushi Nakamura
2006	J	`jnl`	Speech Recognition Based on Student's t-Distribution Derived from Total Bayesian Framework. IEICE Trans. Inf. Syst. Shinji Watanabe, Atsushi Nakamura
2005	A	`conf`	Effects of Bayesian predictive classification using variational Bayesian posteriors for sparse training data in speech recognition. INTERSPEECH Shinji Watanabe, Atsushi Nakamura
2005	J	`jnl`	Selection of Shared-State Hidden Markov Model Structure Using Bayesian Criterion. IEICE Trans. Inf. Syst. Shinji Watanabe, Yasuhiro Minami, Atsushi Nakamura, Naonori Ueda
2004	A	`conf`	Acoustic model adaptation based on coarse/fine training of transfer vectors and its application to a speaker adaptation task. INTERSPEECH Shinji Watanabe
2004	—	`conf`	Automatic determination of acoustic model topology using variational Bayesian estimation and clustering. ICASSP (1) Shinji Watanabe, Atsushi Sako, Atsushi Nakamura
2004	—	`conf`	Bayesian modelling of the speech spectrum using mixture of Gaussians. ICASSP (1) Parham Zolfaghari, Shinji Watanabe, Atsushi Nakamura, Shigeru Katagiri
2004	J	`jnl`	Variational bayesian estimation and clustering for speech recognition. IEEE Trans. Speech Audio Process. Shinji Watanabe, Yasuhiro Minami, Atsushi Nakamura, Naonori Ueda
2003	—	`conf`	Application of variational Bayesian estimation and clustering to acoustic model adaptation. ICASSP (1) Shinji Watanabe, Yasuhiro Minami, Atsushi Nakamura, Naonori Ueda
2002	—	`conf`	Application of Variational Bayesian Approach to Speech Recognition. NIPS Shinji Watanabe, Yasuhiro Minami, Atsushi Nakamura, Naonori Ueda
2002	A	`conf`	Constructing shared-state hidden Markov models based on a Bayesian approach. INTERSPEECH Shinji Watanabe, Yasuhiro Minami, Atsushi Nakamura, Naonori Ueda