Yifan Peng

96 papers A* 5A 16C 4Misc 11Journal 46Unranked 14
YearRankTypeTitle / Venue / Authors
2025 A* conf
Context-aware Dynamic Pruning for Speech Foundation Models.
ICLR
Masao Someki, Yifan Peng, Siddhant Arora, Markus Müller, Athanasios Mouchtaris, Grant P. Strimel, Jing Liu, Shinji Watanabe
2025 J jnl
DYNAC: Dynamic Vocabulary based Non-Autoregressive Contextualization for Speech Recognition.
CoRR
Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025 A conf
DYNAC: Dynamic Vocabulary-based Non-Autoregressive Contextualization for Speech Recognition.
INTERSPEECH
Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025 — conf
ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems.
NAACL (System Demonstrations)
Siddhant Arora, Yifan Peng, Jiatong Shi, Jinchuan Tian, William Chen, Shikhar Bharadwaj, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shuichiro Shimizu, Vaibhav Srivastav, Shinji Watanabe
2025 J jnl
ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems.
CoRR
Siddhant Arora, Yifan Peng, Jiatong Shi, Jinchuan Tian, William Chen, Shikhar Bharadwaj, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shuichiro Shimizu, Vaibhav Srivastav, Shinji Watanabe
2025 — conf
ESPnet-SpeechLM: An Open Speech Language Model Toolkit.
NAACL (System Demonstrations)
Jinchuan Tian, Jiatong Shi, William Chen, Siddhant Arora, Yoshiki Masuyama, Takashi Maekaku, Yihan Wu, Junyi Peng, Shikhar Bharadwaj, Yiwen Zhao, Samuele Cornell, Yifan Peng, Xiang Yue, Chao-Han Huck Yang, Graham Neubig, Shinji Watanabe
2025 J jnl
ESPnet-SpeechLM: An Open Speech Language Model Toolkit.
CoRR
Jinchuan Tian, Jiatong Shi, William Chen, Siddhant Arora, Yoshiki Masuyama, Takashi Maekaku, Yihan Wu, Junyi Peng, Shikhar Bharadwaj, Yiwen Zhao, Samuele Cornell, Yifan Peng, Xiang Yue, Chao-Han Huck Yang, Graham Neubig, Shinji Watanabe
2025 A* conf
Enhancing Audiovisual Speech Recognition Through Bifocal Preference Optimization.
AAAI
Yihan Wu, Yichen Lu, Yifan Peng, Xihua Wang, Ruihua Song, Shinji Watanabe
2025 A conf
Exploring Linear Variant Transformers and k-NN Memory Inference for Long-Form ASR.
INTERSPEECH
Carlos Carvalho, Jinchuan Tian, William Chen, Yifan Peng, Alberto Abad, Shinji Watanabe
2025 A conf
Granary: Speech Recognition and Translation Dataset in 25 European Languages.
INTERSPEECH
Nithin Rao Koluguri, Monica Sekoyan, George Zelenfroynd, Sasha Meister, Shuoyang Ding, Sofia Kostandian, He Huang, Nikolay Karpov, Jagadeesh Balam, Vitaly Lavrukhin, Yifan Peng, Sara Papi, Marco Gaido, Alessio Brutti, Boris Ginsburg
2025 J jnl
Granary: Speech Recognition and Translation Dataset in 25 European Languages.
CoRR
Nithin Rao Koluguri, Monica Sekoyan, George Zelenfroynd, Sasha Meister, Shuoyang Ding, Sofia Kostandian, He Huang, Nikolay Karpov, Jagadeesh Balam, Vitaly Lavrukhin, Yifan Peng, Sara Papi, Marco Gaido, Alessio Brutti, Boris Ginsburg
2025 A conf
Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC.
INTERSPEECH
Qingzheng Wang, Jiancheng Sun, Yifan Peng, Shinji Watanabe
2025 J jnl
Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC.
CoRR
Qingzheng Wang, Jiancheng Sun, Yifan Peng, Shinji Watanabe
2025 A* conf
OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models.
ICML
William Chen, Jinchuan Tian, Yifan Peng, Brian Yan, Chao-Han Huck Yang, Shinji Watanabe
2025 J jnl
OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models.
CoRR
William Chen, Jinchuan Tian, Yifan Peng, Brian Yan, Chao-Han Huck Yang, Shinji Watanabe
2025 A conf
OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning.
INTERSPEECH
Yifan Peng, Muhammad Shakeel, Yui Sudo, William Chen, Jinchuan Tian, Chyi-Jiunn Lin, Shinji Watanabe
2025 J jnl
OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning.
CoRR
Yifan Peng, Muhammad Shakeel, Yui Sudo, William Chen, Jinchuan Tian, Chyi-Jiunn Lin, Shinji Watanabe
2025 J jnl
On The Landscape of Spoken Language Models: A Comprehensive Survey.
CoRR
Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien, Yifan Peng, Haibin Wu, Yossi Adi, Emmanuel Dupoux, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025 J jnl
On The Landscape of Spoken Language Models: A Comprehensive Survey.
Trans. Mach. Learn. Res.
Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien, Yifan Peng, Haibin Wu, Yossi Adi, Emmanuel Dupoux, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025 C conf
Open Full-duplex Voice Agent with Speech-to-Speech Language Model.
ASRU
Edresson Casanova, Chen Chen, Kevin Hu, Ankita Pasad, Elena Rastorgueva, Seelan Lakshmi Narasimhan, Slyne Deng, Ehsan Hosseini-Asl, Piotr Zelasko, Valentin Mendelev, Subhankar Ghosh, Yifan Peng, Zhehuai Chen, Jason Li, Jagadeesh Balam, Vitaly Lavrukhin, Boris Ginsburg
2025 A conf
OpusLM: A Family of Open Unified Speech Language Models.
INTERSPEECH
Jinchuan Tian, William Chen, Yifan Peng, Jiatong Shi, Siddhant Arora, Shikhar Bharadwaj, Takashi Maekaku, Yusuke Shinohara, Keita Goto, Xiang Yue, Huck Yang, Shinji Watanabe
2025 J jnl
OpusLM: A Family of Open Unified Speech Language Models.
CoRR
Jinchuan Tian, William Chen, Yifan Peng, Jiatong Shi, Siddhant Arora, Shikhar Bharadwaj, Takashi Maekaku, Yusuke Shinohara, Keita Goto, Xiang Yue, Huck Yang, Shinji Watanabe
2025 C conf
Unifying Diarization, Separation, and ASR with Multi-Speaker Encoder.
ASRU
Muhammad Shakeel, Yui Sudo, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025 J jnl
Unifying Diarization, Separation, and ASR with Multi-Speaker Encoder.
CoRR
Muhammad Shakeel, Yui Sudo, Yifan Peng, Chyi-Jiunn Lin, Shinji Watanabe
2025 — conf
VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning.
NAACL (Long Papers)
Yifan Peng, Krishna C. Puvvada, Zhehuai Chen, Piotr Zelasko, He Huang, Kunal Dhawan, Ke Hu, Shinji Watanabe, Jagadeesh Balam, Boris Ginsburg
2024 J jnl
4D ASR: Joint Beam Search Integrating CTC, Attention, Transducer, and Mask Predict Decoders.
CoRR
Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Brian Yan, Jiatong Shi, Yifan Peng, Shinji Watanabe
2024 J jnl
An Empirical Study of Speech Language Models for Prompt-Conditioned Speech Synthesis.
CoRR
Yifan Peng, Ilia Kulikov, Yilin Yang, Sravya Popuri, Hui Lu, Changhan Wang, Hongyu Gong
2024 Misc conf
Contextualized Automatic Speech Recognition With Attention-Based Bias Phrase Boosted Beam Search.
ICASSP
Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Yifan Peng, Shinji Watanabe
2024 — conf
Contextualized Automatic Speech Recognition With Dynamic Vocabulary.
SLT
Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Shinji Watanabe
2024 J jnl
Contextualized Automatic Speech Recognition with Attention-Based Bias Phrase Boosted Beam Search.
CoRR
Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Yifan Peng, Shinji Watanabe
2024 J jnl
Contextualized Automatic Speech Recognition with Dynamic Vocabulary.
CoRR
Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Shinji Watanabe
2024 A conf
Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss.
INTERSPEECH
Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024 J jnl
Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss.
CoRR
Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024 Misc conf
Dynamic-Superb: Towards a Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark For Speech.
ICASSP
Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
2024 — conf
ESPnet-EZ: Python-Only ESPnet For Easy Fine-Tuning And Integration.
SLT
Masao Someki, Kwanghee Choi, Siddhant Arora, William Chen, Samuele Cornell, Jionghao Han, Yifan Peng, Jiatong Shi, Vaibhav Srivastav, Shinji Watanabe
2024 J jnl
ESPnet-EZ: Python-only ESPnet for Easy Fine-tuning and Integration.
CoRR
Masao Someki, Kwanghee Choi, Siddhant Arora, William Chen, Samuele Cornell, Jionghao Han, Yifan Peng, Jiatong Shi, Vaibhav Srivastav, Shinji Watanabe
2024 J jnl
Enhancing Audiovisual Speech Recognition through Bifocal Preference Optimization.
CoRR
Yihan Wu, Yichen Lu, Yifan Peng, Xihua Wang, Ruihua Song, Shinji Watanabe
2024 — conf
Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation.
ICASSP Workshops
Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024 J jnl
Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation.
CoRR
Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
2024 J jnl
MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation.
CoRR
Yifan Peng, Ilia Kulikov, Yilin Yang, Sravya Popuri, Hui Lu, Changhan Wang, Hongyu Gong
2024 A conf
MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels.
INTERSPEECH
Darshan Prabhu, Yifan Peng, Preethi Jyothi, Shinji Watanabe
2024 J jnl
Multi-Convformer: Extending Conformer with Multiple Convolution Kernels.
CoRR
Darshan Prabhu, Yifan Peng, Preethi Jyothi, Shinji Watanabe
2024 A conf
OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer.
INTERSPEECH
Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi, Xuankai Chang, Jee-weon Jung, Shinji Watanabe
2024 J jnl
OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer.
CoRR
Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi, Xuankai Chang, Jee-weon Jung, Shinji Watanabe
2024 — conf
OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification.
ACL (1)
Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2024 J jnl
OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification.
CoRR
Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2024 A conf
On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models.
INTERSPEECH
Jinchuan Tian, Yifan Peng, William Chen, Kwanghee Choi, Karen Livescu, Shinji Watanabe
2024 J jnl
On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models.
CoRR
Jinchuan Tian, Yifan Peng, William Chen, Kwanghee Choi, Karen Livescu, Shinji Watanabe
2024 — conf
Robust Audiovisual Speech Recognition Models with Mixture-of-Experts.
SLT
Yihan Wu, Yifan Peng, Yichen Lu, Xuankai Chang, Ruihua Song, Shinji Watanabe
2024 J jnl
Robust Audiovisual Speech Recognition Models with Mixture-of-Experts.
CoRR
Yihan Wu, Yifan Peng, Yichen Lu, Xuankai Chang, Ruihua Song, Shinji Watanabe
2024 J jnl
SpeechComposer: Unifying Multiple Speech Tasks with Prompt Composition.
CoRR
Yihan Wu, Soumi Maiti, Yifan Peng, Wangyou Zhang, Chenda Li, Yuyue Wang, Xihua Wang, Shinji Watanabe, Ruihua Song
2024 A* conf
Towards Robust Speech Representation Learning for Thousands of Languages.
EMNLP
William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
2024 J jnl
Towards Robust Speech Representation Learning for Thousands of Languages.
CoRR
William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
2024 — conf
UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions.
NAACL-HLT
Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan S. Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Karen Livescu, Shinji Watanabe
2024 J jnl
VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning.
CoRR
Yifan Peng, Krishna C. Puvvada, Zhehuai Chen, Piotr Zelasko, He Huang, Kunal Dhawan, Ke Hu, Shinji Watanabe, Jagadeesh Balam, Boris Ginsburg
2024 Misc conf
VoxtLM: Unified Decoder-Only Models for Consolidating Speech Recognition, Synthesis and Speech, Text Continuation Tasks.
ICASSP
Soumi Maiti, Yifan Peng, Shukjae Choi, Jee-weon Jung, Xuankai Chang, Shinji Watanabe
2023 A conf
A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks.
INTERSPEECH
Yifan Peng, Kwangyoun Kim, Felix Wu, Brian Yan, Siddhant Arora, William Chen, Jiyang Tang, Suwon Shon, Prashant Sridhar, Shinji Watanabe
2023 J jnl
A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks.
CoRR
Yifan Peng, Kwangyoun Kim, Felix Wu, Brian Yan, Siddhant Arora, William Chen, Jiyang Tang, Suwon Shon, Prashant Sridhar, Shinji Watanabe
2023 Misc conf
A Study on the Integration of Pipeline and E2E SLU Systems for Spoken Semantic Parsing Toward Stop Quality Challenge.
ICASSP
Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 J jnl
A Study on the Integration of Pipeline and E2E SLU systems for Spoken Semantic Parsing toward STOP Quality Challenge.
CoRR
Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 — conf
CMU's IWSLT 2023 Simultaneous Speech Translation System.
IWSLT@ACL
Brian Yan, Jiatong Shi, Soumi Maiti, William Chen, Xinjian Li, Yifan Peng, Siddhant Arora, Shinji Watanabe
2023 A conf
DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models.
INTERSPEECH
Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2023 J jnl
DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models.
CoRR
Yifan Peng, Yui Sudo, Muhammad Shakeel, Shinji Watanabe
2023 J jnl
Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech.
CoRR
Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
2023 Misc conf
E-Branchformer-Based E2E SLU Toward Stop on-Device Challenge.
ICASSP
Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 — conf
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit.
ACL (demo)
Brian Yan, Jiatong Shi, Yun Tang, Hirofumi Inaguma, Yifan Peng, Siddharth Dalmia, Peter Polak, Patrick Fernandes, Dan Berrebbi, Tomoki Hayashi, Xiaohui Zhang, Zhaoheng Ni, Moto Hira, Soumi Maiti, Juan Pino, Shinji Watanabe
2023 Misc conf
I3D: Transformer Architectures with Input-Dependent Dynamic Depth for Speech Recognition.
ICASSP
Yifan Peng, Jaesong Lee, Shinji Watanabe
2023 J jnl
I3D: Transformer architectures with input-dependent dynamic depth for speech recognition.
CoRR
Yifan Peng, Jaesong Lee, Shinji Watanabe
2023 J jnl
Improving Massively Multilingual ASR With Auxiliary CTC Objectives.
CoRR
William Chen, Brian Yan, Jiatong Shi, Yifan Peng, Soumi Maiti, Shinji Watanabe
2023 Misc conf
Improving Massively Multilingual ASR with Auxiliary CTC Objectives.
ICASSP
William Chen, Brian Yan, Jiatong Shi, Yifan Peng, Soumi Maiti, Shinji Watanabe
2023 C conf
Joint Prediction and Denoising for Large-Scale Multilingual Self-Supervised Learning.
ASRU
William Chen, Jiatong Shi, Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, Shinji Watanabe
2023 J jnl
Joint Prediction and Denoising for Large-scale Multilingual Self-supervised Learning.
CoRR
William Chen, Jiatong Shi, Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, Shinji Watanabe
2023 A conf
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute.
INTERSPEECH
William Chen, Xuankai Chang, Yifan Peng, Zhaoheng Ni, Soumi Maiti, Shinji Watanabe
2023 J jnl
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute.
CoRR
William Chen, Xuankai Chang, Yifan Peng, Zhaoheng Ni, Soumi Maiti, Shinji Watanabe
2023 C conf
Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data.
ASRU
Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi, Siddhant Arora, William Chen, Roshan S. Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-weon Jung, Soumi Maiti, Shinji Watanabe
2023 J jnl
Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Data.
CoRR
Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi, Siddhant Arora, William Chen, Roshan S. Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-weon Jung, Soumi Maiti, Shinji Watanabe
2023 Misc conf
Speechlmscore: Evaluating Speech Generation Using Speech Language Model.
ICASSP
Soumi Maiti, Yifan Peng, Takaaki Saeki, Shinji Watanabe
2023 Misc conf
Structured Pruning of Self-Supervised Pre-Trained Models for Speech Recognition and Understanding.
ICASSP
Yifan Peng, Kwangyoun Kim, Felix Wu, Prashant Sridhar, Shinji Watanabe
2023 J jnl
Structured Pruning of Self-Supervised Pre-trained Models for Speech Recognition and Understanding.
CoRR
Yifan Peng, Kwangyoun Kim, Felix Wu, Prashant Sridhar, Shinji Watanabe
2023 A conf
Tensor decomposition for minimization of E2E SLU model toward on-device processing.
INTERSPEECH
Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 J jnl
The Pipeline System of ASR and NLU with MLM-based Data Augmentation toward STOP Low-resource Challenge.
CoRR
Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 Misc conf
The Pipeline System of ASR and NLU with MLM-based data Augmentation Toward Stop Low-Resource Challenge.
ICASSP
Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 A conf
Time-synchronous one-pass Beam Search for Parallel Online and Offline Transducers with Dynamic Block Training.
INTERSPEECH
Yui Sudo, Muhammad Shakeel, Yifan Peng, Shinji Watanabe
2023 J jnl
UniverSLU: Universal Spoken Language Understanding for Diverse Classification and Sequence Generation Tasks with a Single Network.
CoRR
Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan S. Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2023 J jnl
Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks.
CoRR
Soumi Maiti, Yifan Peng, Shukjae Choi, Jee-weon Jung, Xuankai Chang, Shinji Watanabe
2022 — conf
A Study on the Integration of Pre-Trained SSL, ASR, LM and SLU Models for Spoken Language Understanding.
SLT
Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
2022 J jnl
A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understanding.
CoRR
Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
2022 A conf
Attention Weight Smoothing Using Prior Distributions for Transformer-Based End-to-End ASR.
INTERSPEECH
Takashi Maekaku, Yuya Fujita, Yifan Peng, Shinji Watanabe
2022 A* conf
Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding.
ICML
Yifan Peng, Siddharth Dalmia, Ian R. Lane, Shinji Watanabe
2022 J jnl
Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding.
CoRR
Yifan Peng, Siddharth Dalmia, Ian R. Lane, Shinji Watanabe
2022 — conf
CMU's IWSLT 2022 Dialect Speech Translation System.
IWSLT@ACL
Brian Yan, Patrick Fernandes, Siddharth Dalmia, Jiatong Shi, Yifan Peng, Dan Berrebbi, Xinyi Wang, Graham Neubig, Shinji Watanabe
2022 — conf
E-Branchformer: Branchformer with Enhanced Merging for Speech Recognition.
SLT
Kwangyoun Kim, Felix Wu, Yifan Peng, Jing Pan, Prashant Sridhar, Kyu Jeong Han, Shinji Watanabe
2022 J jnl
E-Branchformer: Branchformer with Enhanced merging for speech recognition.
CoRR
Kwangyoun Kim, Felix Wu, Yifan Peng, Jing Pan, Prashant Sridhar, Kyu Jeong Han, Shinji Watanabe
2022 Misc conf
ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet.
ICASSP
Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
2022 J jnl
SpeechLMScore: Evaluating speech generation using speech language model.
CoRR
Soumi Maiti, Yifan Peng, Takaaki Saeki, Shinji Watanabe
2021 J jnl
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet.
CoRR
Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe