Jinyu Li

363 papers A* 8A 71C 22Misc 73Journal 164Unranked 23
YearRankTypeTitle / Venue / Authors
2026 J jnl
Closing the Modality Reasoning Gap for Speech Large Language Models.
CoRR
Chaoren Wang, Heng Lu, Xueyao Zhang, Shujie Liu, Yan Lu, Jinyu Li, Zhizheng Wu
2026 J jnl
EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning.
CoRR
Dingdong Wang, Shujie Liu, Tianhua Zhang, Youjun Chen, Jinyu Li, Helen Meng
2025 A* conf
ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation.
ICLR
Zongyi Li, Shujie Hu, Shujie Liu, Long Zhou, Jeongsoo Choi, Lingwei Meng, Xun Guo, Jinyu Li, Hefei Ling, Furu Wei
2025 J jnl
Addressing speaker gender bias in large scale speech translation systems.
CoRR
Shubham Bansal, Vikas Joshi, Harveen Singh Chadha, Rupeshkumar Mehta, Jinyu Li
2025 J jnl
AlignFormer: Modality Matching Can Achieve Better Zero-Shot Instruction-Following Speech-LLM.
IEEE J. Sel. Top. Signal Process.
Ruchao Fan, Bo Ren, Yuxuan Hu, Rui Zhao, Shujie Liu, Jinyu Li
2025 — conf
Autoregressive Speech Synthesis without Vector Quantization.
ACL (1)
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen M. Meng, Furu Wei
2025 Misc conf
Boosting Large Language Model for Speech Synthesis: An Empirical Study.
ICASSP
Hongkun Hao, Long Zhou, Shujie Liu, Jinyu Li, Shujie Hu, Rui Wang, Furu Wei
2025 J jnl
CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching.
CoRR
Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
2025 A* conf
FELLE: Autoregressive Speech Synthesis with Token-Wise Coarse-to-Fine Flow Matching.
ACM Multimedia
Hui Wang, Shujie Liu, Lingwei Meng, Jinyu Li, Yifan Yang, Shiwan Zhao, Haiyang Sun, Yanqing Liu, Haoqin Sun, Jiaming Zhou, Yan Lu, Yong Qin
2025 J jnl
FELLE: Autoregressive Speech Synthesis with Token-Wise Coarse-to-Fine Flow Matching.
CoRR
Hui Wang, Shujie Liu, Lingwei Meng, Jinyu Li, Yifan Yang, Shiwan Zhao, Haiyang Sun, Yanqing Liu, Haoqin Sun, Jiaming Zhou, Yan Lu, Yong Qin
2025 J jnl
FlexiCodec: A Dynamic Neural Audio Codec for Low Frame Rates.
CoRR
Jiaqi Li, Yao Qian, Yuxuan Hu, Leying Zhang, Xiaofei Wang, Heng Lu, Manthan Thakker, Jinyu Li, Sheng Zhao, Zhizheng Wu
2025 A conf
Improving Practical Aspects of End-to-End Multi-Talker Speech Recognition for Online and Offline Scenarios.
INTERSPEECH
Aswin Shanmugam Subramanian, Amit Das, Naoyuki Kanda, Jinyu Li, Xiaofei Wang, Yifan Gong
2025 J jnl
Improving Practical Aspects of End-to-End Multi-Talker Speech Recognition for Online and Offline Scenarios.
CoRR
Aswin Shanmugam Subramanian, Amit Das, Naoyuki Kanda, Jinyu Li, Xiaofei Wang, Yifan Gong
2025 A conf
Length Aware Speech Translation for Video Dubbing.
INTERSPEECH
Aswin Shanmugam Subramanian, Harveen Singh Chadha, Vikas Joshi, Shubham Bansal, Jian Xue, Rupeshkumar Mehta, Jinyu Li
2025 J jnl
Length Aware Speech Translation for Video Dubbing.
CoRR
Harveen Singh Chadha, Aswin Shanmugam Subramanian, Vikas Joshi, Shubham Bansal, Jian Xue, Rupeshkumar Mehta, Jinyu Li
2025 C conf
Lightweight Prompt Biasing for Contextualized End-to-End ASR Systems.
ASRU
Bo Ren, Yu Shi, Jinyu Li
2025 J jnl
PHRASED: Phrase Dictionary Biasing for Speech Translation.
CoRR
Peidong Wang, Jian Xue, Rui Zhao, Junkun Chen, Aswin Shanmugam Subramanian, Jinyu Li
2025 J jnl
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs.
CoRR
Abdelrahman Abouelenin, Atabak Ashfaq, Adam Atkinson, Hany Awadalla, Nguyen Bach, Jianmin Bao, Alon Benhaim, Martin Cai, Vishrav Chaudhary, Congcong Chen, Dong Chen, Dongdong Chen, Jun-Kun Chen, Weizhu Chen, Yen-Chun Chen, Yi-ling Chen, Qi Dai, Xiyang Dai, Ruchao Fan, Mei Gao, Min Gao, Amit Garg, Abhishek Goswami, Junheng Hao, Amr Hendy, Yuxuan Hu, Xin Jin, Mahmoud Khademi, Dongwoo Kim, Young Jin Kim, Gina Lee, Jinyu Li, Yunsheng Li, Chen Liang, Xihui Lin, Zeqi Lin, Mengchen Liu, Yang Liu, Gilsinia Lopez, Chong Luo, Piyush Madan, Vadim Mazalov, Arindam Mitra, Ali Mousavi, Anh Nguyen, Jing Pan, Daniel Perez-Becker, Jacob Platin, Thomas Portet, Kai Qiu, Bo Ren, Liliang Ren, Sambuddha Roy, Ning Shang, Yelong Shen, Saksham Singhal, Subhojit Som, Xia Song, Tetyana Sych, Praneetha Vaddamanu, Shuohang Wang, Yiming Wang, Zhenghao Wang, Haibin Wu, Haoran Xu, Weijian Xu, Yifan Yang, Ziyi Yang, Donghan Yu, Ishmam Zabir, Jianwen Zhang, Li Lyna Zhang, Yunan Zhang, Xiren Zhou
2025 A* conf
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis.
ACM Multimedia
Yifan Yang, Shujie Liu, Jinyu Li, Yuxuan Hu, Haibin Wu, Hui Wang, Jianwei Yu, Lingwei Meng, Haiyang Sun, Yanqing Liu, Yan Lu, Kai Yu, Xie Chen
2025 J jnl
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis.
CoRR
Yifan Yang, Shujie Liu, Jinyu Li, Yuxuan Hu, Haibin Wu, Hui Wang, Jianwei Yu, Lingwei Meng, Haiyang Sun, Yanqing Liu, Yan Lu, Kai Yu, Xie Chen
2025 — conf
SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training.
ACL (Findings)
Wenxi Chen, Ziyang Ma, Ruiqi Yan, Yuzhe Liang, Xiquan Li, Ruiyang Xu, Zhikang Niu, Yanqiao Zhu, Yifan Yang, Zhanxun Liu, Kai Yu, Yuxuan Hu, Jinyu Li, Yan Lu, Shujie Liu, Xie Chen
2025 C conf
SLM-S2ST: A multimodal language model for direct speech-to-speech translation.
ASRU
Yuxuan Hu, Haibin Wu, Ruchao Fan, Xiaofei Wang, Heng Lu, Yao Qian, Jinyu Li
2025 J jnl
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation.
CoRR
Hui Wang, Jinghua Zhao, Yifan Yang, Shujie Liu, Junyang Chen, Yanzhe Zhang, Shiwan Zhao, Jinyu Li, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
2025 J jnl
StreamMel: Real-Time Zero-Shot Text-to-Speech Via Interleaved Continuous Autoregressive Modeling.
IEEE Signal Process. Lett.
Hui Wang, Yifan Yang, Shujie Liu, Jinyu Li, Lingwei Meng, Tie-Yan Liu, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
2025 J jnl
StreamMel: Real-Time Zero-shot Text-to-Speech via Interleaved Continuous Autoregressive Modeling.
CoRR
Hui Wang, Yifan Yang, Shujie Liu, Jinyu Li, Lingwei Meng, Yanqing Liu, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
2025 J jnl
Streaming Speaker Change Detection and Gender Classification for Transducer-Based Multi-Talker Speech Translation.
CoRR
Peidong Wang, Naoyuki Kanda, Jian Xue, Jinyu Li, Xiaofei Wang, Aswin Shanmugam Subramanian, Jun-Kun Chen, Sunit Sivasankaran, Xiong Xiao, Yong Zhao
2025 A conf
TS3-Codec: Transformer-Based Simple Streaming Single Codec.
INTERSPEECH
Haibin Wu, Naoyuki Kanda, Sefik Emre Eskimez, Jinyu Li
2025 Misc conf
Target word activity detector: An approach to obtain ASR word boundaries without lexicon.
ICASSP
Sunit Sivasankaran, Eric Sun, Jinyu Li, Yan Huang, Jing Pan
2025 C conf
Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model.
ASRU
Haibin Wu, Yuxuan Hu, Ruchao Fan, Xiaofei Wang, Ken'ichi Kumatani, Bo Ren, Jianwei Yu, Heng Lu, Lijuan Wang, Yao Qian, Jinyu Li
2025 Misc conf
V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow.
ICASSP
Jeongsoo Choi, Ji-Hoon Kim, Jinyu Li, Joon Son Chung, Shujie Liu
2024 J jnl
ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation.
CoRR
Zongyi Li, Shujie Hu, Shujie Liu, Long Zhou, Jeongsoo Choi, Lingwei Meng, Xun Guo, Jinyu Li, Hefei Ling, Furu Wei
2024 J jnl
Advanced Long-Content Speech Recognition With Factorized Neural Transducer.
CoRR
Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
2024 J jnl
Advanced Long-Content Speech Recognition With Factorized Neural Transducer.
IEEE ACM Trans. Audio Speech Lang. Process.
Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
2024 A conf
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS.
INTERSPEECH
Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024 J jnl
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS.
CoRR
Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024 J jnl
Autoregressive Speech Synthesis without Vector Quantization.
CoRR
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
2024 J jnl
Boosting Large Language Model for Speech Synthesis: An Empirical Study.
CoRR
Hongkun Hao, Long Zhou, Shujie Liu, Jinyu Li, Shujie Hu, Rui Wang, Furu Wei
2024 A conf
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning.
INTERSPEECH
Jing Pan, Jian Wu, Yashesh Gaur, Sunit Sivasankaran, Zhuo Chen, Shujie Liu, Jinyu Li
2024 — conf
CTC-GMM: CTC Guided Modality Matching For Fast and Accurate Streaming Speech Translation.
SLT
Rui Zhao, Jinyu Li, Ruchao Fan, Matt Post
2024 J jnl
CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation.
CoRR
Rui Zhao, Jinyu Li, Ruchao Fan, Matt Post
2024 A* conf
CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations.
NeurIPS
Leying Zhang, Yao Qian, Long Zhou, Shujie Liu, Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
2024 J jnl
CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations.
CoRR
Leying Zhang, Yao Qian, Long Zhou, Shujie Liu, Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
2024 Misc conf
Diarist: Streaming Speech Translation with Speaker Diarization.
ICASSP
Mu Yang, Naoyuki Kanda, Xiaofei Wang, Jun-Kun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
2024 — conf
Investigating Neural Audio Codecs For Speech Language Model-Based Speech Generation.
SLT
Jiaqi Li, Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Jun-Kun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu, Michael Zeng
2024 J jnl
Investigating Neural Audio Codecs for Speech Language Model-Based Speech Generation.
CoRR
Jiaqi Li, Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Jun-Kun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu, Michael Zeng
2024 — conf
Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-To-Speech.
SLT
Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024 J jnl
Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech.
CoRR
Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Sheng Zhao, Jinyu Li, Naoyuki Kanda
2024 Misc conf
Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation.
ICASSP
Sara Papi, Peidong Wang, Jun-Kun Chen, Jian Xue, Naoyuki Kanda, Jinyu Li, Yashesh Gaur
2024 A* conf
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models.
ICML
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Eric Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiangyang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
2024 J jnl
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models.
CoRR
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
2024 J jnl
RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis.
CoRR
Detai Xin, Xu Tan, Kai Shen, Zeqian Ju, Dongchao Yang, Yuancheng Wang, Shinnosuke Takamichi, Hiroshi Saruwatari, Shujie Liu, Jinyu Li, Sheng Zhao
2024 Misc conf
Residualtransformer: Residual Low-Rank Learning With Weight-Sharing For Transformer Layers.
ICASSP
Yiming Wang, Jinyu Li
2024 A conf
Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation.
INTERSPEECH
Peidong Wang, Jian Xue, Jinyu Li, Jun-Kun Chen, Aswin Shanmugam Subramanian
2024 J jnl
Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation.
CoRR
Peidong Wang, Jian Xue, Jinyu Li, Jun-Kun Chen, Aswin Shanmugam Subramanian
2024 J jnl
SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data.
IEEE ACM Trans. Audio Speech Lang. Process.
Ziqiang Zhang, Sanyuan Chen, Long Zhou, Yu Wu, Shuo Ren, Shujie Liu, Zhuoyuan Yao, Xun Gong, Li-Rong Dai, Jinyu Li, Furu Wei
2024 J jnl
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer.
IEEE ACM Trans. Audio Speech Lang. Process.
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
2024 Misc conf
T-SOT FNT: Streaming Multi-Talker ASR with Text-Only Domain Adaptation Capability.
ICASSP
Jian Wu, Naoyuki Kanda, Takuya Yoshioka, Rui Zhao, Zhuo Chen, Jinyu Li
2024 A conf
Total-Duration-Aware Duration Modeling for Text-to-Speech Systems.
INTERSPEECH
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
2024 A* conf
TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation.
NeurIPS
Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
2024 J jnl
TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation.
CoRR
Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
2024 J jnl
V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow.
CoRR
Jeongsoo Choi, Ji-Hoon Kim, Jinyu Li, Joon Son Chung, Shujie Liu
2024 J jnl
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers.
CoRR
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
2024 J jnl
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment.
CoRR
Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
2024 J jnl
VatLM: Visual-Audio-Text Pre-Training With Unified Masked Prediction for Speech Representation Learning.
IEEE Trans. Multim.
Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Li-Rong Dai, Daxin Jiang, Jinyu Li, Furu Wei
2024 J jnl
VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation.
IEEE ACM Trans. Audio Speech Lang. Process.
Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei
2024 — conf
WavLLM: Towards Robust and Adaptive Speech Large Language Model.
EMNLP (Findings)
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
2024 J jnl
WavLLM: Towards Robust and Adaptive Speech Large Language Model.
CoRR
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
2023 C conf
A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability.
ASRU
Jian Xue, Peidong Wang, Jinyu Li, Eric Sun
2023 A conf
Accelerating Transducers through Adjacent Token Merging.
INTERSPEECH
Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
2023 J jnl
Accelerating Transducers through Adjacent Token Merging.
CoRR
Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
2023 C conf
Building High-Accuracy Multilingual ASR With Gated Language Experts and Curriculum Training.
ASRU
Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
2023 J jnl
Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training.
CoRR
Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
2023 J jnl
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning.
CoRR
Jing Pan, Jian Wu, Yashesh Gaur, Sunit Sivasankaran, Zhuo Chen, Shujie Liu, Jinyu Li
2023 Misc conf
CTCBERT: Advancing Hidden-Unit Bert with CTC Objectives.
ICASSP
Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li
2023 J jnl
DiariST: Streaming Speech Translation with Speaker Diarization.
CoRR
Mu Yang, Naoyuki Kanda, Xiaofei Wang, Jun-Kun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
2023 Misc conf
Fast and Accurate Factorized Neural Transducer for Text Adaption of End-to-End Speech Recognition Models.
ICASSP
Rui Zhao, Jian Xue, Partha Parthasarathy, Veljko Miljanic, Jinyu Li
2023 Misc conf
Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation.
ICASSP
Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng Zhao
2023 J jnl
Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation.
CoRR
Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng Zhao
2023 C conf
Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach.
ASRU
Jun-Kun Chen, Jian Xue, Peidong Wang, Jing Pan, Jinyu Li
2023 J jnl
Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach.
CoRR
Jun-Kun Chen, Jian Xue, Peidong Wang, Jing Pan, Jinyu Li
2023 Misc conf
Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation.
ICASSP
Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei
2023 A conf
LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers.
INTERSPEECH
Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, Jinyu Li
2023 J jnl
Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation.
CoRR
Sara Papi, Peidong Wang, Jun-Kun Chen, Jian Xue, Naoyuki Kanda, Jinyu Li, Yashesh Gaur
2023 Misc conf
LongFNT: Long-Form Speech Recognition with Factorized Neural Transducer.
ICASSP
Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
2023 J jnl
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers.
CoRR
Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
2023 C conf
On Decoder-Only Architecture For Speech-to-Text and Large Language Model Integration.
ASRU
Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou, Yimeng Zhu, Tianrui Wang, Jinyu Li, Shujie Liu, Bo Ren, Linquan Liu, Yu Wu
2023 J jnl
On decoder-only architecture for speech-to-text and large language model integration.
CoRR
Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou, Yimeng Zhu, Tianrui Wang, Jinyu Li, Shujie Liu, Bo Ren, Linquan Liu, Yu Wu
2023 C conf
Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition.
ASRU
Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
2023 J jnl
Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition.
CoRR
Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
2023 J jnl
ResidualTransformer: Residual Low-rank Learning with Weight-sharing for Transformer Layers.
CoRR
Yiming Wang, Jinyu Li
2023 Misc conf
Self-Supervised Learning with Bi-Label Masked Speech Prediction for Streaming Multi-Talker Speech Recognition.
ICASSP
Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
2023 Misc conf
Simulating Realistic Speech Overlaps Improves Multi-Talker ASR.
ICASSP
Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2023 J jnl
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling.
CoRR
Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
2023 Misc conf
Speaker Change Detection For Transformer Transducer ASR.
ICASSP
Jian Wu, Zhuo Chen, Min Hu, Xiong Xiao, Jinyu Li
2023 J jnl
Speaker Change Detection for Transformer Transducer ASR.
CoRR
Jian Wu, Zhuo Chen, Min Hu, Xiong Xiao, Jinyu Li
2023 Misc conf
Speech Separation with Large-Scale Self-Supervised Learning.
ICASSP
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
2023 J jnl
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer.
CoRR
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
2023 C conf
Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignments.
ASRU
Sara Papi, Peidong Wang, Jun-Kun Chen, Jian Xue, Jinyu Li, Yashesh Gaur
2023 J jnl
Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignments.
CoRR
Sara Papi, Peidong Wang, Jun-Kun Chen, Jian Xue, Jinyu Li, Yashesh Gaur
2023 Misc conf
Vararray Meets T-Sot: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition.
ICASSP
Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2023 J jnl
VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation.
CoRR
Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei
2023 J jnl
t-SOT FNT: Streaming Multi-talker ASR with Text-only Domain Adaptation Capability.
CoRR
Jian Wu, Naoyuki Kanda, Takuya Yoshioka, Rui Zhao, Zhuo Chen, Jinyu Li
2022 Misc conf
A Configurable Multilingual Model is All You Need to Recognize All Languages.
ICASSP
Long Zhou, Jinyu Li, Eric Sun, Shujie Liu
2022 J jnl
A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability.
CoRR
Jian Xue, Peidong Wang, Jinyu Li, Eric Sun
2022 J jnl
Acoustic-aware Non-autoregressive Spell Correction with Mask Sample Decoding.
CoRR
Ruchao Fan, Guoli Ye, Yashesh Gaur, Jinyu Li
2022 J jnl
CTCBERT: Advancing Hidden-unit BERT with CTC Objectives.
CoRR
Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li
2022 Misc conf
Continuous Speech Separation with Recurrent Selective Attention Network.
ICASSP
Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
2022 Misc conf
Continuous Streaming Multi-Talker ASR with Dual-Path Transducers.
ICASSP
Desh Raj, Liang Lu, Zhuo Chen, Yashesh Gaur, Jinyu Li
2022 Misc conf
Endpoint Detection for Streaming End-to-End Multi-Talker ASR.
ICASSP
Liang Lu, Jinyu Li, Yifan Gong
2022 J jnl
Endpoint Detection for Streaming End-to-End Multi-talker ASR.
CoRR
Liang Lu, Jinyu Li, Yifan Gong
2022 Misc conf
Factorized Neural Transducer for Efficient Language Model Adaptation.
ICASSP
Xie Chen, Zhong Meng, Sarangarajan Parthasarathy, Jinyu Li
2022 J jnl
Fast and accurate factorized neural transducer for text adaption of end-to-end speech recognition models.
CoRR
Rui Zhao, Jian Xue, Partha Parthasarathy, Veljko Miljanic, Jinyu Li
2022 Misc conf
Have Best of Both Worlds: Two-Pass Hybrid and E2E Cascading Framework for Speech Recognition.
ICASSP
Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
2022 Misc conf
Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction.
ICASSP
Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
2022 Misc conf
Improving Self-Supervised Learning for Speech Recognition with Intermediate Layer Supervision.
ICASSP
Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang
2022 A conf
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition.
INTERSPEECH
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
2022 J jnl
Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation.
CoRR
Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei
2022 J jnl
LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducers.
CoRR
Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, Jinyu Li
2022 A conf
Large-Scale Streaming End-to-End Speech Translation with Neural Transducers.
INTERSPEECH
Jian Xue, Peidong Wang, Jinyu Li, Matt Post, Yashesh Gaur
2022 J jnl
Large-Scale Streaming End-to-End Speech Translation with Neural Transducers.
CoRR
Jian Xue, Peidong Wang, Jinyu Li, Matt Post, Yashesh Gaur
2022 J jnl
LongFNT: Long-form Speech Recognition with Factorized Neural Transducer.
CoRR
Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
2022 A conf
Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data.
INTERSPEECH
Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei
2022 J jnl
Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data.
CoRR
Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei
2022 J jnl
Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition.
CoRR
Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
2022 A conf
Separating Long-Form Speech with Group-wise Permutation Invariant Training.
INTERSPEECH
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
2022 J jnl
Simulating realistic speech overlaps improves multi-talker ASR.
CoRR
Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2022 J jnl
Speech separation with large-scale self-supervised learning.
CoRR
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
2022 — conf
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing.
ACL (1)
Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
2022 A* conf
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training.
EMNLP
Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
2022 J jnl
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training.
CoRR
Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
2022 A conf
Streaming Multi-Talker ASR with Token-Level Serialized Output Training.
INTERSPEECH
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2022 J jnl
Streaming Multi-Talker ASR with Token-Level Serialized Output Training.
CoRR
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2022 A conf
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings.
INTERSPEECH
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2022 J jnl
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings.
CoRR
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2022 — conf
Streaming, Fast and Accurate on-Device Inverse Text Normalization for Automatic Speech Recognition.
SLT
Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
2022 J jnl
Streaming, fast and accurate on-device Inverse Text Normalization for Automatic Speech Recognition.
CoRR
Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphonso, Jinyu Li, Yifan Gong
2022 A conf
Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training.
INTERSPEECH
Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei
2022 J jnl
Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training.
CoRR
Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei
2022 J jnl
The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Task.
CoRR
Ziqiang Zhang, Junyi Ao, Long Zhou, Shujie Liu, Furu Wei, Jinyu Li
2022 J jnl
Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems.
IEEE ACM Trans. Audio Speech Lang. Process.
Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
2022 J jnl
Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systems.
CoRR
Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
2022 J jnl
Ultra Fast Speech Separation Model with Teacher Student Learning.
CoRR
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
2022 Misc conf
Unispeech-Sat: Universal Speech Representation Learning With Speaker Aware Pre-Training.
ICASSP
Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
2022 J jnl
VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning.
CoRR
Qiu-Shi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei
2022 J jnl
VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition.
CoRR
Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
2022 Misc conf
Wav2vec-Switch: Contrastive Learning from Original-Noisy Speech Pairs for Robust Speech Recognition.
ICASSP
Yiming Wang, Jinyu Li, Heming Wang, Yao Qian, Chengyi Wang, Yu Wu
2022 J jnl
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing.
IEEE J. Sel. Top. Signal Process.
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
2022 A conf
Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?
INTERSPEECH
Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Peidong Wang, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei
2022 J jnl
Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?
CoRR
Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Peidong Wang, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei
2021 J jnl
A Configurable Multilingual Model is All You Need to Recognize All Languages.
CoRR
Long Zhou, Jinyu Li, Eric Sun, Shujie Liu
2021 A conf
A Light-Weight Contextual Spelling Correction Model for Customizing Transducer-Based Speech Recognition Systems.
Interspeech
Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
2021 J jnl
A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systems.
CoRR
Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
2021 Misc conf
Continuous Speech Separation with Conformer.
ICASSP
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
2021 J jnl
Continuous Speech Separation with Recurrent Selective Attention Network.
CoRR
Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
2021 J jnl
Continuous Streaming Multi-Talker ASR with Dual-path Transducers.
CoRR
Desh Raj, Liang Lu, Zhuo Chen, Yashesh Gaur, Jinyu Li
2021 Misc conf
Developing Real-Time Streaming Transformer Transducer for Speech Recognition on Large-Scale Dataset.
ICASSP
Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li
2021 — conf
Dual-Path RNN for Long Recording Speech Separation.
SLT
Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Böddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
2021 Misc conf
Ensemble Combination between Different Time Segmentations.
ICASSP
Jeremy Heng Meng Wong, Dimitrios Dimitriadis, Ken'ichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 J jnl
Factorized Neural Transducer for Efficient Language Model Adaptation.
CoRR
Xie Chen, Zhong Meng, Sarangarajan Parthasarathy, Jinyu Li
2021 J jnl
Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition.
CoRR
Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
2021 A conf
Improving Multilingual Transformer Transducer Models by Reducing Language Confusions.
Interspeech
Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
2021 J jnl
Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction.
CoRR
Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
2021 A conf
Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS.
Interspeech
Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
2021 — conf
Integration of Speech Separation, Diarization, and Recognition for Multi-Speaker Meetings: System Description, Comparison, and Analysis.
SLT
Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
2021 J jnl
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition.
CoRR
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
2021 — conf
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition.
SLT
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
2021 Misc conf
Internal Language Model Training for Domain-Adaptive End-To-End Speech Recognition.
ICASSP
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
2021 J jnl
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition.
CoRR
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
2021 A conf
Investigation of Practical Aspects of Single Channel Speech Separation for ASR.
Interspeech
Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
2021 J jnl
Investigation of Practical Aspects of Single Channel Speech Separation for ASR.
CoRR
Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
2021 — conf
Listen, Look and Deliberate: Visual Context-Aware Speech Recognition Using Pre-Trained Text-Video Representations.
SLT
Shahram Ghorbani, Yashesh Gaur, Yu Shi, Jinyu Li
2021 Misc conf
Microsoft Speaker Diarization System for the Voxceleb Speaker Recognition Challenge 2020.
ICASSP
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
2021 A conf
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition.
Interspeech
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
2021 J jnl
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition.
CoRR
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
2021 A conf
Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems.
Interspeech
Vikas Joshi, Amit Das, Eric Sun, Rupesh R. Mehta, Jinyu Li, Yifan Gong
2021 C conf
On Addressing Practical Challenges for RNN-Transducer.
ASRU
Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
2021 J jnl
On Addressing Practical Challenges for RNN-Transducer.
CoRR
Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
2021 A conf
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer.
Interspeech
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
2021 A conf
Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias Are All You Need.
Interspeech
Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
2021 J jnl
Recent Advances in End-to-End Automatic Speech Recognition.
CoRR
Jinyu Li
2021 J jnl
Self-Supervised Learning for speech recognition with Intermediate layer supervision.
CoRR
Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang
2021 J jnl
Separating Long-Form Speech with Group-Wise Permutation Invariant Training.
CoRR
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
2021 J jnl
Sequence-level self-learning with multiple hypotheses.
CoRR
Ken'ichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
2021 J jnl
Speaker Separation Using Speaker Inventories and Estimated Speech.
IEEE ACM Trans. Audio Speech Lang. Process.
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
2021 J jnl
SpeechT5: Unified-Modal Encoder-Decoder Pre-training for Spoken Language Processing.
CoRR
Junyi Ao, Rui Wang, Long Zhou, Shujie Liu, Shuo Ren, Yu Wu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
2021 J jnl
Streaming End-to-End Multi-Talker Speech Recognition.
IEEE Signal Process. Lett.
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
2021 A conf
Streaming Multi-Talker Speech Recognition with Joint Speaker Identification.
Interspeech
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
2021 J jnl
Streaming Multi-talker Speech Recognition with Joint Speaker Identification.
CoRR
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
2021 A conf
Ultra Fast Speech Separation Model with Teacher Student Learning.
Interspeech
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
2021 J jnl
UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training.
CoRR
Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
2021 J jnl
Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognition.
CoRR
Yiming Wang, Jinyu Li, Heming Wang, Yao Qian, Chengyi Wang, Yu Wu
2021 J jnl
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing.
CoRR
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Furu Wei
2020 J jnl
Adaptation Algorithms for Speech Recognition: An Overview.
CoRR
Peter Bell, Joachim Fainberg, Ondrej Klejch, Jinyu Li, Steve Renals, Pawel Swietojanski
2020 A conf
An End-to-End Architecture of Online Multi-Channel Speech Separation.
INTERSPEECH
Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo, Lei Xie
2020 J jnl
An End-to-end Architecture of Online Multi-channel Speech Separation.
CoRR
Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo, Lei Xie
2020 J jnl
Character-Aware Attention-Based End-to-End Speech Recognition.
CoRR
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
2020 A conf
Combination of End-to-End and Hybrid Models for Speech Recognition.
INTERSPEECH
Jeremy Heng Meng Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
2020 J jnl
Continuous Speech Separation with Conformer.
CoRR
Sanyuan Chen, Yu Wu, Zhuo Chen, Jinyu Li, Chengyi Wang, Shujie Liu, Ming Zhou
2020 Misc conf
Continuous Speech Separation: Dataset and Analysis.
ICASSP
Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
2020 J jnl
Continuous speech separation: dataset and analysis.
CoRR
Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Jinyu Li
2020 A conf
Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability.
INTERSPEECH
Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
2020 J jnl
Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability.
CoRR
Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
2020 J jnl
Developing Real-time Streaming Transformer Transducer for Speech Recognition on Large-scale Dataset.
CoRR
Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li
2020 J jnl
Domain Adaptation via Teacher-Student Learning for End-to-End Speech Recognition.
CoRR
Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
2020 J jnl
Don't shoot butterfly with rifles: Multi-channel Continuous Speech Separation with Early Exit Transformer.
CoRR
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li
2020 Misc conf
Exploring Pre-Training with Alignments for RNN Transducer Based End-to-End Speech Recognition.
ICASSP
Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
2020 J jnl
Exploring Pre-training with Alignments for RNN Transducer based End-to-End Speech Recognition.
CoRR
Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
2020 A conf
Exploring Transformers for Large-Scale Speech Recognition.
INTERSPEECH
Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
2020 J jnl
Exploring Transformers for Large-Scale Speech Recognition.
CoRR
Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
2020 Misc conf
High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model.
ICASSP
Jinyu Li, Rui Zhao, Eric Sun, Jeremy Heng Meng Wong, Amit Das, Zhong Meng, Yifan Gong
2020 J jnl
High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model.
CoRR
Jinyu Li, Rui Zhao, Eric Sun, Jeremy Heng Meng Wong, Amit Das, Zhong Meng, Yifan Gong
2020 J jnl
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis.
CoRR
Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Mao-Kui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
2020 J jnl
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition.
CoRR
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
2020 Misc conf
L-Vector: Neural Label Embedding for Domain Adaptation.
ICASSP
Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
2020 J jnl
L-Vector: Neural Label Embedding for Domain Adaptation.
CoRR
Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
2020 J jnl
Listen, Look and Deliberate: Visual context-aware speech recognition using pre-trained text-video representations.
CoRR
Shahram Ghorbani, Yashesh Gaur, Yu Shi, Jinyu Li
2020 A conf
Low Latency End-to-End Streaming Speech Recognition with a Scout Network.
INTERSPEECH
Chengyi Wang, Yu Wu, Liang Lu, Shujie Liu, Jinyu Li, Guoli Ye, Ming Zhou
2020 J jnl
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020.
CoRR
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
2020 Misc conf
Minimum Latency Training Strategies for Streaming Sequence-to-Sequence ASR.
ICASSP
Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
2020 J jnl
Minimum Latency Training Strategies for Streaming Sequence-to-Sequence ASR.
CoRR
Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
2020 J jnl
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer.
CoRR
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
2020 A conf
On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition.
INTERSPEECH
Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang, Rui Zhao, Shujie Liu
2020 J jnl
On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition.
CoRR
Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang, Rui Zhao, Shujie Liu
2020 A conf
Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator.
INTERSPEECH
Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
2020 A conf
Semantic Mask for Transformer Based End-to-End Speech Recognition.
INTERSPEECH
Chengyi Wang, Yu Wu, Yujiao Du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
2020 A conf
Sequence-Level Self-Learning with Multiple Hypotheses.
INTERSPEECH
Ken'ichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
2020 J jnl
Speaker Separation Using Speaker Inventories and Estimated Speech.
CoRR
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
2020 J jnl
Streaming end-to-end multi-talker speech recognition.
CoRR
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
2020 A conf
Transfer Learning Approaches for Streaming End-to-End Speech Recognition System.
INTERSPEECH
Vikas Joshi, Rui Zhao, Rupesh R. Mehta, Kshitiz Kumar, Jinyu Li
2020 J jnl
Transfer Learning Approaches for Streaming End-to-End Speech Recognition System.
CoRR
Vikas Joshi, Rui Zhao, Rupesh R. Mehta, Kshitiz Kumar, Jinyu Li
2020 Misc conf
Using Personalized Speech Synthesis and Neural Language Generator for Rapid Speaker Adaptation.
ICASSP
Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
2019 A conf
Acoustic-to-Phrase Models for Speech Recognition.
INTERSPEECH
Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
2019 J jnl
Advancing Acoustic-to-Word CTC Model With Attention and Mixed-Units.
IEEE ACM Trans. Audio Speech Lang. Process.
Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
2019 Misc conf
Adversarial Speaker Adaptation.
ICASSP
Zhong Meng, Jinyu Li, Yifan Gong
2019 J jnl
Adversarial Speaker Adaptation.
CoRR
Zhong Meng, Jinyu Li, Yifan Gong
2019 Misc conf
Adversarial Speaker Verification.
ICASSP
Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
2019 J jnl
Adversarial Speaker Verification.
CoRR
Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
2019 J jnl
Attentive Adversarial Learning for Domain-Invariant Training.
CoRR
Zhong Meng, Jinyu Li, Yifan Gong
2019 Misc conf
Attentive Adversarial Learning for Domain-invariant Training.
ICASSP
Zhong Meng, Jinyu Li, Yifan Gong
2019 C conf
CNN with Phonetic Attention for Text-Independent Speaker Verification.
ASRU
Tianyan Zhou, Yong Zhao, Jinyu Li, Yifan Gong, Jian Wu
2019 C conf
Character-Aware Attention-Based End-to-End Speech Recognition.
ASRU
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
2019 J jnl
Conditional Teacher-Student Learning.
CoRR
Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
2019 Misc conf
Conditional Teacher-student Learning.
ICASSP
Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
2019 C conf
Domain Adaptation via Teacher-Student Learning for End-to-End Speech Recognition.
ASRU
Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
2019 Misc conf
Improving Layer Trajectory LSTM with Future Context Frames.
ICASSP
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
2019 C conf
Improving RNN Transducer Modeling for End-to-End Speech Recognition.
ASRU
Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
2019 J jnl
Improving RNN Transducer Modeling for End-to-End Speech Recognition.
CoRR
Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
2019 A conf
Layer Trajectory BLSTM.
INTERSPEECH
Eric Sun, Jinyu Li, Yifan Gong
2019 J jnl
Semantic Mask for Transformer based End-to-End Speech Recognition.
CoRR
Chengyi Wang, Yu Wu, Yujiao Du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
2019 A conf
Speaker Adaptation for Attention-Based End-to-End Speech Recognition.
INTERSPEECH
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
2019 J jnl
Speaker Adaptation for Attention-Based End-to-End Speech Recognition.
CoRR
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
2019 J jnl
Speaker Adaptation for End-to-End CTC Models.
CoRR
Ke Li, Jinyu Li, Yong Zhao, Kshitiz Kumar, Yifan Gong
2019 C conf
Speech Separation Using Speaker Inventory.
ASRU
Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
2019 Misc conf
Towards Code-switching ASR for End-to-end CTC Models.
ICASSP
Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
2019 Misc conf
Universal Acoustic Modeling Using Neural Mixture Models.
ICASSP
Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
2018 J jnl
Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units.
CoRR
Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
2018 Misc conf
Advancing Acoustic-to-Word CTC Model.
ICASSP
Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
2018 J jnl
Advancing Acoustic-to-Word CTC Model.
CoRR
Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
2018 J jnl
Advancing Connectionist Temporal Classification With Attention Modeling.
CoRR
Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
2018 Misc conf
Advancing Connectionist Temporal Classification with Attention Modeling.
ICASSP
Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
2018 A conf
Adversarial Feature-Mapping for Speech Enhancement.
INTERSPEECH
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Fred Juang
2018 J jnl
Adversarial Feature-Mapping for Speech Enhancement.
CoRR
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
2018 Misc conf
Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation.
ICASSP
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
2018 J jnl
Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation.
CoRR
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
2018 J jnl
Cracking the cocktail party problem by multi-beam deep attractor network.
CoRR
Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
2018 A conf
Cycle-Consistent Speech Enhancement.
INTERSPEECH
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Fred Juang
2018 J jnl
Cycle-Consistent Speech Enhancement.
CoRR
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
2018 Misc conf
Developing Far-Field Speaker System Via Teacher-Student Learning.
ICASSP
Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
2018 J jnl
Developing Far-Field Speaker System Via Teacher-Student Learning.
CoRR
Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
2018 Misc conf
Domain and Speaker Adaptation for Cortana Speech Recognition.
ICASSP
Yong Zhao, Jinyu Li, Shi-Xiong Zhang, Liping Chen, Yifan Gong
2018 — conf
Exploring Layer Trajectory LSTM with Depth Processing Units and Attention.
SLT
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
2018 A conf
Improved Training for Online End-to-end Speech Recognition Systems.
INTERSPEECH
Suyoun Kim, Michael L. Seltzer, Jinyu Li, Rui Zhao
2018 A conf
Layer Trajectory LSTM.
INTERSPEECH
Jinyu Li, Changliang Liu, Yifan Gong
2018 J jnl
Layer Trajectory LSTM.
CoRR
Jinyu Li, Changliang Liu, Yifan Gong
2018 — conf
Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network.
SLT
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
2018 J jnl
Progressive Joint Modeling in Unsupervised Single-Channel Overlapped Speech Recognition.
IEEE ACM Trans. Audio Speech Lang. Process.
Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
2018 J jnl
Recent Progresses in Deep Learning based Acoustic Models (Updated).
CoRR
Dong Yu, Jinyu Li
2018 — conf
Speaker Adaptation for End-to-End CTC Models.
SLT
Ke Li, Jinyu Li, Yong Zhao, Kshitiz Kumar, Yifan Gong
2018 Misc conf
Speaker-Invariant Training Via Adversarial Learning.
ICASSP
Zhong Meng, Jinyu Li, Zhuo Chen, Yang Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang Juang
2018 J jnl
Speaker-Invariant Training via Adversarial Learning.
CoRR
Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang Juang
2017 J jnl
Acoustic-To-Word Model Without OOV.
CoRR
Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
2017 C conf
Acoustic-to-word model without OOV.
ASRU
Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
2017 — ch.
Challenges in and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft.
New Era for Robust Speech Recognition, Exploiting Deep Learning
Yifan Gong, Yan Huang, Kshitiz Kumar, Jinyu Li, Chaojun Liu, Guoli Ye, Shi-Xiong Zhang, Yong Zhao, Rui Zhao
2017 C conf
Cracking the cocktail party problem by multi-beam deep attractor network.
ASRU
Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
2017 J jnl
End-to-End Attention based Text-Dependent Speaker Verification.
CoRR
Shi-Xiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
2017 Misc conf
Extended low-rank plus diagonal adaptation for deep and recurrent neural networks.
ICASSP
Yong Zhao, Jinyu Li, Kshitiz Kumar, Yifan Gong
2017 Misc conf
Improved cepstra minimum-mean-square-error noise reduction algorithm for robust speech recognition.
ICASSP
Jinyu Li, Yan Huang, Yifan Gong
2017 J jnl
Improved training for online end-to-end speech recognition systems.
CoRR
Suyoun Kim, Michael L. Seltzer, Jinyu Li, Rui Zhao
2017 A conf
Improving Mask Learning Based Speech Enhancement System with Restoration Layers and Residual Connection.
INTERSPEECH
Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
2017 A conf
Large-Scale Domain Adaptation via Teacher-Student Learning.
INTERSPEECH
Jinyu Li, Michael L. Seltzer, Xi Wang, Rui Zhao, Yifan Gong
2017 J jnl
Large-Scale Domain Adaptation via Teacher-Student Learning.
CoRR
Jinyu Li, Michael L. Seltzer, Xi Wang, Rui Zhao, Yifan Gong
2017 J jnl
Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition.
CoRR
Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
2017 J jnl
Recent progresses in deep learning based acoustic models.
IEEE CAA J. Autom. Sinica
Dong Yu, Jinyu Li
2017 J jnl
Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition.
CoRR
Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
2017 C conf
Unsupervised adaptation with domain separation networks for robust speech recognition.
ASRU
Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
2016 A conf
Deep Convolutional Neural Networks with Layer-Wise Context Expansion and Attention.
INTERSPEECH
Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
2016 — conf
End-to-End attention based text-dependent speaker verification.
SLT
Shi-Xiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
2016 Misc conf
Exploring multidimensional lstms for large vocabulary ASR.
ICASSP
Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
2016 J jnl
Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptation.
CoRR
Pawel Swietojanski, Jinyu Li, Steve Renals
2016 J jnl
Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptation.
IEEE ACM Trans. Audio Speech Lang. Process.
Pawel Swietojanski, Jinyu Li, Steve Renals
2016 Misc conf
Low-rank plus diagonal adaptation for deep neural networks.
ICASSP
Yong Zhao, Jinyu Li, Yifan Gong
2016 Misc conf
Recurrent support vector machines for speech recognition.
ICASSP
Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
2016 Misc conf
Simplifying long short-term memory acoustic models for fast training and decoding.
ICASSP
Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
2015 Misc conf
An analysis of convolutional neural networks for speech recognition.
ICASSP
Jui-Ting Huang, Jinyu Li, Yifan Gong
2015 Misc conf
Investigating online low-footprint speaker adaptation using generalized linear regression and click-through data.
ICASSP
Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
2015 C conf
LSTM time and frequency recurrence for automatic speech recognition.
ASRU
Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
2015 A conf
Maximum a posteriori adaptation of network parameters in deep models.
INTERSPEECH
Zhen Huang, Sabato Marco Siniscalchi, I-Fan Chen, Jinyu Li, Jiadong Wu, Chin-Hui Lee
2015 A conf
Rapid adaptation for deep neural networks through multi-task learning.
INTERSPEECH
Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Ji Wu, Chin-Hui Lee
2015 A conf
SVD-based universal DNN modeling for multiple scenarios.
INTERSPEECH
Changliang Liu, Jinyu Li, Yifan Gong
2015 Misc conf
Small-footprint high-performance deep neural network-based speech recognition using split-VQ.
ICASSP
Yongqiang Wang, Jinyu Li, Yifan Gong
2014 J jnl
An Overview of Noise-Robust Automatic Speech Recognition.
IEEE ACM Trans. Audio Speech Lang. Process.
Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
2014 A conf
Beyond cross-entropy: towards better frame-level objective functions for deep neural network training in automatic speech recognition.
INTERSPEECH
Zhen Huang, Jinyu Li, Chao Weng, Chin-Hui Lee
2014 Misc conf
Factorized adaptation for deep neural network.
ICASSP
Jinyu Li, Jui-Ting Huang, Yifan Gong
2014 Misc conf
Feature compensation using linear combination of speaker and environment dependent correction vectors.
ICASSP
Xiong Xiao, Jinyu Li, Engsiong Chng, Haizhou Li
2014 A conf
Feature space maximum a posteriori linear regression for adaptation of deep neural networks.
INTERSPEECH
Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Chao Weng, Chin-Hui Lee
2014 Misc conf
Investigation of maxout networks for speech recognition.
ICASSP
Pawel Swietojanski, Jinyu Li, Jui-Ting Huang
2014 A conf
Learning small-size DNN with output-distribution-based criteria.
INTERSPEECH
Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
2014 Misc conf
Singular value decomposition based low-footprint speaker adaptation and personalization for deep neural network.
ICASSP
Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
2014 — conf
Variable-activation and variable-input deep neural network for robust speech recognition.
SLT
Rui Zhao, Jinyu Li, Yifan Gong
2014 A conf
Variable-component deep neural network for robust speech recognition.
INTERSPEECH
Rui Zhao, Jinyu Li, Yifan Gong
2013 Misc conf
Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers.
ICASSP
Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
2013 A* conf
Feature Learning in Deep Neural Networks - A Study on Speech Recognition Tasks
ICLR
Dong Yu, Michael L. Seltzer, Jinyu Li, Jui-Ting Huang, Frank Seide
2013 J jnl
Hermitian Polynomial for Speaker Adaptation of Connectionist Speech Recognition Systems.
IEEE Trans. Speech Audio Process.
Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
2013 A conf
Investigations on hessian-free optimization for cross-entropy training of deep neural networks.
INTERSPEECH
Simon Wiesler, Jinyu Li, Jian Xue
2013 J jnl
Model-based margin estimation for hidden Markov model learning and generalisation.
IET Signal Process.
Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
2013 Misc conf
Recent advances in deep learning for speech research at Microsoft.
ICASSP
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Michael L. Seltzer, Geoffrey Zweig, Xiaodong He, Jason D. Williams, Yifan Gong, Alex Acero
2013 A conf
Restructuring of deep neural network acoustic models with singular value decomposition.
INTERSPEECH
Jian Xue, Jinyu Li, Yifan Gong
2012 A conf
Efficient VTS Adaptation Using Jacobian Approximation.
INTERSPEECH
Jinyu Li, Michael L. Seltzer, Yifan Gong
2012 A conf
Hermitian based Hidden Activation Functions for Adaptation of Hybrid HMM/ANN Models.
INTERSPEECH
Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
2012 Misc conf
Improvements to VTS feature enhancement.
ICASSP
Jinyu Li, Michael L. Seltzer, Yifan Gong
2012 — conf
Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM.
SLT
Jinyu Li, Dong Yu, Jui-Ting Huang, Yifan Gong
2012 Misc conf
Lasso environment model combination for robust speech recognition.
ICASSP
Xiong Xiao, Jinyu Li, Engsiong Chng, Haizhou Li
2011 J jnl
Calibration of Confidence Measures in Speech Recognition.
IEEE ACM Trans. Audio Speech Lang. Process.
Dong Yu, Jinyu Li, Li Deng
2011 A conf
Feature Normalization Using Structured Full Transforms for Robust Speech Recognition.
INTERSPEECH
Xiong Xiao, Jinyu Li, Chng Eng Siong, Haizhou Li
2011 Misc conf
Maximum likelihood adaptation of histogram equalization with constraint for robust speech recognition.
ICASSP
Xiong Xiao, Jinyu Li, Engsiong Chng, Haizhou Li
2010 J jnl
A Study on the Generalization Capability of Acoustic Models for Robust Speech Recognition.
IEEE Trans. Speech Audio Process.
Xiong Xiao, Jinyu Li, Engsiong Chng, Haizhou Li, Chin-Hui Lee
2010 A conf
Shrinkage model adaptation in automatic speech recognition.
INTERSPEECH
Jinyu Li, Yu Tsao, Chin-Hui Lee
2010 A conf
Unscented transform with online distortion estimation for HMM adaptation.
INTERSPEECH
Jinyu Li, Dong Yu, Yifan Gong, Li Deng
2010 Misc conf
Word confidence calibration using a maximum entropy model with constraints on confidence and word distributions.
ICASSP
Dong Yu, Shizhen Wang, Jinyu Li, Li Deng
2009 C conf
A study on hidden Markov model's generalization capability for speech recognition.
ASRU
Xiong Xiao, Jinyu Li, Engsiong Chng, Haizhou Li, Chin-Hui Lee
2009 A conf
A study on soft margin estimation of linear regression parameters for speaker adaptation.
INTERSPEECH
Shigeki Matsuda, Yu Tsao, Jinyu Li, Satoshi Nakamura, Chin-Hui Lee
2009 J jnl
A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions.
Comput. Speech Lang.
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
2009 Misc conf
Ensemble speaker and speaking environment modeling approach with advanced online estimation process.
ICASSP
Yu Tsao, Jinyu Li, Chin-Hui Lee
2009 — conf
Soft margin estimation on improving environment structures for ensemble speaker and speaking environment modeling.
IUCS
Yu Tsao, Jinyu Li, Chin-Hui Lee, Satoshi Nakamura
2008 Misc conf
Adaptation of compressed HMM parameters for resource-constrained speech recognition.
ICASSP
Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
2008 Misc conf
HMM adaptation using a phase-sensitive acoustic distortion model for environment-robust speech recognition.
ICASSP
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
2008 A conf
On a generalization of margin-based discriminative training to robust speech recognition.
INTERSPEECH
Jinyu Li, Chin-Hui Lee
2008 — —
Soft margin estimation for automatic speech recognition.
Jinyu Li
2008 A conf
Soft margin estimation with various separation levels for LVCSR.
INTERSPEECH
Jinyu Li, Zhi-Jie Yan, Chin-Hui Lee, Ren-Hua Wang
2007 C conf
A study on soft margin estimation for LVCSR.
ASRU
Jinyu Li, Zhi-Jie Yan, Chin-Hui Lee, Ren-Hua Wang
2007 J jnl
Approximate Test Risk Bound Minimization Through Soft Margin Estimation.
IEEE Trans. Speech Audio Process.
Jinyu Li, Ming Yuan, Chin-Hui Lee
2007 — conf
Approximate Test Risk Minimization Through Soft Margin Estimation.
ICASSP (4)
Jinyu Li, Sabato Marco Siniscalchi, Chin-Hui Lee
2007 A conf
Detection-based ASR in the automatic speech attribute transcription project.
INTERSPEECH
Ilana Bromberg, Qian Qian, Jun Hou, Jinyu Li, Chengyuan Ma, Brett Matthews, Antonio Moreno-Daniel, Jeremy Morris, Sabato Marco Siniscalchi, Yu Tsao, Yu Wang
2007 C conf
High-performance hmm adaptation with joint compensation of additive and convolutive distortions via Vector Taylor Series.
ASRU
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
2007 A conf
Soft margin feature extraction for automatic speech recognition.
INTERSPEECH
Jinyu Li, Chin-Hui Lee
2006 A conf
A study on lattice rescoring with knowledge scores for automatic speech recognition.
INTERSPEECH
Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
2006 — conf
Language Recognition Based on Score Distribution Feature Vectors and Discriminative Classifier Fusion.
Odyssey
Jinyu Li, Sibel Yaman, Chin-Hui Lee, Bin Ma, Rong Tong, Donglai Zhu, Haizhou Li
2006 A conf
Soft margin estimation of hidden Markov model parameters.
INTERSPEECH
Jinyu Li, Ming Yuan, Chin-Hui Lee
2005 — conf
A Study on Knowledge Source Integration for Candidate Rescoring in Automatic Speech Recognition.
ICASSP (1)
Jinyu Li, Yu Tsao, Chin-Hui Lee
2005 A conf
A study on separation between acoustic models and its applications.
INTERSPEECH
Yu Tsao, Jinyu Li, Chin-Hui Lee
2005 — conf
Application of E
WIRN/NAIS
Sabato Marco Siniscalchi, Jinyu Li, Giovanni Pilato, Giorgio Vassallo, Mark A. Clements, Antonio Gentile, Filippo Sorbello
2005 A conf
On designing and evaluating speech event detectors.
INTERSPEECH
Jinyu Li, Chin-Hui Lee
2000 A conf
A novel search algorithm for LSF VQ.
INTERSPEECH
Jinyu Li, Xin Luo, Ren-Hua Wang