Hung-yi Lee

699 papers A* 21A 87B 1C 34Misc 71Journal 396Unranked 87
YearRankTypeTitle / Venue / Authors
2026 J jnl
AQAScore: Evaluating Semantic Alignment in Text-to-Audio Generation via Audio Question Answering.
CoRR
Chun-Yi Kuan, Kai-Wei Chang, Hung-yi Lee
2026 J jnl
AQUA-Bench: Beyond Finding Answers to Knowing When There Are None in Audio Question Answering.
CoRR
Chun-Yi Kuan, Hung-yi Lee
2026 — conf
BILLY: Steering Large Language Models via Merging Persona Vectors for Creative Generation.
EACL (Volume 1: Long Papers)
Tsung-Min Pai, Jui-I Wang, Li-Chun Lu, Shao-Hua Sun, Hung-yi Lee, Kai-Wei Chang
2026 J jnl
Causal Tracing of Audio-Text Fusion in Large Audio Language Models.
CoRR
Wei-Chih Chen, Chien-yu Huang, Hung-yi Lee
2026 J jnl
Cross-Attention Reprogramming for ASR: Bridging Discrete Speech Units and Pretrained Language Models.
IEEE Access
Pei-Jun Liao, Hung-yi Lee, Hsin-Min Wang
2026 J jnl
Generalized Stock Price Prediction for Multiple Stocks Combined with News Fusion.
CoRR
Pei-Jun Liao, Hung-Shin Lee, Yao-Fei Cheng, Li-Wei Chen, Hung-yi Lee, Hsin-Min Wang
2026 J jnl
How Auditory Knowledge in LLM Backbones Shapes Audio Language Models: A Holistic Evaluation.
CoRR
Ke-Han Lu, Szu-Wei Fu, Chao-Han Huck Yang, Zhehuai Chen, Sung-Feng Huang, Chih-Kai Yang, Yi-Cheng Lin, Chi-Yuan Hsiao, Wenze Ren, En-Pei Hu, Yu-Han Huang, An-Yu Cheng, Cheng-Han Chiang, Yu Tsao, Yu-Chiang Frank Wang, Hung-yi Lee
2026 J jnl
How Contrastive Decoding Enhances Large Audio Language Models?
CoRR
Tzu-Quan Lin, Wei-Ping Huang, Yi-Cheng Lin, Hung-yi Lee
2026 J jnl
Latent-Mark: An Audio Watermark Robust to Neural Resynthesis.
CoRR
Yen-Shan Chen, Shih-Yu Lai, Ying-Jung Tsou, Yi-Cheng Lin, Bing-Yu Chen, Yun-Nung Chen, Hung-yi Lee, Shang-Tse Chen
2026 J jnl
MUGEN: Evaluating and Improving Multi-audio Understanding of Large Audio-Language Models.
CoRR
Chih-Kai Yang, Yun-Shao Tsai, Yu-Kai Guo, Ping-Le Tsai, Yen-Ting Piao, Hung-Wei Chen, Ting-Lin Hsiao, Yun-Man Hsu, Ke-Han Lu, Hung-yi Lee
2026 J jnl
Membership Inference Attacks against Large Audio Language Models.
CoRR
Jia-Kai Dong, Yu-Xiang Lin, Hung-yi Lee
2026 J jnl
Nudging Hidden States: Training-Free Model Steering for Chain-of-Thought Reasoning in Large Audio-Language Models.
CoRR
Lok-Lam Ieong, Chia-Chien Chen, Chih-Kai Yang, Yu-Han Huang, An-Yu Cheng, Hung-yi Lee
2026 J jnl
On Calibration of Large Language Models: From Response To Capability.
CoRR
Sin-Han Yang, Cheng-Kuang Wu, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee, Shao-Hua Sun
2026 J jnl
On the Fallacy of Global Token Perplexity in Spoken Language Model Evaluation.
CoRR
Jeff Chan-Jan Sju, Liang-Hsuan Tseng, Yi-Cheng Lin, Yen-Chun Kuo, Ju-Chieh Chou, Kai-Wei Chang, Hung-yi Lee, Carlos Busso
2026 J jnl
SPAR-K: Scheduled Periodic Alternating Early Exit for Spoken Language Models.
CoRR
Hsiao-Ying Huang, Cheng-Han Chiang, Hung-yi Lee
2026 J jnl
TASTE-Streaming: Towards Streamable Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling.
CoRR
Liang-Hsuan Tseng, Hung-yi Lee
2026 J jnl
TaigiSpeech: A Low-Resource Real-World Speech Intent Dataset and Preliminary Results with Scalable Data Mining In-the-Wild.
CoRR
Kai-Wei Chang, Yi-Cheng Lin, Huang-Cheng Chou, Wenze Ren, Yu-Han Huang, Yun-Shao Tsai, Chien-Cheng Chen, Yu Tsao, Yuan-Fu Liao, Shrikanth Narayanan, James R. Glass, Hung-yi Lee
2026 J jnl
The Binding Effect: Analyzing How Multi-Dimensional Cues Form Gender Bias in Instruction TTS.
CoRR
Kuan-Yu Chen, Yi-Cheng Lin, Po-Chung Hsieh, Huang-Cheng Chou, Chih-Fan Hsu, Jeng-Lin Li, Hung-yi Lee, Jian-Jiun Ding
2026 J jnl
The ICASSP 2026 HumDial Challenge: Benchmarking Human-like Spoken Dialogue Systems in the LLM Era.
CoRR
Zhixian Zhao, Shuiyuan Wang, Guojian Li, Hongfei Xue, Chengyou Wang, Shuai Wang, Longshuai Xiao, Zihan Zhang, Hui Bu, Xin Xu, Xinsheng Wang, Hexin Liu, Eng Siong Chng, Hung-yi Lee, Haizhou Li, Lei Xie
2026 J jnl
TiCo: Time-Controllable Training for Spoken Dialogue Models.
CoRR
Kai-Wei Chang, Wei-Chih Chen, En-Pei Hu, Hung-yi Lee, James R. Glass
2025 J jnl
A Preliminary Exploration with GPT-4o Voice Mode.
CoRR
Yu-Xiang Lin, Chih-Kai Yang, Wei-Chih Chen, Chen-An Li, Chien-yu Huang, Xuanjun Chen, Hung-yi Lee
2025 J jnl
A Preliminary Study of RAG for Taiwanese Historical Archives.
CoRR
Claire Lin, Bo-Han Feng, Xuanjun Chen, Te-Lun Yang, Hung-yi Lee, Jyh-Shing Roger Jang
2025 C conf
A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data.
ASRU
Cheng-Kang Chou, Chan-Jan Hsu, Ho-Lam Chung, Liang-Hsuan Tseng, Hsi-Chun Cheng, Yu-Kuan Fu, Kuan-Po Huang, Hung-yi Lee
2025 J jnl
A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data.
CoRR
Cheng-Kang Chou, Chan-Jan Hsu, Ho-Lam Chung, Liang-Hsuan Tseng, Hsi-Chun Cheng, Yu-Kuan Fu, Kuan-Po Huang, Hung-yi Lee
2025 C conf
A correlation-permutation approach for speech-music encoders model merging.
ASRU
Fabian Ritter Gutierrez, Yi-Cheng Lin, Jeremy H. M. Wong, Hung-yi Lee, Eng Siong Chng, Nancy F. Chen
2025 J jnl
A correlation-permutation approach for speech-music encoders model merging.
CoRR
Fabian Ritter Gutierrez, Yi-Cheng Lin, Jeremy H. M. Wong, Hung-yi Lee, Eng Siong Chng, Nancy F. Chen
2025 J jnl
AEGIS : Automated Co-Evolutionary Framework for Guarding Prompt Injections Schema.
CoRR
Ting-Chun Liu, Ching Yu Hsu, Kuan-Yi Lee, Chi-An Fu, Hung-yi Lee
2025 C conf
ASTAR-NTU solution to AudioMOS Challenge 2025 Track1.
ASRU
Fabian Ritter Gutierrez, Yi-Cheng Lin, Jui-Chiang Wei, Jeremy H. M. Wong, Nancy F. Chen, Hung-yi Lee
2025 J jnl
ASTAR-NTU solution to AudioMOS Challenge 2025 Track1.
CoRR
Fabian Ritter Gutierrez, Yi-Cheng Lin, Jui-Chiang Wei, Jeremy H. M. Wong, Nancy F. Chen, Hung-yi Lee
2025 J jnl
AdaSearch: Balancing Parametric Knowledge and Search in Large Language Models via Reinforcement Learning.
CoRR
Tzu-Han Lin, Wei-Lin Chen, Chen-An Li, Hung-yi Lee, Yun-Nung Chen, Yu Meng
2025 J jnl
Adaptive vector steering: A training-free, layer-wise intervention for hallucination mitigation in large audio and multimodal models.
CoRR
Tsung-En Lin, Kuan-Yi Lee, Hung-yi Lee
2025 — conf
Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback.
ACL (1)
Guan-Ting Lin, Prashanth Gurunath Shivakumar, Aditya Gourav, Yile Gu, Ankur Gandhe, Hung-yi Lee, Ivan Bulyko
2025 J jnl
An Exploration of Mamba for Speech Self-Supervised Models.
CoRR
Tzu-Quan Lin, Heng-Cheng Kuo, Tzu-Chieh Wei, Hsi-Chun Cheng, Chun-Wei Chen, Hsien-Fu Hsiao, Yu Tsao, Hung-yi Lee
2025 A conf
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models.
INTERSPEECH
Chi-Yuan Hsiao, Ke-Han Lu, Kai-Wei Chang, Chih-Kai Yang, Wei-Chih Chen, Hung-yi Lee
2025 J jnl
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models.
CoRR
Chi-Yuan Hsiao, Ke-Han Lu, Kai-Wei Chang, Chih-Kai Yang, Wei-Chih Chen, Hung-yi Lee
2025 J jnl
Answer, Refuse, or Guess? Investigating Risk-Aware Decision Making in Language Models.
CoRR
Cheng-Kuang Wu, Zhi Rui Tam, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee
2025 — conf
Audio-Aware Large Language Models as Judges for Speaking Styles.
EMNLP (Findings)
Cheng-Han Chiang, Xiaofei Wang, Chung-Ching Lin, Kevin Lin, Linjie Li, Radu Kopetz, Yao Qian, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
2025 J jnl
Audio-Aware Large Language Models as Judges for Speaking Styles.
CoRR
Cheng-Han Chiang, Xiaofei Wang, Chung-Ching Lin, Kevin Lin, Linjie Li, Radu Kopetz, Yao Qian, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
2025 J jnl
Audio-Maestro: Enhancing Large Audio-Language Models with Tool-Augmented Reasoning.
CoRR
Kuan-Yi Lee, Tsung-En Lin, Hung-yi Lee
2025 C conf
AudioLens: A Closer Look at Auditory Attribute Perception of Large Audio-Language Models.
ASRU
Chih-Kai Yang, Neo Ho, Yi-Jyun Lee, Hung-yi Lee
2025 J jnl
AudioLens: A Closer Look at Auditory Attribute Perception of Large Audio-Language Models.
CoRR
Chih-Kai Yang, Neo Ho, Yi-Jyun Lee, Hung-yi Lee
2025 J jnl
BILLY: Steering Large Language Models via Merging Persona Vectors for Creative Generation.
CoRR
Tsung-Min Pai, Jui-I Wang, Li-Chun Lu, Shao-Hua Sun, Hung-yi Lee, Kai-Wei Chang
2025 J jnl
BreezyVoice: Adapting TTS for Taiwanese Mandarin with Enhanced Polyphone Disambiguation - Challenges and Insights.
CoRR
Chan-Jan Hsu, Yi-Cheng Lin, Chia-Chun Lin, Wei-Chih Chen, Ho-Lam Chung, Chen-An Li, Yi-Chang Chen, Chien-Yu Yu, Ming-Ji Lee, Chien-Cheng Chen, Ru-Heng Huang, Hung-yi Lee, Da-Shan Shiu
2025 C conf
CO-VADA: A Confidence-Oriented Voice Augmentation Debiasing Approach for Fair Speech Emotion Recognition.
ASRU
Yun-Shao Tsai, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 J jnl
CO-VADA: A Confidence-Oriented Voice Augmentation Debiasing Approach for Fair Speech Emotion Recognition.
CoRR
Yun-Shao Tsai, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 Misc conf
Can Large Audio-Language Models Truly Hear? Tackling Hallucinations with Multi-Task Assessment and Stepwise Audio Reasoning.
ICASSP
Chun-Yi Kuan, Hung-yi Lee
2025 J jnl
Clear Minds Think Alike: What Makes LLM Fine-tuning Robust? A Study of Token Perplexity.
CoRR
Chao-Chung Wu, Zhi Rui Tam, Chieh-Yen Lin, Hung-yi Lee, Yun-Nung Chen
2025 J jnl
CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding Tasks.
CoRR
Hongchao Jiang, Yiming Chen, Yushi Cao, Hung-yi Lee, Robby T. Tan
2025 A conf
Codec-Based Deepfake Source Tracing via Neural Audio Codec Taxonomy.
INTERSPEECH
Xuanjun Chen, I-Ming Lin, Lin Zhang, Jiawei Du, Haibin Wu, Hung-yi Lee, Jyh-Shing Roger Jang
2025 J jnl
Codec-Based Deepfake Source Tracing via Neural Audio Codec Taxonomy.
CoRR
Xuanjun Chen, I-Ming Lin, Lin Zhang, Jiawei Du, Haibin Wu, Hung-yi Lee, Jyh-Shing Roger Jang
2025 J jnl
CodecFake-Omni: A Large-Scale Codec-based Deepfake Speech Dataset.
CoRR
Jiawei Du, Xuanjun Chen, Haibin Wu, Lin Zhang, I-Ming Lin, I-Hsiang Chiu, Wenze Ren, Yuan Tseng, Yu Tsao, Jyh-Shing Roger Jang, Hung-yi Lee
2025 A* conf
Creativity in LLM-based Multi-Agent Systems: A Survey.
EMNLP
Yi-Cheng Lin, Kang-Chieh Chen, Zhe-Yan Li, Tzu-Heng Wu, Tzu-Hsuan Wu, Kuan-Yu Chen, Hung-yi Lee, Yun-Nung Chen
2025 J jnl
Creativity in LLM-based Multi-Agent Systems: A Survey.
CoRR
Yi-Cheng Lin, Kang-Chieh Chen, Zhe-Yan Li, Tzu-Heng Wu, Tzu-Hsuan Wu, Kuan-Yu Chen, Hung-yi Lee, Yun-Nung Chen
2025 J jnl
DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignment.
CoRR
Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, Chao-Han Huck Yang, Sung-Feng Huang, Chih-Kai Yang, Chee-En Yu, Chun-Wei Chen, Wei-Chih Chen, Chien-yu Huang, Yi-Cheng Lin, Yu-Xiang Lin, Chi-An Fu, Chun-Yi Kuan, Wenze Ren, Xuanjun Chen, Wei-Ping Huang, En-Pei Hu, Tzu-Quan Lin, Yuan-Kuei Wu, Kuan-Po Huang, Hsiao-Ying Huang, Huang-Cheng Chou, Kai-Wei Chang, Cheng-Han Chiang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee
2025 J jnl
Detecting the Undetectable: Assessing the Efficacy of Current Spoof Detection Methods Against Seamless Speech Edits.
CoRR
Sung-Feng Huang, Heng-Cheng Kuo, Zhehuai Chen, Xuesong Yang, Chao-Han Huck Yang, Yu Tsao, Yu-Chiang Frank Wang, Hung-yi Lee, Szu-Wei Fu
2025 Misc conf
Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data.
ICASSP
Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, Chao-Han Huck Yang, Jagadeesh Balam, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee
2025 J jnl
Discrete Audio Tokens: More Than a Survey!
CoRR
Pooneh Mousavi, Gallil Maimon, Adel Moumen, Darius Petermann, Jiatong Shi, Haibin Wu, Haici Yang, Anastasia Kuznetsova, Artem Ploujnikov, Ricard Marxer, Bhuvana Ramabhadran, Benjamin Elizalde, Loren Lugosch, Jinyu Li, Cem Subakan, Philip C. Woodland, Minje Kim, Hung-yi Lee, Shinji Watanabe, Yossi Adi, Mirco Ravanelli
2025 J jnl
Discrete Audio Tokens: More Than a Survey!
Trans. Mach. Learn. Res.
Pooneh Mousavi, Gallil Maimon, Adel Moumen, Darius Petermann, Jiatong Shi, Haibin Wu, Haici Yang, Anastasia Kuznetsova, Artem Ploujnikov, Ricard Marxer, Bhuvana Ramabhadran, Benjamin Elizalde, Loren Lugosch, Jinyu Li, Cem Subakan, Philip C. Woodland, Minje Kim, Hung-yi Lee, Shinji Watanabe, Yossi Adi, Mirco Ravanelli
2025 A conf
Distilling a speech and music encoder with task arithmetic.
INTERSPEECH
Fabian Ritter Gutierrez, Yi-Cheng Lin, Jui-Chiang Wei, Jeremy H. M. Wong, Eng Siong Chng, Nancy F. Chen, Hung-yi Lee
2025 J jnl
Distilling a speech and music encoder with task arithmetic.
CoRR
Fabian Ritter Gutierrez, Yi-Cheng Lin, Jui-Chiang Wei, Jeremy H. M. Wong, Eng Siong Chng, Nancy F. Chen, Hung-yi Lee
2025 C conf
EMO-Debias: Benchmarking Gender Debiasing Techniques in Multi-Label Speech Emotion Recognition.
ASRU
Yi-Cheng Lin, Huang-Cheng Chou, Yu-Hsuan Li Liang, Hung-yi Lee
2025 J jnl
EMO-Debias: Benchmarking Gender Debiasing Techniques in Multi-Label Speech Emotion Recognition.
CoRR
Yi-Cheng Lin, Huang-Cheng Chou, Yu-Hsuan Li Liang, Hung-yi Lee
2025 Misc conf
Enhancing Multilingual ASR for Unseen Languages via Language Embedding Modeling.
ICASSP
Shao-Syuan Huang, Kuan-Po Huang, Andy T. Liu, Hung-yi Lee
2025 J jnl
From Alignment to Advancement: Bootstrapping Audio-Language Alignment with Synthetic Data.
CoRR
Chun-Yi Kuan, Hung-yi Lee
2025 C conf
Full-Duplex-Bench: A Benchmark to Evaluate Full-Duplex Spoken Dialogue Models on Turn-taking Capabilities.
ASRU
Guan-Ting Lin, Jiachen Lian, Tingle Li, Qirui Wang, Gopala Anumanchipalli, Alexander H. Liu, Hung-yi Lee
2025 J jnl
Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilities.
CoRR
Guan-Ting Lin, Jiachen Lian, Tingle Li, Qirui Wang, Gopala Anumanchipalli, Alexander H. Liu, Hung-yi Lee
2025 J jnl
Game-Time: Evaluating Temporal Dynamics in Spoken Language Models.
CoRR
Kai-Wei Chang, En-Pei Hu, Chun-Yi Kuan, Wenze Ren, Wei-Chih Chen, Guan-Ting Lin, Yu Tsao, Shao-Hua Sun, Hung-yi Lee, James Glass
2025 — conf
Gender Bias in Instruction-Guided Speech Synthesis Models.
NAACL (Findings)
Chun-Yi Kuan, Hung-yi Lee
2025 J jnl
Gender Bias in Instruction-Guided Speech Synthesis Models.
CoRR
Chun-Yi Kuan, Hung-yi Lee
2025 A* conf
Generative Audio Language Modeling with Continuous-valued Tokens and Masked Next-Token Prediction.
ICML
Shu-Wen Yang, Byeonggeun Kim, Kuan-Po Huang, Qingming Tang, Huy Phan, Bo-Ru Lu, Harshavardhan Sundar, Shalini Ghosh, Hung-yi Lee, Chieh-Chi Kao, Chao Wang
2025 J jnl
Generative Audio Language Modeling with Continuous-valued Tokens and Masked Next-Token Prediction.
CoRR
Shu-Wen Yang, Byeonggeun Kim, Kuan-Po Huang, Qingming Tang, Huy Phan, Bo-Ru Lu, Harsha Sundar, Shalini Ghosh, Hung-yi Lee, Chieh-Chi Kao, Chao Wang
2025 J jnl
Hearing the Order: Investigating Selection Bias in Large Audio-Language Models.
CoRR
Yu-Xiang Lin, Chen-An Li, Sheng-Lun Wei, Po-Chun Chen, Hsin-Hsi Chen, Hung-yi Lee
2025 — conf
Hierarchical Speculative Decoding with Dynamic Window.
NAACL (Findings)
Shensian Syu, Hung-yi Lee
2025 C conf
HighRateMOS: Sampling-Rate Aware Modeling for Speech Quality Assessment.
ASRU
Wenze Ren, Yi-Cheng Lin, Wen-Chin Huang, Ryandhimas E. Zezario, Szu-Wei Fu, Sung-Feng Huang, Erica Cooper, Haibin Wu, Hung-Yu Wei, Hsin-Min Wang, Hung-yi Lee, Yu Tsao
2025 J jnl
How Does Instrumental Music Help SingFake Detection?
CoRR
Xuanjun Chen, Chia-Yu Hu, I-Ming Lin, Yi-Cheng Lin, I-Hsiang Chiu, You Zhang, Sung-Feng Huang, Yi-Hsuan Yang, Haibin Wu, Hung-yi Lee, Jyh-Shing Roger Jang
2025 A* conf
IMPACT: Iterative Mask-based Parallel Decoding for Text-to-Audio Generation with Diffusion Modeling.
ICML
Kuan-Po Huang, Shu-Wen Yang, Huy Phan, Bo-Ru Lu, Byeonggeun Kim, Sashank Macha, Qingming Tang, Shalini Ghosh, Hung-yi Lee, Chieh-Chi Kao, Chao Wang
2025 J jnl
IMPACT: Iterative Mask-based Parallel Decoding for Text-to-Audio Generation with Diffusion Modeling.
CoRR
Kuan-Po Huang, Shu-Wen Yang, Huy Phan, Bo-Ru Lu, Byeonggeun Kim, Sashank Macha, Qingming Tang, Shalini Ghosh, Hung-yi Lee, Chieh-Chi Kao, Chao Wang
2025 — conf
Identifying Speaker Information in Feed-Forward Layers of Self-Supervised Speech Transformers.
APSIPA
Tzu-Quan Lin, Hsi-Chun Cheng, Hung-yi Lee, Hao Tang
2025 J jnl
Identifying Speaker Information in Feed-Forward Layers of Self-Supervised Speech Transformers.
CoRR
Tzu-Quan Lin, Hsi-Chun Cheng, Hung-yi Lee, Hao Tang
2025 Misc conf
Improving Speech Emotion Recognition in Under-Resourced Languages via Speech-to-Speech Translation with Bootstrapping Data Selection.
ICASSP
Hsi-Che Lin, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 J jnl
Investigating Safety Vulnerabilities of Large Audio-Language Models Under Speaker Emotional Variations.
CoRR
Bo-Han Feng, Chien-Feng Liu, Yu-Hsuan Li Liang, Chih-Kai Yang, Szu-Wei Fu, Zhehuai Chen, Ke-Han Lu, Sung-Feng Huang, Chao-Han Huck Yang, Yu-Chiang Frank Wang, Yun-Nung Chen, Hung-yi Lee
2025 C conf
Is Smaller Always Faster? Tradeoffs in Compressing Self-Supervised Speech Transformers.
ASRU
Tzu-Quan Lin, Tsung-Huan Yang, Chun-Yao Chang, Kuang-Ming Chen, Tzu-hsun Feng, Hung-yi Lee, Hao Tang
2025 J jnl
Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?
CoRR
Zhi Rui Tam, Cheng-Kuang Wu, Yu Ying Chiu, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee
2025 J jnl
Localizing Audio-Visual Deepfakes via Hierarchical Boundary Modeling.
CoRR
Xuanjun Chen, Shih-Peng Cheng, Jiawei Du, Lin Zhang, Xiaoxiao Miao, Chung-Che Wang, Haibin Wu, Hung-yi Lee, Jyh-Shing Roger Jang
2025 J jnl
MI-Fuse: Label Fusion for Unsupervised Domain Adaptation with Closed-Source Large-Audio Language Model.
CoRR
Hsiao-Ying Huang, Yi-Cheng Lin, Hung-yi Lee
2025 C conf
MMMOS: Multi-domain Multi-axis Audio Quality Assessment.
ASRU
Yi-Cheng Lin, Jia-Hung Chen, Hung-yi Lee
2025 J jnl
MMMOS: Multi-domain Multi-axis Audio Quality Assessment.
CoRR
Yi-Cheng Lin, Jia-Hung Chen, Hung-yi Lee
2025 A conf
Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning.
INTERSPEECH
Shi-Xin Fang, Liang-Yeh Shen, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 J jnl
Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning.
CoRR
Liang-Yeh Shen, Shi-Xin Fang, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 A conf
Mitigating Subgroup Disparities in Multi-Label Speech Emotion Recognition: A Pseudo-Labeling and Unsupervised Learning Approach.
INTERSPEECH
Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 J jnl
Mitigating Subgroup Disparities in Multi-Label Speech Emotion Recognition: A Pseudo-Labeling and Unsupervised Learning Approach.
CoRR
Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2025 C conf
Multi-Distillation from Speech and Music Representation Models.
ASRU
Jui-Chiang Wei, Yi-Cheng Lin, Fabian Ritter-Gutierrez, Hung-yi Lee
2025 J jnl
On The Landscape of Spoken Language Models: A Comprehensive Survey.
CoRR
Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien, Yifan Peng, Haibin Wu, Yossi Adi, Emmanuel Dupoux, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025 J jnl
On The Landscape of Spoken Language Models: A Comprehensive Survey.
Trans. Mach. Learn. Res.
Siddhant Arora, Kai-Wei Chang, Chung-Ming Chien, Yifan Peng, Haibin Wu, Yossi Adi, Emmanuel Dupoux, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025 J jnl
Prompt-Based One-Shot Exact Length-Controlled Generation with LLMs.
CoRR
Juncheng Xie, Hung-yi Lee
2025 J jnl
Pseudo2Real: Task Arithmetic for Pseudo-Label Correction in Automatic Speech Recognition.
CoRR
Yi-Cheng Lin, Yu-Hsuan Li Liang, Hsuan Su, Tzu-Quan Lin, Shang-Tse Chen, Yun-Nung Chen, Hung-yi Lee
2025 C conf
Reducing Object Hallucination in Large Audio-Language Models via Audio-Aware Decoding.
ASRU
Tzu-Wen Hsu, Ke-Han Lu, Cheng-Han Chiang, Hung-yi Lee
2025 J jnl
Reducing Object Hallucination in Large Audio-Language Models via Audio-Aware Decoding.
CoRR
Tzu-Wen Hsu, Ke-Han Lu, Cheng-Han Chiang, Hung-yi Lee
2025 J jnl
SAKE: Towards Editing Auditory Attribute Knowledge of Large Audio-Language Models.
CoRR
Chih-Kai Yang, Yen-Ting Piao, Tzu-Wen Hsu, Szu-Wei Fu, Zhehuai Chen, Ke-Han Lu, Sung-Feng Huang, Chao-Han Huck Yang, Yu-Chiang Frank Wang, Yun-Nung Chen, Hung-yi Lee
2025 A conf
SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information.
INTERSPEECH
Chih-Kai Yang, Neo Ho, Yen-Ting Piao, Hung-yi Lee
2025 J jnl
SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information.
CoRR
Chih-Kai Yang, Neo Ho, Yen-Ting Piao, Hung-yi Lee
2025 J jnl
SHANKS: Simultaneous Hearing and Thinking for Spoken Language Models.
CoRR
Cheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin, Kevin Lin, Shujie Liu, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
2025 C conf
SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognition.
ASRU
Ming-Hao Hsu, Hung-yi Lee
2025 J jnl
STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models.
CoRR
Cheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin, Kevin Lin, Shujie Liu, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
2025 C conf
SUTA-LM: Bridging Test-Time Adaptation and Language Model Rescoring for Robust ASR.
ASRU
Wei-Ping Huang, Guan-Ting Lin, Hung-yi Lee
2025 J jnl
SUTA-LM: Bridging Test-Time Adaptation and Language Model Rescoring for Robust ASR.
CoRR
Wei-Ping Huang, Guan-Ting Lin, Hung-yi Lee
2025 — conf
Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model Merging.
EMNLP (Findings)
Hua Farn, Hsuan Su, Shachi H. Kumar, Saurav Sahay, Shang-Tse Chen, Hung-yi Lee
2025 Misc conf
Spectral-Aware Low-Rank Adaptation for Speaker Verification.
ICASSP
Zhe Li, Man-Wai Mak, Mert Pilanci, Hung-yi Lee, Helen Meng
2025 J jnl
Spectral-Aware Low-Rank Adaptation for Speaker Verification.
CoRR
Zhe Li, Man-Wai Mak, Mert Pilanci, Hung-yi Lee, Helen Meng
2025 J jnl
Speech-FT: A Fine-tuning Strategy for Enhancing Speech Representation Models Without Compromising Generalization Ability.
CoRR
Tzu-Quan Lin, Wei-Ping Huang, Hao Tang, Hung-yi Lee
2025 A conf
Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models.
INTERSPEECH
Ke-Han Lu, Chun-Yi Kuan, Hung-yi Lee
2025 J jnl
Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models.
CoRR
Ke-Han Lu, Chun-Yi Kuan, Hung-yi Lee
2025 Misc conf
SpeechCaps: Advancing Instruction-Based Universal Speech Models with Multi-Talker Speaking Style Captioning.
ICASSP
Chien-yu Huang, Min-Han Shih, Ke-Han Lu, Chi-Yuan Hsiao, Hung-yi Lee
2025 J jnl
Style Amnesia: Investigating Speaking Style Degradation and Mitigation in Multi-Turn Spoken Language Models.
CoRR
Yu-Xiang Lin, Cheng-Han Chiang, Hung-yi Lee
2025 J jnl
TASLA: Text-Aligned Speech Tokens with Multiple Layer-Aggregation.
CoRR
Ming-Hao Hsu, Liang-Hsuan Tseng, Hung-yi Lee, Zhizheng Wu
2025 J jnl
TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling.
CoRR
Liang-Hsuan Tseng, Yi-Chang Chen, Kuan-Yi Lee, Da-Shan Shiu, Hung-yi Lee
2025 J jnl
TAU: A Benchmark for Cultural Sound Understanding Beyond Semantics.
CoRR
Yi-Cheng Lin, Yu-Hua Chen, Jia-Kai Dong, Yueh-Hsuan Huang, Szu-Chi Chen, Yu-Chen Chen, Chih-Yao Chen, Yu-Jung Lin, Yu-Ling Chen, Zih-Yu Chen, I-Ning Tsai, Hsiu-Hsuan Wang, Ho-Lam Chung, Ke-Han Lu, Hung-yi Lee
2025 — conf
TRACT: Regression-Aware Fine-tuning Meets Chain-of-Thought Reasoning for LLM-as-a-Judge.
ACL (1)
Cheng-Han Chiang, Hung-yi Lee, Michal Lukasik
2025 J jnl
TRACT: Regression-Aware Fine-tuning Meets Chain-of-Thought Reasoning for LLM-as-a-Judge.
CoRR
Cheng-Han Chiang, Hung-yi Lee, Michal Lukasik
2025 A conf
Teaching Audio-Aware Large Language Models What Does Not Hear: Mitigating Hallucinations through Synthesized Negative Samples.
INTERSPEECH
Chun-Yi Kuan, Hung-yi Lee
2025 J jnl
Teaching Audio-Aware Large Language Models What Does Not Hear: Mitigating Hallucinations through Synthesized Negative Samples.
CoRR
Chun-Yi Kuan, Hung-yi Lee
2025 A conf
The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties.
INTERSPEECH
William Chen, Chutong Meng, Jiatong Shi, Martijn Bartelds, Shih-Heng Wang, Hsiu-Hsuan Wang, Rafael Mosquera, Sara Hincapie, Dan Jurafsky, Antonis Anastasopoulos, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025 J jnl
The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties.
CoRR
William Chen, Chutong Meng, Jiatong Shi, Martijn Bartelds, Shih-Heng Wang, Hsiu-Hsuan Wang, Rafael Mosquera, Sara Hincapie, Dan Jurafsky, Antonis Anastasopoulos, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2025 C conf
Towards Generalized Source Tracing for Codec-Based Deepfake Speech.
ASRU
I-Ming Lin, Xuanjun Chen, Lin Zhang, Haibin Wu, Hung-yi Lee, Jyh-Shing Roger Jang
2025 J jnl
Towards Generalized Source Tracing for Codec-Based Deepfake Speech.
CoRR
Xuanjun Chen, I-Ming Lin, Lin Zhang, Haibin Wu, Hung-yi Lee, Jyh-Shing Roger Jang
2025 A* conf
Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey.
EMNLP
Chih-Kai Yang, Neo S. Ho, Hung-yi Lee
2025 J jnl
Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey.
CoRR
Chih-Kai Yang, Neo S. Ho, Hung-yi Lee
2025 A conf
ToxicTone: A Mandarin Audio Dataset Annotated for Toxicity and Toxic Utterance Tonality.
INTERSPEECH
Yu-Xiang Luo, Yi-Cheng Lin, Ming-To Chuang, Jia-Hung Chen, I-Ning Tsai, Pei Xing Kiew, Yueh-Hsuan Huang, Chien-Feng Liu, Yu-Chen Chen, Bo-Han Feng, Wenze Ren, Hung-yi Lee
2025 J jnl
ToxicTone: A Mandarin Audio Dataset Annotated for Toxicity and Toxic Utterance Tonality.
CoRR
Yu-Xiang Luo, Yi-Cheng Lin, Ming-To Chuang, Jia-Hung Chen, I-Ning Tsai, Pei Xing Kiew, Yueh-Hsuan Huang, Chien-Feng Liu, Yu-Chen Chen, Bo-Han Feng, Wenze Ren, Hung-yi Lee
2025 — conf
Transferring Textual Preferences to Vision-Language Understanding through Model Merging.
ACL (2)
Chen-An Li, Tzu-Han Lin, Yun-Nung Chen, Hung-yi Lee
2025 J jnl
Transferring Textual Preferences to Vision-Language Understanding through Model Merging.
CoRR
Chen-An Li, Tzu-Han Lin, Yun-Nung Chen, Hung-yi Lee
2025 A conf
VoiceNoNG: Robust High-Quality Speech Editing Model without Hallucinations.
INTERSPEECH
Sung-Feng Huang, Heng-Cheng Kuo, Zhehuai Chen, Xuesong Yang, Pin-Jui Ku, Ante Jukic, Huck Yang, Yu Tsao, Yu-Chiang Frank Wang, Hung-yi Lee, Szu-Wei Fu
2025 J jnl
When Silence Matters: The Impact of Irrelevant Audio on Text Reasoning in Large Audio-Language Models.
CoRR
Chen-An Li, Tzu-Han Lin, Hung-yi Lee
2024 J jnl
A Large-Scale Evaluation of Speech Foundation Models.
CoRR
Shu-Wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
2024 J jnl
A Large-Scale Evaluation of Speech Foundation Models.
IEEE ACM Trans. Audio Speech Lang. Process.
Shu-Wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
2024 Misc conf
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models.
ICASSP
Yuan Tseng, Layne Berry, Yiting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Poyao Huang, Chun-Mao Lai, Shang-wen Li, David Harwath, Yu Tsao, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee
2024 — conf
Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations.
ACL (1)
Guan-Ting Lin, Cheng-Han Chiang, Hung-yi Lee
2024 J jnl
Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations.
CoRR
Guan-Ting Lin, David Cheng-Han Chiang, Hung-yi Lee
2024 J jnl
Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback.
CoRR
Guan-Ting Lin, Prashanth Gurunath Shivakumar, Aditya Gourav, Yile Gu, Ankur Gandhe, Hung-yi Lee, Ivan Bulyko
2024 J jnl
Building a Taiwanese Mandarin Spoken Language Model: A First Attempt.
CoRR
Chih-Kai Yang, Yu-Kuan Fu, Chen-An Li, Yi-Cheng Lin, Yu-Xiang Lin, Wei-Chih Chen, Ho-Lam Chung, Chun-Yi Kuan, Wei-Ping Huang, Ke-Han Lu, Tzu-Quan Lin, Hsiu-Hsuan Wang, En-Pei Hu, Chan-Jan Hsu, Liang-Hsuan Tseng, I-Hsiang Chiu, Ulin Sanga, Xuanjun Chen, Po-Chun Hsu, Shu-Wen Yang, Hung-yi Lee
2024 — conf
Can LLMs Understand the Implication of Emphasized Sentences in Dialogue?
EMNLP (Findings)
Guan-Ting Lin, Hung-yi Lee
2024 J jnl
Can LLMs Understand the Implication of Emphasized Sentences in Dialogue?
CoRR
Guan-Ting Lin, Hung-yi Lee
2024 J jnl
Can Large Audio-Language Models Truly Hear? Tackling Hallucinations with Multi-Task Assessment and Stepwise Audio Reasoning.
CoRR
Chun-Yi Kuan, Hung-yi Lee
2024 — conf
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages.
ACL (1)
Shih-Cheng Huang, Pin-Zu Li, Yu-Chi Hsu, Kuang-Ming Chen, Yu-Tung Lin, Shih-Kai Hsiao, Richard Tzong-Han Tsai, Hung-yi Lee
2024 J jnl
Codec-SUPERB @ SLT 2024: A lightweight benchmark for neural audio codec models.
CoRR
Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-Wei Chang, Jiawei Du, Ke-Han Lu, Alexander H. Liu, Ho-Lam Chung, Yuan-Kuei Wu, Dongchao Yang, Songxiang Liu, Yi-Chiao Wu, Xu Tan, James R. Glass, Shinji Watanabe, Hung-yi Lee
2024 — conf
Codec-SUPERB: An In-Depth Analysis of Sound Codec Models.
ACL (Findings)
Haibin Wu, Ho-Lam Chung, Yi-Cheng Lin, Yuan-Kuei Wu, Xuanjun Chen, Yu-Chi Pai, Hsiu-Hsuan Wang, Kai-Wei Chang, Alexander H. Liu, Hung-yi Lee
2024 J jnl
Codec-SUPERB: An In-Depth Analysis of Sound Codec Models.
CoRR
Haibin Wu, Ho-Lam Chung, Yi-Cheng Lin, Yuan-Kuei Wu, Xuanjun Chen, Yu-Chi Pai, Hsiu-Hsuan Wang, Kai-Wei Chang, Alexander H. Liu, Hung-yi Lee
2024 — conf
Codec-Superb @ SLT 2024: A Lightweight Benchmark For Neural Audio Codec Models.
SLT
Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-Wei Chang, Jiawei Du, Ke-Han Lu, Alexander H. Liu, Ho-Lam Chung, Yuan-Kuei Wu, Dongchao Yang, Songxiang Liu, Yi-Chiao Wu, Xu Tan, James R. Glass, Shinji Watanabe, Hung-yi Lee
2024 A conf
CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems.
INTERSPEECH
Haibin Wu, Yuan Tseng, Hung-yi Lee
2024 J jnl
CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems.
CoRR
Haibin Wu, Yuan Tseng, Hung-yi Lee
2024 A* conf
Continual Test-time Adaptation for End-to-end Speech Recognition on Noisy Speech.
EMNLP
Guan-Ting Lin, Wei Huang, Hung-yi Lee
2024 J jnl
Continual Test-time Adaptation for End-to-end Speech Recognition on Noisy Speech.
CoRR
Guan-Ting Lin, Wei-Ping Huang, Hung-yi Lee
2024 A conf
DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models.
INTERSPEECH
Tzu-Quan Lin, Hung-yi Lee, Hao Tang
2024 J jnl
DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models.
CoRR
Tzu-Quan Lin, Hung-yi Lee, Hao Tang
2024 — conf
DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset.
SLT
Jiawei Du, I-Ming Lin, I-Hsiang Chiu, Xuanjun Chen, Haibin Wu, Wenze Ren, Yu Tsao, Hung-yi Lee, Jyh-Shing Roger Jang
2024 J jnl
DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset.
CoRR
Jiawei Du, I-Ming Lin, I-Hsiang Chiu, Xuanjun Chen, Haibin Wu, Wenze Ren, Yu Tsao, Hung-yi Lee, Jyh-Shing Roger Jang
2024 A conf
Dataset-Distillation Generative Model for Speech Emotion Recognition.
INTERSPEECH
Fabian Ritter Gutierrez, Kuan-Po Huang, Jeremy H. M. Wong, Dianwen Ng, Hung-yi Lee, Nancy F. Chen, Eng Siong Chng
2024 J jnl
Dataset-Distillation Generative Model for Speech Emotion Recognition.
CoRR
Fabian Ritter Gutierrez, Kuan-Po Huang, Jeremy H. M. Wong, Dianwen Ng, Hung-yi Lee, Nancy F. Chen, Eng Siong Chng
2024 A conf
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment.
INTERSPEECH
Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee
2024 J jnl
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment.
CoRR
Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee
2024 J jnl
Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models.
CoRR
Shachi H. Kumar, Saurav Sahay, Sahisnu Mazumder, Eda Okur, Ramesh Manuvinakurike, Nicole Beckage, Hsuan Su, Hung-yi Lee, Lama Nachman
2024 — conf
Detecting the Undetectable: Assessing the Efficacy of Current Spoof Detection Methods Against Seamless Speech Edits.
SLT
Sung-Feng Huang, Heng-Cheng Kuo, Zhehuai Chen, Xuesong Yang, Chao-Han Huck Yang, Yu Tsao, Yu-Chiang Frank Wang, Hung-yi Lee, Szu-Wei Fu
2024 J jnl
Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data.
CoRR
Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, Chao-Han Huck Yang, Jagadeesh Balam, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee
2024 — conf
Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whisper.
SLT
Chih-Kai Yang, Kuan-Po Huang, Hung-yi Lee
2024 J jnl
Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whisper.
CoRR
Chih-Kai Yang, Kuan-Po Huang, Hung-yi Lee
2024 A* conf
DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging.
EMNLP
Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Yun-Nung Chen
2024 J jnl
DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging.
CoRR
Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Yun-Nung Chen
2024 J jnl
Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks.
CoRR
Chien-yu Huang, Wei-Chih Chen, Shu-Wen Yang, Andy T. Liu, Chen-An Li, Yu-Xiang Lin, Wei-Cheng Tseng, Anuj Diwan, Yi-Jen Shih, Jiatong Shi, William Chen, Xuanjun Chen, Chi-Yuan Hsiao, Puyuan Peng, Shih-Heng Wang, Chun-Yi Kuan, Ke-Han Lu, Kai-Wei Chang, Chih-Kai Yang, Fabian Ritter Gutierrez, Ming To Chuang, Kuan-Po Huang, Siddhant Arora, You-Kuan Lin, Eunjung Yeo, Kalvin Chang, Chung-Ming Chien, Kwanghee Choi, Cheng-Hsiu Hsieh, Yi-Cheng Lin, Chee-En Yu, I-Hsiang Chiu, Heitor R. Guimarães, Jionghao Han, Tzu-Quan Lin, Tzu-Yuan Lin, Homu Chang, Ting-Wu Chang, Chun Wei Chen, Shou-Jen Chen, Yu-Hua Chen, Hsi-Chun Cheng, Kunal Dhawan, Jia-Lin Fang, Shi-Xin Fang, Kuan-Yu Fang Chiang, Chi An Fu, Hsien-Fu Hsiao, Ching Yu Hsu, Shao-Syuan Huang, Lee Chen Wei, Hsi-Che Lin, Hsuan-Hao Lin, Hsuan-Ting Lin, Jian-Ren Lin, Ting-Chun Liu, Li-Chun Lu, Tsung-Min Pai, Ankita Pasad, Shih-Yun Shan Kuan, Suwon Shon, Yuxun Tang, Yun-Shao Tsai, Jui-Chiang Wei, Tzu-Chieh Wei, Chengxi Wu, Dien-Ruei Wu, Chao-Han Huck Yang, Chieh-Chi Yang, Jia Qi Yip, Shao-Xiang Yuan, Vahid Noroozi, Zhehuai Chen, Haibin Wu, Karen Livescu, David Harwath, Shinji Watanabe, Hung-yi Lee
2024 Misc conf
Dynamic-Superb: Towards a Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark For Speech.
ICASSP
Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
2024 — conf
EMO-Codec: An In-Depth Look at Emotion Preservation Capacity of Legacy and Neural Codec Models with Subjective and Objective Evaluations.
APSIPA
Wenze Ren, Yi-Cheng Lin, Huang-Cheng Chou, Haibin Wu, Yi-Chiao Wu, Chi-Chun Lee, Hung-yi Lee, Hsin-Min Wang, Yu Tsao
2024 J jnl
EMO-Codec: An In-Depth Look at Emotion Preservation capacity of Legacy and Neural Codec Models With Subjective and Objective Evaluations.
CoRR
Wenze Ren, Yi-Cheng Lin, Huang-Cheng Chou, Haibin Wu, Yi-Chiao Wu, Chi-Chun Lee, Hung-yi Lee, Yu Tsao
2024 J jnl
EMO-SUPERB: An In-depth Look at Speech Emotion Recognition.
CoRR
Haibin Wu, Huang-Cheng Chou, Kai-Wei Chang, Lucas Goncalves, Jiawei Du, Jyh-Shing Roger Jang, Chi-Chun Lee, Hung-yi Lee
2024 — conf
Efficient Training of Self-Supervised Speech Foundation Models on a Compute Budget.
SLT
Andy T. Liu, Yi-Cheng Lin, Haibin Wu, Stefan Winkler, Hung-yi Lee
2024 J jnl
Efficient Training of Self-Supervised Speech Foundation Models on a Compute Budget.
CoRR
Andy T. Liu, Yi-Cheng Lin, Haibin Wu, Stefan Winkler, Hung-yi Lee
2024 — conf
Embracing Ambiguity And Subjectivity Using The All-Inclusive Aggregation Rule For Evaluating Multi-Label Speech Emotion Recognition Systems.
SLT
Huang-Cheng Chou, Haibin Wu, Lucas Goncalves, Seong-Gyun Leem, Ali N. Salman, Carlos Busso, Hung-yi Lee, Chi-Chun Lee
2024 A conf
Emo-bias: A Large Scale Evaluation of Social Bias on Speech Emotion Recognition.
INTERSPEECH
Yi-Cheng Lin, Haibin Wu, Huang-Cheng Chou, Chi-Chun Lee, Hung-yi Lee
2024 — conf
Empower Typed Descriptions by Large Language Models for Speech Emotion Recognition.
APSIPA
Haibin Wu, Huang-Cheng Chou, Kai-Wei Chang, Lucas Goncalves, Jiawei Du, Jyh-Shing Roger Jang, Chi-Chun Lee, Hung-yi Lee
2024 J jnl
Enhancing Multilingual ASR for Unseen Languages via Language Embedding Modeling.
CoRR
Shao-Syuan Huang, Kuan-Po Huang, Andy T. Liu, Hung-yi Lee
2024 — conf
Ensemble Knowledge Distillation from Speech SSL Models Considering Inter-Teacher Differences.
ISCSLP
Pei-Jun Liao, Hung-yi Lee, Hsin-Min Wang
2024 J jnl
Examining Forgetting in Continual Pre-training of Aligned Large Language Models.
CoRR
Chen-An Li, Hung-yi Lee
2024 A conf
Exploring In-Context Learning of Textless Speech Language Model for Speech Classification Tasks.
INTERSPEECH
Kai-Wei Chang, Ming-Hao Hsu, Shang-wen Li, Hung-yi Lee
2024 — conf
Fusion Of Discrete Representations and Self-Augmented Representations for Multilingual Automatic Speech Recognition.
SLT
Shih-Heng Wang, Jiatong Shi, Chien-yu Huang, Shinji Watanabe, Hung-yi Lee
2024 J jnl
Fusion of Discrete Representations and Self-Augmented Representations for Multilingual Automatic Speech Recognition.
CoRR
Shih-Heng Wang, Jiatong Shi, Chien-yu Huang, Shinji Watanabe, Hung-yi Lee
2024 A conf
GSQA: An End-to-End Model for Generative Spoken Question Answering.
INTERSPEECH
Min-Han Shih, Ho-Lam Chung, Yu-Chi Pai, Ming-Hao Hsu, Guan-Ting Lin, Shang-wen Li, Hung-yi Lee
2024 J jnl
How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario.
CoRR
Shih-Heng Wang, Zih-Ching Chen, Jiatong Shi, Ming-To Chuang, Guan-Ting Lin, Kuan-Po Huang, David Harwath, Shang-wen Li, Hung-yi Lee
2024 A* conf
I Need Help! Evaluating LLM's Ability to Ask for Users' Support: A Case Study on Text-to-SQL Generation.
EMNLP
Cheng-Kuang Wu, Zhi Rui Tam, Chao-Chung Wu, Chieh-Yen Lin, Hung-yi Lee, Yun-Nung Chen
2024 J jnl
I Need Help! Evaluating LLM's Ability to Ask for Users' Support: A Case Study on Text-to-SQL Generation.
CoRR
Cheng-Kuang Wu, Zhi Rui Tam, Chao-Chung Wu, Chieh-Yen Lin, Hung-yi Lee, Yun-Nung Chen
2024 J jnl
Improving Non-Autoregressive Translation Quality With Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC.
IEEE ACM Trans. Audio Speech Lang. Process.
Shensian Syu, Juncheng Xie, Hung-yi Lee
2024 J jnl
Improving Speech Emotion Recognition in Under-Resourced Languages via Speech-to-Speech Translation with Bootstrapping Data Selection.
CoRR
Hsi-Che Lin, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee
2024 J jnl
InstructionCP: A fast approach to transfer Large Language Models into target language.
CoRR
Kuang-Ming Chen, Hung-yi Lee
2024 — conf
Integrating Self-Supervised Speech Model with Pseudo Word-Level Targets from Visually-Grounded Speech Model.
ICASSP Workshops
Hung-Chieh Fang, Nai-Xuan Ye, Yi-Jen Shih, Puyuan Peng, Hsuan-Fu Wang, Layne Berry, Hung-yi Lee, David Harwath
2024 J jnl
Integrating Self-supervised Speech Model with Pseudo Word-level Targets from Visually-grounded Speech Model.
CoRR
Hung-Chieh Fang, Nai-Xuan Ye, Yi-Jen Shih, Puyuan Peng, Hsuan-Fu Wang, Layne Berry, Hung-yi Lee, David Harwath
2024 J jnl
Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies.
CoRR
Hung-Ting Su, Chun-Tong Chao, Ya-Ching Hsu, Xudong Lin, Yulei Niu, Hung-yi Lee, Winston H. Hsu
2024 — conf
Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR And Speech-to-Text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision.
ICASSP Workshops
Chih-Kai Yang, Kuan-Po Huang, Ke-Han Lu, Chun-Yi Kuan, Chi-Yuan Hsiao, Hung-yi Lee
2024 J jnl
Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision.
CoRR
Chih-Kai Yang, Kuan-Po Huang, Ke-Han Lu, Chun-Yi Kuan, Chi-Yuan Hsiao, Hung-yi Lee
2024 J jnl
Investigating the Effects of Large-Scale Pseudo-Stereo Data and Different Speech Foundation Model on Dialogue Generative Spoken Language Model.
CoRR
Yu-Kuan Fu, Cheng-Kuang Lee, Hsiu-Hsuan Wang, Hung-yi Lee
2024 J jnl
LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Play.
CoRR
Li-Chun Lu, Shou-Jen Chen, Tsung-Min Pai, Chan-Hung Yu, Hung-yi Lee, Shao-Hua Sun
2024 A* conf
Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course.
EMNLP
Cheng-Han Chiang, Wei-Chih Chen, Chun-Yi Kuan, Chienchou Yang, Hung-yi Lee
2024 J jnl
Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course.
CoRR
Cheng-Han Chiang, Wei-Chih Chen, Chun-Yi Kuan, Chienchou Yang, Hung-yi Lee
2024 — conf
Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation For Code-Switching ASR Using Realistic Data.
SLT
Liang-Hsuan Tseng, Zih-Ching Chen, Wei-Shun Chang, Cheng-Kuang Lee, Tsung-Ren Huang, Hung-yi Lee
2024 J jnl
Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Data.
CoRR
Liang-Hsuan Tseng, Zih-Ching Chen, Wei-Shun Chang, Cheng-Kuang Lee, Tsung-Ren Huang, Hung-yi Lee
2024 — conf
Let Me Speak Freely? A Study On The Impact Of Format Restrictions On Large Language Model Performance.
EMNLP (Industry Track)
Zhi Rui Tam, Cheng-Kuang Wu, Yi-Lin Tsai, Chieh-Yen Lin, Hung-yi Lee, Yun-Nung Chen
2024 J jnl
Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models.
CoRR
Zhi Rui Tam, Cheng-Kuang Wu, Yi-Lin Tsai, Chieh-Yen Lin, Hung-yi Lee, Yun-Nung Chen
2024 J jnl
Listen and Speak Fairly: A Study on Semantic Gender Bias in Speech Integrated Large Language Models.
CoRR
Yi-Cheng Lin, Tzu-Quan Lin, Chih-Kai Yang, Ke-Han Lu, Wei-Chih Chen, Chun-Yi Kuan, Hung-yi Lee
2024 — conf
Listen and Speak Fairly: a Study on Semantic Gender Bias in Speech Integrated Large Language Models.
SLT
Yi-Cheng Lin, Tzu-Quan Lin, Chih-Kai Yang, Ke-Han Lu, Wei-Chih Chen, Chun-Yi Kuan, Hung-yi Lee
2024 A conf
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets.
INTERSPEECH
Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
2024 J jnl
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets.
CoRR
Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
2024 J jnl
Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization.
CoRR
Wei-Ping Huang, Sung-Feng Huang, Hung-yi Lee
2024 — conf
Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generations.
ACL (Findings)
Cheng-Han Chiang, Hung-yi Lee
2024 J jnl
Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generations.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2024 A* conf
Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-Exploration.
NeurIPS
Yun-Yen Chuang, Hung-Min Hsu, Kevin Lin, Chen-Sheng Gu, Ling Zhen Li, Ray-I Chang, Hung-yi Lee
2024 J jnl
Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-Exploration.
CoRR
Yun-Yen Chuang, Hung-Min Hsu, Kevin Lin, Chen-Sheng Gu, Ling Zhen Li, Ray-I Chang, Hung-yi Lee
2024 J jnl
Meta-Whisper: Speech-Based Meta-ICL for ASR on Low-Resource Languages.
CoRR
Ming-Hao Hsu, Kuan Po Huang, Hung-yi Lee
2024 Misc conf
Multimodal Transformer Distillation for Audio-Visual Synchronization.
ICASSP
Xuanjun Chen, Haibin Wu, Chung-Che Wang, Hung-yi Lee, Jyh-Shing Roger Jang
2024 A conf
Neural Codec-based Adversarial Sample Detection for Speaker Verification.
INTERSPEECH
Xuanjun Chen, Jiawei Du, Haibin Wu, Jyh-Shing Roger Jang, Hung-yi Lee
2024 J jnl
Neural Codec-based Adversarial Sample Detection for Speaker Verification.
CoRR
Xuanjun Chen, Jiawei Du, Haibin Wu, Jyh-Shing Roger Jang, Hung-yi Lee
2024 — conf
Noise Robust Distillation of Self-Supervised Speech Models via Correlation Metrics.
ICASSP Workshops
Fabian Ritter Gutierrez, Kuan-Po Huang, Dianwen Ng, Jeremy H. M. Wong, Hung-yi Lee, Eng Siong Chng, Nancy F. Chen
2024 J jnl
Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data.
CoRR
Juncheng Xie, Shensian Syu, Hung-yi Lee
2024 — conf
On the Evaluation of Speech Foundation Models for Spoken Language Understanding.
ACL (Findings)
Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan S. Sharma, Jee-weon Jung, Hira Dhamyal, William Chen, Suwon Shon, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2024 J jnl
On the Evaluation of Speech Foundation Models for Spoken Language Understanding.
CoRR
Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan S. Sharma, Jee-weon Jung, Hira Dhamyal, William Chen, Suwon Shon, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2024 A conf
On the social bias of speech self-supervised models.
INTERSPEECH
Yi-Cheng Lin, Tzu-Quan Lin, Hsi-Che Lin, Andy T. Liu, Hung-yi Lee
2024 J jnl
On the social bias of speech self-supervised models.
CoRR
Yi-Cheng Lin, Tzu-Quan Lin, Hsi-Che Lin, Andy T. Liu, Hung-yi Lee
2024 — conf
Open-Emotion: A Reproducible EMO-Superb For Speech Emotion Recognition Systems.
SLT
Haibin Wu, Huang-Cheng Chou, Kai-Wei Chang, Lucas Goncalves, Jiawei Du, Jyh-Shing Roger Jang, Chi-Chun Lee, Hung-yi Lee
2024 — conf
Over-Reasoning and Redundant Calculation of Large Language Models.
EACL (2)
Cheng-Han Chiang, Hung-yi Lee
2024 J jnl
Over-Reasoning and Redundant Calculation of Large Language Models.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2024 — conf
PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques.
ICASSP Workshops
Tzu-Han Lin, How-Shing Wang, Hao-Yung Weng, Kuang-Chen Peng, Zih-Ching Chen, Hung-yi Lee
2024 J jnl
PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques.
CoRR
Tzu-Han Lin, How-Shing Wang, Hao-Yung Weng, Kuang-Chen Peng, Zih-Ching Chen, Hung-yi Lee
2024 Misc conf
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue.
ICASSP
Guan-Ting Lin, Prashanth Gurunath Shivakumar, Ankur Gandhe, Chao-Han Huck Yang, Yile Gu, Shalini Ghosh, Andreas Stolcke, Hung-yi Lee, Ivan Bulyko
2024 A conf
Parameter-efficient Fine-tuning of Speaker-Aware Dynamic Prompts for Speaker Verification.
INTERSPEECH
Zhe Li, Man-Wai Mak, Hung-yi Lee, Helen Meng
2024 — ed.
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts), ACL 2024, Bangkok, Thailand, August 11-16, 2024
ACL (5)
Luis Chiruzzo, Hung-yi Lee, Leonardo F. R. Ribeiro
2024 — conf
Property Neurons in Self-Supervised Speech Transformers.
SLT
Tzu-Quan Lin, Guan-Ting Lin, Hung-yi Lee, Hao Tang
2024 J jnl
Property Neurons in Self-Supervised Speech Transformers.
CoRR
Tzu-Quan Lin, Guan-Ting Lin, Hung-yi Lee, Hao Tang
2024 A* conf
REBORN: Reinforcement-Learned Boundary Segmentation with Iterative Training for Unsupervised ASR.
NeurIPS
Liang-Hsuan Tseng, En-Pei Hu, Cheng-Han Chiang, Yuan Tseng, Hung-yi Lee, Lin-Shan Lee, Shao-Hua Sun
2024 J jnl
REBORN: Reinforcement-Learned Boundary Segmentation with Iterative Training for Unsupervised ASR.
CoRR
Liang-Hsuan Tseng, En-Pei Hu, David Cheng-Han Chiang, Yuan Tseng, Hung-yi Lee, Lin-Shan Lee, Shao-Hua Sun
2024 J jnl
Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model Merging.
CoRR
Hua Farn, Hsuan Su, Shachi H. Kumar, Saurav Sahay, Shang-Tse Chen, Hung-yi Lee
2024 Misc conf
Scalable Ensemble-Based Detection Method Against Adversarial Attacks For Speaker Verification.
ICASSP
Haibin Wu, Heng-Cheng Kuo, Yu Tsao, Hung-yi Lee
2024 A conf
Singing Voice Graph Modeling for SingFake Detection.
INTERSPEECH
Xuanjun Chen, Haibin Wu, Roger Jang, Hung-yi Lee
2024 J jnl
Singing Voice Graph Modeling for SingFake Detection.
CoRR
Xuanjun Chen, Haibin Wu, Jyh-Shing Roger Jang, Hung-yi Lee
2024 — conf
Speech-Copilot: Leveraging Large Language Models for Speech Processing Via Task Decomposition, Modularization, and Program Generation.
SLT
Chun-Yi Kuan, Chih-Kai Yang, Wei-Ping Huang, Ke-Han Lu, Hung-yi Lee
2024 J jnl
Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generation.
CoRR
Chun-Yi Kuan, Chih-Kai Yang, Wei-Ping Huang, Ke-Han Lu, Hung-yi Lee
2024 — conf
SpeechCLIP+: Self-Supervised Multi-Task Representation Learning for Speech Via Clip and Speech-Image Data.
ICASSP Workshops
Hsuan-Fu Wang, Yi-Jen Shih, Heng-Jui Chang, Layne Berry, Puyuan Peng, Hung-yi Lee, Hsin-Min Wang, David Harwath
2024 J jnl
SpeechCLIP+: Self-supervised multi-task representation learning for speech via CLIP and speech-image data.
CoRR
Hsuan-Fu Wang, Yi-Jen Shih, Heng-Jui Chang, Layne Berry, Puyuan Peng, Hung-yi Lee, Hsin-Min Wang, David Harwath
2024 J jnl
SpeechCaps: Advancing Instruction-Based Universal Speech Models with Multi-Talker Speaking Style Captioning.
CoRR
Chien-yu Huang, Min-Han Shih, Ke-Han Lu, Chi-Yuan Hsiao, Hung-yi Lee
2024 Misc conf
SpeechDPR: End-To-End Spoken Passage Retrieval For Open-Domain Spoken Question Answering.
ICASSP
Chyi-Jiunn Lin, Guan-Ting Lin, Yung-Sung Chuang, Wei-Lun Wu, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Lin-Shan Lee
2024 J jnl
SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering.
CoRR
Chyi-Jiunn Lin, Guan-Ting Lin, Yung-Sung Chuang, Wei-Lun Wu, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Lin-Shan Lee
2024 J jnl
SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks.
CoRR
Kai-Wei Chang, Haibin Wu, Yu-Kai Wang, Yuan-Kuei Wu, Hua Shen, Wei-Cheng Tseng, Iu-thing Kang, Shang-wen Li, Hung-yi Lee
2024 J jnl
SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks.
IEEE ACM Trans. Audio Speech Lang. Process.
Kai-Wei Chang, Haibin Wu, Yu-Kai Wang, Yuan-Kuei Wu, Hua Shen, Wei-Cheng Tseng, Iu-thing Kang, Shang-wen Li, Hung-yi Lee
2024 J jnl
Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models.
CoRR
Yi-Cheng Lin, Wei-Chih Chen, Hung-yi Lee
2024 — conf
Spoken Stereoset: on Evaluating Social Bias Toward Speaker in Speech Large Language Models.
SLT
Yi-Cheng Lin, Wei-Chih Chen, Hung-yi Lee
2024 A* conf
StreamBench: Towards Benchmarking Continuous Improvement of Language Agents.
NeurIPS
Cheng-Kuang Wu, Zhi Rui Tam, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee
2024 J jnl
StreamBench: Towards Benchmarking Continuous Improvement of Language Agents.
CoRR
Cheng-Kuang Wu, Zhi Rui Tam, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee
2024 — conf
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning.
NAACL (Student Research Workshop)
Shih-Cheng Huang, Shih-Heng Wang, Min-Han Shih, Saurav Sahay, Hung-yi Lee
2024 A* conf
Task Arithmetic can Mitigate Synthetic-to-Real Gap in Automatic Speech Recognition.
EMNLP
Hsuan Su, Hua Farn, Fan-Yun Sun, Shang-Tse Chen, Hung-yi Lee
2024 J jnl
Task Arithmetic can Mitigate Synthetic-to-Real Gap in Automatic Speech Recognition.
CoRR
Hsuan Su, Hua Farn, Fan-Yun Sun, Shang-Tse Chen, Hung-yi Lee
2024 J jnl
Towards ASR Robust Spoken Language Understanding Through In-Context Learning With Word Confusion Networks.
CoRR
Kevin Everson, Yile Gu, Chao-Han Huck Yang, Prashanth Gurunath Shivakumar, Guan-Ting Lin, Jari Kolehmainen, Ivan Bulyko, Ankur Gandhe, Shalini Ghosh, Wael Hamza, Hung-yi Lee, Ariya Rastrow, Andreas Stolcke
2024 Misc conf
Towards ASR Robust Spoken Language Understanding Through in-Context Learning with Word Confusion Networks.
ICASSP
Kevin Everson, Yile Gu, Chao-Han Huck Yang, Prashanth Gurunath Shivakumar, Guan-Ting Lin, Jari Kolehmainen, Ivan Bulyko, Ankur Gandhe, Shalini Ghosh, Wael Hamza, Hung-yi Lee, Ariya Rastrow, Andreas Stolcke
2024 J jnl
Towards audio language modeling - an overview.
CoRR
Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-Wei Chang, Ho-Lam Chung, Alexander H. Liu, Hung-yi Lee
2024 A conf
Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models.
INTERSPEECH
Chun-Yi Kuan, Wei-Ping Huang, Hung-yi Lee
2024 J jnl
Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models.
CoRR
Chun-Yi Kuan, Wei-Ping Huang, Hung-yi Lee
2024 — conf
Unveiling Narrative Reasoning Limits of Large Language Models with Trope in Movie Synopses.
EMNLP (Findings)
Hung-Ting Su, Ya-Ching Hsu, Xudong Lin, Xiang Qian Shi, Yulei Niu, Han-Yuan Hsu, Hung-yi Lee, Winston H. Hsu
2024 J jnl
Unveiling Narrative Reasoning Limits of Large Language Models with Trope in Movie Synopses.
CoRR
Hung-Ting Su, Ya-Ching Hsu, Xudong Lin, Xiang Qian Shi, Yulei Niu, Han-Yuan Hsu, Hung-yi Lee, Winston H. Hsu
2024 Misc conf
Zero Resource Code-Switched Speech Benchmark Using Speech Utterance Pairs for Multiple Spoken Languages.
ICASSP
Kuan-Po Huang, Chih-Kai Yang, Yu-Kuan Fu, Ewan Dunbar, Hung-yi Lee
2023 J jnl
A Closer Look into Automatic Evaluation Using Large Language Models.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2023 — conf
A Closer Look into Using Large Language Models for Automatic Evaluation.
EMNLP (Findings)
David Cheng-Han Chiang, Hung-yi Lee
2023 J jnl
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models.
CoRR
Yuan Tseng, Layne Berry, Yi-Ting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Po-Yao Huang, Chun-Mao Lai, Shang-wen Li, David Harwath, Yu Tsao, Shinji Watanabe, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee
2023 J jnl
An Exploration of In-Context Learning for Speech Language Model.
CoRR
Ming-Hao Hsu, Kai-Wei Chang, Shang-wen Li, Hung-yi Lee
2023 — conf
Are Synonym Substitution Attacks Really Synonym Substitution Attacks?
ACL (Findings)
David Cheng-Han Chiang, Hung-yi Lee
2023 Misc conf
Bridging Speech and Textual Pre-Trained Models With Unsupervised ASR.
ICASSP
Jiatong Shi, Chan-Jan Hsu, Ho-Lam Chung, Dongji Gao, Paola García, Shinji Watanabe, Ann Lee, Hung-yi Lee
2023 — conf
Can Large Language Models Be an Alternative to Human Evaluations?
ACL (1)
David Cheng-Han Chiang, Hung-yi Lee
2023 J jnl
Can Large Language Models Be an Alternative to Human Evaluations?
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2023 Misc conf
Cascading and Direct Approaches to Unsupervised Constituency Parsing on Spoken Sentences.
ICASSP
Yuan Tseng, Cheng-I Jeff Lai, Hung-yi Lee
2023 J jnl
Cascading and Direct Approaches to Unsupervised Constituency Parsing on Spoken Sentences.
CoRR
Yuan Tseng, Cheng-I Lai, Hung-yi Lee
2023 — conf
Chapter: Exploiting Convolutional Neural Network Adapters for Self-Supervised Speech Models.
ICASSP Workshops
Zih-Ching Chen, Yu-Shun Sung, Hung-yi Lee
2023 J jnl
Chat Vector: A Simple Approach to Equip LLMs With New Language Chat Capabilities.
CoRR
Shih-Cheng Huang, Pin-Zu Li, Yu-Chi Hsu, Kuang-Ming Chen, Yu-Tung Lin, Shih-Kai Hsiao, Richard Tzong-Han Tsai, Hung-yi Lee
2023 J jnl
Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech.
CoRR
Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
2023 Misc conf
Ensemble Knowledge Distillation of Self-Supervised Speech Models.
ICASSP
Kuan-Po Huang, Tzu-hsun Feng, Yu-Kuan Fu, Tsu-Yuan Hsu, Po-Chieh Yen, Wei-Cheng Tseng, Kai-Wei Chang, Hung-yi Lee
2023 J jnl
Ensemble knowledge distillation of self-supervised speech models.
CoRR
Kuan-Po Huang, Tzu-hsun Feng, Yu-Kuan Fu, Tsu-Yuan Hsu, Po-Chieh Yen, Wei-Cheng Tseng, Kai-Wei Chang, Hung-yi Lee
2023 Misc conf
Euro: Espnet Unsupervised ASR Open-Source Toolkit.
ICASSP
Dongji Gao, Jiatong Shi, Shun-Po Chuang, Leibny Paola García, Hung-yi Lee, Shinji Watanabe, Sanjeev Khudanpur
2023 J jnl
Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond.
CoRR
Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chung, Xuankai Chang, Yuxun Tang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 C conf
Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond.
ASRU
Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chuang, Xuankai Chang, Yuxun Tang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 J jnl
GSQA: An End-to-End Model for Generative Spoken Question Answering.
CoRR
Min-Han Shih, Ho-Lam Chung, Yu-Chi Pai, Ming-Hao Hsu, Guan-Ting Lin, Shang-wen Li, Hung-yi Lee
2023 A* conf
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs.
ICML
Guan-Ting Liu, En-Pei Hu, Pu-Jen Cheng, Hung-yi Lee, Shao-Hua Sun
2023 J jnl
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs.
CoRR
Guan-Ting Liu, En-Pei Hu, Pu-Jen Cheng, Hung-yi Lee, Shao-Hua Sun
2023 A conf
How to Estimate Model Transferability of Pre-Trained Speech Models?
INTERSPEECH
Zih-Ching Chen, Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Shuo-Yiin Chang, Rohit Prabhavalkar, Hung-yi Lee, Tara N. Sainath
2023 J jnl
How to Estimate Model Transferability of Pre-Trained Speech Models?
CoRR
Zih-Ching Chen, Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Shuo-Yiin Chang, Rohit Prabhavalkar, Hung-yi Lee, Tara N. Sainath
2023 J jnl
Improving Cascaded Unsupervised Speech Translation with Denoising Back-translation.
CoRR
Yu-Kuan Fu, Liang-Hsuan Tseng, Jiatong Shi, Chen-An Li, Tsu-Yuan Hsu, Shinji Watanabe, Hung-yi Lee
2023 J jnl
Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC.
CoRR
Shen-sian Syu, Juncheng Xie, Hung-yi Lee
2023 A conf
Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target.
INTERSPEECH
Guan-Wei Wu, Guan-Ting Lin, Shang-wen Li, Hung-yi Lee
2023 J jnl
Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target.
CoRR
Guan-Wei Wu, Guan-Ting Lin, Shang-wen Li, Hung-yi Lee
2023 — conf
Introducing Semantics into Speech Encoders.
ACL (1)
Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Bing Liu, Akshat Shrivastava, Shang-wen Li, Liang-Hsuan Tseng, Guan-Ting Lin, Alexei Baevski, Hung-yi Lee, Yizhou Sun, Wei Wang
2023 J jnl
Investigating Human-Identifiable Features Hidden in Adversarial Perturbations.
CoRR
Dennis Y. Menn, Tzu-hsun Feng, Sriram Vishwanath, Hung-yi Lee
2023 J jnl
Learning from Red Teaming: Gender Bias Provocation and Mitigation in Large Language Models.
CoRR
Hsuan Su, Cheng-Chu Cheng, Hua Farn, Shachi H. Kumar, Saurav Sahay, Shang-Tse Chen, Hung-yi Lee
2023 J jnl
Low-Resource Self-Supervised Learning with SSL-Enhanced TTS.
CoRR
Po-Chun Hsu, Ali Elkahky, Wei-Ning Hsu, Yossi Adi, Tu Anh Nguyen, Jade Copet, Emmanuel Dupoux, Hung-yi Lee, Abdelrahman Mohamed
2023 Misc conf
M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval.
ICASSP
Layne Berry, Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Hung-yi Lee, David Harwath
2023 A conf
ML-SUPERB: Multilingual Speech Universal PERformance Benchmark.
INTERSPEECH
Jiatong Shi, Dan Berrebbi, William Chen, En-Pei Hu, Wei-Ping Huang, Ho-Lam Chung, Xuankai Chang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 J jnl
ML-SUPERB: Multilingual Speech Universal PERformance Benchmark.
CoRR
Jiatong Shi, Dan Berrebbi, William Chen, Ho-Lam Chung, En-Pei Hu, Wei-Ping Huang, Xuankai Chang, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Shinji Watanabe
2023 C conf
Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization.
ASRU
Wei-Ping Huang, Sung-Feng Huang, Hung-yi Lee
2023 C conf
MelHuBERT: A Simplified Hubert on Mel Spectrograms.
ASRU
Tzu-Quan Lin, Hung-yi Lee, Hao Tang
2023 J jnl
MetaEx-GAN: Meta Exploration to Improve Natural Language Generation via Generative Adversarial Networks.
IEEE ACM Trans. Audio Speech Lang. Process.
Yun-Yen Chuang, Hung-Min Hsu, Kevin Lin, Ray-I Chang, Hung-yi Lee
2023 J jnl
MiniSUPERB: Lightweight Benchmark for Self-supervised Speech Models.
CoRR
Yu-Hsiang Wang, Huang-Yu Chen, Kai-Wei Chang, Winston H. Hsu, Hung-yi Lee
2023 C conf
Minisuperb: Lightweight Benchmark for Self-Supervised Speech Models.
ASRU
Yu-Hsiang Wang, Huang-Yu Chen, Kai-Wei Chang, Winston H. Hsu, Hung-yi Lee
2023 J jnl
Noise robust distillation of self-supervised speech models via correlation metrics.
CoRR
Fabian Ritter Gutierrez, Kuan-Po Huang, Dianwen Ng, Jeremy Heng Meng Wong, Hung-yi Lee, Eng Siong Chng, Nancy F. Chen
2023 Misc conf
Once-for-All Sequence Compression for Self-Supervised Speech Models.
ICASSP
Hsuan-Jui Chen, Yen Meng, Hung-yi Lee
2023 J jnl
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue.
CoRR
Guan-Ting Lin, Prashanth Gurunath Shivakumar, Ankur Gandhe, Chao-Han Huck Yang, Yile Gu, Shalini Ghosh, Andreas Stolcke, Hung-yi Lee, Ivan Bulyko
2023 J jnl
Parallel Synthesis for Autoregressive Speech Generation.
IEEE ACM Trans. Audio Speech Lang. Process.
Po-Chun Hsu, Da-Rong Liu, Andy T. Liu, Hung-yi Lee
2023 Misc conf
Personalized Lightweight Text-to-Speech: Voice Cloning with Adaptive Structured Pruning.
ICASSP
Sung-Feng Huang, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-yi Lee
2023 J jnl
Personalized Lightweight Text-to-Speech: Voice Cloning with Adaptive Structured Pruning.
CoRR
Sung-Feng Huang, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-yi Lee
2023 J jnl
Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue.
CoRR
Hsuan Su, Shachi H. Kumar, Sahisnu Mazumder, Wenda Chen, Ramesh Manuvinakurike, Eda Okur, Saurav Sahay, Lama Nachman, Shang-Tse Chen, Hung-yi Lee
2023 B ed.
Proceedings of the 16th International Natural Language Generation Conference, INLG 2023, Prague, Czechia, September 11 - 15, 2023
INLG
C. Maria Keet, Hung-yi Lee, Sina Zarrieß
2023 C conf
Prompting and Adapter Tuning For Self-Supervised Encoder-Decoder Speech Model.
ASRU
Kai-Wei Chang, Ming-Hsin Chen, Yun-Ping Lin, Jing Neng Hsu, Paul Kuo-Ming Huang, Chien-yu Huang, Shang-wen Li, Hung-yi Lee
2023 J jnl
Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model.
CoRR
Kai-Wei Chang, Ming-Hsin Chen, Yun-Ping Lin, Jing Neng Hsu, Paul Kuo-Ming Huang, Chien-yu Huang, Shang-wen Li, Hung-yi Lee
2023 — conf
Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS.
RepL4NLP@ACL
David Cheng-Han Chiang, Hung-yi Lee, Yung-Sung Chuang, James R. Glass
2023 J jnl
Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS.
CoRR
David Cheng-Han Chiang, Yung-Sung Chuang, James R. Glass, Hung-yi Lee
2023 — conf
SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks.
ACL (1)
Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan S. Sharma, Wei-Lun Wu, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2023 J jnl
Scalable Ensemble-based Detection Method against Adversarial Attacks for speaker verification.
CoRR
Haibin Wu, Heng-Cheng Kuo, Yu Tsao, Hung-yi Lee
2023 J jnl
SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts.
CoRR
Haibin Wu, Kai-Wei Chang, Yuan-Kuei Wu, Hung-yi Lee
2023 J jnl
SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks.
CoRR
Kai-Wei Chang, Yu-Kai Wang, Hua Shen, Iu-thing Kang, Wei-Cheng Tseng, Shang-wen Li, Hung-yi Lee
2023 J jnl
Step by Step to Fairness: Attributing Societal Bias in Task-oriented Dialogue Systems.
CoRR
Hsuan Su, Rebecca Qian, Chinnadhurai Sankar, Shahin Shayandeh, Shang-Tse Chen, Hung-yi Lee, Daniel M. Bikel
2023 Misc conf
T5lephone: Bridging Speech and Text Self-Supervised Models for Spoken Language Understanding Via Phoneme Level T5.
ICASSP
Chan-Jan Hsu, Ho-Lam Chung, Hung-yi Lee, Yu Tsao
2023 — conf
The Defender's Perspective on Automatic Speaker Verification: An Overview.
DADA@IJCAI
Haibin Wu, Jiawen Kang, Lingwei Meng, Helen Meng, Hung-yi Lee
2023 J jnl
The defender's perspective on automatic speaker verification: An overview.
CoRR
Haibin Wu, Jiawen Kang, Lingwei Meng, Helen Meng, Hung-yi Lee
2023 C conf
Towards General-Purpose Text-Instruction-Guided Voice Conversion.
ASRU
Chun-Yi Kuan, Chen-An Li, Tsu-Yuan Hsu, Tse-Yang Lin, Ho-Lam Chung, Kai-Wei Chang, Shuo-Yiin Chang, Hung-yi Lee
2023 J jnl
Towards General-Purpose Text-Instruction-Guided Voice Conversion.
CoRR
Chun-Yi Kuan, Chen-An Li, Tsu-Yuan Hsu, Tse-Yang Lin, Ho-Lam Chung, Kai-Wei Chang, Shuo-Yiin Chang, Hung-yi Lee
2023 A conf
Why We Should Report the Details in Subjective Evaluation of TTS More Rigorously.
INTERSPEECH
Cheng-Han Chiang, Wei-Ping Huang, Hung-yi Lee
2023 J jnl
Zero Resource Code-switched Speech Benchmark Using Speech Utterance Pairs For Multiple Spoken Languages.
CoRR
Kuan-Po Huang, Chih-Kai Yang, Yu-Kuan Fu, Ewan Dunbar, Hung-yi Lee
2023 C conf
Zero-Shot Singing Voice Synthesis from Musical Score.
ASRU
Jun-You Wang, Hung-yi Lee, Jyh-Shing Roger Jang, Li Su
2022 — ed.
13th International Symposium on Chinese Spoken Language Processing, ISCSLP 2022, Singapore, December 11-14, 2022
ISCSLP
Kong Aik Lee, Hung-yi Lee, Yanfeng Lu, Minghui Dong
2022 J jnl
A Fully Integrated 1.7mW Attention-Based Automatic Speech Recognition Processor.
IEEE Trans. Circuits Syst. II Express Briefs
Yi-Long Liou, Jui-Yang Hsu, Chen-Sheng Chen, Alexander H. Liu, Hung-yi Lee, Tsung-Te Liu
2022 — conf
AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks.
NAACL-HLT (Findings)
Chin-Lun Fu, Zih-Ching Chen, Yun-Ru Lee, Hung-yi Lee
2022 J jnl
AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks.
CoRR
Chin-Lun Fu, Zih-Ching Chen, Yun-Ru Lee, Hung-yi Lee
2022 Misc conf
Adversarial Sample Detection for Speaker Verification by Neural Vocoders.
ICASSP
Haibin Wu, Po-Chun Hsu, Ji Gao, Shanshan Zhang, Shen Huang, Jian Kang, Zhiyong Wu, Helen Meng, Hung-yi Lee
2022 A conf
An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks.
INTERSPEECH
Kai-Wei Chang, Wei-Cheng Tseng, Shang-wen Li, Hung-yi Lee
2022 J jnl
An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks.
CoRR
Kai-Wei Chang, Wei-Cheng Tseng, Shang-wen Li, Hung-yi Lee
2022 Misc conf
Analyzing The Robustness of Unsupervised Speech Recognition.
ICASSP
Guan-Ting Lin, Chan-Jan Hsu, Da-Rong Liu, Hung-yi Lee, Yu Tsao
2022 — conf
Anticipation-Free Training for Simultaneous Machine Translation.
IWSLT@ACL
Chih-Chiang Chang, Shun-Po Chuang, Hung-yi Lee
2022 J jnl
Anticipation-free Training for Simultaneous Translation.
CoRR
Chih-Chiang Chang, Shun-Po Chuang, Hung-yi Lee
2022 J jnl
Bridging Speech and Textual Pre-trained Models with Unsupervised ASR.
CoRR
Jiatong Shi, Chan-Jan Hsu, Ho-Lam Chung, Dongji Gao, Paola García, Shinji Watanabe, Ann Lee, Hung-yi Lee
2022 J jnl
CHAPTER: Exploiting Convolutional Neural Network Adapters for Self-supervised Speech Models.
CoRR
Zih-Ching Chen, Yu-Shun Sung, Hung-yi Lee
2022 Misc conf
Characterizing the Adversarial Vulnerability of Speech self-Supervised Learning.
ICASSP
Haibin Wu, Bo Zheng, Xu Li, Xixin Wu, Hung-yi Lee, Helen Meng
2022 J jnl
Compressing Transformer-based self-supervised models for speech processing.
CoRR
Tzu-Quan Lin, Tsung-Huan Yang, Chun-Yao Chang, Kuang-Ming Chen, Tzu-hsun Feng, Hung-yi Lee, Hao Tang
2022 A conf
DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores.
INTERSPEECH
Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee
2022 J jnl
DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores.
CoRR
Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee
2022 A conf
DUAL: Discrete Spoken Unit Adaptive Learning for Textless Spoken Question Answering.
INTERSPEECH
Guan-Ting Lin, Yung-Sung Chuang, Ho-Lam Chung, Shu-Wen Yang, Hsuan-Jui Chen, Shuyan Annie Dong, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Lin-Shan Lee
2022 J jnl
DUAL: Discrete Spoken Unit Adaptive Learning for Textless Spoken Question Answering.
CoRR
Guan-Ting Lin, Yung-Sung Chuang, Ho-Lam Chung, Shu-Wen Yang, Hsuan-Jui Chen, Shuyan Dong, Shang-wen Li, Abdelrahman Mohamed, Hung-yi Lee, Lin-Shan Lee
2022 Misc conf
Distilhubert: Speech Representation Learning by Layer-Wise Distillation of Hidden-Unit Bert.
ICASSP
Heng-Jui Chang, Shu-Wen Yang, Hung-yi Lee
2022 Misc conf
Don't Speak Too Fast: The Impact of Data Bias on Self-Supervised Speech Models.
ICASSP
Yen Meng, Yi-Hui Chou, Andy T. Liu, Hung-yi Lee
2022 J jnl
EURO: ESPnet Unsupervised ASR Open-source Toolkit.
CoRR
Dongji Gao, Jiatong Shi, Shun-Po Chuang, Leibny Paola García, Hung-yi Lee, Shinji Watanabe, Sanjeev Khudanpur
2022 J jnl
Editorial Editorial of Special Issue on Self-Supervised Learning for Speech and Audio Processing.
IEEE J. Sel. Top. Signal Process.
Hung-yi Lee, Shinji Watanabe, Karen Livescu, Abdelrahman Mohamed, Tara N. Sainath
2022 A conf
Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translation.
INTERSPEECH
Chih-Chiang Chang, Hung-yi Lee
2022 J jnl
Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translation.
CoRR
Chih-Chiang Chang, Hung-yi Lee
2022 — conf
Exploring Efficient-Tuning Methods in Self-Supervised Speech Models.
SLT
Zih-Ching Chen, Chin-Lun Fu, Chih-Ying Liu, Shang-Wen (Daniel) Li, Hung-yi Lee
2022 J jnl
Exploring Efficient-tuning Methods in Self-supervised Speech Models.
CoRR
Zih-Ching Chen, Chin-Lun Fu, Chih-Ying Liu, Shang-wen Li, Hung-yi Lee
2022 A conf
Few Shot Cross-Lingual TTS Using Transferable Phoneme Embedding.
INTERSPEECH
Wei-Ping Huang, Po-Chun Chen, Sung-Feng Huang, Hung-yi Lee
2022 J jnl
Few-Shot Cross-Lingual TTS Using Transferable Phoneme Embedding.
CoRR
Wei-Ping Huang, Po-Chun Chen, Sung-Feng Huang, Hung-yi Lee
2022 J jnl
Few-shot Prompting Towards Controllable Response Generation.
CoRR
Hsuan Su, Po-Han Chi, Shih-Cheng Huang, Ho-Lam Chung, Saurav Sahay, Shang-Tse Chen, Hung-yi Lee
2022 J jnl
General Framework for Self-Supervised Model Priming for Parameter-Efficient Fine-tuning.
CoRR
Shih-Cheng Huang, Shih-Heng Wang, Min-Han Shih, Saurav Sahay, Hung-yi Lee
2022 J jnl
How Far Are We from Real Synonym Substitution Attacks?
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2022 A conf
Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptation.
INTERSPEECH
Kuan-Po Huang, Yu-Kuan Fu, Yu Zhang, Hung-yi Lee
2022 J jnl
Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptation.
CoRR
Kuan-Po Huang, Yu-Kuan Fu, Yu Zhang, Hung-yi Lee
2022 — conf
Improving Generalizability of Distilled Self-Supervised Speech Processing Models Under Distorted Settings.
SLT
Kuan-Po Huang, Yu-Kuan Fu, Tsu-Yuan Hsu, Fabian Ritter Gutierrez, Fan-Lin Wang, Liang-Hsuan Tseng, Yu Zhang, Hung-yi Lee
2022 J jnl
Improving generalizability of distilled self-supervised speech processing models under distorted settings.
CoRR
Kuan-Po Huang, Yu-Kuan Fu, Tsu-Yuan Hsu, Fabian Ritter Gutierrez, Fan-Lin Wang, Liang-Hsuan Tseng, Yu Zhang, Hung-yi Lee
2022 J jnl
Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning.
IEEE ACM Trans. Audio Speech Lang. Process.
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee
2022 J jnl
Improving the transferability of speech separation by meta-learning.
CoRR
Kuan-Po Huang, Yuan-Kuei Wu, Hung-yi Lee
2022 J jnl
Introducing Semantics into Speech Encoders.
CoRR
Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Akshat Shrivastava, Shang-wen Li, Liang-Hsuan Tseng, Alexei Baevski, Guan-Ting Lin, Hung-yi Lee, Yizhou Sun, Wei Wang
2022 J jnl
Learning Phone Recognition From Unpaired Audio and Phone Sequences Based on Generative Adversarial Network.
IEEE ACM Trans. Audio Speech Lang. Process.
Da-Rong Liu, Po-Chun Hsu, Yi-Chen Chen, Sung-Feng Huang, Shun-Po Chuang, Da-Yi Wu, Hung-yi Lee
2022 J jnl
Learning Phone Recognition from Unpaired Audio and Phone Sequences Based on Generative Adversarial Network.
CoRR
Da-Rong Liu, Po-Chun Hsu, Yi-Chen Chen, Sung-Feng Huang, Shun-Po Chuang, Da-Yi Wu, Hung-yi Lee
2022 A conf
Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition.
INTERSPEECH
Guan-Ting Lin, Shang-wen Li, Hung-yi Lee
2022 J jnl
Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition.
CoRR
Guan-Ting Lin, Shang-wen Li, Hung-yi Lee
2022 J jnl
M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval.
CoRR
Layne Berry, Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Hung-yi Lee, David Harwath
2022 A conf
MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification.
INTERSPEECH
Yang Zhang, Zhiqiang Lv, Haibin Wu, Shanshan Zhang, Pengfei Hu, Zhiyong Wu, Hung-yi Lee, Helen Meng
2022 J jnl
MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification.
CoRR
Yang Zhang, Zhiqiang Lv, Haibin Wu, Shanshan Zhang, Pengfei Hu, Zhiyong Wu, Hung-yi Lee, Helen Meng
2022 J jnl
MelHuBERT: A simplified HuBERT on Mel spectrogram.
CoRR
Tzu-Quan Lin, Hung-yi Lee, Hao Tang
2022 A conf
Membership Inference Attacks Against Self-supervised Speech Models.
INTERSPEECH
Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee
2022 — conf
Meta Learning for Natural Language Processing: A Survey.
NAACL-HLT
Hung-yi Lee, Shang-wen Li, Thang Vu
2022 J jnl
Meta Learning for Natural Language Processing: A Survey.
CoRR
Hung-yi Lee, Shang-wen Li, Ngoc Thang Vu
2022 J jnl
Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speech.
IEEE ACM Trans. Audio Speech Lang. Process.
Sung-Feng Huang, Chyi-Jiunn Lin, Da-Rong Liu, Yi-Chen Chen, Hung-yi Lee
2022 J jnl
Model Extraction Attack against Self-supervised Speech Models.
CoRR
Tsu-Yuan Hsu, Chen-An Li, Tung-Yu Wu, Hung-yi Lee
2022 J jnl
Multimodal Transformer Distillation for Audio-Visual Synchronization.
CoRR
Xuanjun Chen, Haibin Wu, Chung-Che Wang, Hung-yi Lee, Jyh-Shing Roger Jang
2022 — conf
On Compressing Sequences for Self-Supervised Speech Models.
SLT
Yen Meng, Hsuan-Jui Chen, Jiatong Shi, Shinji Watanabe, Paola García, Hung-yi Lee, Hao Tang
2022 J jnl
On Compressing Sequences for Self-Supervised Speech Models.
CoRR
Yen Meng, Hsuan-Jui Chen, Jiatong Shi, Shinji Watanabe, Paola García, Hung-yi Lee, Hao Tang
2022 — conf
On the Efficiency of Integrating Self-Supervised Learning and Meta-Learning for User-Defined Few-Shot Keyword Spotting.
SLT
Wei-Tsung Kao, Yuan-Kuei Wu, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-yi Lee
2022 J jnl
On the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting.
CoRR
Wei-Tsung Kao, Yuen-Kwei Wu, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-yi Lee
2022 A* conf
On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets.
AAAI
David Cheng-Han Chiang, Hung-yi Lee
2022 — conf
On the Utility of Self-Supervised Models for Prosody-Related Tasks.
SLT
Guan-Ting Lin, Chi-Luen Feng, Wei-Ping Huang, Yuan Tseng, Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Nigel G. Ward
2022 J jnl
On the Utility of Self-supervised Models for Prosody-related Tasks.
CoRR
Guan-Ting Lin, Chi-Luen Feng, Wei-Ping Huang, Yuan Tseng, Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Nigel G. Ward
2022 J jnl
Once-for-All Sequence Compression for Self-Supervised Speech Models.
CoRR
Hsuan-Jui Chen, Yen Meng, Hung-yi Lee
2022 J jnl
Parallel Synthesis for Autoregressive Speech Generation.
CoRR
Po-Chun Hsu, Da-Rong Liu, Andy T. Liu, Hung-yi Lee
2022 Misc conf
Partially Fake Audio Detection by Self-Attention-Based Fake Span Discovery.
ICASSP
Haibin Wu, Heng-Cheng Kuo, Naijun Zheng, Kuo-Hsuan Hung, Hung-yi Lee, Yu Tsao, Hsin-Min Wang, Helen Meng
2022 J jnl
Partially Fake Audio Detection by Self-attention-based Fake Span Discovery.
CoRR
Haibin Wu, Heng-Cheng Kuo, Naijun Zheng, Kuo-Hsuan Hung, Hung-yi Lee, Yu Tsao, Hsin-Min Wang, Helen Meng
2022 — conf
Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection.
SLT
Xuanjun Chen, Haibin Wu, Helen Meng, Hung-yi Lee, Jyh-Shing Roger Jang
2022 J jnl
Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection.
CoRR
Xuanjun Chen, Haibin Wu, Helen Meng, Hung-yi Lee, Jyh-Shing Roger Jang
2022 J jnl
Re-Examining Human Annotations for Interpretable NLP.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2022 Misc conf
S3PRL-VC: Open-Source Voice Conversion Framework with Self-Supervised Speech Representations.
ICASSP
Wen-Chin Huang, Shu-Wen Yang, Tomoki Hayashi, Hung-yi Lee, Shinji Watanabe, Tomoki Toda
2022 J jnl
SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks.
CoRR
Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan S. Sharma, Wei-Lun Wu, Hung-yi Lee, Karen Livescu, Shinji Watanabe
2022 J jnl
SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning.
CoRR
Tzu-hsun Feng, Shuyan Annie Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-wen Li, Hung-yi Lee
2022 — conf
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities.
ACL (1)
Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2022 J jnl
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities.
CoRR
Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Jeff Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2022 J jnl
Searching for the Essence of Adversarial Perturbations.
CoRR
Dennis Y. Menn, Hung-yi Lee
2022 J jnl
Self-Supervised Speech Representation Learning: A Review.
CoRR
Abdelrahman Mohamed, Hung-yi Lee, Lasse Borgholt, Jakob D. Havtorn, Joakim Edin, Christian Igel, Katrin Kirchhoff, Shang-wen Li, Karen Livescu, Lars Maaløe, Tara N. Sainath, Shinji Watanabe
2022 J jnl
Self-Supervised Speech Representation Learning: A Review.
IEEE J. Sel. Top. Signal Process.
Abdelrahman Mohamed, Hung-yi Lee, Lasse Borgholt, Jakob D. Havtorn, Joakim Edin, Christian Igel, Katrin Kirchhoff, Shang-wen Li, Karen Livescu, Lars Maaløe, Tara N. Sainath, Shinji Watanabe
2022 J jnl
Silence is Sweeter Than Speech: Self-Supervised Model Using Silence to Store Speaker Information.
CoRR
Chi-Luen Feng, Po-Chun Hsu, Hung-yi Lee
2022 — conf
SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model.
SLT
Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Layne Berry, Hung-yi Lee, David Harwath
2022 J jnl
SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model.
CoRR
Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Layne Berry, Hung-yi Lee, David Harwath
2022 A conf
Spoofing-Aware Speaker Verification by Multi-Level Fusion.
INTERSPEECH
Haibin Wu, Lingwei Meng, Jiawen Kang, Jinchao Li, Xu Li, Xixin Wu, Hung-yi Lee, Helen Meng
2022 J jnl
Spoofing-Aware Speaker Verification by Multi-Level Fusion.
CoRR
Haibin Wu, Lingwei Meng, Jiawen Kang, Jinchao Li, Xu Li, Xixin Wu, Hung-yi Lee, Helen Meng
2022 J jnl
Structured Prompt Tuning.
CoRR
Chi-Liang Liu, Hung-yi Lee, Wen-tau Yih
2022 — conf
Superb @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning.
SLT
Tzu-hsun Feng, Shuyan Annie Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-wen Li, Hung-yi Lee
2022 J jnl
T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5.
CoRR
Chan-Jan Hsu, Ho-Lam Chung, Hung-yi Lee, Yu Tsao
2022 — conf
Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion.
Odyssey
Haibin Wu, Jiawen Kang, Lingwei Meng, Yang Zhang, Xixin Wu, Zhiyong Wu, Hung-yi Lee, Helen Meng
2022 J jnl
Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion.
CoRR
Haibin Wu, Jiawen Kang, Lingwei Meng, Yang Zhang, Xixin Wu, Zhiyong Wu, Hung-yi Lee, Helen Meng
2022 J jnl
The Ability of Self-Supervised Speech Models for Audio Representations.
CoRR
Tung-Yu Wu, Chen-An Li, Tzu-Han Lin, Tsu-Yuan Hsu, Hung-yi Lee
2022 Misc conf
Toward Degradation-Robust Voice Conversion.
ICASSP
Chien-yu Huang, Kai-Wei Chang, Hung-yi Lee
2022 J jnl
Understanding, Detecting, and Separating Out-of-Distribution Samples and Adversarial Samples in Text Classification.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2022 J jnl
Universal Adaptor: Converting Mel-Spectrograms Between Different Configurations for Speech Synthesis.
CoRR
Fan-Lin Wang, Po-Chun Hsu, Da-Rong Liu, Hung-yi Lee
2022 — conf
XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding.
ACL (2)
Chan-Jan Hsu, Hung-yi Lee, Yu Tsao
2022 J jnl
XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding.
CoRR
Chan-Jan Hsu, Hung-yi Lee, Yu Tsao
2021 Misc conf
Adversarial Defense for Automatic Speaker Verification by Cascaded Self-Supervised Learning Models.
ICASSP
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee
2021 J jnl
Adversarial defense for automatic speaker verification by cascaded self-supervised learning models.
CoRR
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee
2021 Misc conf
Again-VC: A One-Shot Voice Conversion Using Activation Guidance and Adaptive Instance Normalization.
ICASSP
Yen-Hao Chen, Da-Yi Wu, Tsung-Han Wu, Hung-yi Lee
2021 C conf
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition.
ASRU
Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-Wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe
2021 J jnl
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition.
CoRR
Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-Wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe
2021 — conf
Audio Albert: A Lite Bert for Self-Supervised Learning of Audio Representation.
SLT
Po-Han Chi, Pei-Hung Chung, Tsung-Han Wu, Chun-Cheng Hsieh, Yen-Hao Chen, Shang-wen Li, Hung-yi Lee
2021 A conf
Auto-KWS 2021 Challenge: Task, Datasets, and Baselines.
Interspeech
Jingsong Wang, Yuxuan He, Chunyu Zhao, Qijie Shao, Wei-Wei Tu, Tom Ko, Hung-yi Lee, Lei Xie
2021 J jnl
Auto-KWS 2021 Challenge: Task, Datasets, and Baselines.
CoRR
Jingsong Wang, Yuxuan He, Chunyu Zhao, Qijie Shao, Wei-Wei Tu, Tom Ko, Hung-yi Lee, Lei Xie
2021 J jnl
Characterizing the adversarial vulnerability of speech self-supervised learning.
CoRR
Haibin Wu, Bo Zheng, Xu Li, Xixin Wu, Hung-yi Lee, Helen Meng
2021 J jnl
CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning.
CoRR
Jiun-Hao Jhan, Chao-Peng Liu, Shyh-Kang Jeng, Hung-yi Lee
2021 — conf
Defending Your Voice: Adversarial Attack on Voice Conversion.
SLT
Chien-yu Huang, Yist Y. Lin, Hung-yi Lee, Lin-Shan Lee
2021 J jnl
DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT.
CoRR
Heng-Jui Chang, Shu-Wen Yang, Hung-yi Lee
2021 J jnl
Don't speak too fast: The impact of data bias on self-supervised speech models.
CoRR
Yen Meng, Yi-Hui Chou, Andy T. Liu, Hung-yi Lee
2021 — conf
End-to-End Whispered Speech Recognition with Frequency-Weighted Approaches and Pseudo Whisper Pre-training.
SLT
Heng-Jui Chang, Alexander H. Liu, Hung-yi Lee, Lin-Shan Lee
2021 Misc conf
Fragmentvc: Any-To-Any Voice Conversion by End-To-End Extracting and Fusing Fine-Grained Voice Fragments with Attention.
ICASSP
Yist Y. Lin, Chung-Ming Chien, Jheng-Hao Lin, Hung-yi Lee, Lin-Shan Lee
2021 — conf
Hierarchical Prosody Modeling for Non-Autoregressive Speech Synthesis.
SLT
Chung-Ming Chien, Hung-yi Lee
2021 — conf
How Far Are We from Robust Voice Conversion: A Survey.
SLT
Tzu-Hsien Huang, Jheng-Hao Lin, Hung-yi Lee
2021 J jnl
Improving Automatic Speech Recognition and Speech Translation via Word Embedding Prediction.
IEEE ACM Trans. Audio Speech Lang. Process.
Shun-Po Chuang, Alexander H. Liu, Tzu-Wei Sung, Hung-yi Lee
2021 J jnl
Improving Cross-Lingual Reading Comprehension with Self-Training.
CoRR
Wei-Cheng Huang, Chien-yu Huang, Hung-yi Lee
2021 J jnl
Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning.
CoRR
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee
2021 Misc conf
Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech.
ICASSP
Chung-Ming Chien, Jheng-Hao Lin, Chien-yu Huang, Po-Chun Hsu, Hung-yi Lee
2021 J jnl
Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech.
CoRR
Chung-Ming Chien, Jheng-Hao Lin, Chien-yu Huang, Po-Chun Hsu, Hung-yi Lee
2021 — conf
Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation.
ACL/IJCNLP (Findings)
Shun-Po Chuang, Yung-Sung Chuang, Chih-Chiang Chang, Hung-yi Lee
2021 J jnl
Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation.
CoRR
Shun-Po Chuang, Yung-Sung Chuang, Chih-Chiang Chang, Hung-yi Lee
2021 — conf
Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models' Transferability.
EMNLP (Findings)
Wei-Tsung Kao, Hung-yi Lee
2021 J jnl
Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models' Transferability.
CoRR
Wei-Tsung Kao, Hung-yi Lee
2021 J jnl
Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models.
CoRR
Liang-Hsuan Tseng, Yu-Kuan Fu, Heng-Jui Chang, Hung-yi Lee
2021 J jnl
Membership Inference Attacks Against Self-supervised Speech Models.
CoRR
Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee
2021 J jnl
Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speech.
CoRR
Sung-Feng Huang, Chyi-Jiunn Lin, Hung-yi Lee
2021 J jnl
Mitigating Biases in Toxic Language Detection through Invariant Rationalization.
CoRR
Yung-Sung Chuang, Mingye Gao, Hongyin Luo, James R. Glass, Hung-yi Lee, Yun-Nung Chen, Shang-wen Li
2021 J jnl
Multi-accent Speech Separation with One Shot Learning.
CoRR
Kuan-Po Huang, Yuan-Kuei Wu, Hung-yi Lee
2021 A* conf
Multi-modal User Intent Classification Under the Scenario of Smart Factory (Student Abstract).
AAAI
Yu-Ching Chiu, Bo-Hao Chang, Tzu-yu Chen, Cheng-Fu Yang, Nanyi Bi, Richard Tzong-Han Tsai, Hung-yi Lee, Jane Yung-jen Hsu
2021 C conf
Non-Autoregressive Mandarin-English Code-Switching Speech Recognition.
ASRU
Shun-Po Chuang, Heng-Jui Chang, Sung-Feng Huang, Hung-yi Lee
2021 J jnl
Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization.
CoRR
Shun-Po Chuang, Heng-Jui Chang, Sung-Feng Huang, Hung-yi Lee
2021 J jnl
On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2021 Misc conf
One Shot Learning for Speech Separation.
ICASSP
Yuan-Kuei Wu, Kuan-Po Huang, Yu Tsao, Hung-yi Lee
2021 J jnl
Parallelized Reverse Curriculum Generation.
CoRR
Zih-Yun Chiu, Yi-Lin Tuan, Hung-yi Lee, Li-Chen Fu
2021 — conf
Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention.
NAACL-HLT
Hsuan Su, Jiun-Hao Jhan, Fan-Yun Sun, Saurav Sahay, Hung-yi Lee
2021 J jnl
Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention.
CoRR
Hsuan Su, Jiun-Hao Jhan, Fan-Yun Sun, Saurav Sahay, Hung-yi Lee
2021 A conf
S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations.
Interspeech
Jheng-Hao Lin, Yist Y. Lin, Chung-Ming Chien, Hung-yi Lee
2021 J jnl
S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations.
CoRR
Jheng-Hao Lin, Yist Y. Lin, Chung-Ming Chien, Hung-yi Lee
2021 J jnl
S3PRL-VC: Open-source Voice Conversion Framework with Self-supervised Speech Representations.
CoRR
Wen-Chin Huang, Shu-Wen Yang, Tomoki Hayashi, Hung-yi Lee, Shinji Watanabe, Tomoki Toda
2021 A conf
SUPERB: Speech Processing Universal PERformance Benchmark.
Interspeech
Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2021 J jnl
SUPERB: Speech processing Universal PERformance Benchmark.
CoRR
Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
2021 Misc conf
Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining.
ICASSP
Cheng-I Lai, Yung-Sung Chuang, Hung-yi Lee, Shang-wen Li, James R. Glass
2021 J jnl
Speech Representation Learning Through Self-supervised Pretraining And Multi-task Finetuning.
CoRR
Yi-Chen Chen, Shu-Wen Yang, Cheng-Kuang Lee, Simon See, Hung-yi Lee
2021 J jnl
SpeechNet: A Universal Modularized Model for Speech Processing Tasks.
CoRR
Yi-Chen Chen, Po-Han Chi, Shu-Wen Yang, Kai-Wei Chang, Jheng-Hao Lin, Sung-Feng Huang, Da-Rong Liu, Chi-Liang Liu, Cheng-Kuang Lee, Hung-yi Lee
2021 J jnl
Spotting adversarial samples for speaker verification by neural vocoders.
CoRR
Haibin Wu, Po-Chun Hsu, Ji Gao, Shanshan Zhang, Shen Huang, Jian Kang, Zhiyong Wu, Helen Meng, Hung-yi Lee
2021 A conf
Stabilizing Label Assignment for Speech Separation by Self-Supervised Pre-Training.
Interspeech
Sung-Feng Huang, Shun-Po Chuang, Da-Rong Liu, Yi-Chen Chen, Gene-Ping Yang, Hung-yi Lee
2021 J jnl
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech.
IEEE ACM Trans. Audio Speech Lang. Process.
Andy T. Liu, Shang-wen Li, Hung-yi Lee
2021 — conf
The Efficacy of Self-Supervised Speech Models for Audio Representations.
HEAR@NeurIPS
Tung-Yu Wu, Tsu-Yuan Hsu, Chen-An Li, Tzu-Han Lin, Hung-yi Lee
2021 J jnl
Toward Degradation-Robust Voice Conversion.
CoRR
Chien-yu Huang, Kai-Wei Chang, Hung-yi Lee
2021 A conf
Towards Lifelong Learning of End-to-End ASR.
Interspeech
Heng-Jui Chang, Hung-yi Lee, Lin-Shan Lee
2021 J jnl
Towards Lifelong Learning of End-to-end ASR.
CoRR
Heng-Jui Chang, Hung-yi Lee, Lin-Shan Lee
2021 A conf
Utilizing Self-Supervised Representations for MOS Prediction.
Interspeech
Wei-Cheng Tseng, Chien-yu Huang, Wei-Tsung Kao, Yist Y. Lin, Hung-yi Lee
2021 J jnl
Utilizing Self-supervised Representations for MOS Prediction.
CoRR
Wei-Cheng Tseng, Chien-yu Huang, Wei-Tsung Kao, Yist Y. Lin, Hung-yi Lee
2021 A conf
Voting for the Right Answer: Adversarial Defense for Speaker Verification.
Interspeech
Haibin Wu, Yang Zhang, Zhiyong Wu, Dong Wang, Hung-yi Lee
2021 J jnl
Voting for the right answer: Adversarial defense for speaker verification.
CoRR
Haibin Wu, Yang Zhang, Zhiyong Wu, Dong Wang, Hung-yi Lee
2020 J jnl
A Study of Cross-Lingual Ability and Language-specific Information in Multilingual BERT.
CoRR
Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee
2020 J jnl
AGAIN-VC: A One-shot Voice Conversion using Activation Guidance and Adaptive Instance Normalization.
CoRR
Yen-Hao Chen, Da-Yi Wu, Tsung-Han Wu, Hung-yi Lee
2020 J jnl
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation.
CoRR
Po-Han Chi, Pei-Hung Chung, Tsung-Han Wu, Chun-Cheng Hsieh, Shang-wen Li, Hung-yi Lee
2020 A conf
DARTS-ASR: Differentiable Architecture Search for Multilingual Speech Recognition and Adaptation.
INTERSPEECH
Yi-Chen Chen, Jui-Yang Hsu, Cheng-Kuang Lee, Hung-yi Lee
2020 J jnl
DARTS-ASR: Differentiable Architecture Search for Multilingual Speech Recognition and Adaptation.
CoRR
Yi-Chen Chen, Jui-Yang Hsu, Cheng-Kuang Lee, Hung-yi Lee
2020 J jnl
Defending Your Voice: Adversarial Attack on Voice Conversion.
CoRR
Chien-yu Huang, Yist Y. Lin, Hung-yi Lee, Lin-Shan Lee
2020 Misc conf
Defense Against Adversarial Attacks on Spoofing Countermeasures of ASV.
ICASSP
Haibin Wu, Songxiang Liu, Helen Meng, Hung-yi Lee
2020 J jnl
Defense against adversarial attacks on spoofing countermeasures of ASV.
CoRR
Haibin Wu, Songxiang Liu, Helen Meng, Hung-yi Lee
2020 A conf
Defense for Black-Box Attacks on Anti-Spoofing Models by Self-Supervised Learning.
INTERSPEECH
Haibin Wu, Andy T. Liu, Hung-yi Lee
2020 J jnl
Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning.
CoRR
Haibin Wu, Andy T. Liu, Hung-yi Lee
2020 J jnl
End-to-end Whispered Speech Recognition with Frequency-weighted Approaches and Layer-wise Transfer Learning.
CoRR
Heng-Jui Chang, Alexander H. Liu, Hung-yi Lee, Lin-Shan Lee
2020 J jnl
FragmentVC: Any-to-Any Voice Conversion by End-to-End Extracting and Fusing Fine-Grained Voice Fragments With Attention.
CoRR
Yist Y. Lin, Chung-Ming Chien, Jheng-Hao Lin, Hung-yi Lee, Lin-Shan Lee
2020 J jnl
Further Boosting BERT-based Models by Duplicating Existing Layers: Some Intriguing Phenomena inside BERT.
CoRR
Wei-Tsung Kao, Tsung-Han Wu, Po-Han Chi, Chun-Cheng Hsieh, Hung-yi Lee
2020 J jnl
Guest Editorial Special Issue on Adversarial Learning in Computational Intelligence.
IEEE Trans. Emerg. Top. Comput. Intell.
Zixing Zhang, Dimitris N. Metaxas, Hung-yi Lee, Björn W. Schuller
2020 J jnl
Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer.
CoRR
Tsung-Han Wu, Chun-Cheng Hsieh, Yen-Hao Chen, Po-Han Chi, Hung-yi Lee
2020 J jnl
Hierarchical Prosody Modeling for Non-Autoregressive Speech Synthesis.
CoRR
Chung-Ming Chien, Hung-yi Lee
2020 J jnl
How Far Are We from Robust Voice Conversion: A Survey.
CoRR
Tzu-Hsien Huang, Jheng-Hao Lin, Chien-yu Huang, Hung-yi Lee
2020 Misc conf
Interrupted and Cascaded Permutation Invariant Training for Speech Separation.
ICASSP
Gene-Ping Yang, Szu-Lin Wu, Yao-Wen Mao, Hung-yi Lee, Lin-Shan Lee
2020 J jnl
Investigation of Sentiment Controllable Chatbot.
CoRR
Hung-yi Lee, Cheng-Hao Ho, Chien-Fu Lin, Chiung-Chih Chang, Chih-Wei Lee, Yau-Shian Wang, Tsung-Yuan Hsu, Kuan-Yu Chen
2020 A* conf
LAMOL: LAnguage MOdeling for Lifelong Language Learning.
ICLR
Fan-Keng Sun, Cheng-Hao Ho, Hung-yi Lee
2020 J jnl
Language Representation in Multilingual BERT and its applications to improve Cross-lingual Generalization.
CoRR
Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Chung-Yi Li, Hung-yi Lee
2020 J jnl
Learning Interpretable and Discrete Representations with Adversarial Training for Unsupervised Text Classification.
CoRR
Yau-Shian Wang, Hung-yi Lee, Yun-Nung Chen
2020 Misc conf
Meta Learning for End-To-End Low-Resource Speech Recognition.
ICASSP
Jui-Yang Hsu, Yuan-Jui Chen, Hung-yi Lee
2020 Misc conf
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders.
ICASSP
Andy T. Liu, Shu-Wen Yang, Po-Han Chi, Po-Chun Hsu, Hung-yi Lee
2020 J jnl
One Shot Learning for Speech Separation.
CoRR
Yuan-Kuei Wu, Kuan-Po Huang, Yu Tsao, Hung-yi Lee
2020 Misc conf
One-Shot Voice Conversion by Vector Quantization.
ICASSP
Da-Yi Wu, Hung-yi Lee
2020 A* conf
Order-Free Learning Alleviating Exposure Bias in Multi-Label Classification.
AAAI
Che-Ping Tsai, Hung-yi Lee
2020 J jnl
Pre-Training a Language Model Without Human Language.
CoRR
David Cheng-Han Chiang, Hung-yi Lee
2020 — conf
Pretrained Language Model Embryology: The Birth of ALBERT.
EMNLP (1)
David Cheng-Han Chiang, Sung-Feng Huang, Hung-yi Lee
2020 J jnl
Pretrained Language Model Embryology: The Birth of ALBERT.
CoRR
David Cheng-Han Chiang, Sung-Feng Huang, Hung-yi Lee
2020 J jnl
SADDEL: Joint Speech Separation and Denoising Model based on Multitask Learning.
CoRR
Yuan-Kuei Wu, Chao-I Tuan, Hung-yi Lee, Yu Tsao
2020 Misc conf
Self-Supervised Deep Learning for Fisheye Image Rectification.
ICASSP
Chun-Hao Chao, Pin-Lun Hsu, Hung-yi Lee, Yu-Chiang Frank Wang
2020 J jnl
Self-supervised Pre-training Reduces Label Permutation Instability of Speech Separation.
CoRR
Sung-Feng Huang, Shun-Po Chuang, Da-Rong Liu, Yi-Chen Chen, Gene-Ping Yang, Hung-yi Lee
2020 A conf
Semi-Supervised Learning for Multi-Speaker Text-to-Speech Synthesis Using Discrete Speech Representation.
INTERSPEECH
Tao Tu, Yuan-Jui Chen, Alexander H. Liu, Hung-yi Lee
2020 J jnl
Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining.
CoRR
Cheng-I Lai, Yung-Sung Chuang, Hung-yi Lee, Shang-wen Li, James R. Glass
2020 J jnl
Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation.
CoRR
Tao Tu, Yuan-Jui Chen, Alexander H. Liu, Hung-yi Lee
2020 Misc conf
Sequence-to-Sequence Automatic Speech Recognition with Word Embedding Regularization and Fused Decoding.
ICASSP
Alexander H. Liu, Tzu-Wei Sung, Shun-Po Chuang, Hung-yi Lee, Lin-Shan Lee
2020 A conf
SpeechBERT: An Audio-and-Text Jointly Learned Language Model for End-to-End Spoken Question Answering.
INTERSPEECH
Yung-Sung Chuang, Chi-Liang Liu, Hung-yi Lee, Lin-Shan Lee
2020 J jnl
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech.
CoRR
Andy T. Liu, Shang-wen Li, Hung-yi Lee
2020 A* conf
TaylorGAN: Neighbor-Augmented Policy Update Towards Sample-Efficient Natural Language Generation.
NeurIPS
Chun-Hsing Lin, Siang-Ruei Wu, Hung-yi Lee, Yun-Nung Chen
2020 J jnl
TaylorGAN: Neighbor-Augmented Policy Update for Sample-Efficient Natural Language Generation.
CoRR
Chun-Hsing Lin, Siang-Ruei Wu, Hung-yi Lee, Yun-Nung Chen
2020 Misc conf
Towards Unsupervised Speech Recognition and Synthesis with Quantized Speech Representation Learning.
ICASSP
Alexander H. Liu, Tao Tu, Hung-yi Lee, Lin-Shan Lee
2020 Misc conf
Training Code-Switching Language Model with Monolingual Data.
ICASSP
Shun-Po Chuang, Tzu-Wei Sung, Hung-yi Lee
2020 A conf
Understanding Self-Attention of Self-Supervised Audio Transformers.
INTERSPEECH
Shu-Wen Yang, Andy T. Liu, Hung-yi Lee
2020 J jnl
Understanding Self-Attention of Self-Supervised Audio Transformers.
CoRR
Shu-Wen Yang, Andy T. Liu, Hung-yi Lee
2020 J jnl
Unsupervised Deep Learning based Multiple Choices Question Answering: Start Learning from Basic Knowledge.
CoRR
Chi-Liang Liu, Hung-yi Lee
2020 A conf
VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net Architecture.
INTERSPEECH
Da-Yi Wu, Yen-Hao Chen, Hung-yi Lee
2020 J jnl
VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net architecture.
CoRR
Da-Yi Wu, Yen-Hao Chen, Hung-yi Lee
2020 A conf
WG-WaveNet: Real-Time High-Fidelity Speech Synthesis Without GPU.
INTERSPEECH
Po-Chun Hsu, Hung-yi Lee
2020 J jnl
WG-WaveNet: Real-Time High-Fidelity Speech Synthesis without GPU.
CoRR
Po-Chun Hsu, Hung-yi Lee
2020 Misc conf
What Does a Network Layer Hear? Analyzing Hidden Representations of End-to-End ASR Through Speech Synthesis.
ICASSP
Chung-Yi Li, Pei-Chieh Yuan, Hung-yi Lee
2020 J jnl
What makes multilingual BERT multilingual?
CoRR
Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee
2020 A* conf
Worse WER, but Better BLEU? Leveraging Word Embedding as Intermediate in Multitask End-to-End Speech Translation.
ACL
Shun-Po Chuang, Tzu-Wei Sung, Alexander H. Liu, Hung-yi Lee
2020 J jnl
Worse WER, but Better BLEU? Leveraging Word Embedding as Intermediate in Multitask End-to-End Speech Translation.
CoRR
Shun-Po Chuang, Tzu-Wei Sung, Alexander H. Liu, Hung-yi Lee
2019 C conf
Adversarial Attacks on Spoofing Countermeasures of Automatic Speaker Verification.
ASRU
Songxiang Liu, Haibin Wu, Hung-yi Lee, Helen Meng
2019 J jnl
Adversarial Attacks on Spoofing Countermeasures of automatic speaker verification.
CoRR
Songxiang Liu, Haibin Wu, Hung-yi Lee, Helen Meng
2019 Misc conf
Adversarial Learning of Label Dependency: A Novel Framework for Multi-class Classification.
ICASSP
Che-Ping Tsai, Hung-yi Lee
2019 Misc conf
Adversarial Training of End-to-end Speech Recognition Using a Criticizing Language Model.
ICASSP
Alexander H. Liu, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
Audio Word2vec: Sequence-to-Sequence Autoencoding for Unsupervised Learning of Audio Segmentation and Representation.
IEEE ACM Trans. Audio Speech Lang. Process.
Yi-Chen Chen, Sung-Feng Huang, Hung-yi Lee, Yu-Hsuan Wang, Chia-Hao Shen
2019 A conf
Code-Switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentation.
INTERSPEECH
Ching-Ting Chang, Shun-Po Chuang, Hung-yi Lee
2019 J jnl
Completely Unsupervised Phoneme Recognition By A Generative Adversarial Network Harmonized With Iteratively Refined Hidden Markov Models.
CoRR
Kuan-Yu Chen, Che-Ping Tsai, Da-Rong Liu, Hung-yi Lee, Lin-Shan Lee
2019 A conf
Completely Unsupervised Phoneme Recognition by a Generative Adversarial Network Harmonized with Iteratively Refined Hidden Markov Models.
INTERSPEECH
Kuan-Yu Chen, Che-Ping Tsai, Da-Rong Liu, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
Cross-Lingual Transfer Learning for Question Answering.
CoRR
Chia-Hsuan Lee, Hung-yi Lee
2019 J jnl
Deep Long Audio Inpainting.
CoRR
Ya-Liang Chang, Kuan-Ying Lee, Po-Yu Wu, Hung-yi Lee, Winston H. Hsu
2019 — conf
DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphs.
EMNLP/IJCNLP (1)
Yi-Lin Tuan, Yun-Nung Chen, Hung-yi Lee
2019 J jnl
DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphs.
CoRR
Yi-Lin Tuan, Yun-Nung Chen, Hung-yi Lee
2019 A conf
End-to-End Text-to-Speech for Low-Resource Languages by Cross-Lingual Transfer Learning.
INTERSPEECH
Yuan-Jui Chen, Tao Tu, Cheng-chieh Yeh, Hung-yi Lee
2019 J jnl
End-to-end Text-to-speech for Low-resource Languages by Cross-Lingual Transfer Learning.
CoRR
Tao Tu, Yuan-Jui Chen, Cheng-chieh Yeh, Hung-yi Lee
2019 J jnl
From Semi-supervised to Almost-unsupervised Speech Recognition with Very-low Resource by Jointly Learning Phonetic Structures from Audio and Text Embeddings.
CoRR
Yi-Chen Chen, Sung-Feng Huang, Hung-yi Lee, Lin-Shan Lee
2019 A conf
Generative Adversarial Networks for Unpaired Voice Transformation on Impaired Speech.
INTERSPEECH
Li-Wei Chen, Hung-yi Lee, Yu Tsao
2019 A conf
Improved Speech Separation with Time-and-Frequency Cross-Domain Joint Embedding and Clustering.
INTERSPEECH
Gene-Ping Yang, Chao-I Tuan, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
Improved Speech Separation with Time-and-Frequency Cross-domain Joint Embedding and Clustering.
CoRR
Gene-Ping Yang, Chao-I Tuan, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
Improving Conditional Sequence Generative Adversarial Networks by Stepwise Evaluation.
IEEE ACM Trans. Audio Speech Lang. Process.
Yi-Lin Tuan, Hung-yi Lee
2019 J jnl
Interrupted and cascaded permutation invariant training for speech separation.
CoRR
Gene-Ping Yang, Szu-Lin Wu, Yao-Wen Mao, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
J-Net: Randomly weighted U-Net for audio source separation.
CoRR
Bo-Wen Chen, Yen-Min Hsu, Hung-yi Lee
2019 J jnl
LAMAL: LAnguage Modeling Is All You Need for Lifelong Language Learning.
CoRR
Fan-Keng Sun, Cheng-Hao Ho, Hung-yi Lee
2019 J jnl
MITAS: A Compressed Time-Domain Audio Separation Network with Parameter Sharing.
CoRR
Chao-I Tuan, Yuan-Kuei Wu, Hung-yi Lee, Yu Tsao
2019 J jnl
Machine Comprehension of Spoken Content: TOEFL Listening Test and Spoken SQuAD.
IEEE ACM Trans. Audio Speech Lang. Process.
Chia-Hsuan Lee, Hung-yi Lee, Szu-Lin Wu, Chi-Liang Liu, Wei Fang, Juei-Yang Hsu, Bo-Hsiang Tseng
2019 J jnl
Meta Learning for End-to-End Low-Resource Speech Recognition.
CoRR
Jui-Yang Hsu, Yuan-Jui Chen, Hung-yi Lee
2019 Misc conf
Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation.
ICASSP
Chia-Hsuan Lee, Yun-Nung Chen, Hung-yi Lee
2019 J jnl
Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation.
CoRR
Chia-Hsuan Lee, Yun-Nung Chen, Hung-yi Lee
2019 J jnl
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders.
CoRR
Andy T. Liu, Shu-Wen Yang, Po-Han Chi, Po-Chun Hsu, Hung-yi Lee
2019 A conf
Noise Adaptive Speech Enhancement Using Domain Adversarial Training.
INTERSPEECH
Chien-Feng Liao, Yu Tsao, Hung-yi Lee, Hsin-Min Wang
2019 A conf
One-Shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalization.
INTERSPEECH
Ju-Chieh Chou, Hung-yi Lee
2019 J jnl
One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalization.
CoRR
Ju-Chieh Chou, Cheng-chieh Yeh, Hung-yi Lee
2019 J jnl
Order-free Learning Alleviating Exposure Bias in Multi-label Classification.
CoRR
Che-Ping Tsai, Hung-yi Lee
2019 A conf
Personalized Dialogue Response Generation Learned from Monologues.
INTERSPEECH
Feng-Guang Su, Aliyah R. Hsu, Yi-Lin Tuan, Hung-yi Lee
2019 — conf
Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets.
EMNLP/IJCNLP (1)
Hongren Mao, Hung-yi Lee
2019 J jnl
Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets.
CoRR
Hongren Mao, Hung-yi Lee
2019 J jnl
Sequence-to-sequence Automatic Speech Recognition with Word Embedding Regularization and Fused Decoding.
CoRR
Alexander H. Liu, Tzu-Wei Sung, Shun-Po Chuang, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
SpeechBERT: Cross-Modal Pre-trained Language Model for End-to-end Spoken Question Answering.
CoRR
Yung-Sung Chuang, Chi-Liang Liu, Hung-yi Lee
2019 J jnl
Temporal pattern attention for multivariate time series forecasting.
Mach. Learn.
Shun-Yao Shih, Fan-Keng Sun, Hung-yi Lee
2019 Misc conf
Towards Audio to Scene Image Synthesis Using Generative Adversarial Network.
ICASSP
Chia-Hung Wan, Shun-Po Chuang, Hung-yi Lee
2019 Misc conf
Towards End-to-end Speech-to-text Translation with Two-pass Decoding.
ICASSP
Tzu-Wei Sung, Jun-You Liu, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
Towards Robust Neural Vocoding for Speech Generation: A Survey.
CoRR
Po-Chun Hsu, Chun-hsuan Wang, Andy T. Liu, Hung-yi Lee
2019 J jnl
Towards Unsupervised Speech Recognition and Synthesis with Quantized Speech Representation Learning.
CoRR
Alexander H. Liu, Tao Tu, Hung-yi Lee, Lin-Shan Lee
2019 J jnl
Training a code-switching language model with monolingual data.
CoRR
Shun-Po Chuang, Tzu-Wei Sung, Hung-yi Lee
2019 — conf
Tree Transformer: Integrating Tree Structures into Self-Attention.
EMNLP/IJCNLP (1)
Yau-Shian Wang, Hung-yi Lee, Yun-Nung Chen
2019 J jnl
Tree Transformer: Integrating Tree Structures into Self-Attention.
CoRR
Yau-Shian Wang, Hung-yi Lee, Yun-Nung Chen
2019 A conf
Unsupervised End-to-End Learning of Discrete Linguistic Units for Voice Conversion.
INTERSPEECH
Andy T. Liu, Po-Chun Hsu, Hung-yi Lee
2019 J jnl
Unsupervised End-to-End Learning of Discrete Linguistic Units for Voice Conversion.
CoRR
Andy T. Liu, Po-Chun Hsu, Hung-yi Lee
2019 Misc conf
Using Deep-Q Network to Select Candidates from N-best Speech Recognition Hypotheses for Enhancing Dialogue State Tracking.
ICASSP
Richard Tzong-Han Tsai, Chia-Hao Chen, Chun-Kai Wu, Yu-Cheng Hsiao, Hung-yi Lee
2019 J jnl
What does a network layer hear? Analyzing hidden representations of end-to-end ASR through speech synthesis.
CoRR
Chung-Yi Li, Pei-Chieh Yuan, Hung-yi Lee
2019 — conf
Zero-shot Reading Comprehension by Cross-lingual Transfer Learning with Multi-lingual Language Representation Model.
EMNLP/IJCNLP (1)
Tsung-Yuan Hsu, Chi-Liang Liu, Hung-yi Lee
2019 J jnl
Zero-shot Reading Comprehension by Cross-lingual Transfer Learning with Multi-lingual Language Representation Model.
CoRR
Tsung-Yuan Hsu, Chi-Liang Liu, Hung-yi Lee
2018 J jnl
Adversarial Learning of Label Dependency: A Novel Framework for Multi-class Classification.
CoRR
Che-Ping Tsai, Hung-yi Lee
2018 J jnl
Adversarial Training of End-to-end Speech Recognition Using a Criticizing Language Model.
CoRR
Alexander H. Liu, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Almost-unsupervised Speech Recognition with Close-to-zero Resource Based on Phonetic Structures Learned from Very Small Unpaired Speech and Text Data.
CoRR
Yi-Chen Chen, Chia-Hao Shen, Sung-Feng Huang, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Code-switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentation.
CoRR
Ching-Ting Chang, Shun-Po Chuang, Hung-yi Lee
2018 A conf
Completely Unsupervised Phoneme Recognition by Adversarially Learning Mapping Relationships from Audio Embeddings.
INTERSPEECH
Da-Rong Liu, Kuan-Yu Chen, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Completely Unsupervised Phoneme Recognition by Adversarially Learning Mapping Relationships from Audio Embeddings.
CoRR
Da-Rong Liu, Kuan-Yu Chen, Hung-yi Lee, Lin-Shan Lee
2018 Misc conf
Domain Independent Key Term Extraction from Spoken Content Based on Context and Term Location Information in the Utterances.
ICASSP
Hsien-Chin Lin, Chi-Yu Yang, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Generative Adversarial Networks for Unpaired Voice Transformation on Impaired Speech.
CoRR
Li-Wei Chen, Hung-yi Lee, Yu Tsao
2018 J jnl
Improved Audio Embeddings by Adjacency-Based Clustering with Applications in Spoken Term Detection.
CoRR
Sung-Feng Huang, Yi-Chen Chen, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Improving Conditional Sequence Generative Adversarial Networks by Stepwise Evaluation.
CoRR
Yi-Lin Tuan, Hung-yi Lee
2018 — conf
Improving Unsupervised Style Transfer in end-to-end Speech Synthesis with end-to-end Speech Recognition.
SLT
Da-Rong Liu, Chi-Yu Yang, Szu-Lin Wu, Hung-yi Lee
2018 J jnl
Interactive Spoken Content Retrieval by Deep Reinforcement Learning.
IEEE ACM Trans. Audio Speech Lang. Process.
Hung-yi Lee, Pei-Hung Chung, Yen-Chen Wu, Tzu-Hsiang Lin, Tsung-Hsien Wen
2018 A conf
Joint Learning of Interactive Spoken Content Retrieval and Trainable User Simulator.
INTERSPEECH
Pei-Hung Chung, Kuan Tung, Ching-Lun Tai, Hung-yi Lee
2018 J jnl
Joint Learning of Interactive Spoken Content Retrieval and Trainable User Simulator.
CoRR
Pei-Hung Chung, Kuan Tung, Ching-Lun Tai, Hung-yi Lee
2018 Misc conf
Language Transfer of Audio Word2Vec: Learning Audio Segment Representations Without Target Language Data.
ICASSP
Chia-Hao Shen, Janet Y. Sung, Hung-yi Lee
2018 A* conf
Learning to Encode Text as Human-Readable Summaries using Generative Adversarial Networks.
EMNLP
Yau-Shian Wang, Hung-yi Lee
2018 J jnl
Learning to Encode Text as Human-Readable Summaries using Generative Adversarial Networks.
CoRR
Yau-Shian Wang, Hung-yi Lee
2018 A conf
Multi-target Voice Conversion without Parallel Data by Adversarially Learning Disentangled Audio Representations.
INTERSPEECH
Ju-Chieh Chou, Cheng-chieh Yeh, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Multi-target Voice Conversion without Parallel Data by Adversarially Learning Disentangled Audio Representations.
CoRR
Ju-Chieh Chou, Cheng-chieh Yeh, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Noise Adaptive Speech Enhancement using Domain Adversarial Training.
CoRR
Chien-Feng Liao, Yu Tsao, Hung-yi Lee, Hsin-Min Wang
2018 — conf
ODSQA: Open-Domain Spoken Question Answering Dataset.
SLT
Chia-Hsuan Lee, Shang-Ming Wang, Huan-Cheng Chang, Hung-yi Lee
2018 J jnl
ODSQA: Open-domain Spoken Question Answering Dataset.
CoRR
Chia-Hsuan Lee, Shang-Ming Wang, Huan-Cheng Chang, Hung-yi Lee
2018 J jnl
Phonetic-and-Semantic Embedding of Spoken Words with Applications in Spoken Content Retrieval.
CoRR
Yi-Chen Chen, Sung-Feng Huang, Chia-Hao Shen, Hung-yi Lee, Lin-Shan Lee
2018 — conf
Phonetic-and-Semantic Embedding of Spoken words with Applications in Spoken Content Retrieval.
SLT
Yi-Chen Chen, Sung-Feng Huang, Chia-Hao Shen, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Proximal Policy Optimization and its Dynamic Version for Sequence Generation.
CoRR
Yi-Lin Tuan, Jinzhi Zhang, Yujia Li, Hung-yi Lee
2018 Misc conf
Query-by-Example Spoken Term Detection Using Attention-Based Multi-Hop Networks.
ICASSP
Chia-Wei Ao, Hung-yi Lee
2018 — conf
Rhythm-Flexible Voice Conversion Without Parallel Data Using Cycle-GAN Over Phoneme Posteriorgram Sequences.
SLT
Cheng-chieh Yeh, Po-Chun Hsu, Ju-Chieh Chou, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Rhythm-Flexible Voice Conversion without Parallel Data Using Cycle-GAN over Phoneme Posteriorgram Sequences.
CoRR
Cheng-chieh Yeh, Po-Chun Hsu, Ju-Chieh Chou, Hung-yi Lee, Lin-Shan Lee
2018 Misc conf
Scalable Sentiment for Sequence-to-Sequence Chatbot Response with Performance Analysis.
ICASSP
Chih-Wei Lee, Yau-Shian Wang, Tsung-Yuan Hsu, Kuan-Yu Chen, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Scalable Sentiment for Sequence-to-sequence Chatbot Response with Performance Analysis.
CoRR
Chih-Wei Lee, Yau-Shian Wang, Tsung-Yuan Hsu, Kuan-Yu Chen, Hung-yi Lee, Lin-Shan Lee
2018 Misc conf
Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection.
ICASSP
Yu-Hsuan Wang, Hung-yi Lee, Lin-Shan Lee
2018 J jnl
Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection.
CoRR
Yu-Hsuan Wang, Hung-yi Lee, Lin-Shan Lee
2018 A conf
Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehension.
INTERSPEECH
Chia-Hsuan Li, Szu-Lin Wu, Chi-Liang Liu, Hung-yi Lee
2018 J jnl
Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehension.
CoRR
Chia-Hsuan Li, Szu-Lin Wu, Chi-Liang Liu, Hung-yi Lee
2018 — conf
Supervised and Unsupervised Transfer Learning for Question Answering.
NAACL-HLT
Yu-An Chung, Hung-yi Lee, James R. Glass
2018 J jnl
Temporal Pattern Attention for Multivariate Time Series Forecasting.
CoRR
Shun-Yao Shih, Fan-Keng Sun, Hung-yi Lee
2018 J jnl
Towards Audio to Scene Image Synthesis using Generative Adversarial Network.
CoRR
Chia-Hung Wan, Shun-Po Chuang, Hung-yi Lee
2018 J jnl
Towards Unsupervised Automatic Speech Recognition Trained by Unaligned Speech and Text only.
CoRR
Yi-Chen Chen, Chia-Hao Shen, Sung-Feng Huang, Hung-yi Lee
2017 J jnl
Attention-based CNN Matching Net.
CoRR
Tzu-Chien Liu, Yu-Hsueh Wu, Hung-yi Lee
2017 J jnl
Gate Activation Signal Analysis for Gated Recurrent Neural Networks and Its Correlation with Phoneme Boundaries.
CoRR
Yu-Hsuan Wang, Cheng-Tao Chung, Hung-yi Lee
2017 A conf
Gate Activation Signal Analysis for Gated Recurrent Neural Networks and its Correlation with Phoneme Boundaries.
INTERSPEECH
Yu-Hsuan Wang, Cheng-Tao Chung, Hung-yi Lee
2017 J jnl
Language Transfer of Audio Word2Vec: Learning Audio Segment Representations without Target Language Data.
CoRR
Chia-Hao Shen, Janet Y. Sung, Hung-yi Lee
2017 A* conf
Learning Chinese Word Representations From Glyphs Of Characters.
EMNLP
Tzu-Ray Su, Hung-yi Lee
2017 J jnl
Learning Chinese Word Representations From Glyphs Of Characters.
CoRR
Tzu-Ray Su, Hung-yi Lee
2017 J jnl
Mitigating the Impact of Speech Recognition Errors on Chatbot using Sequence-to-sequence Model.
CoRR
Pin-Jung Chen, I-Hung Hsu, Yi Yao Huang, Hung-yi Lee
2017 C conf
Mitigating the impact of speech recognition errors on chatbot using sequence-to-sequence model.
ASRU
Pin-Jung Chen, I-Hung Hsu, Yi Yao Huang, Hung-yi Lee
2017 A conf
Order-Preserving Abstractive Summarization for Spoken Content Based on Connectionist Temporal Classification.
INTERSPEECH
Bo-Ru Lu, Frank Shyu, Yun-Nung Chen, Hung-yi Lee, Lin-Shan Lee
2017 J jnl
Order-Preserving Abstractive Summarization for Spoken Content Based on Connectionist Temporal Classification.
CoRR
Bo-Ru Lu, Frank Shyu, Yun-Nung Chen, Hung-yi Lee, Lin-Shan Lee
2017 J jnl
Personalized Acoustic Modeling by Weakly Supervised Multi-Task Deep Learning using Acoustic Tokens Discovered from Unlabeled Data.
CoRR
Cheng-Kuang Wei, Cheng-Tao Chung, Hung-yi Lee, Lin-Shan Lee
2017 Misc conf
Personalized acoustic modeling by weakly supervised multi-task deep learning using acoustic tokens discovered from unlabeled data.
ICASSP
Cheng-Kuang Wei, Cheng-Tao Chung, Hung-yi Lee, Lin-Shan Lee
2017 J jnl
Personalized word representations Carrying Personalized Semantics Learned from Social Network Posts.
CoRR
Zih-Wei Lin, Tzu-Wei Sung, Hung-yi Lee, Lin-Shan Lee
2017 C conf
Personalized word representations carrying personalized semantics learned from social network posts.
ASRU
Zih-Wei Lin, Tzu-Wei Sung, Hung-yi Lee, Lin-Shan Lee
2017 J jnl
Personalizing Recurrent-Neural-Network-Based Language Model by Social Network.
IEEE ACM Trans. Audio Speech Lang. Process.
Hung-yi Lee, Bo-Hsiang Tseng, Tsung-Hsien Wen, Yu Tsao
2017 J jnl
Query-by-example Spoken Term Detection using Attention-based Multi-hop Networks.
CoRR
Chia-Wei Ao, Hung-yi Lee
2017 Misc conf
Recurrent Neural Network based language modeling with controllable external Memory.
ICASSP
Wei-Jen Ko, Bo-Hsiang Tseng, Hung-yi Lee
2017 C conf
Seeing and hearing too: Audio representation for video captioning.
ASRU
Shun-Po Chuang, Chia-Hung Wan, Pang-Chi Huang, Chi-Yu Yang, Hung-yi Lee
2017 J jnl
Supervised and Unsupervised Transfer Learning for Question Answering.
CoRR
Yu-An Chung, Hung-yi Lee, James R. Glass
2016 J jnl
Abstractive Headline Generation for Spoken Content by Attentive Recurrent Neural Networks with ASR Error Modeling.
CoRR
Lang-Chi Yu, Hung-yi Lee, Lin-Shan Lee
2016 — conf
Abstractive headline generation for spoken content by attentive recurrent neural networks with ASR error modeling.
SLT
Lang-Chi Yu, Hung-yi Lee, Lin-Shan Lee
2016 J jnl
An Iterative Deep Learning Framework for Unsupervised Discovery of Speech Features and Linguistic Units with Applications on Spoken Term Detection.
CoRR
Cheng-Tao Chung, Cheng-Yu Tsai, Hsiang-Hung Lu, Chia-Hsiang Liu, Hung-yi Lee, Lin-Shan Lee
2016 J jnl
Attention-based Memory Selection Recurrent Network for Language Modeling.
CoRR
Da-Rong Liu, Shun-Po Chuang, Hung-yi Lee
2016 A conf
Audio Word2Vec: Unsupervised Learning of Audio Segment Representations Using Sequence-to-Sequence Autoencoder.
INTERSPEECH
Yu-An Chung, Chao-Chung Wu, Chia-Hao Shen, Hung-yi Lee, Lin-Shan Lee
2016 J jnl
Audio Word2Vec: Unsupervised Learning of Audio Segment Representations using Sequence-to-sequence Autoencoder.
CoRR
Yu-An Chung, Chao-Chung Wu, Chia-Hao Shen, Hung-yi Lee, Lin-Shan Lee
2016 J jnl
Hierarchical Attention Model for Improved Machine Comprehension of Spoken Content.
CoRR
Wei Fang, Juei-Yang Hsu, Hung-yi Lee, Lin-Shan Lee
2016 — conf
Hierarchical attention model for improved machine comprehension of spoken content.
SLT
Wei Fang, Juei-Yang Hsu, Hung-yi Lee, Lin-Shan Lee
2016 A conf
Interactive Spoken Content Retrieval by Deep Reinforcement Learning.
INTERSPEECH
Yen-Chen Wu, Tzu-Hsiang Lin, Yang-De Chen, Hung-yi Lee, Lin-Shan Lee
2016 J jnl
Interactive Spoken Content Retrieval by Deep Reinforcement Learning.
CoRR
Yen-Chen Wu, Tzu-Hsiang Lin, Yang-De Chen, Hung-yi Lee, Lin-Shan Lee
2016 A conf
Neural Attention Models for Sequence Classification: Analysis and Application to Key Term Extraction and Dialogue Act Detection.
INTERSPEECH
Sheng-syun Shen, Hung-yi Lee
2016 J jnl
Neural Attention Models for Sequence Classification: Analysis and Application to Key Term Extraction and Dialogue Act Detection.
CoRR
Sheng-syun Shen, Hung-yi Lee
2016 A conf
Towards Machine Comprehension of Spoken Content: Initial TOEFL Listening Comprehension Test by Machine.
INTERSPEECH
Bo-Hsiang Tseng, Sheng-syun Shen, Hung-yi Lee, Lin-Shan Lee
2016 J jnl
Towards Machine Comprehension of Spoken Content: Initial TOEFL Listening Comprehension Test by Machine.
CoRR
Bo-Hsiang Tseng, Sheng-syun Shen, Hung-yi Lee, Lin-Shan Lee
2015 J jnl
A Multi-layered Acoustic Tokenizing Deep Neural Network (MAT-DNN) for Unsupervised Discovery of Linguistic Units and Generation of High Quality Features.
CoRR
Cheng-Tao Chung, Cheng-Yu Tsai, Hsiang-Hung Lu, Yuan-ming Liou, Yen-Chen Wu, Yen-Ju Lu, Hung-yi Lee, Lin-Shan Lee
2015 C conf
An iterative deep learning framework for unsupervised discovery of speech features and linguistic units with applications on spoken term detection.
ASRU
Cheng-Tao Chung, Cheng-Yu Tsai, Hsiang-Hung Lu, Chia-Hsiang Liu, Hung-yi Lee, Lin-Shan Lee
2015 A conf
Personalized speech recognizer with keyword-based personalized lexicon and language model using word vector representations.
INTERSPEECH
Ching-Feng Yeh, Yuan-ming Liou, Hung-yi Lee, Lin-Shan Lee
2015 J jnl
Personalizing a Universal Recurrent Neural Network Language Model with User Characteristic Features by Crowdsouring over Social Networks.
CoRR
Bo-Hsiang Tseng, Hung-yi Lee, Lin-Shan Lee
2015 C conf
Personalizing universal recurrent neural network language model with user characteristic features by social network crowdsourcing.
ASRU
Bo-Hsiang Tseng, Hung-yi Lee, Lin-Shan Lee
2015 A conf
Semantic retrieval of personal photos using a deep autoencoder fusing visual features with speech annotations represented as word/paragraph vectors.
INTERSPEECH
Hung-tsung Lu, Yuan-ming Liou, Hung-yi Lee, Lin-Shan Lee
2015 J jnl
Spoken Content Retrieval - Beyond Cascading Speech Recognition with Text Retrieval.
IEEE ACM Trans. Audio Speech Lang. Process.
Lin-Shan Lee, James R. Glass, Hung-yi Lee, Chun-an Chan
2015 A conf
Structuring lectures in massive open online courses (MOOCs) for efficient learning by linking similar sections and predicting prerequisites.
INTERSPEECH
Sheng-syun Shen, Hung-yi Lee, Shang-wen Li, Victor Zue, Lin-Shan Lee
2015 J jnl
Towards Structured Deep Neural Network for Automatic Speech Recognition.
CoRR
Yi-Hsiu Liao, Hung-yi Lee, Lin-Shan Lee
2015 J jnl
Towards Structured Deep Neural Network for Automatic Speech Recognition.
CoRR
Yi-Hsiu Liao, Hung-yi Lee, Lin-Shan Lee
2015 C conf
Towards structured deep neural network for automatic speech recognition.
ASRU
Yi-Hsiu Liao, Hung-yi Lee, Lin-Shan Lee
2014 A conf
Alignment of spoken utterances with slide content for easier learning with recorded lectures using structured support vector machine (SVM).
INTERSPEECH
Han Lu, Sheng-syun Shen, Sz-Rung Shiang, Hung-yi Lee, Lin-Shan Lee
2014 A conf
Graph-based re-ranking using acoustic feature similarity between search results for spoken term detection on low-resource languages.
INTERSPEECH
Hung-yi Lee, Yu Zhang, Ekapol Chuangsuwanich, James R. Glass
2014 J jnl
Improved Semantic Retrieval of Spoken Content by Document/Query Expansion with Random Walk Over Acoustic Similarity Graphs.
IEEE ACM Trans. Audio Speech Lang. Process.
Hung-yi Lee, Lin-Shan Lee
2014 J jnl
Improved open-vocabulary spoken content retrieval with word and subword lattices using acoustic feature similarity.
Comput. Speech Lang.
Hung-yi Lee, Po-Wei Chou, Lin-Shan Lee
2014 — conf
Lifting motion planning for humanoid robots.
CASE
Hung-yi Lee, Han-Pang Huang, Huan-Kun Hsu
2014 A conf
Semantic retrieval of personal photos using matrix factorization and two-layer random walk fusing sparse speech annotations with visual features.
INTERSPEECH
Yuan-ming Liou, Yi-Sheng Fu, Hung-yi Lee, Lin-Shan Lee
2014 J jnl
Spoken Knowledge Organization by Semantic Structuring and a Prototype Course Lecture System for Personalized Learning.
IEEE ACM Trans. Audio Speech Lang. Process.
Hung-yi Lee, Sz-Rung Shiang, Ching-Feng Yeh, Yun-Nung Chen, Yu Huang, Sheng-yi Kong, Lin-Shan Lee
2014 A conf
Spoken question answering using tree-structured conditional random fields and two-layer random walk.
INTERSPEECH
Sz-Rung Shiang, Hung-yi Lee, Lin-Shan Lee
2013 J jnl
Enhanced Spoken Term Detection Using Support Vector Machines and Weighted Pseudo Examples.
IEEE Trans. Speech Audio Process.
Hung-yi Lee, Lin-Shan Lee
2013 Misc conf
Enhancing query expansion for semantic retrieval of spoken content with automatically discovered acoustic patterns.
ICASSP
Hung-yi Lee, Yun-Chiao Li, Cheng-Tao Chung, Lin-Shan Lee
2013 A conf
Ensemble of machine learning and acoustic segment model techniques for speech emotion and autism spectrum disorders recognition.
INTERSPEECH
Hung-yi Lee, Ting-Yao Hu, How Jing, Yun-Fan Chang, Yu Tsao, Yu-Cheng Kao, Tsang-Long Pao
2013 Misc conf
Interactive spoken content retrieval by extended query model and continuous state space Markov Decision Process.
ICASSP
Tsung-Hsien Wen, Hung-yi Lee, Pei-Hao Su, Lin-Shan Lee
2013 A conf
Recurrent neural network based language model personalization by social network crowdsourcing.
INTERSPEECH
Tsung-Hsien Wen, Aaron Heidel, Hung-yi Lee, Yu Tsao, Lin-Shan Lee
2013 A conf
Speaking rate normalization with lattice-based context-dependent phoneme duration modeling for personalized speech recognizers on mobile devices.
INTERSPEECH
Ching-Feng Yeh, Hung-yi Lee, Lin-Shan Lee
2013 A conf
Supervised spoken document summarization based on structured support vector machine with utterance clusters as hidden variables.
INTERSPEECH
Sz-Rung Shiang, Hung-yi Lee, Lin-Shan Lee
2013 C conf
Towards unsupervised semantic retrieval of spoken content with query expansion based on automatically discovered acoustic patterns.
ASRU
Yun-Chiao Li, Hung-yi Lee, Cheng-Tao Chung, Chun-an Chan, Lin-Shan Lee
2013 Misc conf
Unsupervised domain adaptation for spoken document summarization with structured support vector machine.
ICASSP
Hung-yi Lee, Yu-Yu Chou, Yow-Bang Wang, Lin-Shan Lee
2012 — conf
Improved semantic retrieval of spoken content by language models enhanced with acoustic similarity graph.
SLT
Hung-yi Lee, Tsung-Hsien Wen, Lin-Shan Lee
2012 J jnl
Integrating Recognition and Retrieval With Relevance Feedback for Spoken Term Detection.
IEEE Trans. Speech Audio Process.
Hung-yi Lee, Chia-Ping Chen, Lin-Shan Lee
2012 A conf
Interactive Spoken Content Retrieval with Different Types of Actions Optimized By a Markov Decision Process.
INTERSPEECH
Tsung-Hsien Wen, Hung-yi Lee, Lin-Shan Lee
2012 J jnl
Interactive Spoken Document Retrieval With Suggested Key Terms Ranked by a Markov Decision Process.
IEEE Trans. Speech Audio Process.
Yi-Cheng Pan, Hung-yi Lee, Lin-Shan Lee
2012 A conf
Open-Vocabulary Retrieval of Spoken Content with Shorter/Longer Queries Considering Word/Subword-based Acoustic Feature Similarity.
INTERSPEECH
Hung-yi Lee, Po-Wei Chou, Lin-Shan Lee
2012 — conf
Personalized language modeling by crowd sourcing with social network data for voice access of cloud applications.
SLT
Tsung-Hsien Wen, Hung-yi Lee, Tai-Yuan Chen, Lin-Shan Lee
2012 Misc conf
Recognition of highly imbalanced code-mixed bilingual speech with frame-level language detection based on blurred posteriorgram.
ICASSP
Ching-Feng Yeh, Aaron Heidel, Hung-yi Lee, Lin-Shan Lee
2012 Misc conf
Semantic query expansion and context-based discriminative term modeling for spoken document retrieval.
ICASSP
Tsung-wei Tu, Hung-yi Lee, Yu-Yu Chou, Lin-Shan Lee
2012 A conf
Supervised Spoken Document Summarization jointly Considering Utterance Importance and Redundancy by Structured Support Vector Machine.
INTERSPEECH
Hung-yi Lee, Yu-Yu Chou, Yow-Bang Wang, Lin-Shan Lee
2012 Misc conf
Unsupervised two-stage keyword extraction from spoken documents by topic coherence and support vector machine.
ICASSP
Yun-Nung Chen, Yu Huang, Hung-yi Lee, Lin-Shan Lee
2012 Misc conf
Utterance-level latent topic transition modeling for spoken documents and its application in automatic summarization.
ICASSP
Hung-yi Lee, Yun-Nung Chen, Lin-Shan Lee
2011 Misc conf
Improved spoken term detection using support vector machines based on lattice context consistency.
ICASSP
Hung-yi Lee, Tsung-wei Tu, Chia-Ping Chen, Chao-Yu Huang, Lin-Shan Lee
2011 C conf
Improved spoken term detection using support vector machines with acoustic and context features from pseudo-relevance feedback.
ASRU
Tsung-wei Tu, Hung-yi Lee, Lin-Shan Lee
2011 Misc conf
Improved spoken term detection with graph-based re-ranking in feature space.
ICASSP
Yun-Nung Chen, Chia-Ping Chen, Hung-yi Lee, Chun-an Chan, Lin-Shan Lee
2010 — conf
A framework integrating different relevance feedback scenarios and approaches for spoken term detection.
SLT
Hung-yi Lee, Chia-Ping Chen, Ching-Feng Yeh, Lin-Shan Lee
2010 Misc conf
An initial attempt to improve spoken term detection by learning optimal weights for different indexing features.
ICASSP
Yu-Hui Chen, Chia-Chen Chou, Hung-yi Lee, Lin-Shan Lee
2010 A conf
Improved spoken term detection by discriminative training of acoustic models based on user relevance feedback.
INTERSPEECH
Hung-yi Lee, Chia-Ping Chen, Ching-Feng Yeh, Lin-Shan Lee
2010 A conf
Improved spoken term detection by feature space pseudo-relevance feedback.
INTERSPEECH
Chia-Ping Chen, Hung-yi Lee, Ching-Feng Yeh, Lin-Shan Lee
2010 Misc conf
Integrating recognition and retrieval with user feedback: A new framework for spoken term detection.
ICASSP
Hung-yi Lee, Lin-Shan Lee
2009 Misc conf
Improved lattice-based spoken document retrieval by directly learning from the evaluation measures.
ICASSP
Chao-Hong Meng, Hung-yi Lee, Lin-Shan Lee
2009 C conf
Spoken term detection from bilingual spontaneous speech using code-switched lattice-based structures for words and subword units.
ASRU
Hung-yi Lee, Yueh-Lien Tang, Hao Tang, Lin-Shan Lee