Yuan Gong

62 papers A* 7A 6B 1C 1Misc 3Journal 35Unranked 9
YearRankTypeTitle / Venue / Authors
2026 J jnl
CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification.
IEEE Trans. Pattern Anal. Mach. Intell.
Yuan Gong, Sameer Khurana, Andrew Rouditchenko, James Glass
2025 A* conf
CAV-MAE Sync: Improving Contrastive Audio-Visual Mask Autoencoders via Fine-Grained Alignment.
CVPR
Edson Araujo, Andrew Rouditchenko, Yuan Gong, Saurabhchand Bhati, Samuel Thomas, Brian Kingsbury, Leonid Karlinsky, Rogério Feris, James R. Glass, Hilde Kuehne
2025 J jnl
CAV-MAE Sync: Improving Contrastive Audio-Visual Mask Autoencoders via Fine-Grained Alignment.
CoRR
Edson Araujo, Andrew Rouditchenko, Yuan Gong, Saurabhchand Bhati, Samuel Thomas, Brian Kingsbury, Leonid Karlinsky, Rogério Feris, James R. Glass, Hilde Kuehne
2025 J jnl
Can Diffusion Models Disentangle? A Theoretical Perspective.
CoRR
Liming Wang, Muhammad Jehanzeb Mirza, Yishu Gong, Yuan Gong, Jiaqi Zhang, Brian H. Tracey, Katerina Placek, Marco Vilela, James R. Glass
2025 Misc conf
Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correction.
ICASSP
Yuanchao Li, Yuan Gong, Chao-Han Huck Yang, Peter Bell, Catherine Lai
2025 A* conf
UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation.
ICLR
Alexander H. Liu, Sang-gil Lee, Chao-Han Huck Yang, Yuan Gong, Yu-Chiang Frank Wang, James R. Glass, Rafael Valle, Bryan Catanzaro
2025 J jnl
UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation.
CoRR
Alexander H. Liu, Sang-gil Lee, Chao-Han Huck Yang, Yuan Gong, Yu-Chiang Frank Wang, James R. Glass, Rafael Valle, Bryan Catanzaro
2024 J jnl
A Closer Look at Neural Codec Resynthesis: Bridging the Gap between Codec and Waveform Generation.
CoRR
Alexander H. Liu, Qirui Wang, Yuan Gong, James R. Glass
2024 A conf
Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformer.
INTERSPEECH
Liming Wang, Yuan Gong, Nauman Dawalatabad, Marco Vilela, Katerina Placek, Brian Tracey, Yishu Gong, Alan Premasiri, Fernando Vieira, James R. Glass
2024 J jnl
Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformer.
CoRR
Liming Wang, Yuan Gong, Nauman Dawalatabad, Marco Vilela, Katerina Placek, Brian Tracey, Yishu Gong, Alan Premasiri, Fernando Vieira, James R. Glass
2024 — conf
DASS: Distilled Audio State Space Models are Stronger and More Duration-Scalable Learners.
SLT
Saurabhchand Bhati, Yuan Gong, Leonid Karlinsky, Hilde Kuehne, Rogério Feris, James R. Glass
2024 — conf
Large Language Model Based Generative Error Correction: A Challenge and Baselines For Speech Recognition, Speaker Tagging, and Emotion Recognition.
SLT
Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li, Zhehuai Chen, Yen-Ting Lin, Chen Chen, Yuchen Hu, Kunal Dhawan, Piotr Zelasko, Chao Zhang, Yun-Nung Chen, Yu Tsao, Jagadeesh Balam, Boris Ginsburg, Sabato Marco Siniscalchi, Eng Siong Chng, Peter Bell, Catherine Lai, Shinji Watanabe, Andreas Stolcke
2024 J jnl
Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition.
CoRR
Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li, Zhehuai Chen, Yen-Ting Lin, Chen Chen, Yuchen Hu, Kunal Dhawan, Piotr Zelasko, Chao Zhang, Yun-Nung Chen, Yu Tsao, Jagadeesh Balam, Boris Ginsburg, Sabato Marco Siniscalchi, Eng Siong Chng, Peter Bell, Catherine Lai, Shinji Watanabe, Andreas Stolcke
2024 A* conf
Listen, Think, and Understand.
ICLR
Yuan Gong, Hongyin Luo, Alexander H. Liu, Leonid Karlinsky, James R. Glass
2024 — conf
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning.
NAACL-HLT (Findings)
Tianhua Zhang, Jiaxin Ge, Hongyin Luo, Yung-Sung Chuang, Mingye Gao, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, Jim Glass
2024 J jnl
Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correction.
CoRR
Yuanchao Li, Yuan Gong, Chao-Han Huck Yang, Peter Bell, Catherine Lai
2024 J jnl
State-Space Large Audio Language Models.
CoRR
Saurabhchand Bhati, Yuan Gong, Leonid Karlinsky, Hilde Kuehne, Rogério Feris, James R. Glass
2024 A conf
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation.
INTERSPEECH
Andrew Rouditchenko, Yuan Gong, Samuel Thomas, Leonid Karlinsky, Hilde Kuehne, Rogério Feris, James Glass
2024 J jnl
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation.
CoRR
Andrew Rouditchenko, Yuan Gong, Samuel Thomas, Leonid Karlinsky, Hilde Kuehne, Rogério Feris, James R. Glass
2023 A* conf
Contrastive Audio-Visual Masked Autoencoder.
ICLR
Yuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath, Leonid Karlinsky, Hilde Kuehne, James R. Glass
2023 C conf
Joint Audio and Speech Understanding.
ASRU
Yuan Gong, Alexander H. Liu, Hongyin Luo, Leonid Karlinsky, James R. Glass
2023 J jnl
Joint Audio and Speech Understanding.
CoRR
Yuan Gong, Alexander H. Liu, Hongyin Luo, Leonid Karlinsky, James R. Glass
2023 J jnl
Listen, Think, and Understand.
CoRR
Yuan Gong, Hongyin Luo, Alexander H. Liu, Leonid Karlinsky, James R. Glass
2023 J jnl
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning.
CoRR
Tianhua Zhang, Jiaxin Ge, Hongyin Luo, Yung-Sung Chuang, Mingye Gao, Yuan Gong, Xixin Wu, Yoon Kim, Helen Meng, James R. Glass
2023 J jnl
SAIL: Search-Augmented Instruction Learning.
CoRR
Hongyin Luo, Yung-Sung Chuang, Yuan Gong, Tianhua Zhang, Yoon Kim, Xixin Wu, Danny Fox, Helen Meng, James R. Glass
2023 — conf
Search Augmented Instruction Learning.
EMNLP (Findings)
Hongyin Luo, Tianhua Zhang, Yung-Sung Chuang, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, James R. Glass
2023 A conf
Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers.
INTERSPEECH
Yuan Gong, Sameer Khurana, Leonid Karlinsky, James R. Glass
2023 J jnl
Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers.
CoRR
Yuan Gong, Sameer Khurana, Leonid Karlinsky, James R. Glass
2022 J jnl
CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification.
CoRR
Yuan Gong, Sameer Khurana, Andrew Rouditchenko, James R. Glass
2022 J jnl
Contrastive Audio-Visual Masked Autoencoder.
CoRR
Yuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath, Leonid Karlinsky, Hilde Kuehne, James R. Glass
2022 — conf
Detecting Dementia from Long Neuropsychological Interviews.
EMNLP (Findings)
Nauman Dawalatabad, Yuan Gong, Sameer Khurana, Rhoda Au, James R. Glass
2022 A* conf
SSAST: Self-Supervised Audio Spectrogram Transformer.
AAAI
Yuan Gong, Cheng-I Lai, Yu-An Chung, James R. Glass
2022 Misc conf
Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessment.
ICASSP
Yuan Gong, Ziyi Chen, Iek-Heng Chu, Peng Chang, James R. Glass
2022 J jnl
Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessment.
CoRR
Yuan Gong, Ziyi Chen, Iek-Heng Chu, Peng Chang, James R. Glass
2022 J jnl
UAVM: A Unified Model for Audio-Visual Learning.
CoRR
Yuan Gong, Alexander H. Liu, Andrew Rouditchenko, James R. Glass
2022 J jnl
UAVM: Towards Unifying Audio and Visual Models.
IEEE Signal Process. Lett.
Yuan Gong, Alexander H. Liu, Andrew Rouditchenko, James R. Glass
2022 Misc conf
Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition.
ICASSP
Yuan Gong, Jin Yu, James R. Glass
2022 J jnl
Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition.
CoRR
Yuan Gong, Jin Yu, James R. Glass
2021 A conf
AST: Audio Spectrogram Transformer.
Interspeech
Yuan Gong, Yu-An Chung, James R. Glass
2021 J jnl
AST: Audio Spectrogram Transformer.
CoRR
Yuan Gong, Yu-An Chung, James R. Glass
2021 J jnl
PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation.
CoRR
Yuan Gong, Yu-An Chung, James R. Glass
2021 J jnl
PSLA: Improving Audio Tagging With Pretraining, Sampling, Labeling, and Aggregation.
IEEE ACM Trans. Audio Speech Lang. Process.
Yuan Gong, Yu-An Chung, James R. Glass
2021 J jnl
SSAST: Self-Supervised Audio Spectrogram Transformer.
CoRR
Yuan Gong, Cheng-I Jeff Lai, Yu-An Chung, James R. Glass
2020 J jnl
Detecting Replay Attacks Using Multi-Channel Audio: A Neural Network-Based Method.
CoRR
Yuan Gong, Jian Yang, Christian Poellabauer
2020 J jnl
Detecting Replay Attacks Using Multi-Channel Audio: A Neural Network-Based Method.
IEEE Signal Process. Lett.
Yuan Gong, Jian Yang, Christian Poellabauer
2019 A conf
ReMASC: Realistic Replay Attack Corpus for Voice Controlled Systems.
INTERSPEECH
Yuan Gong, Jian Yang, Jacob Huber, Mitchell MacKnight, Christian Poellabauer
2019 J jnl
ReMASC: Realistic Replay Attack Corpus for Voice Controlled Systems.
CoRR
Yuan Gong, Jian Yang, Jacob Huber, Mitchell MacKnight, Christian Poellabauer
2019 A* conf
Real-Time Adversarial Attacks.
IJCAI
Yuan Gong, Boyang Li, Christian Poellabauer, Yiyu Shi
2019 J jnl
Real-Time Adversarial Attacks.
CoRR
Yuan Gong, Boyang Li, Christian Poellabauer, Yiyu Shi
2019 A* conf
Second-Order Non-Local Attention Networks for Person Re-Identification.
ICCV
Bryan Bryan, Yuan Gong, Yizhe Zhang, Christian Poellabauer
2019 J jnl
Second-order Non-local Attention Networks for Person Re-identification.
CoRR
Bryan (Ning) Xia, Yuan Gong, Yizhe Zhang, Christian Poellabauer
2018 J jnl
An Overview of Vulnerabilities of Voice Controlled Systems.
CoRR
Yuan Gong, Christian Poellabauer
2018 — conf
Automatic Autism Spectrum Disorder Detection Using Everyday Vocalizations Captured by Smart Devices.
BCB
Yuan Gong, Hasini Yatawatte, Christian Poellabauer, Sandra L. Schneider, Susan Latham
2018 A conf
Impact of Aliasing on Deep CNN-Based End-to-End Acoustic Models.
INTERSPEECH
Yuan Gong, Christian Poellabauer
2018 — conf
Improving LIWC Using Soft Word Matching.
BCB
Yuan Gong, Kevin Shin, Christian Poellabauer
2018 B conf
Protecting Voice Controlled Systems Using Sound Source Identification Based on Acoustic Cues.
ICCCN
Yuan Gong, Christian Poellabauer
2018 J jnl
Protecting Voice Controlled Systems Using Sound Source Identification Based on Acoustic Cues.
CoRR
Yuan Gong, Christian Poellabauer
2018 J jnl
Topic Modeling Based Multi-modal Depression Detection.
CoRR
Yuan Gong, Christian Poellabauer
2018 J jnl
Towards Learning Fine-Grained Disentangled Representations from Speech.
CoRR
Yuan Gong, Christian Poellabauer
2017 — conf
Continuous Assessment of Children's Emotional States Using Acoustic Analysis.
ICHI
Yuan Gong, Christian Poellabauer
2017 J jnl
Crafting Adversarial Examples For Speech Paralinguistics Applications.
CoRR
Yuan Gong, Christian Poellabauer
2017 — conf
Topic Modeling Based Multi-modal Depression Detection.
AVEC@ACM Multimedia
Yuan Gong, Christian Poellabauer