Bowen Shi

68 papers A* 9A 9C 2Misc 4Journal 36Unranked 8
YearRankTypeTitle / Venue / Authors
2026 J jnl
SAM Audio Judge: A Unified Multimodal Framework for Perceptual Evaluation of Audio Separation.
CoRR
Helin Wang, Bowen Shi, Andros Tjandra, John Hoffman, Yi-Chiao Wu, Apoorv Vyas, Najim Dehak, Ann Lee, Wei-Ning Hsu
2025 A conf
Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation.
INTERSPEECH
Mu Yang, Bowen Shi, Matthew Le, Wei-Ning Hsu, Andros Tjandra
2025 J jnl
MR-FlowDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generation.
CoRR
Alon Ziv, Sanyuan Chen, Andros Tjandra, Yossi Adi, Wei-Ning Hsu, Bowen Shi
2025 C conf
Meta Audiobox Aesthetics: Unified Automatic Assessment for Speech, Music and Sound.
ASRU
Andros Tjandra, Yi-Chiao Wu, Baishan Guo, John Hoffman, Brian Ellis, Apoorv Vyas, Bowen Shi, Sanyuan Chen, Matt Le, Nick Zacharov, Carleigh Wood, Ann Lee, Wei-Ning Hsu
2025 J jnl
Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound.
CoRR
Andros Tjandra, Yi-Chiao Wu, Baishan Guo, John Hoffman, Brian Ellis, Apoorv Vyas, Bowen Shi, Sanyuan Chen, Matt Le, Nick Zacharov, Carleigh Wood, Ann Lee, Wei-Ning Hsu
2025 J jnl
SAM Audio: Segment Anything in Audio.
CoRR
Bowen Shi, Andros Tjandra, John Hoffman, Helin Wang, Yi-Chiao Wu, Luya Gao, Julius Richter, Matt Le, Apoorv Vyas, Sanyuan Chen, Christoph Feichtenhofer, Piotr Dollár, Wei-Ning Hsu, Ann Lee
2024 J jnl
Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation.
CoRR
Mu Yang, Bowen Shi, Matthew Le, Wei-Ning Hsu, Andros Tjandra
2024 — conf
Data Efficient Reflow for Few Step Audio Generation.
SLT
Lemeng Wu, Zhaoheng Ni, Bowen Shi, Gaël Le Lan, Anurag Kumar, Varun Nagaraja, Xinhao Mei, Yunyang Xiong, Bilge Soran, Raghuraman Krishnamoorthi, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
2024 A* conf
Generative Pre-training for Speech with Flow Matching.
ICLR
Alexander H. Liu, Matthew Le, Apoorv Vyas, Bowen Shi, Andros Tjandra, Wei-Ning Hsu
2024 J jnl
High Fidelity Text-Guided Music Generation and Editing via Single-Stage Flow Matching.
CoRR
Gaël Le Lan, Bowen Shi, Zhaoheng Ni, Sidd Srinivasan, Anurag Kumar, Brian Ellis, David Kant, Varun Nagaraja, Ernie Chang, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
2024 A conf
Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning.
INTERSPEECH
Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu
2024 J jnl
Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning.
CoRR
Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu
2024 Misc conf
M2BART: Multilingual and Multimodal Encoder-Decoder Pre-Training for Any-to-Any Machine Translation.
ICASSP
Peng-Jen Chen, Bowen Shi, Kelvin Niu, Ann Lee, Wei-Ning Hsu
2024 A* conf
MusicFlow: Cascaded Flow Matching for Text Guided Music Generation.
ICML
K. R. Prajwal, Bowen Shi, Matthew Le, Apoorv Vyas, Andros Tjandra, Mahi Luthra, Baishan Guo, Huiyu Wang, Triantafyllos Afouras, David Kant, Wei-Ning Hsu
2024 J jnl
MusicFlow: Cascaded Flow Matching for Text Guided Music Generation.
CoRR
K. R. Prajwal, Bowen Shi, Matthew Le, Apoorv Vyas, Andros Tjandra, Mahi Luthra, Baishan Guo, Huiyu Wang, Triantafyllos Afouras, David Kant, Wei-Ning Hsu
2024 J jnl
Scaling Speech Technology to 1, 000+ Languages.
J. Mach. Learn. Res.
Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli
2024 — conf
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception.
ACL (1)
HyoJung Han, Mohamed Anwar, Juan Pino, Wei-Ning Hsu, Marine Carpuat, Bowen Shi, Changhan Wang
2024 J jnl
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception.
CoRR
HyoJung Han, Mohamed Anwar, Juan Pino, Wei-Ning Hsu, Marine Carpuat, Bowen Shi, Changhan Wang
2023 J jnl
Audiobox: Unified Audio Generation with Natural Language Prompts.
CoRR
Apoorv Vyas, Bowen Shi, Matthew Le, Andros Tjandra, Yi-Chiao Wu, Baishan Guo, Jiemin Zhang, Xinyue Zhang, Robert Adkins, William Ngan, Jeff Wang, Ivan Cruz, Bapi Akula, Akinniyi Akinyemi, Brian Ellis, Rashel Moritz, Yael Yungster, Alice Rakotoarison, Liang Tan, Chris Summers, Carleigh Wood, Joshua Lane, Mary Williamson, Wei-Ning Hsu
2023 Misc conf
Comparative Layer-Wise Analysis of Self-Supervised Speech Models.
ICASSP
Ankita Pasad, Bowen Shi, Karen Livescu
2023 J jnl
EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis.
CoRR
Tu Anh Nguyen, Wei-Ning Hsu, Antony D'Avirro, Bowen Shi, Itai Gat, Maryam Fazel-Zarandi, Tal Remez, Jade Copet, Gabriel Synnaeve, Michael Hassid, Felix Kreuk, Yossi Adi, Emmanuel Dupoux
2023 A conf
Expresso: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis.
INTERSPEECH
Tu Anh Nguyen, Wei-Ning Hsu, Antony D'Avirro, Bowen Shi, Itai Gat, Maryam Fazel-Zarandi, Tal Remez, Jade Copet, Gabriel Synnaeve, Michael Hassid, Felix Kreuk, Yossi Adi, Emmanuel Dupoux
2023 J jnl
Generative Pre-training for Speech with Flow Matching.
CoRR
Alexander H. Liu, Matt Le, Apoorv Vyas, Bowen Shi, Andros Tjandra, Wei-Ning Hsu
2023 A conf
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation.
INTERSPEECH
Mohamed Anwar, Bowen Shi, Vedanuj Goswami, Wei-Ning Hsu, Juan Pino, Changhan Wang
2023 J jnl
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation.
CoRR
Mohamed Anwar, Bowen Shi, Vedanuj Goswami, Wei-Ning Hsu, Juan Pino, Changhan Wang
2023 A* conf
ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Regeneration.
CVPR
Wei-Ning Hsu, Tal Remez, Bowen Shi, Jacob Donley, Yossi Adi
2023 J jnl
Scaling Speech Technology to 1, 000+ Languages.
CoRR
Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli
2023 — conf
TTIC's Submission to WMT-SLT 23.
WMT
Marcelo Sandoval-Castañeda, Yanhong Li, Bowen Shi, Diane Brentari, Karen Livescu, Gregory Shakhnarovich
2023 A* conf
Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale.
NeurIPS
Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari, Rashel Moritz, Mary Williamson, Vimal Manohar, Yossi Adi, Jay Mahadeokar, Wei-Ning Hsu
2023 J jnl
Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale.
CoRR
Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari, Rashel Moritz, Mary Williamson, Vimal Manohar, Yossi Adi, Jay Mahadeokar, Wei-Ning Hsu
2022 J jnl
A Single Self-Supervised Model for Many Speech Modalities Enables Zero-Shot Modality Transfer.
CoRR
Wei-Ning Hsu, Bowen Shi
2022 J jnl
Comparative layer-wise analysis of self-supervised speech models.
CoRR
Ankita Pasad, Bowen Shi, Karen Livescu
2022 A* conf
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction.
ICLR
Bowen Shi, Wei-Ning Hsu, Kushal Lakhotia, Abdelrahman Mohamed
2022 J jnl
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction.
CoRR
Bowen Shi, Wei-Ning Hsu, Kushal Lakhotia, Abdelrahman Mohamed
2022 A conf
Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT.
INTERSPEECH
Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu
2022 J jnl
Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT.
CoRR
Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu
2022 A* conf
Open-Domain Sign Language Translation Learned from Online Video.
EMNLP
Bowen Shi, Diane Brentari, Gregory Shakhnarovich, Karen Livescu
2022 J jnl
Open-Domain Sign Language Translation Learned from Online Video.
CoRR
Bowen Shi, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2022 J jnl
ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement.
CoRR
Wei-Ning Hsu, Tal Remez, Bowen Shi, Jacob Donley, Yossi Adi
2022 A conf
Robust Self-Supervised Audio-Visual Speech Recognition.
INTERSPEECH
Bowen Shi, Wei-Ning Hsu, Abdelrahman Mohamed
2022 J jnl
Robust Self-Supervised Audio-Visual Speech Recognition.
CoRR
Bowen Shi, Wei-Ning Hsu, Abdelrahman Mohamed
2022 — conf
Searching for fingerspelled content in American Sign Language.
ACL (1)
Bowen Shi, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2022 J jnl
Searching for fingerspelled content in American Sign Language.
CoRR
Bowen Shi, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2022 — conf
TTIC's WMT-SLT 22 Sign Language Translation System.
WMT
Bowen Shi, Diane Brentari, Gregory Shakhnarovich, Karen Livescu
2022 A* conf
u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modality.
NeurIPS
Wei-Ning Hsu, Bowen Shi
2021 A* conf
Fingerspelling Detection in American Sign Language.
CVPR
Bowen Shi, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2021 J jnl
Fingerspelling Detection in American Sign Language.
CoRR
Bowen Shi, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2021 — conf
Whole-Word Segmental Speech Recognition with Acoustic Word Embeddings.
SLT
Bowen Shi, Shane Settle, Karen Livescu
2020 — conf
A Cross-Task Analysis of Text Span Representations.
RepL4NLP@ACL
Shubham Toshniwal, Haoyue Shi, Bowen Shi, Lingyu Gao, Karen Livescu, Kevin Gimpel
2020 J jnl
A Cross-Task Analysis of Text Span Representations.
CoRR
Shubham Toshniwal, Haoyue Shi, Bowen Shi, Lingyu Gao, Karen Livescu, Kevin Gimpel
2020 A conf
A Joint Framework for Audio Tagging and Weakly Supervised Acoustic Event Detection Using DenseNet with Global Average Pooling.
INTERSPEECH
Chieh-Chi Kao, Bowen Shi, Ming Sun, Chao Wang
2020 J jnl
A Joint Framework for Audio Tagging and Weakly Supervised Acoustic Event Detection Using DenseNet with Global Average Pooling.
CoRR
Chieh-Chi Kao, Bowen Shi, Ming Sun, Chao Wang
2020 Misc conf
Few-Shot Acoustic Event Detection Via Meta Learning.
ICASSP
Bowen Shi, Ming Sun, Krishna C. Puvvada, Chieh-Chi Kao, Spyros Matsoukas, Chao Wang
2020 J jnl
Few-shot acoustic event detection via meta-learning.
CoRR
Bowen Shi, Ming Sun, Krishna C. Puvvada, Chieh-Chi Kao, Spyros Matsoukas, Chao Wang
2020 J jnl
Whole-Word Segmental Speech Recognition with Acoustic Word Embeddings.
CoRR
Bowen Shi, Shane Settle, Karen Livescu
2019 J jnl
Compression of Acoustic Event Detection Models With Quantized Distillation.
CoRR
Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic, Spyros Matsoukas, Chao Wang
2019 J jnl
Compression of Acoustic Event Detection Models with Low-rank Matrix Factorization and Quantization Training.
CoRR
Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic, Spyros Matsoukas, Chao Wang
2019 A conf
Compression of Acoustic Event Detection Models with Quantized Distillation.
INTERSPEECH
Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic, Spyros Matsoukas, Chao Wang
2019 A* conf
Fingerspelling Recognition in the Wild With Iterative Visual Attention.
ICCV
Bowen Shi, Aurora Martinez Del Rio, Jonathan Keane, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2019 J jnl
Fingerspelling recognition in the wild with iterative visual attention.
CoRR
Bowen Shi, Aurora Martinez Del Rio, Jonathan Keane, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2019 A conf
On the Contributions of Visual and Textual Supervision in Low-Resource Semantic Speech Retrieval.
INTERSPEECH
Ankita Pasad, Bowen Shi, Herman Kamper, Karen Livescu
2019 J jnl
On the Contributions of Visual and Textual Supervision in Low-resource Semantic Speech Retrieval.
CoRR
Ankita Pasad, Bowen Shi, Herman Kamper, Karen Livescu
2019 Misc conf
Semi-supervised Acoustic Event Detection Based on Tri-training.
ICASSP
Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic, Spyros Matsoukas, Chao Wang
2019 J jnl
Semi-supervised Acoustic Event Detection based on tri-training.
CoRR
Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic, Spyros Matsoukas, Chao Wang
2018 — conf
American Sign Language Fingerspelling Recognition in the Wild.
SLT
Bowen Shi, Aurora Martinez Del Rio, Jonathan Keane, Jonathan Michaux, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2018 J jnl
American Sign Language fingerspelling recognition in the wild.
CoRR
Bowen Shi, Aurora Martinez Del Rio, Jonathan Keane, Jonathan Michaux, Diane Brentari, Greg Shakhnarovich, Karen Livescu
2017 C conf
Multitask training with unlabeled data for end-to-end sign language fingerspelling recognition.
ASRU
Bowen Shi, Karen Livescu
2017 J jnl
Multitask training with unlabeled data for end-to-end sign language fingerspelling recognition.
CoRR
Bowen Shi, Karen Livescu