Wei-Ning Hsu - RankMe

159 papers A* 16A 20B 2C 6Misc 9Journal 83Unranked 23

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	SAM Audio Judge: A Unified Multimodal Framework for Perceptual Evaluation of Audio Separation. CoRR Helin Wang, Bowen Shi, Andros Tjandra, John Hoffman, Yi-Chiao Wu, Apoorv Vyas, Najim Dehak, Ann Lee, Wei-Ning Hsu
2025	A	`conf`	Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation. INTERSPEECH Mu Yang, Bowen Shi, Matthew Le, Wei-Ning Hsu, Andros Tjandra
2025	A*	`conf`	FlowDec: A flow-based full-band general audio codec with high perceptual quality. ICLR Simon Welker, Matthew Le, Ricky T. Q. Chen, Wei-Ning Hsu, Timo Gerkmann, Alexander Richard, Yi-Chiao Wu
2025	J	`jnl`	FlowDec: A flow-based full-band general audio codec with high perceptual quality. CoRR Simon Welker, Matthew Le, Ricky T. Q. Chen, Wei-Ning Hsu, Timo Gerkmann, Alexander Richard, Yi-Chiao Wu
2025	J	`jnl`	MR-FlowDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generation. CoRR Alon Ziv, Sanyuan Chen, Andros Tjandra, Yossi Adi, Wei-Ning Hsu, Bowen Shi
2025	C	`conf`	Meta Audiobox Aesthetics: Unified Automatic Assessment for Speech, Music and Sound. ASRU Andros Tjandra, Yi-Chiao Wu, Baishan Guo, John Hoffman, Brian Ellis, Apoorv Vyas, Bowen Shi, Sanyuan Chen, Matt Le, Nick Zacharov, Carleigh Wood, Ann Lee, Wei-Ning Hsu
2025	J	`jnl`	Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound. CoRR Andros Tjandra, Yi-Chiao Wu, Baishan Guo, John Hoffman, Brian Ellis, Apoorv Vyas, Bowen Shi, Sanyuan Chen, Matt Le, Nick Zacharov, Carleigh Wood, Ann Lee, Wei-Ning Hsu
2025	J	`jnl`	Pushing the Frontier of Audiovisual Perception with Large-Scale Multimodal Correspondence Learning. CoRR Apoorv Vyas, Heng-Jui Chang, Cheng-Fu Yang, Po-Yao Huang, Luya Gao, Julius Richter, Sanyuan Chen, Matt Le, Piotr Dollár, Christoph Feichtenhofer, Ann Lee, Wei-Ning Hsu
2025	J	`jnl`	SAM Audio: Segment Anything in Audio. CoRR Bowen Shi, Andros Tjandra, John Hoffman, Helin Wang, Yi-Chiao Wu, Luya Gao, Julius Richter, Matt Le, Apoorv Vyas, Sanyuan Chen, Christoph Feichtenhofer, Piotr Dollár, Wei-Ning Hsu, Ann Lee
2025	C	`conf`	The AudioMOS Challenge 2025. ASRU Wen-Chin Huang, Hui Wang, Cheng Liu, Yi-Chiao Wu, Andros Tjandra, Wei-Ning Hsu, Erica Cooper, Yong Qin, Tomoki Toda
2025	J	`jnl`	The AudioMOS Challenge 2025. CoRR Wen-Chin Huang, Hui Wang, Cheng Liu, Yi-Chiao Wu, Andros Tjandra, Wei-Ning Hsu, Erica Cooper, Yong Qin, Tomoki Toda
2024	—	`conf`	Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos. ECCV (70) Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman
2024	J	`jnl`	Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos. CoRR Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman
2024	—	`conf`	Attention or Convolution: Transformer Encoders in Audio Language Models for Inference Efficiency. ICASSP Workshops Sungho Jeon, Ching-Feng Yeh, Hakan Inan, Wei-Ning Hsu, Rashi Rungta, Yashar Mehdad, Daniel Bikel
2024	J	`jnl`	Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation. CoRR Mu Yang, Bowen Shi, Matthew Le, Wei-Ning Hsu, Andros Tjandra
2024	—	`conf`	Data Efficient Reflow for Few Step Audio Generation. SLT Lemeng Wu, Zhaoheng Ni, Bowen Shi, Gaël Le Lan, Anurag Kumar, Varun Nagaraja, Xinhao Mei, Yunyang Xiong, Bilge Soran, Raghuraman Krishnamoorthi, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
2024	A*	`conf`	Generative Pre-training for Speech with Flow Matching. ICLR Alexander H. Liu, Matthew Le, Apoorv Vyas, Bowen Shi, Andros Tjandra, Wei-Ning Hsu
2024	J	`jnl`	High Fidelity Text-Guided Music Generation and Editing via Single-Stage Flow Matching. CoRR Gaël Le Lan, Bowen Shi, Zhaoheng Ni, Sidd Srinivasan, Anurag Kumar, Brian Ellis, David Kant, Varun Nagaraja, Ernie Chang, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
2024	A	`conf`	Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning. INTERSPEECH Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu
2024	J	`jnl`	Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning. CoRR Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu
2024	Misc	`conf`	M2BART: Multilingual and Multimodal Encoder-Decoder Pre-Training for Any-to-Any Machine Translation. ICASSP Peng-Jen Chen, Bowen Shi, Kelvin Niu, Ann Lee, Wei-Ning Hsu
2024	A*	`conf`	MusicFlow: Cascaded Flow Matching for Text Guided Music Generation. ICML K. R. Prajwal, Bowen Shi, Matthew Le, Apoorv Vyas, Andros Tjandra, Mahi Luthra, Baishan Guo, Huiyu Wang, Triantafyllos Afouras, David Kant, Wei-Ning Hsu
2024	J	`jnl`	MusicFlow: Cascaded Flow Matching for Text Guided Music Generation. CoRR K. R. Prajwal, Bowen Shi, Matthew Le, Apoorv Vyas, Andros Tjandra, Mahi Luthra, Baishan Guo, Huiyu Wang, Triantafyllos Afouras, David Kant, Wei-Ning Hsu
2024	J	`jnl`	Scaling Speech Technology to 1, 000+ Languages. J. Mach. Learn. Res. Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli
2024	A*	`conf`	Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization. ACM Multimedia Navonil Majumder, Chia-Yu Hung, Deepanway Ghosal, Wei-Ning Hsu, Rada Mihalcea, Soujanya Poria
2024	J	`jnl`	Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization. CoRR Navonil Majumder, Chia-Yu Hung, Deepanway Ghosal, Wei-Ning Hsu, Rada Mihalcea, Soujanya Poria
2024	—	`conf`	XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception. ACL (1) HyoJung Han, Mohamed Anwar, Juan Pino, Wei-Ning Hsu, Marine Carpuat, Bowen Shi, Changhan Wang
2024	J	`jnl`	XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception. CoRR HyoJung Han, Mohamed Anwar, Juan Pino, Wei-Ning Hsu, Marine Carpuat, Bowen Shi, Changhan Wang
2023	J	`jnl`	AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations. CoRR Jiachen Lian, Alexei Baevski, Wei-Ning Hsu, Michael Auli
2023	J	`jnl`	Attention or Convolution: Transformer Encoders in Audio Language Models for Inference Efficiency. CoRR Sungho Jeon, Ching-Feng Yeh, Hakan Inan, Wei-Ning Hsu, Rashi Rungta, Yashar Mehdad, Daniel Bikel
2023	J	`jnl`	Audiobox: Unified Audio Generation with Natural Language Prompts. CoRR Apoorv Vyas, Bowen Shi, Matthew Le, Andros Tjandra, Yi-Chiao Wu, Baishan Guo, Jiemin Zhang, Xinyue Zhang, Robert Adkins, William Ngan, Jeff Wang, Ivan Cruz, Bapi Akula, Akinniyi Akinyemi, Brian Ellis, Rashel Moritz, Yael Yungster, Alice Rakotoarison, Liang Tan, Chris Summers, Carleigh Wood, Joshua Lane, Mary Williamson, Wei-Ning Hsu
2023	C	`conf`	Av-Data2Vec: Self-Supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations. ASRU Jiachen Lian, Alexei Baevski, Wei-Ning Hsu, Michael Auli
2023	J	`jnl`	Cocktail HuBERT: Generalized Self-Supervised Pre-training for Mixture and Single-Source Speech. CoRR Maryam Fazel-Zarandi, Wei-Ning Hsu
2023	Misc	`conf`	Cocktail Hubert: Generalized Self-Supervised Pre-Training for Mixture and Single-Source Speech. ICASSP Maryam Fazel-Zarandi, Wei-Ning Hsu
2023	Misc	`conf`	Continual Learning for On-Device Speech Recognition Using Disentangled Conformers. ICASSP Anuj Diwan, Ching-Feng Yeh, Wei-Ning Hsu, Paden Tomasello, Eunsol Choi, David Harwath, Abdelrahman Mohamed
2023	A*	`conf`	DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning. NeurIPS Alexander H. Liu, Heng-Jui Chang, Michael Auli, Wei-Ning Hsu, James R. Glass
2023	J	`jnl`	DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning. CoRR Alexander H. Liu, Heng-Jui Chang, Michael Auli, Wei-Ning Hsu, James R. Glass
2023	Misc	`conf`	Do Coarser Units Benefit Cluster Prediction-Based Speech Pre-Training? ICASSP Ali Elkahky, Wei-Ning Hsu, Paden Tomasello, Tu Anh Nguyen, Robin Algayres, Yossi Adi, Jade Copet, Emmanuel Dupoux, Abdelrahman Mohamed
2023	J	`jnl`	EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis. CoRR Tu Anh Nguyen, Wei-Ning Hsu, Antony D'Avirro, Bowen Shi, Itai Gat, Maryam Fazel-Zarandi, Tal Remez, Jade Copet, Gabriel Synnaeve, Michael Hassid, Felix Kreuk, Yossi Adi, Emmanuel Dupoux
2023	A*	`conf`	Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language. ICML Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli
2023	J	`jnl`	Efficient Speech Representation Learning with Low-Bit Quantization. CoRR Ching-Feng Yeh, Wei-Ning Hsu, Paden Tomasello, Abdelrahman Mohamed
2023	A	`conf`	Expresso: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis. INTERSPEECH Tu Anh Nguyen, Wei-Ning Hsu, Antony D'Avirro, Bowen Shi, Itai Gat, Maryam Fazel-Zarandi, Tal Remez, Jade Copet, Gabriel Synnaeve, Michael Hassid, Felix Kreuk, Yossi Adi, Emmanuel Dupoux
2023	J	`jnl`	Generative Pre-training for Speech with Flow Matching. CoRR Alexander H. Liu, Matt Le, Apoorv Vyas, Bowen Shi, Andros Tjandra, Wei-Ning Hsu
2023	J	`jnl`	Generative Spoken Dialogue Language Modeling. Trans. Assoc. Comput. Linguistics Tu Anh Nguyen, Eugene Kharitonov, Jade Copet, Yossi Adi, Wei-Ning Hsu, Ali Elkahky, Paden Tomasello, Robin Algayres, Benoît Sagot, Abdelrahman Mohamed, Emmanuel Dupoux
2023	J	`jnl`	Low-Resource Self-Supervised Learning with SSL-Enhanced TTS. CoRR Po-Chun Hsu, Ali Elkahky, Wei-Ning Hsu, Yossi Adi, Tu Anh Nguyen, Jade Copet, Emmanuel Dupoux, Hung-yi Lee, Abdelrahman Mohamed
2023	—	`conf`	Measuring the Impact of Domain Factors in Self-Supervised Pre-Training. ICASSP Workshops Ramon Sanabria, Wei-Ning Hsu, Alexei Baevski, Michael Auli
2023	A	`conf`	MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation. INTERSPEECH Mohamed Anwar, Bowen Shi, Vedanuj Goswami, Wei-Ning Hsu, Juan Pino, Changhan Wang
2023	J	`jnl`	MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation. CoRR Mohamed Anwar, Bowen Shi, Vedanuj Goswami, Wei-Ning Hsu, Juan Pino, Changhan Wang
2023	A*	`conf`	ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Regeneration. CVPR Wei-Ning Hsu, Tal Remez, Bowen Shi, Jacob Donley, Yossi Adi
2023	A*	`conf`	Scaling Laws for Generative Mixed-Modal Language Models. ICML Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
2023	J	`jnl`	Scaling Laws for Generative Mixed-Modal Language Models. CoRR Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
2023	J	`jnl`	Scaling Speech Technology to 1, 000+ Languages. CoRR Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli
2023	—	`conf`	Simple and Effective Unsupervised Speech Translation. ACL (1) Changhan Wang, Hirofumi Inaguma, Peng-Jen Chen, Ilia Kulikov, Yun Tang, Wei-Ning Hsu, Michael Auli, Juan Pino
2023	—	`conf`	Speech-to-Speech Translation for a Real-world Unwritten Language. ACL (Findings) Peng-Jen Chen, Kevin Tran, Yilin Yang, Jingfei Du, Justine Kao, Yu-An Chung, Paden Tomasello, Paul-Ambroise Duquenne, Holger Schwenk, Hongyu Gong, Hirofumi Inaguma, Sravya Popuri, Changhan Wang, Juan Pino, Wei-Ning Hsu, Ann Lee
2023	—	`conf`	Toward Joint Language Modeling for Speech Units and Text. EMNLP (Findings) Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli
2023	J	`jnl`	Toward Joint Language Modeling for Speech Units and Text. CoRR Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli
2023	A*	`conf`	Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale. NeurIPS Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari, Rashel Moritz, Mary Williamson, Vimal Manohar, Yossi Adi, Jay Mahadeokar, Wei-Ning Hsu
2023	J	`jnl`	Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale. CoRR Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari, Rashel Moritz, Mary Williamson, Vimal Manohar, Yossi Adi, Jay Mahadeokar, Wei-Ning Hsu
2022	J	`jnl`	A Single Self-Supervised Model for Many Speech Modalities Enables Zero-Shot Modality Transfer. CoRR Wei-Ning Hsu, Bowen Shi
2022	J	`jnl`	Continual Learning for On-Device Speech Recognition using Disentangled Conformers. CoRR Anuj Diwan, Ching-Feng Yeh, Wei-Ning Hsu, Paden Tomasello, Eunsol Choi, David Harwath, Abdelrahman Mohamed
2022	—	`conf`	Direct Speech-to-Speech Translation With Discrete Units. ACL (1) Ann Lee, Peng-Jen Chen, Changhan Wang, Jiatao Gu, Sravya Popuri, Xutai Ma, Adam Polyak, Yossi Adi, Qing He, Yun Tang, Juan Pino, Wei-Ning Hsu
2022	J	`jnl`	Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language. CoRR Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli
2022	A	`conf`	Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentation. INTERSPEECH Sravya Popuri, Peng-Jen Chen, Changhan Wang, Juan Pino, Yossi Adi, Jiatao Gu, Wei-Ning Hsu, Ann Lee
2022	J	`jnl`	Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentation. CoRR Sravya Popuri, Peng-Jen Chen, Changhan Wang, Juan Pino, Yossi Adi, Jiatao Gu, Wei-Ning Hsu, Ann Lee
2022	J	`jnl`	Generative Spoken Dialogue Language Modeling. CoRR Tu Anh Nguyen, Eugene Kharitonov, Jade Copet, Yossi Adi, Wei-Ning Hsu, Ali Elkahky, Paden Tomasello, Robin Algayres, Benoît Sagot, Abdelrahman Mohamed, Emmanuel Dupoux
2022	A*	`conf`	Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction. ICLR Bowen Shi, Wei-Ning Hsu, Kushal Lakhotia, Abdelrahman Mohamed
2022	J	`jnl`	Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction. CoRR Bowen Shi, Wei-Ning Hsu, Kushal Lakhotia, Abdelrahman Mohamed
2022	A	`conf`	Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT. INTERSPEECH Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu
2022	J	`jnl`	Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT. CoRR Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu
2022	J	`jnl`	Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training. CoRR Ramon Sanabria, Wei-Ning Hsu, Alexei Baevski, Michael Auli
2022	A	`conf`	On-demand compute reduction with stochastic wav2vec 2.0. INTERSPEECH Apoorv Vyas, Wei-Ning Hsu, Michael Auli, Alexei Baevski
2022	J	`jnl`	On-demand compute reduction with stochastic wav2vec 2.0. CoRR Apoorv Vyas, Wei-Ning Hsu, Michael Auli, Alexei Baevski
2022	J	`jnl`	ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement. CoRR Wei-Ning Hsu, Tal Remez, Bowen Shi, Jacob Donley, Yossi Adi
2022	A	`conf`	Robust Self-Supervised Audio-Visual Speech Recognition. INTERSPEECH Bowen Shi, Wei-Ning Hsu, Abdelrahman Mohamed
2022	J	`jnl`	Robust Self-Supervised Audio-Visual Speech Recognition. CoRR Bowen Shi, Wei-Ning Hsu, Abdelrahman Mohamed
2022	J	`jnl`	STOP: A dataset for Spoken Task Oriented Semantic Parsing. CoRR Paden Tomasello, Akshat Shrivastava, Daniel Lazar, Po-Chun Hsu, Duc Le, Adithya Sagar, Ali Elkahky, Jade Copet, Wei-Ning Hsu, Yossef Mordechay, Robin Algayres, Tu Anh Nguyen, Emmanuel Dupoux, Luke Zettlemoyer, Abdelrahman Mohamed
2022	A	`conf`	Simple and Effective Unsupervised Speech Synthesis. INTERSPEECH Alexander H. Liu, Cheng-I Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass
2022	J	`jnl`	Simple and Effective Unsupervised Speech Synthesis. CoRR Alexander H. Liu, Cheng-I Jeff Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass
2022	J	`jnl`	Simple and Effective Unsupervised Speech Translation. CoRR Changhan Wang, Hirofumi Inaguma, Peng-Jen Chen, Ilia Kulikov, Yun Tang, Wei-Ning Hsu, Michael Auli, Juan Pino
2022	J	`jnl`	Speech-to-Speech Translation For A Real-world Unwritten Language. CoRR Peng-Jen Chen, Kevin Tran, Yilin Yang, Jingfei Du, Justine Kao, Yu-An Chung, Paden Tomasello, Paul-Ambroise Duquenne, Holger Schwenk, Hongyu Gong, Hirofumi Inaguma, Sravya Popuri, Changhan Wang, Juan Miguel Pino, Wei-Ning Hsu, Ann Lee
2022	—	`conf`	Stop: A Dataset for Spoken Task Oriented Semantic Parsing. SLT Paden Tomasello, Akshat Shrivastava, Daniel Lazar, Po-Chun Hsu, Duc Le, Adithya Sagar, Ali Elkahky, Jade Copet, Wei-Ning Hsu, Yossi Adi, Robin Algayres, Tu Anh Nguyen, Emmanuel Dupoux, Luke Zettlemoyer, Abdelrahman Mohamed
2022	—	`conf`	Text-Free Prosody-Aware Generative Spoken Language Modeling. ACL (1) Eugene Kharitonov, Ann Lee, Adam Polyak, Yossi Adi, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Morgane Rivière, Abdelrahman Mohamed, Emmanuel Dupoux, Wei-Ning Hsu
2022	A*	`conf`	Textless Speech Emotion Conversion using Discrete & Decomposed Representations. EMNLP Felix Kreuk, Adam Polyak, Jade Copet, Eugene Kharitonov, Tu Anh Nguyen, Morgane Rivière, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi
2022	—	`conf`	Textless Speech-to-Speech Translation on Real Data. NAACL-HLT Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Yossi Adi, Juan Miguel Pino, Jiatao Gu, Wei-Ning Hsu
2022	—	`conf`	Towards End-to-End Unsupervised Speech Recognition. SLT Alexander H. Liu, Wei-Ning Hsu, Michael Auli, Alexei Baevski
2022	J	`jnl`	Towards End-to-end Unsupervised Speech Recognition. CoRR Alexander H. Liu, Wei-Ning Hsu, Michael Auli, Alexei Baevski
2022	—	`conf`	Unified Speech-Text Pre-training for Speech Translation and Recognition. ACL (1) Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Miguel Pino
2022	J	`jnl`	Unified Speech-Text Pre-training for Speech Translation and Recognition. CoRR Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Miguel Pino
2022	A*	`conf`	data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language. ICML Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
2022	J	`jnl`	data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language. CoRR Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
2022	J	`jnl`	textless-lib: a Library for Textless Spoken Language Processing. CoRR Eugene Kharitonov, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Paden Tomasello, Ann Lee, Ali Elkahky, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi
2022	A*	`conf`	u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modality. NeurIPS Wei-Ning Hsu, Bowen Shi
2021	J	`jnl`	Direct simultaneous speech to speech translation. CoRR Xutai Ma, Hongyu Gong, Danni Liu, Ann Lee, Yun Tang, Peng-Jen Chen, Wei-Ning Hsu, Kenneth Heafield, Phillip Koehn, Juan Miguel Pino
2021	J	`jnl`	Direct speech-to-speech translation with discrete units. CoRR Ann Lee, Peng-Jen Chen, Changhan Wang, Jiatao Gu, Xutai Ma, Adam Polyak, Yossi Adi, Qing He, Yun Tang, Juan Miguel Pino, Wei-Ning Hsu
2021	J	`jnl`	Generative Spoken Language Modeling from Raw Audio. CoRR Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux
2021	J	`jnl`	HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units. CoRR Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed
2021	J	`jnl`	HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units. IEEE ACM Trans. Audio Speech Lang. Process. Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed
2021	Misc	`conf`	Hubert: How Much Can a Bad Teacher Benefit ASR Pre-Training? ICASSP Wei-Ning Hsu, Yao-Hung Hubert Tsai, Benjamin Bolte, Ruslan Salakhutdinov, Abdelrahman Mohamed
2021	C	`conf`	Kaizen: Continuously Improving Teacher Using Exponential Moving Average for Semi-Supervised Speech Recognition. ASRU Vimal Manohar, Tatiana Likhomanenko, Qiantong Xu, Wei-Ning Hsu, Ronan Collobert, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
2021	J	`jnl`	Kaizen: Continuously improving teacher using Exponential Moving Average for semi-supervised speech recognition. CoRR Vimal Manohar, Tatiana Likhomanenko, Qiantong Xu, Wei-Ning Hsu, Ronan Collobert, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
2021	A	`conf`	Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training. Interspeech Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu, Vineel Pratap, Jacob Kahn, Ann Lee, Ronan Collobert, Gabriel Synnaeve, Michael Auli
2021	J	`jnl`	Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training. CoRR Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu, Vineel Pratap, Jacob Kahn, Ann Lee, Ronan Collobert, Gabriel Synnaeve, Michael Auli
2021	—	`conf`	Semi-Supervised end-to-end Speech Recognition via Local Prior Matching. SLT Wei-Ning Hsu, Ann Lee, Gabriel Synnaeve, Awni Y. Hannun
2021	A	`conf`	Speech Resynthesis from Discrete Disentangled Self-Supervised Representations. Interspeech Adam Polyak, Yossi Adi, Jade Copet, Eugene Kharitonov, Kushal Lakhotia, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux
2021	J	`jnl`	Speech Resynthesis from Discrete Disentangled Self-Supervised Representations. CoRR Adam Polyak, Yossi Adi, Jade Copet, Eugene Kharitonov, Kushal Lakhotia, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux
2021	—	`conf`	Text-Free Image-to-Speech Synthesis Using Learned Segmental Units. ACL/IJCNLP (1) Wei-Ning Hsu, David Harwath, Tyler Miller, Christopher Song, James R. Glass
2021	J	`jnl`	Text-Free Prosody-Aware Generative Spoken Language Modeling. CoRR Eugene Kharitonov, Ann Lee, Adam Polyak, Yossi Adi, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Morgane Rivière, Abdelrahman Mohamed, Emmanuel Dupoux, Wei-Ning Hsu
2021	J	`jnl`	Textless Speech Emotion Conversion using Decomposed and Discrete Representations. CoRR Felix Kreuk, Adam Polyak, Jade Copet, Eugene Kharitonov, Tu Anh Nguyen, Morgane Rivière, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi
2021	J	`jnl`	Textless Speech-to-Speech Translation on Real Data. CoRR Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Juan Miguel Pino, Jiatao Gu, Wei-Ning Hsu
2021	A*	`conf`	Unsupervised Speech Recognition. NeurIPS Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli
2021	J	`jnl`	Unsupervised Speech Recognition. CoRR Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli
2021	—	`conf`	fairseq S\^2: A Scalable and Integrable Speech Synthesis Toolkit. EMNLP (Demos) Changhan Wang, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Ann Lee, Peng-Jen Chen, Jiatao Gu, Juan Pino
2021	J	`jnl`	fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkit. CoRR Changhan Wang, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Ann Lee, Peng-Jen Chen, Jiatao Gu, Juan Miguel Pino
2020	A	`conf`	A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning. INTERSPEECH Sameer Khurana, Antoine Laurent, Wei-Ning Hsu, Jan Chorowski, Adrian Lancucki, Ricard Marxer, James R. Glass
2020	J	`jnl`	A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning. CoRR Sameer Khurana, Antoine Laurent, Wei-Ning Hsu, Jan Chorowski, Adrian Lancucki, Ricard Marxer, James R. Glass
2020	J	`jnl`	Differentiable Weighted Finite-State Transducers. CoRR Awni Y. Hannun, Vineel Pratap, Jacob Kahn, Wei-Ning Hsu
2020	A*	`conf`	Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech. ICLR David Harwath, Wei-Ning Hsu, James R. Glass
2020	J	`jnl`	Semi-Supervised Speech Recognition via Local Prior Matching. CoRR Wei-Ning Hsu, Ann Lee, Gabriel Synnaeve, Awni Y. Hannun
2020	J	`jnl`	Text-Free Image-to-Speech Synthesis Using Learned Segmental Units. CoRR Wei-Ning Hsu, David Harwath, Christopher Song, James R. Glass
2020	A	`conf`	Unsupervised Methods for Evaluating Speech Representations. INTERSPEECH Michael Gump, Wei-Ning Hsu, James R. Glass
2019	A	`conf`	An Unsupervised Autoregressive Model for Speech Representation Learning. INTERSPEECH Yu-An Chung, Wei-Ning Hsu, Hao Tang, James R. Glass
2019	J	`jnl`	An Unsupervised Autoregressive Model for Speech Representation Learning. CoRR Yu-An Chung, Wei-Ning Hsu, Hao Tang, James R. Glass
2019	Misc	`conf`	Disentangling Correlated Speaker and Noise for Speech Synthesis via Data Augmentation and Adversarial Factorization. ICASSP Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Yu-An Chung, Yuxuan Wang, Yonghui Wu, James R. Glass
2019	—	`conf`	Hierarchical Generative Modeling for Controllable Speech Synthesis. ICLR (Poster) Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Yuxuan Wang, Yuan Cao, Ye Jia, Zhifeng Chen, Jonathan Shen, Patrick Nguyen, Ruoming Pang
2019	J	`jnl`	Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech. CoRR David Harwath, Wei-Ning Hsu, James R. Glass
2019	J	`jnl`	Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. CoRR Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia Xu Chen, Ye Jia, Anjuli Kannan, Tara N. Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, Sébastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George F. Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel Bacchiani, Thomas B. Jablin, Robert Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon
2019	Misc	`conf`	Semi-supervised Training for Improving Data Efficiency in End-to-end Speech Synthesis. ICASSP Yu-An Chung, Yuxuan Wang, Wei-Ning Hsu, Yu Zhang, R. J. Skerry-Ryan
2019	A	`conf`	Transfer Learning from Audio-Visual Grounding to Speech Recognition. INTERSPEECH Wei-Ning Hsu, David Harwath, James R. Glass
2019	J	`jnl`	Transfer Learning from Audio-Visual Grounding to Speech Recognition. CoRR Wei-Ning Hsu, David F. Harwath, James R. Glass
2018	B	`conf`	A Noise-Robust Self-Adaptive Multitarget Speaker Detection System. ICPR Siqi Zheng, Jianzong Wang, Jing Xiao, Wei-Ning Hsu, James R. Glass
2018	A	`conf`	A Study of Enhancement, Augmentation and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition. INTERSPEECH Hao Tang, Wei-Ning Hsu, François Grondin, James R. Glass
2018	J	`jnl`	A Study of Enhancement, Augmentation, and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition. CoRR Hao Tang, Wei-Ning Hsu, François Grondin, James R. Glass
2018	J	`jnl`	Disentangling by Partitioning: A Representation Learning Framework for Multimodal Sensory Data. CoRR Wei-Ning Hsu, James R. Glass
2018	Misc	`conf`	Extracting Domain Invariant Features by Unsupervised Learning for Robust Automatic Speech Recognition. ICASSP Wei-Ning Hsu, James R. Glass
2018	J	`jnl`	Extracting Domain Invariant Features by Unsupervised Learning for Robust Automatic Speech Recognition. CoRR Wei-Ning Hsu, James R. Glass
2018	J	`jnl`	Hierarchical Generative Modeling for Controllable Speech Synthesis. CoRR Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Yuxuan Wang, Yuan Cao, Ye Jia, Zhifeng Chen, Jonathan Shen, Patrick Nguyen, Ruoming Pang
2018	A	`conf`	Scalable Factorized Hierarchical Variational Autoencoder Training. INTERSPEECH Wei-Ning Hsu, James R. Glass
2018	J	`jnl`	Scalable Factorized Hierarchical Variational Autoencoder Training. CoRR Wei-Ning Hsu, James R. Glass
2018	J	`jnl`	Semi-Supervised Training for Improving Data Efficiency in End-to-End Speech Synthesis. CoRR Yu-An Chung, Yuxuan Wang, Wei-Ning Hsu, Yu Zhang, R. J. Skerry-Ryan
2018	A	`conf`	Unsupervised Adaptation with Interpretable Disentangled Representations for Distant Conversational Speech Recognition. INTERSPEECH Wei-Ning Hsu, Hao Tang, James R. Glass
2018	J	`jnl`	Unsupervised Adaptation with Interpretable Disentangled Representations for Distant Conversational Speech Recognition. CoRR Wei-Ning Hsu, Hao Tang, James R. Glass
2018	—	`conf`	Unsupervised Representation Learning of Speech for Dialect Identification. SLT Suwon Shon, Wei-Ning Hsu, James R. Glass
2018	J	`jnl`	Unsupervised Representation Learning of Speech for Dialect Identification. CoRR Suwon Shon, Wei-Ning Hsu, James R. Glass
2017	C	`conf`	Automatic speech recognition of Arabic multi-genre broadcast media. ASRU Maryam Najafian, Wei-Ning Hsu, Ahmed Ali, James R. Glass
2017	A	`conf`	Learning Latent Representations for Speech Generation and Transformation. INTERSPEECH Wei-Ning Hsu, Yu Zhang, James R. Glass
2017	J	`jnl`	Learning Latent Representations for Speech Generation and Transformation. CoRR Wei-Ning Hsu, Yu Zhang, James R. Glass
2017	J	`jnl`	Unsupervised Domain Adaptation for Robust Speech Recognition via Variational Autoencoder-Based Data Augmentation. CoRR Wei-Ning Hsu, Yu Zhang, James R. Glass
2017	—	`conf`	Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Data. NIPS Wei-Ning Hsu, Yu Zhang, James R. Glass
2017	J	`jnl`	Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Data. CoRR Wei-Ning Hsu, Yu Zhang, James R. Glass
2017	C	`conf`	Unsupervised domain adaptation for robust speech recognition via variational autoencoder-based data augmentation. ASRU Wei-Ning Hsu, Yu Zhang, James R. Glass
2016	—	`conf`	A prioritized grid long short-term memory RNN for speech recognition. SLT Wei-Ning Hsu, Yu Zhang, James R. Glass
2016	—	`conf`	Development of the MIT ASR system for the 2016 Arabic Multi-genre Broadcast Challenge. SLT Tuka Al Hanai, Wei-Ning Hsu, James R. Glass
2016	A	`conf`	Exploiting Depth and Highway Connections in Convolutional Recurrent Deep Neural Networks for Speech Recognition. INTERSPEECH Wei-Ning Hsu, Yu Zhang, Ann Lee, James R. Glass
2016	B	`conf`	Neural Attention for Learning to Rank Questions in Community Question Answering. COLING Salvatore Romeo, Giovanni Da San Martino, Alberto Barrón-Cedeño, Alessandro Moschitti, Yonatan Belinkov, Wei-Ning Hsu, Yu Zhang, Mitra Mohtarami, James R. Glass
2016	J	`jnl`	Recurrent Neural Network Encoder with Attention for Community Question Answering. CoRR Wei-Ning Hsu, Yu Zhang, James R. Glass
2016	—	`conf`	SLS at SemEval-2016 Task 3: Neural-based Approaches for Ranking in Community Question Answering. SemEval@NAACL-HLT Mitra Mohtarami, Yonatan Belinkov, Wei-Ning Hsu, Yu Zhang, Tao Lei, Kfir Bar, Scott Cyphers, James R. Glass
2015	A*	`conf`	Active Learning by Learning. AAAI Wei-Ning Hsu, Hsuan-Tien Lin
2015	J	`jnl`	Enhancing Automatically Discovered Multi-level Acoustic Patterns Considering Context Consistency With Applications in Spoken Term Detection. CoRR Cheng-Tao Chung, Wei-Ning Hsu, Cheng-Yi Lee, Lin-Shan Lee
2015	Misc	`conf`	Enhancing automatically discovered multi-level acoustic patterns considering context consistency with applications in spoken term detection. ICASSP Cheng-Tao Chung, Wei-Ning Hsu, Cheng-Yi Lee, Lin-Shan Lee