Puyuan Peng - RankMe

45 papers A* 5A 8C 1Misc 2Journal 24Unranked 5

Year	Rank	Type	Title / Venue / Authors
2025	A	`conf`	CS-FLEURS: A Massively Multilingual and Code-Switched Speech Dataset. INTERSPEECH Brian Yan, Injy Hamed, Shuichiro Shimizu, Vasista Sai Lodagala, William Chen, Olga Iakovenko, Bashar Talafha, Amir Hussein, Alexander Polok, Kalvin Chang, Dominik Klement, Sara Althubaiti, Puyuan Peng, Matthew Wiesner, Thamar Solorio, Ahmed Ali, Sanjeev Khudanpur, Shinji Watanabe
2025	J	`jnl`	CS-FLEURS: A Massively Multilingual and Code-Switched Speech Dataset. CoRR Brian Yan, Injy Hamed, Shuichiro Shimizu, Vasista Sai Lodagala, William Chen, Olga Iakovenko, Bashar Talafha, Amir Hussein, Alexander Polok, Kalvin Chang, Dominik Klement, Sara Althubaiti, Puyuan Peng, Matthew Wiesner, Thamar Solorio, Ahmed Ali, Sanjeev Khudanpur, Shinji Watanabe, Chih-Chen Chen, Zhen Wu, Karim Benharrak, Anuj Diwan, Samuele Cornell, Eunjung Yeo, Kwanghee Choi, Carlos Carvalho, Karen Rosero
2025	J	`jnl`	ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models. CoRR Liyan Tang, Grace Kim, Xinyu Zhao, Thom Lake, Wenxuan Ding, Fangcong Yin, Prasann Singhal, Manya Wadhwa, Zeyu Leo Liu, Zayne Sprague, Ramya Namuduri, Bodun Hu, Juan Diego Rodriguez, Puyuan Peng, Greg Durrett
2025	A*	`conf`	Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. ICLR Chien-yu Huang, Wei-Chih Chen, Shu-Wen Yang, Andy T. Liu, Chen-An Li, Yu-Xiang Lin, Wei-Cheng Tseng, Anuj Diwan, Yi-Jen Shih, Jiatong Shi, William Chen, Chih-Kai Yang, Xuanjun Chen, Chi-Yuan Hsiao, Puyuan Peng, Shih-Heng Wang, Chun-Yi Kuan, Ke-Han Lu, Kai-Wei Chang, Fabian Alejandro Ritter Gutierrez, et al.
2025	A*	`conf`	SyllableLM: Learning Coarse Semantic Units for Speech Language Models. ICLR Alan Baade, Puyuan Peng, David Harwath
2025	J	`jnl`	TalkLess: Blending Extractive and Abstractive Speech Summarization for Editing Speech to Preserve Content and Style. CoRR Karim Benharrak, Puyuan Peng, Amy Pavel
2025	A*	`conf`	TalkLess: Blending Extractive and Abstractive Summarization for Editing Speech to Preserve Content and Style. UIST Karim Benharrak, Puyuan Peng, Amy Pavel
2025	A	`conf`	Temporally Streaming Audio-Visual Synchronization for Real-World Videos. WACV Jordan Voas, Wei-Cheng Tseng, Layne Berry, Xixi Hu, Puyuan Peng, James Stuedemann, David Harwath
2025	J	`jnl`	VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Models. CoRR Sung-Bin Kim, Jeongsoo Choi, Puyuan Peng, Joon Son Chung, Tae-Hyun Oh, David Harwath
2025	A*	`conf`	VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing. EMNLP Zhisheng Zheng, Puyuan Peng, Anuj Diwan, Cong Phuoc Huynh, Xiaohang Sun, Zhu Liu, Vimal Bhat, David Harwath
2025	J	`jnl`	VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing. CoRR Zhisheng Zheng, Puyuan Peng, Anuj Diwan, Cong Phuoc Huynh, Xiaohang Sun, Zhu Liu, Vimal Bhat, David Harwath
2025	J	`jnl`	VoiceStar: Robust Zero-Shot Autoregressive TTS with Duration Control and Extrapolation. CoRR Puyuan Peng, Shang-wen Li, Abdelrahman Mohamed, David Harwath
2024	Misc	`conf`	AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. ICASSP Yuan Tseng, Layne Berry, Yiting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Poyao Huang, Chun-Mao Lai, Shang-wen Li, David Harwath, Yu Tsao, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee
2024	—	`conf`	Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos. ECCV (70) Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman
2024	J	`jnl`	Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos. CoRR Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman
2024	A*	`conf`	BAT: Learning to Reason about Spatial Sounds with Large Language Models. ICML Zhisheng Zheng, Puyuan Peng, Ziyang Ma, Xie Chen, Eunsol Choi, David Harwath
2024	J	`jnl`	BAT: Learning to Reason about Spatial Sounds with Large Language Models. CoRR Zhisheng Zheng, Puyuan Peng, Ziyang Ma, Xie Chen, Eunsol Choi, David Harwath
2024	J	`jnl`	Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. CoRR Chien-yu Huang, Wei-Chih Chen, Shu-Wen Yang, Andy T. Liu, Chen-An Li, Yu-Xiang Lin, Wei-Cheng Tseng, Anuj Diwan, Yi-Jen Shih, Jiatong Shi, William Chen, Xuanjun Chen, Chi-Yuan Hsiao, Puyuan Peng, Shih-Heng Wang, Chun-Yi Kuan, Ke-Han Lu, Kai-Wei Chang, Chih-Kai Yang, Fabian Ritter Gutierrez, Ming To Chuang, Kuan-Po Huang, Siddhant Arora, You-Kuan Lin, Eunjung Yeo, Kalvin Chang, Chung-Ming Chien, Kwanghee Choi, Cheng-Hsiu Hsieh, Yi-Cheng Lin, Chee-En Yu, I-Hsiang Chiu, Heitor R. Guimarães, Jionghao Han, Tzu-Quan Lin, Tzu-Yuan Lin, Homu Chang, Ting-Wu Chang, Chun Wei Chen, Shou-Jen Chen, Yu-Hua Chen, Hsi-Chun Cheng, Kunal Dhawan, Jia-Lin Fang, Shi-Xin Fang, Kuan-Yu Fang Chiang, Chi An Fu, Hsien-Fu Hsiao, Ching Yu Hsu, Shao-Syuan Huang, Lee Chen Wei, Hsi-Che Lin, Hsuan-Hao Lin, Hsuan-Ting Lin, Jian-Ren Lin, Ting-Chun Liu, Li-Chun Lu, Tsung-Min Pai, Ankita Pasad, Shih-Yun Shan Kuan, Suwon Shon, Yuxun Tang, Yun-Shao Tsai, Jui-Chiang Wei, Tzu-Chieh Wei, Chengxi Wu, Dien-Ruei Wu, Chao-Han Huck Yang, Chieh-Chi Yang, Jia Qi Yip, Shao-Xiang Yuan, Vahid Noroozi, Zhehuai Chen, Haibin Wu, Karen Livescu, David Harwath, Shinji Watanabe, Hung-yi Lee
2024	—	`conf`	Integrating Self-Supervised Speech Model with Pseudo Word-Level Targets from Visually-Grounded Speech Model. ICASSP Workshops Hung-Chieh Fang, Nai-Xuan Ye, Yi-Jen Shih, Puyuan Peng, Hsuan-Fu Wang, Layne Berry, Hung-yi Lee, David Harwath
2024	J	`jnl`	Integrating Self-supervised Speech Model with Pseudo Word-level Targets from Visually-grounded Speech Model. CoRR Hung-Chieh Fang, Nai-Xuan Ye, Yi-Jen Shih, Puyuan Peng, Hsuan-Fu Wang, Layne Berry, Hung-yi Lee, David Harwath
2024	A	`conf`	Neural Codec Language Models for Disentangled and Textless Voice Conversion. INTERSPEECH Alan Baade, Puyuan Peng, David Harwath
2024	—	`conf`	SpeechCLIP+: Self-Supervised Multi-Task Representation Learning for Speech Via Clip and Speech-Image Data. ICASSP Workshops Hsuan-Fu Wang, Yi-Jen Shih, Heng-Jui Chang, Layne Berry, Puyuan Peng, Hung-yi Lee, Hsin-Min Wang, David Harwath
2024	J	`jnl`	SpeechCLIP+: Self-supervised multi-task representation learning for speech via CLIP and speech-image data. CoRR Hsuan-Fu Wang, Yi-Jen Shih, Heng-Jui Chang, Layne Berry, Puyuan Peng, Hung-yi Lee, Hsin-Min Wang, David Harwath
2024	J	`jnl`	SyllableLM: Learning Coarse Semantic Units for Speech Language Models. CoRR Alan Baade, Puyuan Peng, David Harwath
2024	—	`conf`	VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild. ACL (1) Puyuan Peng, Po-Yao Huang, Shang-wen Li, Abdelrahman Mohamed, David Harwath
2024	J	`jnl`	VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild. CoRR Puyuan Peng, Po-Yao Huang, Daniel Li, Abdelrahman Mohamed, David Harwath
2023	J	`jnl`	AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. CoRR Yuan Tseng, Layne Berry, Yi-Ting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Po-Yao Huang, Chun-Mao Lai, Shang-wen Li, David Harwath, Yu Tsao, Shinji Watanabe, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee
2023	C	`conf`	Audio-Visual Neural Syntax Acquisition. ASRU Cheng-I Jeff Lai, Freda Shi, Puyuan Peng, Yoon Kim, Kevin Gimpel, Shiyu Chang, Yung-Sung Chuang, Saurabhchand Bhati, David D. Cox, David Harwath, Yang Zhang, Karen Livescu, James R. Glass
2023	J	`jnl`	Audio-Visual Neural Syntax Acquisition. CoRR Cheng-I Jeff Lai, Freda Shi, Puyuan Peng, Yoon Kim, Kevin Gimpel, Shiyu Chang, Yung-Sung Chuang, Saurabhchand Bhati, David D. Cox, David Harwath, Yang Zhang, Karen Livescu, James R. Glass
2023	A	`conf`	Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization. INTERSPEECH Puyuan Peng, Brian Yan, Shinji Watanabe, David Harwath
2023	J	`jnl`	Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization. CoRR Puyuan Peng, Brian Yan, Shinji Watanabe, David Harwath
2023	J	`jnl`	Style-transfer based Speech and Audio-visual Scene Understanding for Robot Action Sequence Acquisition from Videos. CoRR Chiori Hori, Puyuan Peng, David Harwath, Xinyu Liu, Kei Ota, Siddarth Jain, Radu Corcodel, Devesh K. Jha, Diego Romeres, Jonathan Le Roux
2023	A	`conf`	Style-transfer based Speech and Audio-visual Scene understanding for Robot Action Sequence Acquisition from Videos. INTERSPEECH Chiori Hori, Puyuan Peng, David Harwath, Xinyu Liu, Kei Ota, Siddarth Jain, Radu Corcodel, Devesh K. Jha, Diego Romeres, Jonathan Le Roux
2023	J	`jnl`	Syllable Discovery and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Mode. CoRR Puyuan Peng, Shang-wen Li, Okko Räsänen, Abdelrahman Mohamed, David Harwath
2023	A	`conf`	Syllable Discovery and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model. INTERSPEECH Puyuan Peng, Shang-wen Li, Okko Räsänen, Abdelrahman Mohamed, David Harwath
2022	Misc	`conf`	Fast-Slow Transformer for Visually Grounding Speech. ICASSP Puyuan Peng, David Harwath
2022	A	`conf`	MAE-AST: Masked Autoencoding Audio Spectrogram Transformer. INTERSPEECH Alan Baade, Puyuan Peng, David Harwath
2022	J	`jnl`	MAE-AST: Masked Autoencoding Audio Spectrogram Transformer. CoRR Alan Baade, Puyuan Peng, David Harwath
2022	J	`jnl`	Self-Supervised Representation Learning for Speech Using Visual Grounding and Masked Language Modeling. CoRR Puyuan Peng, David Harwath
2022	A	`conf`	Word Discovery in Visually Grounded, Self-Supervised Speech Models. INTERSPEECH Puyuan Peng, David Harwath
2022	J	`jnl`	Word Discovery in Visually Grounded, Self-Supervised Speech Models. CoRR Puyuan Peng, David Harwath
2022	—	`conf`	Zero-shot Video Moment Retrieval With Off-the-Shelf Models. TL4NLP Anuj Diwan, Puyuan Peng, Raymond J. Mooney
2022	J	`jnl`	Zero-shot Video Moment Retrieval With Off-the-Shelf Models. CoRR Anuj Diwan, Puyuan Peng, Raymond J. Mooney
2021	J	`jnl`	Fast-Slow Transformer for Visually Grounding Speech. CoRR Puyuan Peng, David Harwath
2020	J	`jnl`	A Correspondence Variational Autoencoder for Unsupervised Acoustic Word Embeddings. CoRR Puyuan Peng, Herman Kamper, Karen Livescu