Minsu Kim - RankMe

60 papers A* 9A 2B 4Misc 6Journal 35Unranked 4

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understanding. CoRR Junho Kim, Hosu Lee, James M. Rehg, Minsu Kim, Yong Man Ro
2026	J	`jnl`	TMT: Tri-Modal Translation Between Speech, Image, and Text by Processing Different Modalities as Different Languages. IEEE Trans. Multim. Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
2025	J	`jnl`	Prompt Tuning of Deep Neural Networks for Speaker-Adaptive Visual Speech Recognition. IEEE Trans. Pattern Anal. Mach. Intell. Minsu Kim, Hyung-Il Kim, Yong Man Ro
2025	J	`jnl`	Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representations. CoRR Jeong Hun Yeo, Minsu Kim, Chae Won Kim, Stavros Petridis, Yong Man Ro
2024	J	`jnl`	AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model. IEEE Trans. Multim. Jeong Hun Yeo, Minsu Kim, Jeongsoo Choi, Dae Hoe Kim, Yong Man Ro
2024	A*	`conf`	AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation. CVPR Jeongsoo Choi, Se Jin Park, Minsu Kim, Yong Man Ro
2024	A*	`conf`	Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation. ACM Multimedia Minsu Kim, Jeong Hun Yeo, Se Jin Park, Hyeongseop Rha, Yong Man Ro
2024	Misc	`conf`	Exploring Phonetic Context-Aware Lip-Sync for Talking Face Generation. ICASSP Se Jin Park, Minsu Kim, Jeongsoo Choi, Yong Man Ro
2024	—	`conf`	Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation. ACL (1) Se Jin Park, Chae Won Kim, Hyeongseop Rha, Minsu Kim, Joanna Hong, Jeong Hun Yeo, Yong Man Ro
2024	J	`jnl`	Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation. CoRR Se Jin Park, Chae Won Kim, Hyeongseop Rha, Minsu Kim, Joanna Hong, Jeong Hun Yeo, Yong Man Ro
2024	J	`jnl`	Multilingual Visual Speech Recognition with a Single Model by Learning with Discrete Visual Speech Units. CoRR Minsu Kim, Jeong Hun Yeo, Jeongsoo Choi, Se Jin Park, Yong Man Ro
2024	J	`jnl`	TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages. CoRR Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
2024	Misc	`conf`	Text-Driven Talking Face Synthesis by Reprogramming Audio-Driven Models. ICASSP Jeongsoo Choi, Minsu Kim, Se Jin Park, Yong Man Ro
2024	J	`jnl`	Textless Unit-to-Unit Training for Many-to-Many Multilingual Speech-to-Speech Translation. IEEE ACM Trans. Audio Speech Lang. Process. Minsu Kim, Jeongsoo Choi, Dahun Kim, Yong Man Ro
2024	Misc	`conf`	Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-Training and Multi-Modal Tokens. ICASSP Minsu Kim, Jeongsoo Choi, Soumi Maiti, Jeong Hun Yeo, Shinji Watanabe, Yong Man Ro
2024	Misc	`conf`	Visual Speech Recognition for Languages with Limited Labeled Data Using Automatic Labels from Whisper. ICASSP Jeong Hun Yeo, Minsu Kim, Shinji Watanabe, Yong Man Ro
2024	—	`conf`	Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing. EMNLP (Findings) Jeong Hun Yeo, Seunghee Han, Minsu Kim, Yong Man Ro
2024	J	`jnl`	Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing. CoRR Jeong Hun Yeo, Seunghee Han, Minsu Kim, Yong Man Ro
2023	J	`jnl`	AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model. CoRR Jeong Hun Yeo, Minsu Kim, Jeongsoo Choi, Dae Hoe Kim, Yong Man Ro
2023	J	`jnl`	AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation. CoRR Jeongsoo Choi, Se Jin Park, Minsu Kim, Yong Man Ro
2023	J	`jnl`	DF-3DFace: One-to-Many Speech Synchronized 3D Face Animation with Diffusion. CoRR Se Jin Park, Joanna Hong, Minsu Kim, Yong Man Ro
2023	A*	`conf`	Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video. AAAI Minsu Kim, Chae Won Kim, Yong Man Ro
2023	J	`jnl`	Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video. CoRR Minsu Kim, Chae Won Kim, Yong Man Ro
2023	J	`jnl`	Exploring Phonetic Context in Lip Movement for Authentic Talking Face Generation. CoRR Se Jin Park, Minsu Kim, Jeongsoo Choi, Yong Man Ro
2023	A	`conf`	Intelligible Lip-to-Speech Synthesis with Speech Units. INTERSPEECH Jeongsoo Choi, Minsu Kim, Yong Man Ro
2023	J	`jnl`	Intelligible Lip-to-Speech Synthesis with Speech Units. CoRR Jeongsoo Choi, Minsu Kim, Yong Man Ro
2023	A*	`conf`	Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge. ICCV Minsu Kim, Jeong Hun Yeo, Jeongsoo Choi, Yong Man Ro
2023	J	`jnl`	Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge. CoRR Minsu Kim, Jeong Hun Yeo, Jeongsoo Choi, Yong Man Ro
2023	Misc	`conf`	Lip-to-Speech Synthesis in the Wild with Multi-Task Learning. ICASSP Minsu Kim, Joanna Hong, Yong Man Ro
2023	J	`jnl`	Lip-to-Speech Synthesis in the Wild with Multi-task Learning. CoRR Minsu Kim, Joanna Hong, Yong Man Ro
2023	J	`jnl`	Many-to-Many Spoken Language Translation via Unified Speech and Text Representation Learning with Unit-to-Unit Translation. CoRR Minsu Kim, Jeongsoo Choi, Dahun Kim, Yong Man Ro
2023	Misc	`conf`	Multi-Temporal Lip-Audio Memory for Visual Speech Recognition. ICASSP Jeong Hun Yeo, Minsu Kim, Yong Man Ro
2023	J	`jnl`	Multi-Temporal Lip-Audio Memory for Visual Speech Recognition. CoRR Jeong Hun Yeo, Minsu Kim, Yong Man Ro
2023	J	`jnl`	Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition. CoRR Minsu Kim, Hyung-Il Kim, Yong Man Ro
2023	J	`jnl`	Reprogramming Audio-driven Talking Face Synthesis into Text-driven. CoRR Jeongsoo Choi, Minsu Kim, Se Jin Park, Yong Man Ro
2023	J	`jnl`	Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal Tokens. CoRR Minsu Kim, Jeongsoo Choi, Soumi Maiti, Jeong Hun Yeo, Shinji Watanabe, Yong Man Ro
2023	J	`jnl`	Visual Speech Recognition for Low-resource Languages with Automatic Labels From Whisper Model. CoRR Jeong Hun Yeo, Minsu Kim, Shinji Watanabe, Yong Man Ro
2023	A*	`conf`	Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring. CVPR Joanna Hong, Minsu Kim, Jeongsoo Choi, Yong Man Ro
2023	J	`jnl`	Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring. CoRR Joanna Hong, Minsu Kim, Jeongsoo Choi, Yong Man Ro
2022	J	`jnl`	CroMM-VSR: Cross-Modal Memory Augmented Visual Speech Recognition. IEEE Trans. Multim. Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro
2022	A*	`conf`	Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading. AAAI Minsu Kim, Jeong Hun Yeo, Yong Man Ro
2022	J	`jnl`	Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading. CoRR Minsu Kim, Jeong Hun Yeo, Yong Man Ro
2022	J	`jnl`	Lip to Speech Synthesis with Visual Context Attentional GAN. CoRR Minsu Kim, Joanna Hong, Yong Man Ro
2022	J	`jnl`	Meta Input: How to Leverage Off-the-Shelf Deep Neural Networks. CoRR Minsu Kim, Youngjoon Yu, Sungjune Park, Yong Man Ro
2022	J	`jnl`	Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video. CoRR Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro
2022	—	`conf`	Speaker-Adaptive Lip Reading with User-Dependent Padding. ECCV (36) Minsu Kim, Hyunjun Kim, Yong Man Ro
2022	J	`jnl`	Speaker-adaptive Lip Reading with User-dependent Padding. CoRR Minsu Kim, Hyunjun Kim, Yong Man Ro
2022	A*	`conf`	SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory. AAAI Se Jin Park, Minsu Kim, Joanna Hong, Jeongsoo Choi, Yong Man Ro
2022	J	`jnl`	SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory. CoRR Se Jin Park, Minsu Kim, Joanna Hong, Jeongsoo Choi, Yong Man Ro
2022	—	`conf`	VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection. ECCV (36) Joanna Hong, Minsu Kim, Yong Man Ro
2022	J	`jnl`	VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection. CoRR Joanna Hong, Minsu Kim, Yong Man Ro
2022	A	`conf`	Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition. INTERSPEECH Joanna Hong, Minsu Kim, Daehun Yoo, Yong Man Ro
2022	J	`jnl`	Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition. CoRR Joanna Hong, Minsu Kim, Daehun Yoo, Yong Man Ro
2021	B	`conf`	Interpretation of Lesional Detection via Counterfactual Generation. ICIP Junho Kim, Minsu Kim, Yong Man Ro
2021	A*	`conf`	Lip to Speech Synthesis with Visual Context Attentional GAN. NeurIPS Minsu Kim, Joanna Hong, Yong Man Ro
2021	A*	`conf`	Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video. ICCV Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro
2021	J	`jnl`	Speech Reconstruction With Reminiscent Sound Via Visual Voice Memory. IEEE ACM Trans. Audio Speech Lang. Process. Joanna Hong, Minsu Kim, Se Jin Park, Yong Man Ro
2020	B	`conf`	Learning Style Correlation for Elaborate Few-Shot Classification. ICIP Junho Kim, Minsu Kim, Jung Uk Kim, Hong Joo Lee, Sangmin Lee, Joanna Hong, Yong Man Ro
2020	B	`conf`	Robust Video Facial Authentication With Unsupervised Mode Disentanglement. ICIP Minsu Kim, Hong Joo Lee, Sangmin Lee, Yong Man Ro
2020	B	`conf`	Unsupervised Disentangling of Viewpoint and Residues Variations by Substituting Representations for Robust Face Recognition. ICPR Minsu Kim, Joanna Hong, Junho Kim, Hong Joo Lee, Yong Man Ro