Ruohan Gao

86 papers A* 19A 2B 1Misc 4Journal 46Unranked 14
YearRankTypeTitle / Venue / Authors
2026 J jnl
SonoWorld: From One Image to a 3D Audio-Visual Scene.
CoRR
Derong Jin, Xiyi Chen, Ming C. Lin, Ruohan Gao
2025 J jnl
AFFORD2ACT: Affordance-Guided Automatic Keypoint Selection for Generalizable and Lightweight Robotic Manipulation.
CoRR
Anukriti Singh, Kasra Torshizi, Khuzema Habib, Kelin Yu, Ruohan Gao, Pratap Tokekar
2025 J jnl
AVTrustBench: Assessing and Enhancing Reliability and Robustness in Audio-Visual LLMs.
CoRR
Sanjoy Chowdhury, Sayan Nag, Subhrajyoti Dasgupta, Yaoting Wang, Mohamed Elhoseiny, Ruohan Gao, Dinesh Manocha
2025 J jnl
Aurelia: Test-time Reasoning Distillation in Audio-Visual LLMs.
CoRR
Sanjoy Chowdhury, Hanan Gani, Nishit Anand, Sayan Nag, Ruohan Gao, Mohamed Elhoseiny, Salman Khan, Dinesh Manocha
2025 J jnl
ControlTac: Force- and Position-Controlled Tactile Data Augmentation with a Single Reference Image.
CoRR
Dongyu Luo, Kelin Yu, Amir-Hossein Shahidzadeh, Cornelia Fermüller, Yiannis Aloimonos, Ruohan Gao
2025 J jnl
Differentiable Room Acoustic Rendering with Multi-View Vision Priors.
CoRR
Derong Jin, Ruohan Gao
2025 J jnl
EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception.
CoRR
Sanjoy Chowdhury, Subrata Biswas, Sayan Nag, Tushar Nagarajan, Calvin Murdock, Ishwarya Ananthabhotla, Yijun Qian, Vamsi Krishna Ithapu, Dinesh Manocha, Ruohan Gao
2025 J jnl
GenFlowRL: Shaping Rewards with Generative Object-Centric Flow in Visual Reinforcement Learning.
CoRR
Kelin Yu, Sheng Zhang, Harshit Soora, Furong Huang, Heng Huang, Pratap Tokekar, Ruohan Gao
2025 A* conf
Hearing Anywhere in Any Environment.
CVPR
Xiulong Liu, Anurag Kumar, Paul Calamia, Sebastià Vicenc Amengual Garí, Calvin Murdock, Ishwarya Ananthabhotla, Philip W. Robinson, Eli Shlizerman, Vamsi Krishna Ithapu, Ruohan Gao
2025 J jnl
Hearing Anywhere in Any Environment.
CoRR
Xiulong Liu, Anurag Kumar, Paul Calamia, Sebastià Vicenc Amengual Garí, Calvin Murdock, Ishwarya Ananthabhotla, Philip W. Robinson, Eli Shlizerman, Vamsi Krishna Ithapu, Ruohan Gao
2025 — conf
Hierarchical RAG-Driven Multi-hop Reasoning for Medical Video Question Answering.
NLPCC (4)
Ruohan Gao, Qijun Zhao, Yangqianqian Chen
2025 A* conf
Learning to Highlight Audio by Watching Movies.
CVPR
Chao Huang, Ruohan Gao, J. M. F. Tsang, Jan Kurcius, Cagdas Bilen, Chenliang Xu, Anurag Kumar, Sanjeel Parekh
2025 J jnl
Learning to Highlight Audio by Watching Movies.
CoRR
Chao Huang, Ruohan Gao, J. M. F. Tsang, Jan Kurcius, Cagdas Bilen, Chenliang Xu, Anurag Kumar, Sanjeel Parekh
2025 A* conf
Multisensory Machine Intelligence.
AAAI
Ruohan Gao
2025 J jnl
Multisensory machine intelligence.
AI Mag.
Ruohan Gao
2025 J jnl
Predicting the Distribution of Ailanthus altissima Using Deep Learning-Based Analysis of Satellite Imagery.
Symmetry
Ruohan Gao, Zipeng Song, Junhan Zhao, Yingnan Li
2025 — conf
Scene-wide Acoustic Parameter Estimation.
WASPAA
Ricardo Falcón Pérez, Ruohan Gao, Gregor Mueckl, Sebastià Vicenc Amengual Garí, Ishwarya Ananthabhotla
2025 — conf
Towards Perception-Informed Latent HRTF Representations.
WASPAA
You Zhang, Andrew Francl, Ruohan Gao, Paul Calamia, Zhiyao Duan, Ishwarya Ananthabhotla
2025 J jnl
Towards Perception-Informed Latent HRTF Representations.
CoRR
You Zhang, Andrew Francl, Ruohan Gao, Paul Calamia, Zhiyao Duan, Ishwarya Ananthabhotla
2024 — conf
DiffSound: Differentiable Modal Sound Rendering and Inverse Rendering for Diverse Inference Tasks.
SIGGRAPH (Conference Paper Track)
Xutong Jin, Chenxi Xu, Ruohan Gao, Jiajun Wu, Guoping Wang, Sheng Li
2024 J jnl
DiffSound: Differentiable Modal Sound Rendering and Inverse Rendering for Diverse Inference Tasks.
CoRR
Xutong Jin, Chenxi Xu, Ruohan Gao, Jiajun Wu, Guoping Wang, Sheng Li
2024 A* conf
Hearing Anything Anywhere.
CVPR
Mason Long Wang, Ryosuke Sawata, Samuel Clarke, Ruohan Gao, Shangzhe Wu, Jiajun Wu
2024 J jnl
Hearing Anything Anywhere.
CoRR
Mason L. Wang, Ryosuke Sawata, Samuel Clarke, Ruohan Gao, Shangzhe Wu, Jiajun Wu
2024 J jnl
Leveraging Cognitive Conflict and Organizational Unlearning for Digital Mastery in SMEs: Insights From Upper Echelons.
IEEE Trans. Engineering Management
Feng Zhang, Lei Zhu, Jingjing Wang, Ruohan Gao
2024 — conf
MEERKAT: Audio-Visual Large Language Model for Grounding in Space and Time.
ECCV (64)
Sanjoy Chowdhury, Sayan Nag, Subhrajyoti Dasgupta, Jun Chen, Mohamed Elhoseiny, Ruohan Gao, Dinesh Manocha
2024 J jnl
Meerkat: Audio-Visual Large Language Model for Grounding in Space and Time.
CoRR
Sanjoy Chowdhury, Sayan Nag, Subhrajyoti Dasgupta, Jun Chen, Mohamed Elhoseiny, Ruohan Gao, Dinesh Manocha
2024 — conf
Spherical World-Locking for Audio-Visual Localization in Egocentric Videos.
ECCV (24)
Heeseung Yun, Ruohan Gao, Ishwarya Ananthabhotla, Anurag Kumar, Jacob Donley, Chao Li, Gunhee Kim, Vamsi Krishna Ithapu, Calvin Murdock
2024 J jnl
Spherical World-Locking for Audio-Visual Localization in Egocentric Videos.
CoRR
Heeseung Yun, Ruohan Gao, Ishwarya Ananthabhotla, Anurag Kumar, Jacob Donley, Chao Li, Gunhee Kim, Vamsi Krishna Ithapu, Calvin Murdock
2024 A* conf
The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective.
CVPR
Wenqi Jia, Miao Liu, Hao Jiang, Ishwarya Ananthabhotla, James M. Rehg, Vamsi Krishna Ithapu, Ruohan Gao
2024 A conf
VMFTransformer: An Angle-Preserving and Auto-Scaling Machine for Multi-Horizon Probabilistic Forecasting.
ECAI
Yunyi Zhou, Ruohan Gao, Xinping Zheng, Yuchen Huang, Zhixuan Chu
2023 A* conf
An Extensible Multi-modal Multi-task Object Dataset with Materials.
ICLR
Trevor Scott Standley, Ruohan Gao, Dawn Chen, Jiajun Wu, Silvio Savarese
2023 J jnl
An Extensible Multimodal Multi-task Object Dataset with Materials.
CoRR
Trevor Standley, Ruohan Gao, Dawn Chen, Jiajun Wu, Silvio Savarese
2023 J jnl
Differentiable Physics Simulation of Dynamics-Augmented Neural Objects.
IEEE Robotics Autom. Lett.
Simon Le Cleac'h, Hong-Xing Yu, Michelle Guo, Taylor A. Howell, Ruohan Gao, Jiajun Wu, Zachary Manchester, Mac Schwager
2023 J jnl
Learning Object-Centric Neural Scattering Functions for Free-viewpoint Relighting and Scene Composition.
CoRR
Hong-Xing Yu, Michelle Guo, Alireza Fathi, Yen-Yu Chang, Eric Ryan Chan, Ruohan Gao, Thomas A. Funkhouser, Jiajun Wu
2023 J jnl
Learning Object-Centric Neural Scattering Functions for Free-viewpoint Relighting and Scene Composition.
Trans. Mach. Learn. Res.
Hong-Xing Yu, Michelle Guo, Alireza Fathi, Yen-Yu Chang, Eric Ryan Chan, Ruohan Gao, Thomas A. Funkhouser, Jiajun Wu
2023 Misc conf
NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities.
CoRL
Ruohan Zhang, Sharon Lee, Minjune Hwang, Ayano Hiranaka, Chen Wang, Wensi Ai, Jin Jie Ryan Tan, Shreya Gupta, Yilun Hao, Gabrael Levine, Ruohan Gao, Anthony Norcia, Li Fei-Fei, Jiajun Wu
2023 J jnl
NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities.
CoRR
Ruohan Zhang, Sharon Lee, Minjune Hwang, Ayano Hiranaka, Chen Wang, Wensi Ai, Jin Jie Ryan Tan, Shreya Gupta, Yilun Hao, Gabrael Levine, Ruohan Gao, Anthony Norcia, Li Fei-Fei, Jiajun Wu
2023 A* conf
REALIMPACT: A Dataset of Impact Sound Fields for Real Objects.
CVPR
Samuel Clarke, Ruohan Gao, Mason L. Wang, Mark Rau, Julia Xu, Jui-Hsien Wang, Doug L. James, Jiajun Wu
2023 J jnl
RealImpact: A Dataset of Impact Sound Fields for Real Objects.
CoRR
Samuel Clarke, Ruohan Gao, Mason L. Wang, Mark Rau, Julia Xu, Jui-Hsien Wang, Doug L. James, Jiajun Wu
2023 A* conf
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear.
ICRA
Ruohan Gao, Hao Li, Gokul Dharan, Zhuzhu Wang, Chengshu Li, Fei Xia, Silvio Savarese, Li Fei-Fei, Jiajun Wu
2023 J jnl
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear.
CoRR
Ruohan Gao, Hao Li, Gokul Dharan, Zhuzhu Wang, Chengshu Li, Fei Xia, Silvio Savarese, Li Fei-Fei, Jiajun Wu
2023 A* conf
SoundCam: A Dataset for Finding Humans Using Room Acoustics.
NeurIPS
Mason L. Wang, Samuel Clarke, Jui-Hsien Wang, Ruohan Gao, Jiajun Wu
2023 J jnl
SoundCam: A Dataset for Finding Humans Using Room Acoustics.
CoRR
Mason L. Wang, Samuel Clarke, Jui-Hsien Wang, Ruohan Gao, Jiajun Wu
2023 J jnl
The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective.
CoRR
Wenqi Jia, Miao Liu, Hao Jiang, Ishwarya Ananthabhotla, James M. Rehg, Vamsi Krishna Ithapu, Ruohan Gao
2023 A* conf
The Object Folder Benchmark : Multisensory Learning with Neural and Real Objects.
CVPR
Ruohan Gao, Yiming Dou, Hao Li, Tanmay Agarwal, Jeannette Bohg, Yunzhu Li, Li Fei-Fei, Jiajun Wu
2023 J jnl
The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects.
CoRR
Ruohan Gao, Yiming Dou, Hao Li, Tanmay Agarwal, Jeannette Bohg, Yunzhu Li, Li Fei-Fei, Jiajun Wu
2023 J jnl
Visually-Guided Audio Spatialization in Video with Geometry-Aware Multi-task Learning.
Int. J. Comput. Vis.
Rishabh Garg, Ruohan Gao, Kristen Grauman
2022 — conf
Determining critical lung cancer subtypes from gigapixel multi-scale whole slide H&E stains images.
DSIT
Ruohan Gao
2022 J jnl
Differentiable Physics Simulation of Dynamics-Augmented Neural Objects.
CoRR
Simon Le Cleac'h, Hong-Xing Yu, Michelle Guo, Taylor A. Howell, Ruohan Gao, Jiajun Wu, Zachary Manchester, Mac Schwager
2022 A* conf
ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer.
CVPR
Ruohan Gao, Zilin Si, Yen-Yu Chang, Samuel Clarke, Jeannette Bohg, Li Fei-Fei, Wenzhen Yuan, Jiajun Wu
2022 J jnl
ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer.
CoRR
Ruohan Gao, Zilin Si, Yen-Yu Chang, Samuel Clarke, Jeannette Bohg, Li Fei-Fei, Wenzhen Yuan, Jiajun Wu
2022 Misc conf
See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation.
CoRL
Hao Li, Yizhi Zhang, Junzhe Zhu, Shaoxiong Wang, Michelle A. Lee, Huazhe Xu, Edward H. Adelson, Li Fei-Fei, Ruohan Gao, Jiajun Wu
2022 J jnl
See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation.
CoRR
Hao Li, Yizhi Zhang, Junzhe Zhu, Shaoxiong Wang, Michelle A. Lee, Huazhe Xu, Edward H. Adelson, Li Fei-Fei, Ruohan Gao, Jiajun Wu
2022 A* conf
Visual Acoustic Matching.
CVPR
Changan Chen, Ruohan Gao, Paul Calamia, Kristen Grauman
2022 J jnl
Visual Acoustic Matching.
CoRR
Changan Chen, Ruohan Gao, Paul Calamia, Kristen Grauman
2021 Misc conf
DiffImpact: Differentiable Rendering and Identification of Impact Sounds.
CoRL
Samuel Clarke, Negin Heravi, Mark Rau, Ruohan Gao, Jiajun Wu, Doug L. James, Jeannette Bohg
2021 A conf
Geometry-Aware Multi-Task Learning for Binaural Audio Generation from Video.
BMVC
Rishabh Garg, Ruohan Gao, Kristen Grauman
2021 J jnl
Geometry-Aware Multi-Task Learning for Binaural Audio Generation from Video.
CoRR
Rishabh Garg, Ruohan Gao, Kristen Grauman
2021 A* conf
Learning to Set Waypoints for Audio-Visual Navigation.
ICLR
Changan Chen, Sagnik Majumder, Ziad Al-Halah, Ruohan Gao, Santhosh Kumar Ramakrishnan, Kristen Grauman
2021 Misc conf
ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations.
CoRL
Ruohan Gao, Yen-Yu Chang, Shivani Mall, Li Fei-Fei, Jiajun Wu
2021 J jnl
ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations.
CoRR
Ruohan Gao, Yen-Yu Chang, Shivani Mall, Li Fei-Fei, Jiajun Wu
2021 A* conf
VisualVoice: Audio-Visual Speech Separation With Cross-Modal Consistency.
CVPR
Ruohan Gao, Kristen Grauman
2021 J jnl
VisualVoice: Audio-Visual Speech Separation with Cross-Modal Consistency.
CoRR
Ruohan Gao, Kristen Grauman
2020 J jnl
Audio-Visual Waypoints for Navigation.
CoRR
Changan Chen, Sagnik Majumder, Ziad Al-Halah, Ruohan Gao, Santhosh Kumar Ramakrishnan, Kristen Grauman
2020 A* conf
Listen to Look: Action Recognition by Previewing Audio.
CVPR
Ruohan Gao, Tae-Hyun Oh, Kristen Grauman, Lorenzo Torresani
2020 — conf
VisualEchoes: Spatial Image Representation Learning Through Echolocation.
ECCV (9)
Ruohan Gao, Changan Chen, Ziad Al-Halah, Carl Schissler, Kristen Grauman
2020 J jnl
VisualEchoes: Spatial Image Representation Learning through Echolocation.
CoRR
Ruohan Gao, Changan Chen, Ziad Al-Halah, Carl Schissler, Kristen Grauman
2019 A* conf
2.5D Visual Sound.
CVPR
Ruohan Gao, Kristen Grauman
2019 — conf
2.5D Visual Sound.
CVPR Workshops
Ruohan Gao, Kristen Grauman
2019 A* conf
Co-Separating Sounds of Visual Objects.
ICCV
Ruohan Gao, Kristen Grauman
2019 J jnl
Co-Separating Sounds of Visual Objects.
CoRR
Ruohan Gao, Kristen Grauman
2019 J jnl
Listen to Look: Action Recognition by Previewing Audio.
CoRR
Ruohan Gao, Tae-Hyun Oh, Kristen Grauman, Lorenzo Torresani
2018 J jnl
2.5D Visual Sound.
CoRR
Ruohan Gao, Kristen Grauman
2018 A* conf
Im2Flow: Motion Hallucination From Static Images for Action Recognition.
CVPR
Ruohan Gao, Bo Xiong, Kristen Grauman
2018 — conf
Learning to Separate Object Sounds by Watching Unlabeled Video.
CVPR Workshops
Ruohan Gao, Rogério Schmidt Feris, Kristen Grauman
2018 — conf
Learning to Separate Object Sounds by Watching Unlabeled Video.
ECCV (3)
Ruohan Gao, Rogério Schmidt Feris, Kristen Grauman
2018 J jnl
Learning to Separate Object Sounds by Watching Unlabeled Video.
CoRR
Ruohan Gao, Rogério Schmidt Feris, Kristen Grauman
2018 — conf
ShapeCodes: Self-supervised Feature Learning by Lifting Views to Viewgrids.
ECCV (16)
Dinesh Jayaraman, Ruohan Gao, Kristen Grauman
2017 J jnl
Im2Flow: Motion Hallucination from Static Images for Action Recognition.
CoRR
Ruohan Gao, Bo Xiong, Kristen Grauman
2017 A* conf
On-demand Learning for Deep Image Restoration.
ICCV
Ruohan Gao, Kristen Grauman
2017 J jnl
Unsupervised learning through one-shot image-based shape reconstruction.
CoRR
Dinesh Jayaraman, Ruohan Gao, Kristen Grauman
2016 — conf
Accelerating graph mining algorithms via uniform random edge sampling.
ICC
Ruohan Gao, Huanle Xu, Pili Hu, Wing Cheong Lau
2016 J jnl
From One-Trick Ponies to All-Rounders: On-Demand Learning for Image Restoration.
CoRR
Ruohan Gao, Kristen Grauman
2016 — conf
Object-Centric Representation Learning from Unlabeled Videos.
ACCV (5)
Ruohan Gao, Dinesh Jayaraman, Kristen Grauman
2016 J jnl
Object-Centric Representation Learning from Unlabeled Videos.
CoRR
Ruohan Gao, Dinesh Jayaraman, Kristen Grauman
2015 B conf
Graph Property Preservation under Community-Based Sampling.
GLOBECOM
Ruohan Gao, Pili Hu, Wing Cheong Lau