Xiaojian Ma - RankMe

88 papers A* 26A 3Journal 55Unranked 4

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	FlowDreamer: A RGB-D World Model With Flow-Based Motion Representations for Robot Manipulation. IEEE Robotics Autom. Lett. Jun Guo, Xiaojian Ma, Yikai Wang, Min Yang, Huaping Liu, Qing Li
2026	A*	`conf`	TongUI: Internet-Scale Trajectories from Multimodal Web Tutorials for Generalized GUI Agents. AAAI Bofei Zhang, Zirui Shang, Zhi Gao, Wang Zhang, Rui Xie, Xiaojian Ma, Tao Yuan, Xinxiao Wu, Song-Chun Zhu, Qing Li
2025	J	`jnl`	Building LLM Agents by Incorporating Insights from Computer Systems. CoRR Yapeng Mi, Zhi Gao, Xiaojian Ma, Qing Li
2025	J	`jnl`	Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understanding. CoRR Yue Fan, Xiaojian Ma, Rongpeng Su, Jun Guo, Rujie Wu, Xi Chen, Qing Li
2025	A*	`conf`	Falcon: Fast Visuomotor Policies via Partial Denoising. ICML Haojun Chen, Minghao Liu, Chengdong Ma, Xiaojian Ma, Zailin Ma, Huimin Wu, Yuanpei Chen, Yifan Zhong, Mingzhi Wang, Qing Li, Yaodong Yang
2025	J	`jnl`	Falcon: Fast Visuomotor Policies via Partial Denoising. CoRR Haojun Chen, Minghao Liu, Xiaojian Ma, Zailin Ma, Huimin Wu, Chengdong Ma, Yuanpei Chen, Yifan Zhong, Mingzhi Wang, Qing Li, Yaodong Yang
2025	J	`jnl`	FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation. CoRR Jun Guo, Xiaojian Ma, Yikai Wang, Min Yang, Huaping Liu, Qing Li
2025	J	`jnl`	From Objects to Anywhere: A Holistic Benchmark for Multi-level Visual Grounding in 3D Scenes. CoRR Tianxu Wang, Zhuofan Zhang, Ziyu Zhu, Yue Fan, Jing Xiong, Pengxiang Li, Xiaojian Ma, Qing Li
2025	A*	`conf`	GROOT-2: Weakly Supervised Multimodal Instruction Following Agents. ICLR Shaofei Cai, Bowei Zhang, Zihao Wang, Haowei Lin, Xiaojian Ma, Anji Liu, Yitao Liang
2025	J	`jnl`	Iterative Trajectory Exploration for Multimodal Agents. CoRR Pengxiang Li, Zhi Gao, Bofei Zhang, Yapeng Mi, Xiaojian Ma, Chenrui Shi, Tao Yuan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li
2025	J	`jnl`	JARVIS-1: Open-World Multi-Task Agents With Memory-Augmented Multimodal Language Models. IEEE Trans. Pattern Anal. Mach. Intell. Zihao Wang, Shaofei Cai, Anji Liu, Yonggang Jin, Jinbing Hou, Bowei Zhang, Haowei Lin, Zhaofeng He, Zilong Zheng, Yaodong Yang, Xiaojian Ma, Yitao Liang
2025	—	`conf`	JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse. ACL (Findings) Muyao Li, Zihao Wang, Kaichen He, Xiaojian Ma, Yitao Liang
2025	J	`jnl`	JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse. CoRR Muyao Li, Zihao Wang, Kaichen He, Xiaojian Ma, Yitao Liang
2025	J	`jnl`	LEO-VL: Towards 3D Vision-Language Generalists via Data Scaling with Efficient Representation. CoRR Jiangyong Huang, Xiaojian Ma, Xiongkun Linghu, Yue Fan, Junchao He, Wenxin Tan, Qing Li, Song-Chun Zhu, Yixin Chen, Baoxiong Jia, Siyuan Huang
2025	J	`jnl`	LongViTU: Instruction Tuning for Long-Form Video Understanding. CoRR Rujie Wu, Xiaojian Ma, Hai Ci, Yue Fan, Yuxuan Wang, Haozhe Zhao, Qing Li, Yizhou Wang
2025	J	`jnl`	MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoning. CoRR Yapeng Mi, Hengli Li, Yanpeng Zhao, Chenxi Li, Huimin Wu, Xiaojian Ma, Song-Chun Zhu, Ying Nian Wu, Qing Li
2025	J	`jnl`	Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation. CoRR Ziyu Zhu, Xilin Wang, Yixuan Li, Zhuofan Zhang, Xiaojian Ma, Yixin Chen, Baoxiong Jia, Wei Liang, Qian Yu, Zhidong Deng, Siyuan Huang, Qing Li
2025	A*	`conf`	Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage. ICLR Zhi Gao, Bofei Zhang, Pengxiang Li, Xiaojian Ma, Tao Yuan, Yue Fan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li
2025	J	`jnl`	NEP: Autoregressive Image Editing via Next Editing Token Prediction. CoRR Huimin Wu, Xiaojian Ma, Haozhe Zhao, Yanpeng Zhao, Qing Li
2025	A*	`conf`	ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Prompting. CVPR Shaofei Cai, Zihao Wang, Kewei Lian, Zhancun Mu, Xiaojian Ma, Anji Liu, Yitao Liang
2025	J	`jnl`	TongUI: Building Generalized GUI Agents by Learning from Multimodal Web Tutorials. CoRR Bofei Zhang, Zirui Shang, Zhi Gao, Wang Zhang, Rui Xie, Xiaojian Ma, Tao Yuan, Xinxiao Wu, Song-Chun Zhu, Qing Li
2024	A*	`conf`	An Embodied Generalist Agent in 3D World. ICML Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang
2024	A*	`conf`	Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World. ICLR Rujie Wu, Xiaojian Ma, Zhenliang Zhang, Wei Wang, Qing Li, Song-Chun Zhu, Yizhou Wang
2024	A*	`conf`	CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update. CVPR Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li
2024	J	`jnl`	GROOT-2: Weakly Supervised Multi-Modal Instruction Following Agents. CoRR Shaofei Cai, Bowei Zhang, Zihao Wang, Haowei Lin, Xiaojian Ma, Anji Liu, Yitao Liang
2024	A*	`conf`	GROOT: Learning to Follow Instructions by Watching Gameplay Videos. ICLR Shaofei Cai, Bowei Zhang, Zihao Wang, Xiaojian Ma, Anji Liu, Yitao Liang
2024	J	`jnl`	Latent Energy-Based Odyssey: Black-Box Optimization via Expanded Exploration in the Energy-Based Latent Space. CoRR Peiyu Yu, Dinghuai Zhang, Hengzhi He, Xiaojian Ma, Ruiyao Miao, Yifan Lu, Yasi Zhang, Deqian Kong, Ruiqi Gao, Jianwen Xie, Guang Cheng, Ying Nian Wu
2024	A*	`conf`	MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning. ICLR Haozhe Zhao, Zefan Cai, Shuzheng Si, Xiaojian Ma, Kaikai An, Liang Chen, Zixuan Liu, Sheng Wang, Wenjuan Han, Baobao Chang
2024	—	`conf`	MindAgent: Emergent Gaming Interaction. NAACL-HLT (Findings) Ran Gong, Qiuyuan Huang, Xiaojian Ma, Yusuke Noda, Zane Durante, Zilong Zheng, Demetri Terzopoulos, Li Fei-Fei, Jianfeng Gao, Hoi Vo
2024	J	`jnl`	Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage. CoRR Zhi Gao, Bofei Zhang, Pengxiang Li, Xiaojian Ma, Tao Yuan, Yue Fan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li
2024	J	`jnl`	OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents. CoRR Zihao Wang, Shaofei Cai, Zhancun Mu, Haowei Lin, Ceyao Zhang, Xuejie Liu, Qing Li, Anji Liu, Xiaojian Ma, Yitao Liang
2024	J	`jnl`	RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation. CoRR Zihao Wang, Anji Liu, Haowei Lin, Jiaqi Li, Xiaojian Ma, Yitao Liang
2024	J	`jnl`	ROCKET-1: Master Open-World Interaction with Visual-Temporal Context Prompting. CoRR Shaofei Cai, Zihao Wang, Kewei Lian, Zhancun Mu, Xiaojian Ma, Anji Liu, Yitao Liang
2024	J	`jnl`	Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting. CoRR Jun Guo, Xiaojian Ma, Yue Fan, Huaping Liu, Qing Li
2024	J	`jnl`	Task-oriented Sequential Grounding in 3D Scenes. CoRR Zhuofan Zhang, Ziyu Zhu, Pengxiang Li, Tengyu Liu, Xiaojian Ma, Yixin Chen, Baoxiong Jia, Siyuan Huang, Qing Li
2024	J	`jnl`	UltraEdit: Instruction-based Fine-Grained Image Editing at Scale. CoRR Haozhe Zhao, Xiaojian Ma, Liang Chen, Shuzheng Si, Rujie Wu, Kaikai An, Peiyu Yu, Minjia Zhang, Qing Li, Baobao Chang
2024	—	`conf`	Unifying 3D Vision-Language Understanding via Promptable Queries. ECCV (44) Ziyu Zhu, Zhuofan Zhang, Xiaojian Ma, Xuesong Niu, Yixin Chen, Baoxiong Jia, Zhidong Deng, Siyuan Huang, Qing Li
2024	J	`jnl`	Unifying 3D Vision-Language Understanding via Promptable Queries. CoRR Ziyu Zhu, Zhuofan Zhang, Xiaojian Ma, Xuesong Niu, Yixin Chen, Baoxiong Jia, Zhidong Deng, Siyuan Huang, Qing Li
2024	J	`jnl`	VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding. CoRR Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li
2024	—	`conf`	🤖 VideoAgent: A Memory-Augmented Multimodal Agent for Video Understanding. ECCV (22) Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li
2023	A*	`conf`	3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment. ICCV Ziyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng, Siyuan Huang, Qing Li
2023	J	`jnl`	3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment. CoRR Ziyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng, Siyuan Huang, Qing Li
2023	J	`jnl`	An Embodied Generalist Agent in 3D World. CoRR Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang
2023	J	`jnl`	Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World. CoRR Rujie Wu, Xiaojian Ma, Qing Li, Wei Wang, Zhenliang Zhang, Song-Chun Zhu, Yizhou Wang
2023	J	`jnl`	CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update. CoRR Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li
2023	A*	`conf`	Describe, Explain, Plan and Select: Interactive Planning with LLMs Enables Open-World Multi-Task Agents. NeurIPS Zihao Wang, Shaofei Cai, Guanzhou Chen, Anji Liu, Xiaojian Ma, Yitao Liang
2023	J	`jnl`	Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents. CoRR Zihao Wang, Shaofei Cai, Anji Liu, Xiaojian Ma, Yitao Liang
2023	J	`jnl`	GROOT: Learning to Follow Instructions by Watching Gameplay Videos. CoRR Shaofei Cai, Bowei Zhang, Zihao Wang, Xiaojian Ma, Anji Liu, Yitao Liang
2023	J	`jnl`	JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models. CoRR Zihao Wang, Shaofei Cai, Anji Liu, Yonggang Jin, Jinbing Hou, Bowei Zhang, Haowei Lin, Zhaofeng He, Zilong Zheng, Yaodong Yang, Xiaojian Ma, Yitao Liang
2023	A*	`conf`	Learning Energy-Based Prior Model with Diffusion-Amortized MCMC. NeurIPS Peiyu Yu, Yaxuan Zhu, Sirui Xie, Xiaojian Ma, Ruiqi Gao, Song-Chun Zhu, Ying Nian Wu
2023	J	`jnl`	Learning Energy-Based Prior Model with Diffusion-Amortized MCMC. CoRR Peiyu Yu, Yaxuan Zhu, Sirui Xie, Xiaojian Ma, Ruiqi Gao, Song-Chun Zhu, Ying Nian Wu
2023	J	`jnl`	MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning. CoRR Haozhe Zhao, Zefan Cai, Shuzheng Si, Xiaojian Ma, Kaikai An, Liang Chen, Zixuan Liu, Sheng Wang, Wenjuan Han, Baobao Chang
2023	J	`jnl`	MindAgent: Emergent Gaming Interaction. CoRR Ran Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-Chun Zhu, Demetri Terzopoulos, Li Fei-Fei, Jianfeng Gao
2023	A*	`conf`	Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction. CVPR Shaofei Cai, Zihao Wang, Xiaojian Ma, Anji Liu, Yitao Liang
2023	J	`jnl`	Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction. CoRR Shaofei Cai, Zihao Wang, Xiaojian Ma, Anji Liu, Yitao Liang
2023	A*	`conf`	SQA3D: Situated Question Answering in 3D Scenes. ICLR Xiaojian Ma, Silong Yong, Zilong Zheng, Qing Li, Yitao Liang, Song-Chun Zhu, Siyuan Huang
2022	A*	`conf`	Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions. CVPR Huaizu Jiang, Xiaojian Ma, Weili Nie, Zhiding Yu, Yuke Zhu, Anima Anandkumar
2022	J	`jnl`	Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions. CoRR Huaizu Jiang, Xiaojian Ma, Weili Nie, Zhiding Yu, Yuke Zhu, Anima Anandkumar
2022	J	`jnl`	Latent Diffusion Energy-Based Model for Interpretable Text Modeling. CoRR Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruiqi Gao, Yixin Zhu, Song-Chun Zhu, Ying Nian Wu
2022	A*	`conf`	Latent Diffusion Energy-Based Model for Interpretable Text Modelling. ICML Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruiqi Gao, Yixin Zhu, Song-Chun Zhu, Ying Nian Wu
2022	J	`jnl`	Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation. CoRR Jiangyong Huang, William Yicheng Zhu, Baoxiong Jia, Zan Wang, Xiaojian Ma, Qing Li, Siyuan Huang
2022	A*	`conf`	RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning. ICLR Xiaojian Ma, Weili Nie, Zhiding Yu, Huaizu Jiang, Chaowei Xiao, Yuke Zhu, Song-Chun Zhu, Anima Anandkumar
2022	J	`jnl`	RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning. CoRR Xiaojian Ma, Weili Nie, Zhiding Yu, Huaizu Jiang, Chaowei Xiao, Yuke Zhu, Song-Chun Zhu, Anima Anandkumar
2022	J	`jnl`	SQA3D: Situated Question Answering in 3D Scenes. CoRR Xiaojian Ma, Silong Yong, Zilong Zheng, Qing Li, Yitao Liang, Song-Chun Zhu, Siyuan Huang
2021	A*	`conf`	Adversarial Option-Aware Hierarchical Imitation Learning. ICML Mingxuan Jing, Wenbing Huang, Fuchun Sun, Xiaojian Ma, Tao Kong, Chuang Gan, Lei Li
2021	J	`jnl`	Adversarial Option-Aware Hierarchical Imitation Learning. CoRR Mingxuan Jing, Wenbing Huang, Fuchun Sun, Xiaojian Ma, Tao Kong, Chuang Gan, Lei Li
2021	J	`jnl`	HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem Solving. CoRR Sirui Xie, Xiaojian Ma, Peiyu Yu, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu
2021	A*	`conf`	Unsupervised Foreground Extraction via Deep Region Competition. NeurIPS Peiyu Yu, Sirui Xie, Xiaojian Ma, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu
2021	J	`jnl`	Unsupervised Foreground Extraction via Deep Region Competition. CoRR Peiyu Yu, Sirui Xie, Xiaojian Ma, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu
2020	A	`conf`	A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU. IROS Shuang Li, Jiaxi Jiang, Philipp Ruppel, Hongzhuo Liang, Xiaojian Ma, Norman Hendrich, Fuchun Sun, Jianwei Zhang
2020	J	`jnl`	A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU. CoRR Shuang Li, Jiaxi Jiang, Philipp Ruppel, Hongzhuo Liang, Xiaojian Ma, Norman Hendrich, Fuchun Sun, Jianwei Zhang
2020	A*	`conf`	Reinforcement Learning from Imperfect Demonstrations under Soft Expert Guidance. AAAI Mingxuan Jing, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Chao Yang, Bin Fang, Huaping Liu
2020	A	`conf`	Robust Robotic Pouring using Audition and Haptics. IROS Hongzhuo Liang, Chuangchuang Zhou, Shuang Li, Xiaojian Ma, Norman Hendrich, Timo Gerkmann, Fuchun Sun, Marcus Stoffel, Jianwei Zhang
2020	J	`jnl`	Robust Robotic Pouring using Audition and Haptics. CoRR Hongzhuo Liang, Chuangchuang Zhou, Shuang Li, Xiaojian Ma, Norman Hendrich, Timo Gerkmann, Fuchun Sun, Jianwei Zhang
2020	A*	`conf`	Theory-Based Causal Transfer: Integrating Instance-Level Induction and Abstract-Level Structure Learning. AAAI Mark Edmonds, Xiaojian Ma, Siyuan Qi, Yixin Zhu, Hongjing Lu, Song-Chun Zhu
2019	A*	`conf`	Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement. NeurIPS Chao Yang, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Huaping Liu, Junzhou Huang, Chuang Gan
2019	J	`jnl`	Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement. CoRR Chao Yang, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Huaping Liu, Junzhou Huang, Chuang Gan
2019	A	`conf`	Making Sense of Audio Vibration for Liquid Height Estimation in Robotic Pouring. IROS Hongzhuo Liang, Shuang Li, Xiaojian Ma, Norman Hendrich, Timo Gerkmann, Fuchun Sun, Jianwei Zhang
2019	J	`jnl`	Making Sense of Audio Vibration for Liquid Height Estimation in Robotic Pouring. CoRR Hongzhuo Liang, Shuang Li, Xiaojian Ma, Norman Hendrich, Timo Gerkmann, Jianwei Zhang
2019	A*	`conf`	PointNetGPD: Detecting Grasp Configurations from Point Sets. ICRA Hongzhuo Liang, Xiaojian Ma, Shuang Li, Michael Görner, Song Tang, Bin Fang, Fuchun Sun, Jianwei Zhang
2019	J	`jnl`	Reinforcement Learning from Imperfect Demonstrations under Soft Expert Guidance. CoRR Mingxuan Jing, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Chao Yang, Bin Fang, Huaping Liu
2019	A*	`conf`	Task Transfer by Preference-Based Cost Learning. AAAI Mingxuan Jing, Xiaojian Ma, Wen-bing Huang, Fuchun Sun, Huaping Liu
2019	J	`jnl`	Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning. CoRR Mark Edmonds, Xiaojian Ma, Siyuan Qi, Yixin Zhu, Hongjing Lu, Song-Chun Zhu
2019	A*	`conf`	Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. ICRA Shuang Li, Xiaojian Ma, Hongzhuo Liang, Michael Görner, Philipp Ruppel, Bin Fang, Fuchun Sun, Jianwei Zhang
2018	J	`jnl`	Adversarial Task Transfer from Preference. CoRR Xiaojian Ma, Mingxuan Jing, Fuchun Sun, Huaping Liu
2018	J	`jnl`	Learning and Inference Movement with Deep Generative Model. CoRR Mingxuan Jing, Xiaojian Ma, Fuchun Sun, Huaping Liu
2018	J	`jnl`	PointNetGPD: Detecting Grasp Configurations from Point Sets. CoRR Hongzhuo Liang, Xiaojian Ma, Shuang Li, Michael Görner, Song Tang, Bin Fang, Fuchun Sun, Jianwei Zhang
2018	J	`jnl`	Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. CoRR Shuang Li, Xiaojian Ma, Hongzhuo Liang, Michael Görner, Philipp Ruppel, Bin Fang, Fuchun Sun, Jianwei Zhang