Shengbang Tong

50 papers A* 9Journal 36Unranked 5

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Asymmetric Idiosyncrasies in Multimodal Models. CoRR Muzi Tao, Chufan Shi, Huijuan Wang, Shengbang Tong, Xuezhe Ma
2026	J	`jnl`	Beyond Language Modeling: An Exploration of Multimodal Pretraining. CoRR Shengbang Tong, David Fan, John Nguyen, Ellis Brown, Gaoyue Zhou, Shengyi Qian, Boyang Zheng, Théophane Vallaeys, Junlin Han, Rob Fergus, Naila Murray, Marjan Ghazvininejad, Mike Lewis, Nicolas Ballas, Amir Bar, Michael Rabbat, Jakob Verbeek, Luke Zettlemoyer, Koustuv Sinha, Yann LeCun, Saining Xie
2026	J	`jnl`	Reliable and Responsible Foundation Models: A Comprehensive Survey. CoRR Xinyu Yang, Junlin Han, Rishi Bommasani, Jinqi Luo, Wenjie Qu, Wangchunshu Zhou, Adel Bibi, Xiyao Wang, Jaehong Yoon, Elias Stengel-Eskin, Shengbang Tong, Lingfeng Shen, Rafael Rafailov, Runjia Li, Zhaoyang Wang, Yiyang Zhou, Chenhang Cui, Yu Wang, Wenhao Zheng, Huichi Zhou, Jindong Gu, Zhaorun Chen, Peng Xia, Tony Lee, Thomas P. Zollo, Vikash Sehwag, Jixuan Leng, Jiuhai Chen, Yuxin Wen, Huan Zhang, Zhun Deng, Linjun Zhang, Pavel Izmailov, Pang Wei Koh, Yulia Tsvetkov, Andrew Wilson, Jiaheng Zhang, James Zou, Cihang Xie, Hao Wang, Philip Torr, Julian J. McAuley, David Alvarez-Melis, Florian Tramèr, Kaidi Xu, Suman Jana, Chris Callison-Burch, René Vidal, Filippos Kokkinos, Mohit Bansal, Beidi Chen, Huaxiu Yao
2026	J	`jnl`	Scaling Text-to-Image Diffusion Transformers with Representation Autoencoders. CoRR Shengbang Tong, Boyang Zheng, Ziteng Wang, Bingda Tang, Nanye Ma, Ellis Brown, Jihan Yang, Rob Fergus, Yann LeCun, Saining Xie
2026	A*	`conf`	Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs. AAAI Chun-Hsiao Yeh, Chenyu Wang, Shengbang Tong, Ta Ying Cheng, Ruoyu Wang, Tianzhe Chu, Yuexiang Zhai, Yubei Chen, Shenghua Gao, Yi Ma
2025	J	`jnl`	Cambrian-S: Towards Spatial Supersensing in Video. CoRR Shusheng Yang, Jihan Yang, Pinzhi Huang, Ellis Brown, Zihao Yang, Yue Yu, Shengbang Tong, Zihan Zheng, Yifan Xu, Muhan Wang, Daohan Lu, Rob Fergus, Yann LeCun, Li Fei-Fei, Saining Xie
2025	J	`jnl`	Diffusion Transformers with Representation Autoencoders. CoRR Boyang Zheng, Nanye Ma, Shengbang Tong, Saining Xie
2025	J	`jnl`	From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models. CoRR Irving Fang, Juexiao Zhang, Shengbang Tong, Chen Feng
2025	J	`jnl`	From Pixels to Feelings: Aligning MLLMs with Human Cognitive Perception of Images. CoRR Yiming Chen, Junlin Han, Tianyi Bai, Shengbang Tong, Filippos Kokkinos, Philip Torr
2025	J	`jnl`	Learning to See Before Seeing: Demystifying LLM Visual Priors from Language Pre-training. CoRR Junlin Han, Shengbang Tong, David Fan, Yufan Ren, Koustuv Sinha, Philip Torr, Filippos Kokkinos
2025	—	`conf`	MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark. ACL (1) Xiang Yue, Tianyu Zheng, Yuansheng Ni, Yubo Wang, Kai Zhang, Shengbang Tong, Yuxuan Sun, Botao Yu, Ge Zhang, Huan Sun, Yu Su, Wenhu Chen, Graham Neubig
2025	J	`jnl`	Reliable and Responsible Foundation Models. Trans. Mach. Learn. Res. Xinyu Yang, Junlin Han, Rishi Bommasani, Jinqi Luo, Wenjie Qu, Wangchunshu Zhou, Adel Bibi, Xiyao Wang, Jaehong Yoon, Elias Stengel-Eskin, Shengbang Tong, Lingfeng Shen, Rafael Rafailov, Runjia Li, Zhaoyang Wang, Yiyang Zhou, Chenhang Cui, Yu Wang, Wenhao Zheng, Huichi Zhou, Jindong Gu, Zhaorun Chen, Peng Xia, Tony Lee, Thomas P. Zollo, Vikash Sehwag, Jixuan Leng, Jiuhai Chen, Yuxin Wen, Huan Zhang, Zhun Deng, Linjun Zhang, Pavel Izmailov, Pang Wei Koh, Yulia Tsvetkov, Andrew Gordon Wilson, Jiaheng Zhang, James Zou, Cihang Xie, Hao Wang, Philip Torr, Julian J. McAuley, David Alvarez-Melis, Florian Tramèr, Kaidi Xu, Suman Jana, Chris Callison-Burch, René Vidal, Filippos Kokkinos, Mohit Bansal, Beidi Chen, Huaxiu Yao
2025	A*	`conf`	SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training. ICML Tianzhe Chu, Yuexiang Zhai, Jihan Yang, Shengbang Tong, Saining Xie, Dale Schuurmans, Quoc V. Le, Sergey Levine, Yi Ma
2025	J	`jnl`	SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training. CoRR Tianzhe Chu, Yuexiang Zhai, Jihan Yang, Shengbang Tong, Saining Xie, Dale Schuurmans, Quoc V. Le, Sergey Levine, Yi Ma
2025	J	`jnl`	Scaling Language-Free Visual Representation Learning. CoRR David Fan, Shengbang Tong, Jiachen Zhu, Koustuv Sinha, Zhuang Liu, Xinlei Chen, Michael Rabbat, Nicolas Ballas, Yann LeCun, Amir Bar, Saining Xie
2025	J	`jnl`	Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs. CoRR Chun-Hsiao Yeh, Chenyu Wang, Shengbang Tong, Ta Ying Cheng, Ruoyu Wang, Tianzhe Chu, Yuexiang Zhai, Yubei Chen, Shenghua Gao, Yi Ma
2025	J	`jnl`	Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction. CoRR Junhong Shen, Hao Bai, Lunjun Zhang, Yifei Zhou, Amrith Setlur, Shengbang Tong, Diego Caples, Nan Jiang, Tong Zhang, Ameet Talwalkar, Aviral Kumar
2024	J	`jnl`	Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs. CoRR Shengbang Tong, Ellis Brown, Penghao Wu, Sanghyun Woo, Manoj Middepogu, Sai Charitha Akula, Jihan Yang, Shusheng Yang, Adithya Iyer, Xichen Pan, Austin Wang, Rob Fergus, Yann LeCun, Saining Xie
2024	—	`conf`	Closed-Loop Transcription via Convolutional Sparse Coding. CPAL Xili Dai, Ke Chen, Shengbang Tong, Jingyuan Zhang, Xingjian Gao, Mingyang Li, Druv Pai, Yuexiang Zhai, Xiaojun Yuan, Heung-Yeung Shum, Lionel M. Ni, Yi Ma
2024	J	`jnl`	Connecting Joint-Embedding Predictive Architecture with Contrastive Self-supervised Learning. CoRR Shentong Mo, Shengbang Tong
2024	J	`jnl`	Ctrl123: Consistent Novel View Synthesis via Closed-Loop Transcription. CoRR Hongxiang Zhao, Xili Dai, Jianan Wang, Shengbang Tong, Jingyuan Zhang, Weida Wang, Lei Zhang, Yi Ma
2024	—	`conf`	Emergence of Segmentation with Minimalistic White-Box Transformers. CPAL Yaodong Yu, Tianzhe Chu, Shengbang Tong, Ziyang Wu, Druv Pai, Sam Buchanan, Yi Ma
2024	A*	`conf`	Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs. CVPR Shengbang Tong, Zhuang Liu, Yuexiang Zhai, Yi Ma, Yann LeCun, Saining Xie
2024	J	`jnl`	Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs. CoRR Shengbang Tong, Zhuang Liu, Yuexiang Zhai, Yi Ma, Yann LeCun, Saining Xie
2024	J	`jnl`	Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning. CoRR Yuexiang Zhai, Hao Bai, Zipeng Lin, Jiayi Pan, Shengbang Tong, Yifei Zhou, Alane Suhr, Saining Xie, Yann LeCun, Yi Ma, Sergey Levine
2024	A*	`conf`	Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models. ICLR Tianzhe Chu, Shengbang Tong, Tianjiao Ding, Xili Dai, Benjamin David Haeffele, René Vidal, Yi Ma
2024	—	`conf`	Investigating the Catastrophic Forgetting in Multimodal Large Language Model Fine-Tuning. CPAL Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, Yi Ma
2024	J	`jnl`	MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark. CoRR Xiang Yue, Tianyu Zheng, Yuansheng Ni, Yubo Wang, Kai Zhang, Shengbang Tong, Yuxuan Sun, Botao Yu, Ge Zhang, Huan Sun, Yu Su, Wenhu Chen, Graham Neubig
2024	J	`jnl`	MetaMorph: Multimodal Understanding and Generation via Instruction Tuning. CoRR Shengbang Tong, David Fan, Jiachen Zhu, Yunyang Xiong, Xinlei Chen, Koustuv Sinha, Michael Rabbat, Yann LeCun, Saining Xie, Zhuang Liu
2024	—	`conf`	Unsupervised Learning of Structured Representation via Closed-Loop Transcription. CPAL Shengbang Tong, Xili Dai, Yubei Chen, Mingyang Li, Zengyi Li, Brent Yi, Yann LeCun, Yi Ma
2024	J	`jnl`	White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is? J. Mach. Learn. Res. Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Hao Bai, Yuexiang Zhai, Benjamin D. Haeffele, Yi Ma
2023	J	`jnl`	Closed-Loop Transcription via Convolutional Sparse Coding. CoRR Xili Dai, Ke Chen, Shengbang Tong, Jingyuan Zhang, Xingjian Gao, Mingyang Li, Druv Pai, Yuexiang Zhai, Xiaojun Yuan, Heung-Yeung Shum, Lionel M. Ni, Yi Ma
2023	J	`jnl`	EMP-SSL: Towards Self-Supervised Learning in One Training Epoch. CoRR Shengbang Tong, Yubei Chen, Yi Ma, Yann LeCun
2023	J	`jnl`	Emergence of Segmentation with Minimalistic White-Box Transformers. CoRR Yaodong Yu, Tianzhe Chu, Shengbang Tong, Ziyang Wu, Druv Pai, Sam Buchanan, Yi Ma
2023	J	`jnl`	Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models. CoRR Tianzhe Chu, Shengbang Tong, Tianjiao Ding, Xili Dai, Benjamin David Haeffele, René Vidal, Yi Ma
2023	A*	`conf`	Incremental Learning of Structured Memory via Closed-Loop Transcription. ICLR Shengbang Tong, Xili Dai, Ziyang Wu, Mingyang Li, Brent Yi, Yi Ma
2023	J	`jnl`	Investigating the Catastrophic Forgetting in Multimodal Large Language Models. CoRR Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, Yi Ma
2023	A*	`conf`	Mass-Producing Failures of Multimodal Systems with Language Models. NeurIPS Shengbang Tong, Erik Jones, Jacob Steinhardt
2023	J	`jnl`	Mass-Producing Failures of Multimodal Systems with Language Models. CoRR Shengbang Tong, Erik Jones, Jacob Steinhardt
2023	A*	`conf`	Unsupervised Manifold Linearizing and Clustering. ICCV Tianjiao Ding, Shengbang Tong, Kwan Ho Ryan Chan, Xili Dai, Yi Ma, Benjamin D. Haeffele
2023	J	`jnl`	Unsupervised Manifold Linearizing and Clustering. CoRR Tianjiao Ding, Shengbang Tong, Kwan Ho Ryan Chan, Xili Dai, Yi Ma, Benjamin D. Haeffele
2023	A*	`conf`	White-Box Transformers via Sparse Rate Reduction. NeurIPS Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Benjamin D. Haeffele, Yi Ma
2023	J	`jnl`	White-Box Transformers via Sparse Rate Reduction. CoRR Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Benjamin D. Haeffele, Yi Ma
2023	J	`jnl`	White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is? CoRR Yaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu, Ziyang Wu, Shengbang Tong, Hao Bai, Yuexiang Zhai, Benjamin D. Haeffele, Yi Ma
2022	J	`jnl`	CTRL: Closed-Loop Transcription to an LDR via Minimaxing Rate Reduction. Entropy Xili Dai, Shengbang Tong, Mingyang Li, Ziyang Wu, Michael Psenka, Kwan Ho Ryan Chan, Pengyuan Zhai, Yaodong Yu, Xiaojun Yuan, Heung-Yeung Shum, Yi Ma
2022	J	`jnl`	Incremental Learning of Structured Memory via Closed-Loop Transcription. CoRR Shengbang Tong, Xili Dai, Ziyang Wu, Mingyang Li, Brent Yi, Yi Ma
2022	A*	`conf`	Revisiting Sparse Convolutional Model for Visual Recognition. NeurIPS Xili Dai, Mingyang Li, Pengyuan Zhai, Shengbang Tong, Xingjian Gao, Shao-Lun Huang, Zhihui Zhu, Chong You, Yi Ma
2022	J	`jnl`	Revisiting Sparse Convolutional Model for Visual Recognition. CoRR Xili Dai, Mingyang Li, Pengyuan Zhai, Shengbang Tong, Xingjian Gao, Shao-Lun Huang, Zhihui Zhu, Chong You, Yi Ma
2022	J	`jnl`	Unsupervised Learning of Structured Representations via Closed-Loop Transcription. CoRR Shengbang Tong, Xili Dai, Yubei Chen, Mingyang Li, Zengyi Li, Brent Yi, Yann LeCun, Yi Ma
2021	J	`jnl`	Closed-Loop Data Transcription to an LDR via Minimaxing Rate Reduction. CoRR Xili Dai, Shengbang Tong, Mingyang Li, Ziyang Wu, Kwan Ho Ryan Chan, Pengyuan Zhai, Yaodong Yu, Michael Psenka, Xiaojun Yuan, Heung-Yeung Shum, Yi Ma