Hexiang Hu

87 papers A* 28B 1Journal 50Unranked 8
YearRankTypeTitle / Venue / Authors
2026 J jnl
KITTEN: A Knowledge-Integrated Evaluation of Image Generation on Visual Entities.
Trans. Mach. Learn. Res.
Hsin-Ping Huang, Xinyi Wang, Yonatan Bitton, Hagai Taitelbaum, Gaurav Singh Tomar, Ming-Wei Chang, Xuhui Jia, Kelvin C. K. Chan, Hexiang Hu, Yu-Chuan Su, Ming-Hsuan Yang
2025 J jnl
Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps.
CoRR
Nanye Ma, Shangyuan Tong, Haolin Jia, Hexiang Hu, Yu-Chuan Su, Mingda Zhang, Xuan Yang, Yandong Li, Tommi S. Jaakkola, Xuhui Jia, Saining Xie
2025 — conf
LOFT: Scalable and More Realistic Long-Context Evaluation.
NAACL (Findings)
Jinhyuk Lee, Anthony Chen, Zhuyun Dai, Dheeru Dua, Devendra Singh Sachan, Michael Boratko, Yi Luan, Sébastien M. R. Arnold, Vincent Perot, Siddharth Dalmia, Hexiang Hu, Xudong Lin, Panupong Pasupat, Aida Amini, Jeremy R. Cole, Sebastian Riedel, Iftekhar Naim, Ming-Wei Chang, Kelvin Guu
2025 A* conf
MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks.
ICLR
Jiacheng Chen, Tianhao Liang, Sherman Siu, Zhengqing Wang, Kai Wang, Yubo Wang, Yuansheng Ni, Ziyan Jiang, Wang Zhu, Bohan Lyu, Dongfu Jiang, Xuan He, Yuan Liu, Hexiang Hu, Xiang Yue, Wenhu Chen
2025 A* conf
OmnixR: Evaluating Omni-modality Language Models on Reasoning across Modalities.
ICLR
Lichang Chen, Hexiang Hu, Mingda Zhang, Yiwen Chen, Zifeng Wang, Yandong Li, Pranav Shyam, Tianyi Zhou, Heng Huang, Ming-Hsuan Yang, Boqing Gong
2025 A* conf
Scaling Inference Time Compute for Diffusion Models.
CVPR
Nanye Ma, Shangyuan Tong, Haolin Jia, Hexiang Hu, Yu-Chuan Su, Mingda Zhang, Xuan Yang, Yandong Li, Tommi S. Jaakkola, Xuhui Jia, Saining Xie
2024 J jnl
Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
CoRR
Jinhyuk Lee, Anthony Chen, Zhuyun Dai, Dheeru Dua, Devendra Singh Sachan, Michael Boratko, Yi Luan, Sébastien M. R. Arnold, Vincent Perot, Siddharth Dalmia, Hexiang Hu, Xudong Lin, Panupong Pasupat, Aida Amini, Jeremy R. Cole, Sebastian Riedel, Iftekhar Naim, Ming-Wei Chang, Kelvin Guu
2024 A* conf
Instruct-Imagen: Image Generation with Multi-modal Instruction.
CVPR
Hexiang Hu, Kelvin C. K. Chan, Yu-Chuan Su, Wenhu Chen, Yandong Li, Kihyuk Sohn, Yang Zhao, Xue Ben, Boqing Gong, William W. Cohen, Ming-Wei Chang, Xuhui Jia
2024 J jnl
Instruct-Imagen: Image Generation with Multi-modal Instruction.
CoRR
Hexiang Hu, Kelvin C. K. Chan, Yu-Chuan Su, Wenhu Chen, Yandong Li, Kihyuk Sohn, Yang Zhao, Xue Ben, Boqing Gong, William W. Cohen, Ming-Wei Chang, Xuhui Jia
2024 J jnl
KITTEN: A Knowledge-Intensive Evaluation of Image Generation on Visual Entities.
CoRR
Hsin-Ping Huang, Xinyi Wang, Yonatan Bitton, Hagai Taitelbaum, Gaurav Singh Tomar, Ming-Wei Chang, Xuhui Jia, Kelvin C. K. Chan, Hexiang Hu, Yu-Chuan Su, Ming-Hsuan Yang
2024 J jnl
MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks.
CoRR
Jiacheng Chen, Tianhao Liang, Sherman Siu, Zhengqing Wang, Kai Wang, Yubo Wang, Yuansheng Ni, Wang Zhu, Ziyan Jiang, Bohan Lyu, Dongfu Jiang, Xuan He, Yuan Liu, Hexiang Hu, Xiang Yue, Wenhu Chen
2024 A* conf
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions.
ICML
Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang
2024 J jnl
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions.
CoRR
Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang
2024 J jnl
OmnixR: Evaluating Omni-modality Language Models on Reasoning across Modalities.
CoRR
Lichang Chen, Hexiang Hu, Mingda Zhang, Yiwen Chen, Zifeng Wang, Yandong Li, Pranav Shyam, Tianyi Zhou, Heng Huang, Ming-Hsuan Yang, Boqing Gong
2024 A* conf
On Scaling Up a Multilingual Vision and Language Model.
CVPR
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2024 — conf
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers.
ECCV (87)
Cong Wei, Yang Chen, Haonan Chen, Hexiang Hu, Ge Zhang, Jie Fu, Alan Ritter, Wenhu Chen
2023 A* conf
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?
EMNLP
Yang Chen, Hexiang Hu, Yi Luan, Haitian Sun, Soravit Changpinyo, Alan Ritter, Ming-Wei Chang
2023 J jnl
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?
CoRR
Yang Chen, Hexiang Hu, Yi Luan, Haitian Sun, Soravit Changpinyo, Alan Ritter, Ming-Wei Chang
2023 J jnl
Drinking From a Firehose: Continual Learning With Web-Scale Natural Language.
IEEE Trans. Pattern Anal. Mach. Intell.
Hexiang Hu, Ozan Sener, Fei Sha, Vladlen Koltun
2023 A* conf
From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces.
NeurIPS
Peter Shaw, Mandar Joshi, James Cohan, Jonathan Berant, Panupong Pasupat, Hexiang Hu, Urvashi Khandelwal, Kenton Lee, Kristina Toutanova
2023 J jnl
From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces.
CoRR
Peter Shaw, Mandar Joshi, James Cohan, Jonathan Berant, Panupong Pasupat, Hexiang Hu, Urvashi Khandelwal, Kenton Lee, Kristina Toutanova
2023 A* conf
Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities.
ICCV
Hexiang Hu, Yi Luan, Yang Chen, Urvashi Khandelwal, Mandar Joshi, Kenton Lee, Kristina Toutanova, Ming-Wei Chang
2023 J jnl
Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities.
CoRR
Hexiang Hu, Yi Luan, Yang Chen, Urvashi Khandelwal, Mandar Joshi, Kenton Lee, Kristina Toutanova, Ming-Wei Chang
2023 J jnl
PaLI-X: On Scaling up a Multilingual Vision and Language Model.
CoRR
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2023 A* conf
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding.
ICML
Kenton Lee, Mandar Joshi, Iulia Raluca Turc, Hexiang Hu, Fangyu Liu, Julian Martin Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, Kristina Toutanova
2023 A* conf
PreSTU: Pre-Training for Scene-Text Understanding.
ICCV
Jihyung Kil, Soravit Changpinyo, Xi Chen, Hexiang Hu, Sebastian Goodman, Wei-Lun Chao, Radu Soricut
2023 A* conf
Re-Imagen: Retrieval-Augmented Text-to-Image Generator.
ICLR
Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen
2023 A* conf
Subject-driven Text-to-Image Generation via Apprenticeship Learning.
NeurIPS
Wenhu Chen, Hexiang Hu, Yandong Li, Nataniel Ruiz, Xuhui Jia, Ming-Wei Chang, William W. Cohen
2023 J jnl
Subject-driven Text-to-Image Generation via Apprenticeship Learning.
CoRR
Wenhu Chen, Hexiang Hu, Yandong Li, Nataniel Ruiz, Xuhui Jia, Ming-Wei Chang, William W. Cohen
2023 J jnl
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers.
CoRR
Cong Wei, Yang Chen, Haonan Chen, Hexiang Hu, Ge Zhang, Jie Fu, Alan Ritter, Wenhu Chen
2022 A* conf
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text.
EMNLP
Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen
2022 J jnl
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text.
CoRR
Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen
2022 J jnl
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding.
CoRR
Kenton Lee, Mandar Joshi, Iulia Turc, Hexiang Hu, Fangyu Liu, Julian Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, Kristina Toutanova
2022 J jnl
PreSTU: Pre-Training for Scene-Text Understanding.
CoRR
Jihyung Kil, Soravit Changpinyo, Xi Chen, Hexiang Hu, Sebastian Goodman, Wei-Lun Chao, Radu Soricut
2022 J jnl
Re-Imagen: Retrieval-Augmented Text-to-Image Generator.
CoRR
Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen
2021 J jnl
A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection.
CoRR
Cheng Zhang, Tai-Yu Pan, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
2021 J jnl
Learning Adaptive Classifiers Synthesis for Generalized Few-Shot Learning.
Int. J. Comput. Vis.
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan
2021 A* conf
Learning the Best Pooling Strategy for Visual Semantic Embedding.
CVPR
Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang, Changhu Wang
2021 A* conf
MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection.
ICCV
Cheng Zhang, Tai-Yu Pan, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
2021 A* conf
On Model Calibration for Long-Tailed Object Detection and Instance Segmentation.
NeurIPS
Tai-Yu Pan, Cheng Zhang, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
2021 J jnl
On Model Calibration for Long-Tailed Object Detection and Instance Segmentation.
CoRR
Tai-Yu Pan, Cheng Zhang, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
2021 — conf
Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?
EMNLP (1)
Linlu Qiu, Hexiang Hu, Bowen Zhang, Peter Shaw, Fei Sha
2021 J jnl
Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?
CoRR
Linlu Qiu, Hexiang Hu, Bowen Zhang, Peter Shaw, Fei Sha
2021 — conf
Visually Grounded Concept Composition.
EMNLP (Findings)
Bowen Zhang, Hexiang Hu, Linlu Qiu, Peter Shaw, Fei Sha
2021 J jnl
Visually Grounded Concept Composition.
CoRR
Bowen Zhang, Hexiang Hu, Linlu Qiu, Peter Shaw, Fei Sha
2020 J jnl
A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus.
CoRR
Bowen Zhang, Hexiang Hu, Joonseok Lee, Ming Zhao, Sheide Chammas, Vihan Jain, Eugene Ie, Fei Sha
2020 A* conf
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps.
ACL
Wang Zhu, Hexiang Hu, Jiacheng Chen, Zhiwei Deng, Vihan Jain, Eugene Ie, Fei Sha
2020 J jnl
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps.
CoRR
Wang Zhu, Hexiang Hu, Jiacheng Chen, Zhiwei Deng, Vihan Jain, Eugene Ie, Fei Sha
2020 J jnl
Drinking from a Firehose: Continual Learning with Web-scale Natural Language.
CoRR
Hexiang Hu, Ozan Sener, Fei Sha, Vladlen Koltun
2020 A* conf
Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions.
CVPR
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha
2020 J jnl
Learning the Best Pooling Strategy for Visual Semantic Embedding.
CoRR
Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang, Changhu Wang
2020 — conf
Learning to Represent Image and Text with Denotation Graph.
EMNLP (1)
Bowen Zhang, Hexiang Hu, Vihan Jain, Eugene Ie, Fei Sha
2020 J jnl
Learning to Represent Image and Text with Denotation Graph.
CoRR
Bowen Zhang, Hexiang Hu, Vihan Jain, Eugene Ie, Fei Sha
2020 J jnl
Structured Label Inference for Visual Understanding.
IEEE Trans. Pattern Anal. Mach. Intell.
Nelson Nauata, Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
2020 J jnl
Visual Storytelling via Predicting Anchor Word Embeddings in the Stories.
CoRR
Bowen Zhang, Hexiang Hu, Fei Sha
2019 J jnl
Binary Image Selection (BISON): Interpretable Evaluation of Visual Grounding.
CoRR
Hexiang Hu, Ishan Misra, Laurens van der Maaten
2019 A* conf
Engaging Image Captioning via Personality.
CVPR
Kurt Shuster, Samuel Humeau, Hexiang Hu, Antoine Bordes, Jason Weston
2019 — conf
Evaluating Text-to-Image Matching using Binary Image Selection (BISON).
ICCV Workshops
Hexiang Hu, Ishan Misra, Laurens van der Maaten
2019 J jnl
Learning Classifier Synthesis for Generalized Few-Shot Learning.
CoRR
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha
2019 A* conf
Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation.
NeurIPS
Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim
2019 J jnl
Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation.
CoRR
Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim
2019 J jnl
Synthesized Policies for Transfer and Adaptation across Tasks and Environments.
CoRR
Hexiang Hu, Liyu Chen, Boqing Gong, Fei Sha
2018 — conf
Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets.
NAACL-HLT
Wei-Lun Chao, Hexiang Hu, Fei Sha
2018 A* conf
Compressed Video Action Recognition.
CVPR
Chao-Yuan Wu, Manzil Zaheer, Hexiang Hu, R. Manmatha, Alexander J. Smola, Philipp Krähenbühl
2018 A* conf
Cross-Dataset Adaptation for Visual Question Answering.
CVPR
Wei-Lun Chao, Hexiang Hu, Fei Sha
2018 J jnl
Cross-Dataset Adaptation for Visual Question Answering.
CoRR
Wei-Lun Chao, Hexiang Hu, Fei Sha
2018 — conf
Cross-Modal and Hierarchical Modeling of Video and Text.
ECCV (13)
Bowen Zhang, Hexiang Hu, Fei Sha
2018 J jnl
Cross-Modal and Hierarchical Modeling of Video and Text.
CoRR
Bowen Zhang, Hexiang Hu, Fei Sha
2018 J jnl
Engaging Image Captioning Via Personality.
CoRR
Kurt Shuster, Samuel Humeau, Hexiang Hu, Antoine Bordes, Jason Weston
2018 A* conf
Learning Answer Embeddings for Visual Question Answering.
CVPR
Hexiang Hu, Wei-Lun Chao, Fei Sha
2018 J jnl
Learning Answer Embeddings for Visual Question Answering.
CoRR
Hexiang Hu, Wei-Lun Chao, Fei Sha
2018 J jnl
Learning Embedding Adaptation for Few-Shot Learning.
CoRR
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha
2018 B conf
Multi-Task Learning for Sequence Tagging: An Empirical Study.
COLING
Soravit Changpinyo, Hexiang Hu, Fei Sha
2018 J jnl
Multi-Task Learning for Sequence Tagging: An Empirical Study.
CoRR
Soravit Changpinyo, Hexiang Hu, Fei Sha
2018 J jnl
Structured Label Inference for Visual Understanding.
CoRR
Nelson Nauata, Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
2018 A* conf
Synthesize Policies for Transfer and Adaptation across Tasks and Environments.
NeurIPS
Hexiang Hu, Liyu Chen, Boqing Gong, Fei Sha
2018 J jnl
Toward Multimodal Model-Agnostic Meta-Learning.
CoRR
Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim
2017 J jnl
Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets.
CoRR
Wei-Lun Chao, Hexiang Hu, Fei Sha
2017 J jnl
Compressed Video Action Recognition.
CoRR
Chao-Yuan Wu, Manzil Zaheer, Hexiang Hu, R. Manmatha, Alexander J. Smola, Philipp Krähenbühl
2017 A* conf
FastMask: Segment Multi-scale Object Candidates in One Shot.
CVPR
Hexiang Hu, Shiyi Lan, Yuning Jiang, Zhimin Cao, Fei Sha
2017 J jnl
LabelBank: Revisiting Global Perspectives for Semantic Segmentation.
CoRR
Hexiang Hu, Zhiwei Deng, Guang-Tong Zhou, Fei Sha, Greg Mori
2016 J jnl
FastMask: Segment Object Multi-scale Candidates in One Shot.
CoRR
Hexiang Hu, Shiyi Lan, Yuning Jiang, Zhimin Cao, Fei Sha
2016 A* conf
Learning Structured Inference Neural Networks with Label Relations.
CVPR
Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
2016 J jnl
Recalling Holistic Information for Semantic Segmentation.
CoRR
Hexiang Hu, Zhiwei Deng, Guang-Tong Zhou, Fei Sha, Greg Mori
2016 A* conf
Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition.
CVPR
Zhiwei Deng, Arash Vahdat, Hexiang Hu, Greg Mori
2015 J jnl
Learning Structured Inference Neural Networks with Label Relations.
CoRR
Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
2015 J jnl
Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition.
CoRR
Zhiwei Deng, Arash Vahdat, Hexiang Hu, Greg Mori