Jiuxiang Gu

160 papers A* 38A 4B 1Misc 2Journal 96Unranked 19
YearRankTypeTitle / Venue / Authors
2026 — conf
A Survey on LLM-based Conversational User Simulation.
EACL (Volume 1: Long Papers)
Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa F. Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
2026 J jnl
Automatic Method Illustration Generation for AI Scientific Papers via Drawing Middleware Creation, Evolution, and Orchestration.
CoRR
Zhuoling Li, Jiarui Zhang, Ping Hu, Jason Kuen, Jiuxiang Gu, Hossein Rahmani, Jun Liu
2026 J jnl
DiffGraph: An Automated Agent-driven Model Merging Framework for In-the-Wild Text-to-Image Generation.
CoRR
Zhuoling Li, Hossein Rahmani, Jiarui Zhang, Yu Xue, Majid Mirmehdi, Jason Kuen, Jiuxiang Gu, Jun Liu
2026 J jnl
From Preferences to Prejudice: The Role of Alignment Tuning in Shaping Social Bias in Video Diffusion Models.
Trans. Mach. Learn. Res.
Zefan Cai, Haoyi Qiu, Haozhe Zhao, Ke Wan, Jiachen Li, Jiuxiang Gu, Wen Xiao, Nanyun Peng, Junjie Hu
2026 J jnl
LaViDa-R1: Advancing Reasoning for Unified Multimodal Diffusion Language Models.
CoRR
Shufan Li, Yuchen Zhu, Jiuxiang Gu, Kangning Liu, Zhe Lin, Yongxin Chen, Molei Tao, Aditya Grover, Jason Kuen
2026 J jnl
MiLDEdit: Reasoning-Based Multi-Layer Design Document Editing.
CoRR
Zihao Lin, Wanrong Zhu, Jiuxiang Gu, Jihyung Kil, Christopher Tensmeyer, Lin Zhang, Shilong Liu, Ruiyi Zhang, Lifu Huang, Vlad I. Morariu, Tong Sun
2026 A* conf
OIDA-QA: A Multimodal Benchmark for Analyzing the Opioid Industry Documents Archive.
AAAI
Xuan Shen, Brian Wingenroth, Zichao Wang, Jason Kuen, Wanrong Zhu, Ruiyi Zhang, Yiwei Wang, Lichun Ma, Anqi Liu, Hongfu Liu, Tong Sun, Kevin S. Hawkins, Kate Tasker, G. Caleb Alexander, Jiuxiang Gu
2026 J jnl
Reasoning-Based Personalized Generation for Users with Sparse Data.
CoRR
Bo Ni, Branislav Kveton, Samyadeep Basu, Subhojyoti Mukherjee, Leyao Wang, Franck Dernoncourt, Sungchul Kim, Seunghyun Yoon, Zichao Wang, Ruiyi Zhang, Puneet Mathur, Jihyung Kil, Jiuxiang Gu, Nedim Lipka, Yu Wang, Ryan A. Rossi, Tyler Derr
2026 J jnl
SNCE: Geometry-Aware Supervision for Scalable Discrete Image Generation.
CoRR
Shufan Li, Jiuxiang Gu, Kangning Liu, Zhe Lin, Aditya Grover, Jason Kuen
2026 A* conf
VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use.
AAAI
Zhehao Zhang, Ryan A. Rossi, Tong Yu, Franck Dernoncourt, Ruiyi Zhang, Jiuxiang Gu, Sungchul Kim, Xiang Chen, Zichao Wang, Nedim Lipka
2025 Misc conf
A Survey on Small Language Models.
RANLP
Chien Van Nguyen, Xuan Shen, Ryan Aponte, Yu Xia, Samyadeep Basu, Zhengmian Hu, Jian Chen, Mihir Parmar, Sasidhar Kunapuli, Joe Barrow, Junda Wu, Ashish Singh, Yu Wang, Jiuxiang Gu, Nesreen K. Ahmed, Nedim Lipka, Ruiyi Zhang, Xiang Chen, Tong Yu, Sungchul Kim, Hanieh Deilamsalehy, Namyong Park, Michael Rimer, Zhehao Zhang, Huanrui Yang, Puneet Mathur, Gang Wu, Franck Dernoncourt, Ryan A. Rossi, Thien Huu Nguyen
2025 A conf
ARTIST: Improving the Generation of Text-Rich Images with Disentangled Diffusion Models and Large Language Models.
WACV
Jianyi Zhang, Yufan Zhou, Jiuxiang Gu, Curtis Wigington, Tong Yu, Yiran Chen, Tong Sun, Ruiyi Zhang
2025 A* conf
CoMMIT: Coordinated Multimodal Instruction Tuning.
EMNLP
Xintong Li, Junda Wu, Tong Yu, Rui Wang, Yu Wang, Xiang Chen, Jiuxiang Gu, Lina Yao, Julian J. McAuley, Jingbo Shang
2025 A conf
Differential Privacy Mechanisms in Neural Tangent Kernel Regression.
WACV
Jiuxiang Gu, Yingyu Liang, Zhizhou Sha, Zhenmei Shi, Zhao Song
2025 J jnl
DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance.
CoRR
Xuan Shen, Chenxia Han, Yufa Zhou, Yanyue Xie, Yifan Gong, Quanyi Wang, Yiwei Wang, Yanzhi Wang, Pu Zhao, Jiuxiang Gu
2025 J jnl
Efficient Reasoning with Hidden Thinking.
CoRR
Xuan Shen, Yizhou Wang, Xiangxi Shi, Yanzhi Wang, Pu Zhao, Jiuxiang Gu
2025 J jnl
FastCar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the Edge.
CoRR
Xuan Shen, Weize Ma, Yufa Zhou, Enhao Tang, Yanyue Xie, Zhengang Li, Yifan Gong, Quanyi Wang, Henghui Ding, Yiwei Wang, Yanzhi Wang, Pu Zhao, Jun Lin, Jiuxiang Gu
2025 J jnl
From Preferences to Prejudice: The Role of Alignment Tuning in Shaping Social Bias in Video Diffusion Models.
CoRR
Zefan Cai, Haoyi Qiu, Haozhe Zhao, Ke Wan, Jiachen Li, Jiuxiang Gu, Wen Xiao, Nanyun Peng, Junjie Hu
2025 — conf
From Selection to Generation: A Survey of LLM-based Active Learning.
ACL (1)
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian J. McAuley
2025 J jnl
From Selection to Generation: A Survey of LLM-based Active Learning.
CoRR
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian J. McAuley
2025 J jnl
Image Tokenizer Needs Post-Training.
CoRR
Kai Qiu, Xiang Li, Hao Chen, Jason Kuen, Xiaohao Xu, Jiuxiang Gu, Yinyi Luo, Bhiksha Raj, Zhe Lin, Marios Savvides
2025 A* conf
ImageFolder: Autoregressive Image Generation with Folded Tokens.
ICLR
Xiang Li, Kai Qiu, Hao Chen, Jason Kuen, Jiuxiang Gu, Bhiksha Raj, Zhe Lin
2025 J jnl
Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation.
CoRR
Shufan Li, Jiuxiang Gu, Kangning Liu, Zhe Lin, Zijun Wei, Aditya Grover, Jason Kuen
2025 A* conf
LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers.
AAAI
Xuan Shen, Zhao Song, Yufa Zhou, Bo Chen, Yanyu Li, Yifan Gong, Kai Zhang, Hao Tan, Jason Kuen, Henghui Ding, Zhihao Shu, Wei Niu, Pu Zhao, Yanzhi Wang, Jiuxiang Gu
2025 J jnl
MENTOR: Efficient Multimodal-Conditioned Tuning for Autoregressive Vision Generation Models.
CoRR
Haozhe Zhao, Zefan Cai, Shuzheng Si, Liang Chen, Jiuxiang Gu, Wen Xiao, Junjie Hu
2025 — conf
METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scaling.
ACL (1)
Bingxuan Li, Yiwei Wang, Jiuxiang Gu, Kai-Wei Chang, Nanyun Peng
2025 J jnl
METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scaling.
CoRR
Bingxuan Li, Yiwei Wang, Jiuxiang Gu, Kai-Wei Chang, Nanyun Peng
2025 J jnl
MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces.
CoRR
Reuben Luera, Ryan A. Rossi, Franck Dernoncourt, Samyadeep Basu, Sungchul Kim, Subhojyoti Mukherjee, Puneet Mathur, Ruiyi Zhang, Jihyung Kil, Nedim Lipka, Seunghyun Yoon, Jiuxiang Gu, Zichao Wang, Cindy Xiong Bearfield, Branislav Kveton
2025 J jnl
MMGR: Multi-Modal Generative Reasoning.
CoRR
Zefan Cai, Haoyi Qiu, Tianyi Ma, Haozhe Zhao, Gengze Zhou, Kung-Hsiang Huang, Parisa Kordjamshidi, Minjia Zhang, Wen Xiao, Jiuxiang Gu, Nanyun Peng, Junjie Hu
2025 J jnl
MS4UI: A Dataset for Multi-modal Summarization of User Interface Instructional Videos.
CoRR
Yuan Zang, Hao Tan, Seunghyun Yoon, Franck Dernoncourt, Jiuxiang Gu, Kushal Kafle, Chen Sun, Trung Bui
2025 A* conf
MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Data.
CVPR
Hanwen Jiang, Zexiang Xu, Desai Xie, Ziwen Chen, Haian Jin, Fujun Luan, Zhixin Shu, Kai Zhang, Sai Bi, Xin Sun, Jiuxiang Gu, Qixing Huang, Georgios Pavlakos, Hao Tan
2025 J jnl
More Than the Final Answer: Improving Visual Extraction and Logical Consistency in Vision-Language Models.
CoRR
Hoang Anh Just, Yifei Fan, Handong Zhao, Jiuxiang Gu, Ruiyi Zhang, Simon Jenni, Kushal Kafle, Ruoxi Jia, Jing Shi
2025 Misc conf
Multi-LLM Debiasing Framework.
RANLP
Deonna M. Owens, Ryan A. Rossi, Sungchul Kim, Tong Yu, Franck Dernoncourt, Xiang Chen, Ruiyi Zhang, Jiuxiang Gu, Hanieh Deilamsalehy, Nedim Lipka
2025 J jnl
Multimodal LLMs as Customized Reward Models for Text-to-Image Generation.
CoRR
Shijie Zhou, Ruiyi Zhang, Huaisheng Zhu, Branislav Kveton, Yufan Zhou, Jiuxiang Gu, Jian Chen, Changyou Chen
2025 A* conf
Numerical Pruning for Efficient Autoregressive Models.
AAAI
Xuan Shen, Zhao Song, Yufa Zhou, Bo Chen, Jing Liu, Ruiyi Zhang, Ryan A. Rossi, Hao Tan, Tong Yu, Xiang Chen, Yufan Zhou, Tong Sun, Pu Zhao, Yanzhi Wang, Jiuxiang Gu
2025 J jnl
OIDA-QA: A Multimodal Benchmark for Analyzing the Opioid Industry Documents Archive.
CoRR
Xuan Shen, Brian Wingenroth, Zichao Wang, Jason Kuen, Wanrong Zhu, Ruiyi Zhang, Yiwei Wang, Lichun Ma, Anqi Liu, Hongfu Liu, Tong Sun, Kevin S. Hawkins, Kate Tasker, G. Caleb Alexander, Jiuxiang Gu
2025 J jnl
Personalization of Large Language Models: A Survey.
Trans. Mach. Learn. Res.
Zhehao Zhang, Ryan A. Rossi, Branislav Kveton, Yijia Shao, Diyi Yang, Hamed Zamani, Franck Dernoncourt, Joe Barrow, Tong Yu, Sungchul Kim, Ruiyi Zhang, Jiuxiang Gu, Tyler Derr, Hongjie Chen, Junda Wu, Xiang Chen, Zichao Wang, Subrata Mitra, Nedim Lipka, Nesreen K. Ahmed, Yu Wang
2025 A* conf
QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edge.
CVPR
Xuan Shen, Weize Ma, Jing Liu, Changdi Yang, Rui Ding, Quanyi Wang, Henghui Ding, Wei Niu, Yanzhi Wang, Pu Zhao, Jun Lin, Jiuxiang Gu
2025 J jnl
QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edge.
CoRR
Xuan Shen, Weize Ma, Jing Liu, Changdi Yang, Rui Ding, Quanyi Wang, Henghui Ding, Wei Niu, Yanzhi Wang, Pu Zhao, Jun Lin, Jiuxiang Gu
2025 J jnl
R-KV: Redundancy-aware KV Cache Compression for Training-Free Reasoning Models Acceleration.
CoRR
Zefan Cai, Wen Xiao, Hanshi Sun, Cheng Luo, Yikai Zhang, Ke Wan, Yucheng Li, Yeyang Zhou, Li-Wen Chang, Jiuxiang Gu, Zhen Dong, Anima Anandkumar, Abedelkadir Asi, Junjie Hu
2025 J jnl
Refer to Anything with Vision-Language Prompts.
CoRR
Shengcao Cao, Zijun Wei, Jason Kuen, Kangning Liu, Lingzhi Zhang, Jiuxiang Gu, Hyunjoon Jung, Liang-Yan Gui, Yu-Xiong Wang
2025 J jnl
Robust Latent Matters: Boosting Image Generation with Sampling Error Synthesis.
CoRR
Kai Qiu, Xiang Li, Jason Kuen, Hao Chen, Xiaohao Xu, Jiuxiang Gu, Yinyi Luo, Bhiksha Raj, Zhe Lin, Marios Savvides
2025 A* conf
SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding.
ICLR
Jian Chen, Ruiyi Zhang, Yufan Zhou, Tong Yu, Franck Dernoncourt, Jiuxiang Gu, Ryan A. Rossi, Changyou Chen, Tong Sun
2025 — conf
Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes.
NAACL (Short Papers)
Isabel O. Gallegos, Ryan Aponte, Ryan A. Rossi, Joe Barrow, Md. Mehrab Tanjim, Tong Yu, Hanieh Deilamsalehy, Ruiyi Zhang, Sungchul Kim, Franck Dernoncourt, Nedim Lipka, Deonna M. Owens, Jiuxiang Gu
2025 J jnl
Sparse-LaViDa: Sparse Multimodal Discrete Diffusion Language Models.
CoRR
Shufan Li, Jiuxiang Gu, Kangning Liu, Zhe Lin, Zijun Wei, Aditya Grover, Jason Kuen
2025 J jnl
Towards Visual Text Grounding of Multimodal Large Language Model.
CoRR
Ming Li, Ruiyi Zhang, Jian Chen, Jiuxiang Gu, Yufan Zhou, Franck Dernoncourt, Wanrong Zhu, Tianyi Zhou, Tong Sun
2024 J jnl
A Multi-LLM Debiasing Framework.
CoRR
Deonna M. Owens, Ryan A. Rossi, Sungchul Kim, Tong Yu, Franck Dernoncourt, Xiang Chen, Ruiyi Zhang, Jiuxiang Gu, Hanieh Deilamsalehy, Nedim Lipka
2024 J jnl
A Survey of Small Language Models.
CoRR
Chien Van Nguyen, Xuan Shen, Ryan Aponte, Yu Xia, Samyadeep Basu, Zhengmian Hu, Jian Chen, Mihir Parmar, Sasidhar Kunapuli, Joe Barrow, Junda Wu, Ashish Singh, Yu Wang, Jiuxiang Gu, Franck Dernoncourt, Nesreen K. Ahmed, Nedim Lipka, Ruiyi Zhang, Xiang Chen, Tong Yu, Sungchul Kim, Hanieh Deilamsalehy, Namyong Park, Mike Rimer, Zhehao Zhang, Huanrui Yang, Ryan A. Rossi, Thien Huu Nguyen
2024 A* conf
ADOPD: A Large-Scale Document Page Decomposition Dataset.
ICLR
Jiuxiang Gu, Xiangxi Shi, Jason Kuen, Lu Qi, Ruiyi Zhang, Anqi Liu, Ani Nenkova, Tong Sun
2024 J jnl
ARTIST: Improving the Generation of Text-rich Images by Disentanglement.
CoRR
Jianyi Zhang, Yufan Zhou, Jiuxiang Gu, Curtis Wigington, Tong Yu, Yiran Chen, Tong Sun, Ruiyi Zhang
2024 — conf
Advancing Vision-Language Models with Adapter Ensemble Strategies.
EMNLP (Findings)
Yue Bai, Handong Zhao, Zhe Lin, Ajinkya Kale, Jiuxiang Gu, Tong Yu, Sungchul Kim, Yun Fu
2024 A* conf
Category-Aware Active Domain Adaptation.
ICML
Wenxiao Xiao, Jiuxiang Gu, Hongfu Liu
2024 J jnl
CoMMIT: Coordinated Instruction Tuning for Multimodal Large Language Models.
CoRR
Junda Wu, Xintong Li, Tong Yu, Yu Wang, Xiang Chen, Jiuxiang Gu, Lina Yao, Jingbo Shang, Julian J. McAuley
2024 J jnl
Conv-Basis: A New Paradigm for Efficient Attention Inference and Gradient Computation in Transformers.
CoRR
Jiuxiang Gu, Yingyu Liang, Heshan Liu, Zhenmei Shi, Zhao Song, Junze Yin
2024 A* conf
Customization Assistant for Text-to-image Generation.
CVPR
Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Tong Sun
2024 J jnl
Differential Privacy Mechanisms in Neural Tangent Kernel Regression.
CoRR
Jiuxiang Gu, Yingyu Liang, Zhizhou Sha, Zhenmei Shi, Zhao Song
2024 J jnl
Differential Privacy of Cross-Attention with Provable Guarantee.
CoRR
Jiuxiang Gu, Yingyu Liang, Zhenmei Shi, Zhao Song, Yufa Zhou
2024 — conf
DocScript: Document-level Script Event Prediction.
LREC/COLING
Puneet Mathur, Vlad I. Morariu, Aparna Garimella, Franck Dernoncourt, Jiuxiang Gu, Ramit Sawhney, Preslav Nakov, Dinesh Manocha, Rajiv Jain
2024 J jnl
DocSynthv2: A Practical Autoregressive Modeling for Document Generation.
CoRR
Sanket Biswas, Rajiv Jain, Vlad I. Morariu, Jiuxiang Gu, Puneet Mathur, Curtis Wigington, Tong Sun, Josep Lladós
2024 J jnl
Exploring the Frontiers of Softmax: Provable Optimization, Applications in Diffusion Model, and Beyond.
CoRR
Jiuxiang Gu, Chenyang Li, Yingyu Liang, Zhenmei Shi, Zhao Song
2024 J jnl
Fast John Ellipsoid Computation with Differential Privacy Optimization.
CoRR
Jiuxiang Gu, Xiaoyu Li, Yingyu Liang, Zhenmei Shi, Zhao Song, Junwei Yu
2024 J jnl
Fourier Circuits in Neural Networks: Unlocking the Potential of Large Language Models in Mathematical Reasoning and Modular Arithmetic.
CoRR
Jiuxiang Gu, Chenyang Li, Yingyu Liang, Zhenmei Shi, Zhao Song, Tianyi Zhou
2024 J jnl
ImageFolder: Autoregressive Image Generation with Folded Tokens.
CoRR
Xiang Li, Kai Qiu, Hao Chen, Jason Kuen, Jiuxiang Gu, Bhiksha Raj, Zhe Lin
2024 J jnl
LLaVA-Read: Enhancing Reading Ability of Multimodal Language Models.
CoRR
Ruiyi Zhang, Yufan Zhou, Jian Chen, Jiuxiang Gu, Changyou Chen, Tong Sun
2024 A* conf
LRM: Large Reconstruction Model for Single Image to 3D.
ICLR
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, Hao Tan
2024 J jnl
LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers.
CoRR
Xuan Shen, Zhao Song, Yufa Zhou, Bo Chen, Yanyu Li, Yifan Gong, Kai Zhang, Hao Tan, Jason Kuen, Henghui Ding, Zhihao Shu, Wei Niu, Pu Zhao, Yanzhi Wang, Jiuxiang Gu
2024 J jnl
LoRA-Contextualizing Adaptation of Large Multimodal Models for Long Document Understanding.
CoRR
Jian Chen, Ruiyi Zhang, Yufan Zhou, Tong Yu, Franck Dernoncourt, Jiuxiang Gu, Ryan A. Rossi, Changyou Chen, Tong Sun
2024 J jnl
MMR: Evaluating Reading Ability of Large Multimodal Models.
CoRR
Jian Chen, Ruiyi Zhang, Yufan Zhou, Ryan A. Rossi, Jiuxiang Gu, Changyou Chen
2024 J jnl
MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Data.
CoRR
Hanwen Jiang, Zexiang Xu, Desai Xie, Ziwen Chen, Haian Jin, Fujun Luan, Zhixin Shu, Kai Zhang, Sai Bi, Xin Sun, Jiuxiang Gu, Qixing Huang, Georgios Pavlakos, Hao Tan
2024 J jnl
Numerical Pruning for Efficient Autoregressive Models.
CoRR
Xuan Shen, Zhao Song, Yufa Zhou, Bo Chen, Jing Liu, Ruiyi Zhang, Ryan A. Rossi, Hao Tan, Tong Yu, Xiang Chen, Yufan Zhou, Tong Sun, Pu Zhao, Yanzhi Wang, Jiuxiang Gu
2024 J jnl
Personalization of Large Language Models: A Survey.
CoRR
Zhehao Zhang, Ryan A. Rossi, Branislav Kveton, Yijia Shao, Diyi Yang, Hamed Zamani, Franck Dernoncourt, Joe Barrow, Tong Yu, Sungchul Kim, Ruiyi Zhang, Jiuxiang Gu, Tyler Derr, Hongjie Chen, Junda Wu, Xiang Chen, Zichao Wang, Subrata Mitra, Nedim Lipka, Nesreen K. Ahmed, Yu Wang
2024 J jnl
Personalized Multimodal Large Language Models: A Survey.
CoRR
Junda Wu, Hanjia Lyu, Yu Xia, Zhehao Zhang, Joe Barrow, Ishita Kumar, Mehrnoosh Mirtaheri, Hongjie Chen, Ryan A. Rossi, Franck Dernoncourt, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Namyong Park, Sungchul Kim, Huanrui Yang, Subrata Mitra, Zhengmian Hu, Nedim Lipka, Dang Nguyen, Yue Zhao, Jiebo Luo, Julian J. McAuley
2024 A* conf
SOHES: Self-supervised Open-world Hierarchical Entity Segmentation.
ICLR
Shengcao Cao, Jiuxiang Gu, Jason Kuen, Hao Tan, Ruiyi Zhang, Handong Zhao, Ani Nenkova, Liangyan Gui, Tong Sun, Yu-Xiong Wang
2024 J jnl
SOHES: Self-supervised Open-world Hierarchical Entity Segmentation.
CoRR
Shengcao Cao, Jiuxiang Gu, Jason Kuen, Hao Tan, Ruiyi Zhang, Handong Zhao, Ani Nenkova, Liang-Yan Gui, Tong Sun, Yu-Xiong Wang
2024 J jnl
SUGAR: Subject-Driven Video Customization in a Zero-Shot Manner.
CoRR
Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Nanxuan Zhao, Jing Shi, Tong Sun
2024 — conf
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning.
ACL (Findings)
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu, Tianyi Zhou
2024 J jnl
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning.
CoRR
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu, Tianyi Zhou
2024 — conf
Self-Cleaning: Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances.
NAACL-HLT (Findings)
Zhendong Chu, Ruiyi Zhang, Tong Yu, Rajiv Jain, Vlad I. Morariu, Jiuxiang Gu, Ani Nenkova
2024 A* conf
TRINS: Towards Multimodal Language Models that Can Read.
CVPR
Ruiyi Zhang, Yanzhe Zhang, Jian Chen, Yufan Zhou, Jiuxiang Gu, Changyou Chen, Tong Sun
2024 J jnl
TRINS: Towards Multimodal Language Models that Can Read.
CoRR
Ruiyi Zhang, Yanzhe Zhang, Jian Chen, Yufan Zhou, Jiuxiang Gu, Changyou Chen, Tong Sun
2024 J jnl
Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers.
CoRR
Jiuxiang Gu, Yingyu Liang, Zhenmei Shi, Zhao Song, Yufa Zhou
2024 — conf
TextLap: Customizing Language Models for Text-to-Layout Planning.
EMNLP (Findings)
Jian Chen, Ruiyi Zhang, Yufan Zhou, Jennifer Healey, Jiuxiang Gu, Zhiqiang Xu, Changyou Chen
2024 J jnl
TextLap: Customizing Language Models for Text-to-Layout Planning.
CoRR
Jian Chen, Ruiyi Zhang, Yufan Zhou, Jennifer Healey, Jiuxiang Gu, Zhiqiang Xu, Changyou Chen
2024 J jnl
Toffee: Efficient Million-Scale Dataset Construction for Subject-Driven Text-to-Image Generation.
CoRR
Yufan Zhou, Ruiyi Zhang, Kaizhi Zheng, Nanxuan Zhao, Jiuxiang Gu, Zichao Wang, Xin Eric Wang, Tong Sun
2024 J jnl
Toward Infinite-Long Prefix in Transformer.
CoRR
Jiuxiang Gu, Yingyu Liang, Zhenmei Shi, Zhao Song, Chiwun Yang
2024 J jnl
Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective.
CoRR
Jiuxiang Gu, Yingyu Liang, Zhenmei Shi, Zhao Song, Yufa Zhou
2024 J jnl
VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use.
CoRR
Zhehao Zhang, Ryan A. Rossi, Tong Yu, Franck Dernoncourt, Ruiyi Zhang, Jiuxiang Gu, Sungchul Kim, Xiang Chen, Zichao Wang, Nedim Lipka
2024 J jnl
XQ-GAN: An Open-source Image Tokenization Framework for Autoregressive Generation.
CoRR
Xiang Li, Kai Qiu, Hao Chen, Jason Kuen, Jiuxiang Gu, Jindong Wang, Zhe Lin, Bhiksha Raj
2023 — conf
A Critical Analysis of Document Out-of-Distribution Detection.
EMNLP (Findings)
Jiuxiang Gu, Yifei Ming, Yi Zhou, Jason Kuen, Vlad I. Morariu, Handong Zhao, Ruiyi Zhang, Nikolaos Barmpalios, Anqi Liu, Yixuan Li, Tong Sun, Ani Nenkova
2023 A* conf
AIMS: All-Inclusive Multi-Level Segmentation for Anything.
NeurIPS
Lu Qi, Jason Kuen, Weidong Guo, Jiuxiang Gu, Zhe Lin, Bo Du, Yu Xu, Ming-Hsuan Yang
2023 J jnl
AIMS: All-Inclusive Multi-Level Segmentation.
CoRR
Lu Qi, Jason Kuen, Weidong Guo, Jiuxiang Gu, Zhe Lin, Bo Du, Yu Xu, Ming-Hsuan Yang
2023 J jnl
Customization Assistant for Text-to-image Generation.
CoRR
Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Tong Sun
2023 A* conf
DocEdit: Language-Guided Document Editing.
AAAI
Puneet Mathur, Rajiv Jain, Jiuxiang Gu, Franck Dernoncourt, Dinesh Manocha, Vlad I. Morariu
2023 A* conf
High Quality Entity Segmentation.
ICCV
Lu Qi, Jason Kuen, Tiancheng Shen, Jiuxiang Gu, Wenbo Li, Weidong Guo, Jiaya Jia, Zhe Lin, Ming-Hsuan Yang
2023 J jnl
Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances.
CoRR
Zhendong Chu, Ruiyi Zhang, Tong Yu, Rajiv Jain, Vlad I. Morariu, Jiuxiang Gu, Ani Nenkova
2023 J jnl
LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding.
CoRR
Yanzhe Zhang, Ruiyi Zhang, Jiuxiang Gu, Yufan Zhou, Nedim Lipka, Diyi Yang, Tong Sun
2023 J jnl
LRM: Large Reconstruction Model for Single Image to 3D.
CoRR
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, Hao Tan
2023 A conf
LayerDoc: Layer-wise Extraction of Spatial Hierarchical Structure in Visually-Rich Documents.
WACV
Puneet Mathur, Rajiv Jain, Ashutosh Mehra, Jiuxiang Gu, Franck Dernoncourt, Anandhavelu Natarajan, Quan Hung Tran, Verena Kaynig-Fittkau, Ani Nenkova, Dinesh Manocha, Vlad I. Morariu
2023 A* conf
Learning the Visualness of Text Using Large Vision-Language Models.
EMNLP
Gaurav Verma, Ryan A. Rossi, Christopher Tensmeyer, Jiuxiang Gu, Ani Nenkova
2023 J jnl
Learning the Visualness of Text Using Large Vision-Language Models.
CoRR
Gaurav Verma, Ryan A. Rossi, Christopher Tensmeyer, Jiuxiang Gu, Ani Nenkova
2023 J jnl
Open World Entity Segmentation.
IEEE Trans. Pattern Anal. Mach. Intell.
Lu Qi, Jason Kuen, Yi Wang, Jiuxiang Gu, Hengshuang Zhao, Philip H. S. Torr, Zhe Lin, Jiaya Jia
2023 J jnl
Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning.
CoRR
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Heng Huang, Jiuxiang Gu, Tianyi Zhou
2022 — conf
CA-SSL: Class-Agnostic Semi-Supervised Learning for Detection and Segmentation.
ECCV (31)
Lu Qi, Jason Kuen, Zhe Lin, Jiuxiang Gu, Fengyun Rao, Dian Li, Weidong Guo, Zhen Wen, Ming-Hsuan Yang, Jiaya Jia
2022 A* conf
Delving into Out-of-Distribution Detection with Vision-Language Representations.
NeurIPS
Yifei Ming, Ziyang Cai, Jiuxiang Gu, Yiyou Sun, Wei Li, Yixuan Li
2022 J jnl
Delving into Out-of-Distribution Detection with Vision-Language Representations.
CoRR
Yifei Ming, Ziyang Cai, Jiuxiang Gu, Yiyou Sun, Wei Li, Yixuan Li
2022 A conf
DocLayoutTTS: Dataset and Baselines for Layout-informed Document-level Neural Speech Synthesis.
INTERSPEECH
Puneet Mathur, Franck Dernoncourt, Quan Hung Tran, Jiuxiang Gu, Ani Nenkova, Vlad I. Morariu, Rajiv Jain, Dinesh Manocha
2022 — conf
DocTime: A Document-level Temporal Dependency Graph Parser.
NAACL-HLT
Puneet Mathur, Vlad I. Morariu, Verena Kaynig-Fittkau, Jiuxiang Gu, Franck Dernoncourt, Quan Hung Tran, Ani Nenkova, Dinesh Manocha, Rajiv Jain
2022 A* conf
EI-CLIP: Entity-aware Interventional Contrastive Learning for E-commerce Cross-modal Retrieval.
CVPR
Haoyu Ma, Handong Zhao, Zhe Lin, Ajinkya Kale, Zhangyang Wang, Tong Yu, Jiuxiang Gu, Sunav Choudhary, Xiaohui Xie
2022 A* conf
FedKC: Federated Knowledge Composition for Multilingual Natural Language Understanding.
WWW
Haoyu Wang, Handong Zhao, Yaqing Wang, Tong Yu, Jiuxiang Gu, Jing Gao
2022 J jnl
Fine-Grained Entity Segmentation.
CoRR
Lu Qi, Jason Kuen, Weidong Guo, Tiancheng Shen, Jiuxiang Gu, Wenbo Li, Jiaya Jia, Zhe Lin, Ming-Hsuan Yang
2022 — conf
Improving the Reliability for Confidence Estimation.
ECCV (27)
Haoxuan Qu, Yanchao Li, Lin Geng Foo, Jason Kuen, Jiuxiang Gu, Jun Liu
2022 J jnl
Improving the Reliability for Confidence Estimation.
CoRR
Haoxuan Qu, Yanchao Li, Lin Geng Foo, Jason Kuen, Jiuxiang Gu, Jun Liu
2022 — conf
Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns.
ACL (Findings)
Zihan Wang, Jiuxiang Gu, Jason Kuen, Handong Zhao, Vlad I. Morariu, Ruiyi Zhang, Ani Nenkova, Tong Sun, Jingbo Shang
2022 A* conf
MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding.
EMNLP
Zilong Wang, Jiuxiang Gu, Chris Tensmeyer, Nikolaos Barmpalios, Ani Nenkova, Tong Sun, Jingbo Shang, Vlad I. Morariu
2022 J jnl
MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding.
CoRR
Zilong Wang, Jiuxiang Gu, Chris Tensmeyer, Nikolaos Barmpalios, Ani Nenkova, Tong Sun, Jingbo Shang, Vlad I. Morariu
2022 — conf
Meta Spatio-Temporal Debiasing for Video Scene Graph Generation.
ECCV (27)
Li Xu, Haoxuan Qu, Jason Kuen, Jiuxiang Gu, Jun Liu
2022 J jnl
Meta Spatio-Temporal Debiasing for Video Scene Graph Generation.
CoRR
Li Xu, Haoxuan Qu, Jason Kuen, Jiuxiang Gu, Jun Liu
2022 A* conf
Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labeling.
CVPR
Dat Huynh, Jason Kuen, Zhe Lin, Jiuxiang Gu, Ehsan Elhamifar
2022 A* conf
TiGAN: Text-Based Interactive Image Generation and Manipulation.
AAAI
Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Chris Tensmeyer, Tong Yu, Changyou Chen, Jinhui Xu, Tong Sun
2022 A* conf
Towards Language-Free Training for Text-to-Image Generation.
CVPR
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun
2022 A* conf
UNISON: Unpaired Cross-Lingual Image Captioning.
AAAI
Jiahui Gao, Yi Zhou, Philip L. H. Yu, Shafiq R. Joty, Jiuxiang Gu
2022 J jnl
Unified Pretraining Framework for Document Understanding.
CoRR
Jiuxiang Gu, Jason Kuen, Vlad I. Morariu, Handong Zhao, Nikolaos Barmpalios, Rajiv Jain, Ani Nenkova, Tong Sun
2022 B conf
User-Entity Differential Privacy in Learning Natural Language Models.
IEEE Big Data
Phung Lai, NhatHai Phan, Tong Sun, Rajiv Jain, Franck Dernoncourt, Jiuxiang Gu, Nikolaos Barmpalios
2022 J jnl
User-Entity Differential Privacy in Learning Natural Language Models.
CoRR
Phung Lai, NhatHai Phan, Tong Sun, Rajiv Jain, Franck Dernoncourt, Jiuxiang Gu, Nikolaos Barmpalios
2021 J jnl
CaSP: Class-agnostic Semi-Supervised Pretraining for Detection and Segmentation.
CoRR
Lu Qi, Jason Kuen, Zhe Lin, Jiuxiang Gu, Fengyun Rao, Dian Li, Weidong Guo, Zhen Wen, Jiaya Jia
2021 A* conf
Exploiting Semantic Embedding and Visual Feature for Facial Action Unit Detection.
CVPR
Huiyuan Yang, Lijun Yin, Yi Zhou, Jiuxiang Gu
2021 J jnl
LAFITE: Towards Language-Free Training for Text-to-Image Generation.
CoRR
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun
2021 A* conf
Multi-Scale Aligned Distillation for Low-Resolution Detection.
CVPR
Lu Qi, Jason Kuen, Jiuxiang Gu, Zhe Lin, Yi Wang, Yukang Chen, Yanwei Li, Jiaya Jia
2021 J jnl
Multi-Scale Aligned Distillation for Low-Resolution Detection.
CoRR
Lu Qi, Jason Kuen, Jiuxiang Gu, Zhe Lin, Yi Wang, Yukang Chen, Yanwei Li, Jiaya Jia
2021 J jnl
Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labeling.
CoRR
Dat Huynh, Jason Kuen, Zhe Lin, Jiuxiang Gu, Ehsan Elhamifar
2021 J jnl
Open-World Entity Segmentation.
CoRR
Lu Qi, Jason Kuen, Yi Wang, Jiuxiang Gu, Hengshuang Zhao, Zhe Lin, Philip H. S. Torr, Jiaya Jia
2021 A* conf
SelfDoc: Self-Supervised Document Representation Learning.
CVPR
Peizhao Li, Jiuxiang Gu, Jason Kuen, Vlad I. Morariu, Handong Zhao, Rajiv Jain, Varun Manjunatha, Hongfu Liu
2021 J jnl
SelfDoc: Self-Supervised Document Representation Learning.
CoRR
Peizhao Li, Jiuxiang Gu, Jason Kuen, Vlad I. Morariu, Handong Zhao, Rajiv Jain, Varun Manjunatha, Hongfu Liu
2021 — conf
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU models.
NAACL-HLT
Mengnan Du, Varun Manjunatha, Rajiv Jain, Ruchi Deshpande, Franck Dernoncourt, Jiuxiang Gu, Tong Sun, Xia Hu
2021 J jnl
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU models.
CoRR
Mengnan Du, Varun Manjunatha, Rajiv Jain, Ruchi Deshpande, Franck Dernoncourt, Jiuxiang Gu, Tong Sun, Xia Hu
2021 A* conf
UniDoc: Unified Pretraining Framework for Document Understanding.
NeurIPS
Jiuxiang Gu, Jason Kuen, Vlad I. Morariu, Handong Zhao, Rajiv Jain, Nikolaos Barmpalios, Ani Nenkova, Tong Sun
2020 — conf
Finding It at Another Side: A Viewpoint-Adapted Matching Encoder for Change Captioning.
ECCV (14)
Xiangxi Shi, Xu Yang, Jiuxiang Gu, Shafiq R. Joty, Jianfei Cai
2020 J jnl
Finding It at Another Side: A Viewpoint-Adapted Matching Encoder for Change Captioning.
CoRR
Xiangxi Shi, Xu Yang, Jiuxiang Gu, Shafiq R. Joty, Jianfei Cai
2020 A* conf
Self-Supervised Relationship Probing.
NeurIPS
Jiuxiang Gu, Jason Kuen, Shafiq R. Joty, Jianfei Cai, Vlad I. Morariu, Handong Zhao, Tong Sun
2020 J jnl
Unsupervised Cross-lingual Image Captioning.
CoRR
Jiahui Gao, Yi Zhou, Philip L. H. Yu, Jiuxiang Gu
2020 J jnl
Video captioning with boundary-aware hierarchical language decoding and joint video prediction.
Neurocomputing
Xiangxi Shi, Jianfei Cai, Jiuxiang Gu, Shafiq R. Joty
2019 J jnl
Resilient Load Restoration in Microgrids Considering Mobile Energy Storage Fleets: A Deep Reinforcement Learning Approach.
CoRR
Shuhan Yao, Jiuxiang Gu, Peng Wang, Tianyang Zhao, Huajun Zhang, Xiaochuan Liu
2019 A* conf
Scene Graph Generation With External Knowledge and Image Reconstruction.
CVPR
Jiuxiang Gu, Handong Zhao, Zhe Lin, Sheng Li, Jianfei Cai, Mingyang Ling
2019 J jnl
Scene Graph Generation with External Knowledge and Image Reconstruction.
CoRR
Jiuxiang Gu, Handong Zhao, Zhe Lin, Sheng Li, Jianfei Cai, Mingyang Ling
2019 A* conf
Unpaired Image Captioning via Scene Graph Alignments.
ICCV
Jiuxiang Gu, Shafiq R. Joty, Jianfei Cai, Handong Zhao, Xu Yang, Gang Wang
2019 J jnl
Unpaired Image Captioning via Scene Graph Alignments.
CoRR
Jiuxiang Gu, Shafiq R. Joty, Jianfei Cai, Handong Zhao, Xu Yang, Gang Wang
2019 A* conf
Watch It Twice: Video Captioning with a Refocused Video Encoder.
ACM Multimedia
Xiangxi Shi, Jianfei Cai, Shafiq R. Joty, Jiuxiang Gu
2019 J jnl
Watch It Twice: Video Captioning with a Refocused Video Encoder.
CoRR
Xiangxi Shi, Jianfei Cai, Shafiq R. Joty, Jiuxiang Gu
2018 A* conf
Look, Imagine and Match: Improving Textual-Visual Cross-Modal Retrieval With Generative Models.
CVPR
Jiuxiang Gu, Jianfei Cai, Shafiq R. Joty, Li Niu, Gang Wang
2018 — conf
NTU ROSE Lab at TRECVID 2018: Ad-hoc Video Search and Video to Text.
TRECVID
Muhammet Bastan, Xiangxi Shi, Jiuxiang Gu, Zhao Heng, Chen Zhuo, Dennis Sng, Alex C. Kot
2018 J jnl
Recent advances in convolutional neural networks.
Pattern Recognit.
Jiuxiang Gu, Zhenhua Wang, Jason Kuen, Lianyang Ma, Amir Shahroudy, Bing Shuai, Ting Liu, Xingxing Wang, Gang Wang, Jianfei Cai, Tsuhan Chen
2018 A* conf
Stack-Captioning: Coarse-to-Fine Learning for Image Captioning.
AAAI
Jiuxiang Gu, Jianfei Cai, Gang Wang, Tsuhan Chen
2018 — conf
Unpaired Image Captioning by Language Pivoting.
ECCV (1)
Jiuxiang Gu, Shafiq R. Joty, Jianfei Cai, Gang Wang
2018 J jnl
Unpaired Image Captioning by Language Pivoting.
CoRR
Jiuxiang Gu, Shafiq R. Joty, Jianfei Cai, Gang Wang
2018 J jnl
Video Captioning with Boundary-aware Hierarchical Language Decoding and Joint Video Prediction.
CoRR
Xiangxi Shi, Jianfei Cai, Jiuxiang Gu, Shafiq R. Joty
2017 A* conf
An Empirical Study of Language CNN for Image Captioning.
ICCV
Jiuxiang Gu, Gang Wang, Jianfei Cai, Tsuhan Chen
2017 J jnl
Look, Imagine and Match: Improving Textual-Visual Cross-Modal Retrieval with Generative Models.
CoRR
Jiuxiang Gu, Jianfei Cai, Shafiq R. Joty, Li Niu, Gang Wang
2017 J jnl
Stack-Captioning: Coarse-to-Fine Learning for Image Captioning.
CoRR
Jiuxiang Gu, Jianfei Cai, Gang Wang, Tsuhan Chen
2016 J jnl
Recurrent Highway Networks with Language CNN for Image Captioning.
CoRR
Jiuxiang Gu, Gang Wang, Tsuhan Chen
2015 J jnl
Recent Advances in Convolutional Neural Networks.
CoRR
Jiuxiang Gu, Zhenhua Wang, Jason Kuen, Lianyang Ma, Amir Shahroudy, Bing Shuai, Ting Liu, Xingxing Wang, Gang Wang