Yaya Shi

28 papers A* 7Journal 18Unranked 3
YearRankTypeTitle / Venue / Authors
2025 A* conf
TaskGalaxy: Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types.
ICLR
Jiankang Chen, Tianke Zhang, Changyi Liu, Haojie Ding, Yaya Shi, Cheng Feng, Huihui Xiao, Bin Wen, Fan Yang, Tingting Gao, Di Zhang
2025 J jnl
TaskGalaxy: Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types.
CoRR
Jiankang Chen, Tianke Zhang, Changyi Liu, Haojie Ding, Yaya Shi, Feng Cheng, Huihui Xiao, Bin Wen, Fan Yang, Tingting Gao, Di Zhang
2025 — conf
iMOVE : Instance-Motion-Aware Video Understanding.
ACL (Findings)
Jiaze Li, Yaya Shi, Zongyang Ma, Haoran Xu, Yandong Bai, Huihui Xiao, Ruiwen Kang, Fan Yang, Tingting Gao, Di Zhang
2025 J jnl
iMOVE: Instance-Motion-Aware Video Understanding.
CoRR
Jiaze Li, Yaya Shi, Zongyang Ma, Haoran Xu, Feng Cheng, Huihui Xiao, Ruiwen Kang, Fan Yang, Tingting Gao, Di Zhang
2024 A* conf
MIBench: Evaluating Multimodal Large Language Models over Multiple Images.
EMNLP
Haowei Liu, Xi Zhang, Haiyang Xu, Yaya Shi, Chaoya Jiang, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu
2024 J jnl
MIBench: Evaluating Multimodal Large Language Models over Multiple Images.
CoRR
Haowei Liu, Xi Zhang, Haiyang Xu, Yaya Shi, Chaoya Jiang, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu
2024 — conf
Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training.
LREC/COLING
Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu
2024 J jnl
Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training.
CoRR
Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu
2024 J jnl
UniQRNet: Unifying Referring Expression Grounding and Segmentation with QRNet.
ACM Trans. Multim. Comput. Commun. Appl.
Jiabo Ye, Junfeng Tian, Ming Yan, Haiyang Xu, Qinghao Ye, Yaya Shi, Xiaoshan Yang, Xuwu Wang, Ji Zhang, Liang He, Xin Lin
2024 — conf
Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval.
LREC/COLING
Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu
2024 J jnl
Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval.
CoRR
Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu
2024 A* conf
mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Model.
ACM Multimedia
Anwen Hu, Yaya Shi, Haiyang Xu, Jiabo Ye, Qinghao Ye, Ming Yan, Chenliang Li, Qi Qian, Ji Zhang, Fei Huang
2023 A* conf
Learning Semantics-Grounded Vocabulary Representation for Video-Text Retrieval.
ACM Multimedia
Yaya Shi, Haowei Liu, Haiyang Xu, Zongyang Ma, Qinghao Ye, Anwen Hu, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha
2023 J jnl
Learning Video-Text Aligned Representations for Video Captioning.
ACM Trans. Multim. Comput. Commun. Appl.
Yaya Shi, Haiyang Xu, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha
2023 J jnl
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks.
CoRR
Haiyang Xu, Qinghao Ye, Xuan Wu, Ming Yan, Yuan Miao, Jiabo Ye, Guohai Xu, Anwen Hu, Yaya Shi, Guangwei Xu, Chenliang Li, Qi Qian, Maofei Que, Ji Zhang, Xiao Zeng, Fei Huang
2023 A* conf
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video.
ICML
Haiyang Xu, Qinghao Ye, Ming Yan, Yaya Shi, Jiabo Ye, Yuanhong Xu, Chenliang Li, Bin Bi, Qi Qian, Wei Wang, Guohai Xu, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou
2023 J jnl
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video.
CoRR
Haiyang Xu, Qinghao Ye, Ming Yan, Yaya Shi, Jiabo Ye, Yuanhong Xu, Chenliang Li, Bin Bi, Qi Qian, Wei Wang, Guohai Xu, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou
2023 J jnl
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality.
CoRR
Qinghao Ye, Haiyang Xu, Guohai Xu, Jiabo Ye, Ming Yan, Yiyang Zhou, Junyang Wang, Anwen Hu, Pengcheng Shi, Yaya Shi, Chenliang Li, Yuanhong Xu, Hehong Chen, Junfeng Tian, Qian Qi, Ji Zhang, Fei Huang
2023 J jnl
mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Model.
CoRR
Anwen Hu, Yaya Shi, Haiyang Xu, Jiabo Ye, Qinghao Ye, Ming Yan, Chenliang Li, Qi Qian, Ji Zhang, Fei Huang
2022 J jnl
A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Tracking.
IEEE Trans. Circuits Syst. Video Technol.
Zhenbang Li, Yaya Shi, Jin Gao, Shaoru Wang, Bing Li, Pengpeng Liang, Weiming Hu
2022 A* conf
EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching.
CVPR
Yaya Shi, Xu Yang, Haiyang Xu, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha
2021 J jnl
A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Tracking.
CoRR
Zhenbang Li, Yaya Shi, Jin Gao, Shaoru Wang, Bing Li, Pengpeng Liang, Weiming Hu
2021 J jnl
EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching.
CoRR
Yaya Shi, Xu Yang, Haiyang Xu, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha
2021 J jnl
Student Physical Health Information Management Model under Big Data Environment.
Sci. Program.
Hui Wang, Ning Wang, Meijie Li, Simeng Mi, Yaya Shi
2020 A* conf
Object Relational Graph With Teacher-Recommended Learning for Video Captioning.
CVPR
Ziqi Zhang, Yaya Shi, Chunfeng Yuan, Bing Li, Peijin Wang, Weiming Hu, Zheng-Jun Zha
2020 J jnl
Object Relational Graph with Teacher-Recommended Learning for Video Captioning.
CoRR
Ziqi Zhang, Yaya Shi, Chunfeng Yuan, Bing Li, Peijin Wang, Weiming Hu, Zhengjun Zha
2019 J jnl
VATEX Captioning Challenge 2019: Multi-modal Information Fusion and Multi-stage Training Strategy for Video Captioning.
CoRR
Ziqi Zhang, Yaya Shi, Jiutong Wei, Chunfeng Yuan, Bing Li, Weiming Hu
2018 J jnl
Permafrost Presence/Absence Mapping of the Qinghai-Tibet Plateau Based on Multi-Source Remote Sensing Data.
Remote. Sens.
Yaya Shi, Fujun Niu, Chengsong Yang, Tao Che, Zhanju Lin, Jing Luo