Tao Jin

109 papers A* 40A 1Misc 1Journal 48Unranked 19
YearRankTypeTitle / Venue / Authors
2026 A* conf
Scene-Aware Spatiotemporal Generalization: Towards Robust Temporal Action Detection Across Domains.
AAAI
Fangming Feng, Sihang Cai, Zequn Xie, Yangyang Wu, Tao Jin
2026 J jnl
TAG: Triple Alignment With Rationale Generation for Knowledge-Based Visual Question Answering.
IEEE Trans. Big Data
Sihang Cai, Xuan Lin, Wenqiang Xu, Jingtong Wu, Tao Jin, Zhou Zhao, Fei Wu, Jun Yu
2026 J jnl
WorldEdit: Towards Open-World Image Editing with a Knowledge-Informed Benchmark.
CoRR
Wang Lin, Feng Wang, Majun Zhang, Wentao Hu, Tao Jin, Zhou Zhao, Fei Wu, Jingyuan Chen, Alan L. Yuille, Sucheng Ren
2025 A* conf
A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter.
AAAI
Zirun Guo, Xize Cheng, Yangyang Wu, Tao Jin
2025 J jnl
APO: Enhancing Reasoning Ability of MLLMs via Asymmetric Policy Optimization.
CoRR
Minjie Hong, Zirun Guo, Yan Xia, Zehan Wang, Ziang Zhang, Tao Jin, Zhou Zhao
2025 A* conf
Bridging the Gap for Test-Time Multimodal Sentiment Analysis.
AAAI
Zirun Guo, Tao Jin, Wenlong Xu, Wang Lin, Yangyang Wu
2025 J jnl
Chat-Driven Text Generation and Interaction for Person Retrieval.
CoRR
Zequn Xie, Chuxin Wang, Sihang Cai, Yeqiang Wang, Shulei Wang, Tao Jin
2025 A* conf
ConceptGuard: Continual Personalized Text-to-Image Generation with Forgetting and Confusion Mitigation.
CVPR
Zirun Guo, Tao Jin
2025 J jnl
ConceptGuard: Continual Personalized Text-to-Image Generation with Forgetting and Confusion Mitigation.
CoRR
Zirun Guo, Tao Jin
2025 Misc conf
Curriculum Learning aided Audio-Visual Speech Recognition with Arbitrary Speaker Number.
ICASSP
Yuxiao Lin, Tao Jin, Xize Cheng, Zhou Zhao, Fei Wu
2025 — conf
Data-Efficiently Learn Large Language Model for Universal 3D Scene Perception.
NAACL (Findings)
Zehan Wang, Haifeng Huang, Yang Zhao, Ziang Zhang, Tao Jin, Zhou Zhao
2025 A* conf
Diff-Prompt: Diffusion-Driven Prompt Generator with Mask Supervision.
ICLR
Weicai Yan, Wang Lin, Zirun Guo, Ye Wang, Fangming Feng, Xiaoda Yang, Zehan Wang, Tao Jin
2025 J jnl
Diff-Prompt: Diffusion-Driven Prompt Generator with Mask Supervision.
CoRR
Weicai Yan, Wang Lin, Zirun Guo, Ye Wang, Fangming Feng, Xiaoda Yang, Zehan Wang, Tao Jin
2025 — conf
Efficient Prompting for Continual Adaptation to Missing Modalities.
NAACL (Long Papers)
Zirun Guo, Shulei Wang, Wang Lin, Weicai Yan, Yangyang Wu, Tao Jin
2025 J jnl
Efficient Prompting for Continual Adaptation to Missing Modalities.
CoRR
Zirun Guo, Shulei Wang, Wang Lin, Weicai Yan, Yangyang Wu, Tao Jin
2025 A* conf
IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models.
ICML
Hanting Wang, Tao Jin, Wang Lin, Shulei Wang, Hai Huang, Shengpeng Ji, Zhou Zhao
2025 J jnl
IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models.
CoRR
Hanting Wang, Tao Jin, Wang Lin, Shulei Wang, Hai Huang, Shengpeng Ji, Zhou Zhao
2025 A* conf
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting.
ACM Multimedia
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Tao Jin, Zhou Zhao
2025 J jnl
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting.
CoRR
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Tao Jin, Zhou Zhao
2025 J jnl
Low-rank Prompt Interaction for Continual Vision-Language Retrieval.
CoRR
Weicai Yan, Ye Wang, Wang Lin, Zirun Guo, Zhou Zhao, Tao Jin
2025 J jnl
MARS-Sep: Multimodal-Aligned Reinforced Sound Separation.
CoRR
Zihan Zhang, Xize Cheng, Zhennan Jiang, Dongjie Fu, Jingyuan Chen, Zhou Zhao, Tao Jin
2025 J jnl
Multi-talker audio-visual speech recognition towards diverse scenarios.
Frontiers Inf. Technol. Electron. Eng.
Yuxiao Lin, Tao Jin, Xize Cheng, Zhou Zhao, Fei Wu
2025 — conf
Multimodal Conditional Retrieval with High Controllability.
KDD (2)
Xiaoda Yang, Xize Cheng, Minghui Fang, Hongshun Qiu, Yuhang Ma, Junyu Lu, Jiaqi Duan, Sihang Cai, Zehan Wang, Ruofan Hu, Dongjie Fu, Zhou Zhao, Tao Jin
2025 A* conf
Non-Natural Image Understanding with Advancing Frequency-based Vision Encoders.
CVPR
Wang Lin, Qingsong Wang, Yueying Feng, Shulei Wang, Tao Jin, Zhou Zhao, Fei Wu, Chang Yao, Jingyuan Chen
2025 J jnl
Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning.
CoRR
Zirun Guo, Minjie Hong, Tao Jin
2025 — conf
Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding.
NAACL (Findings)
Shulei Wang, Shuai Yang, Wang Lin, Zirun Guo, Sihang Cai, Hai Huang, Ye Wang, Jingyuan Chen, Tao Jin
2025 A* conf
OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces.
ICLR
Zehan Wang, Ziang Zhang, Minjie Hong, Hang Zhang, Luping Liu, Rongjie Huang, Xize Cheng, Shengpeng Ji, Tao Jin, Hengshuang Zhao, Zhou Zhao
2025 J jnl
OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios.
CoRR
Xize Cheng, Dongjie Fu, Xiaoda Yang, Minghui Fang, Ruofan Hu, Jingyu Lu, Jionghao Bai, Zehan Wang, Shengpeng Ji, Rongjie Huang, Linjun Li, Yu Chen, Tao Jin, Zhou Zhao
2025 A* conf
OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup.
ICLR
Xize Cheng, Siqi Zheng, Zehan Wang, Minghui Fang, Ziang Zhang, Rongjie Huang, Shengpeng Ji, Jialong Zuo, Tao Jin, Zhou Zhao
2025 J jnl
Open-set Cross Modal Generalization via Multimodal Unified Representation.
CoRR
Hai Huang, Yan Xia, Shulei Wang, Hanting Wang, Minghui Fang, Shengpeng Ji, Sashuai Zhou, Tao Jin, Zhou Zhao
2025 A* conf
PACHAT: Persona-Aware Speech Assistant for Multi-party Dialogue.
EMNLP
Dongjie Fu, Xize Cheng, Linjun Li, Xiaoda Yang, Lujia Yang, Tao Jin
2025 J jnl
Recognize-and-tell: Generating video captions with textual cue in scene.
Expert Syst. Appl.
Tao Jin, Wang Lin, Hao Jiang, Jian Wang, Xiao Jin, Zhimeng Zhang, Jingyuan Chen, Zhou Zhao, Zhongfei Zhang
2025 J jnl
SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer.
CoRR
Jimin Xu, Bosheng Qin, Tao Jin, Zhou Zhao, Zhenhui Ye, Jun Yu, Fei Wu
2025 A* conf
Smoothing the Shift: Towards Stable Test-Time Adaptation under Complex Multimodal Noises.
ICLR
Zirun Guo, Tao Jin
2025 J jnl
Smoothing the Shift: Towards Stable Test-Time Adaptation under Complex Multimodal Noises.
CoRR
Zirun Guo, Tao Jin
2025 A* conf
SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language.
CVPR
Zehan Wang, Sashuai Zhou, Shaoxuan He, Haifeng Huang, Lihe Yang, Ziang Zhang, Xize Cheng, Shengpeng Ji, Tao Jin, Hengshuang Zhao, Zhou Zhao
2025 A* conf
Speech Token Prediction via Compressed-to-fine Language Modeling for Speech Generation.
ACM Multimedia
Wenrui Liu, Qian Chen, Wen Wang, Guanrou Yang, Weiqin Li, Minghui Fang, Jialong Zuo, Xiaoda Yang, Tao Jin, Jin Xu, Zemin Liu, Yafeng Chen, Jionghao Bai, Zhifang Guo
2025 A* conf
Speech Watermarking with Discrete Intermediate Representations.
AAAI
Shengpeng Ji, Ziyue Jiang, Jialong Zuo, Minghui Fang, Yifu Chen, Tao Jin, Zhou Zhao
2025 — conf
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback.
ACL (1)
Zehan Wang, Ke Lei, Chen Zhu, Jiawei Huang, Sashuai Zhou, Luping Liu, Xize Cheng, Shengpeng Ji, Zhenhui Ye, Tao Jin, Zhou Zhao
2025 J jnl
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback.
CoRR
Zehan Wang, Ke Lei, Chen Zhu, Jiawei Huang, Sashuai Zhou, Luping Liu, Xize Cheng, Shengpeng Ji, Zhenhui Ye, Tao Jin, Zhou Zhao
2025 A* conf
TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal.
ACM Multimedia
Hanting Wang, Shengpeng Ji, Shulei Wang, Hai Huang, Xiao Jin, Qifei Zhang, Tao Jin
2025 J jnl
TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal.
CoRR
Hanting Wang, Shengpeng Ji, Shulei Wang, Hai Huang, Xiao Jin, Qifei Zhang, Tao Jin
2025 — conf
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis.
ACL (Findings)
Yu Zhang, Wenxiang Guo, Changhao Pan, Dongyu Yao, Zhiyuan Zhu, Ziyue Jiang, Yuhan Wang, Tao Jin, Zhou Zhao
2025 J jnl
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis.
CoRR
Yu Zhang, Wenxiang Guo, Changhao Pan, Dongyu Yao, Zhiyuan Zhu, Ziyue Jiang, Yuhan Wang, Tao Jin, Zhou Zhao
2025 A* conf
Towards Transformer-Based Aligned Generation with Self-Coherence Guidance.
CVPR
Shulei Wang, Wang Lin, Hai Huang, Hanting Wang, Sihang Cai, WenKang Han, Tao Jin, Jingyuan Chen, Jiacheng Sun, Jieming Zhu, Zhou Zhao
2025 J jnl
Towards Transformer-Based Aligned Generation with Self-Coherence Guidance.
CoRR
Shulei Wang, Wang Lin, Hai Huang, Hanting Wang, Sihang Cai, WenKang Han, Tao Jin, Jingyuan Chen, Jiacheng Sun, Jieming Zhu, Zhou Zhao
2025 J jnl
Unleashing the Power of Natural Audio Featuring Multiple Sound Sources.
CoRR
Xize Cheng, Slytherin Wang, Zehan Wang, Rongjie Huang, Tao Jin, Zhou Zhao
2025 A conf
Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval.
INTERSPEECH
Ruofan Hu, Yan Xia, Minjie Hong, Jieming Zhu, Bo Chen, Xiaoda Yang, Minghui Fang, Tao Jin
2025 J jnl
Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval.
CoRR
Ruofan Hu, Yan Xia, Minjie Hong, Jieming Zhu, Bo Chen, Xiaoda Yang, Minghui Fang, Tao Jin
2025 A* conf
VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?
ICLR
Xize Cheng, Ruofan Hu, Xiaoda Yang, Jingyu Lu, Dongjie Fu, Zehan Wang, Shengpeng Ji, Rongjie Huang, Boyang Zhang, Tao Jin, Zhou Zhao
2024 J jnl
A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter.
CoRR
Zirun Guo, Xize Cheng, Yangyang Wu, Tao Jin
2024 A* conf
Action Imitation in Common Action Space for Customized Action Image Synthesis.
NeurIPS
Wang Lin, Jingyuan Chen, Jiaxin Shi, Zirun Guo, Yichen Zhu, Zehan Wang, Tao Jin, Zhou Zhao, Fei Wu, Shuicheng Yan, Hanwang Zhang
2024 A* conf
AudioVSR: Enhancing Video Speech Recognition with Audio Data.
EMNLP
Xiaoda Yang, Xize Cheng, Jiaqi Duan, Hongshun Qiu, Minjie Hong, Minghui Fang, Shengpeng Ji, Jialong Zuo, Zhiqing Hong, Zhimeng Zhang, Tao Jin
2024 A* conf
Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts.
ACM Multimedia
Dongjie Fu, Xize Cheng, Xiaoda Yang, Hanting Wang, Zhou Zhao, Tao Jin
2024 J jnl
Bridging the Gap for Test-Time Multimodal Sentiment Analysis.
CoRR
Zirun Guo, Tao Jin, Wenlong Xu, Wang Lin, Yangyang Wu
2024 A* conf
Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding.
ACM Multimedia
Tao Jin, Weicai Yan, Ye Wang, Sihang Cai, Qifan Shuai, Zhou Zhao
2024 A* conf
Classifier-guided Gradient Modulation for Enhanced Multimodal Learning.
NeurIPS
Zirun Guo, Tao Jin, Jingyuan Chen, Zhou Zhao
2024 J jnl
Classifier-guided Gradient Modulation for Enhanced Multimodal Learning.
CoRR
Zirun Guo, Tao Jin, Jingyuan Chen, Zhou Zhao
2024 A* conf
E
NeurIPS
Wang Lin, Yueying Feng, WenKang Han, Tao Jin, Zhou Zhao, Fei Wu, Chang Yao, Jingyuan Chen
2024 A* conf
EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration.
KDD
Ye Wang, Jiahao Xun, Minjie Hong, Jieming Zhu, Tao Jin, Wang Lin, Haoyuan Li, Linjun Li, Yan Xia, Zhou Zhao, Zhenhua Dong
2024 J jnl
EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration.
CoRR
Ye Wang, Jiahao Xun, Mingjie Hong, Jieming Zhu, Tao Jin, Wang Lin, Haoyuan Li, Linjun Li, Yan Xia, Zhou Zhao, Zhenhua Dong
2024 A* conf
Extending Multi-modal Contrastive Representations.
NeurIPS
Ziang Zhang, Zehan Wang, Luping Liu, Rongjie Huang, Xize Cheng, Zhenhui Ye, Wang Lin, Huadai Liu, Haifeng Huang, Yang Zhao, Tao Jin, Siqi Zheng, Zhou Zhao
2024 A* conf
FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion.
ICML
Zehan Wang, Ziang Zhang, Xize Cheng, Rongjie Huang, Luping Liu, Zhenhui Ye, Haifeng Huang, Yang Zhao, Tao Jin, Peng Gao, Zhou Zhao
2024 J jnl
FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion.
CoRR
Zehan Wang, Ziang Zhang, Xize Cheng, Rongjie Huang, Luping Liu, Zhenhui Ye, Haifeng Huang, Yang Zhao, Tao Jin, Peng Gao, Zhou Zhao
2024 J jnl
GTADT: Gated tone-sensitive acne grading via augmented domain transfer.
Multim. Tools Appl.
Min Tan, Ruirui Wang, Ankur Purwar, Tao Jin, Jun Yu, Alex C. Kot
2024 A* conf
Low-rank Prompt Interaction for Continual Vision-Language Retrieval.
ACM Multimedia
Weicai Yan, Ye Wang, Wang Lin, Zirun Guo, Zhou Zhao, Tao Jin
2024 A* conf
MPOD123: One Image to 3D Content Generation Using Mask-Enhanced Progressive Outline-to-Detail Optimization.
CVPR
Jimin Xu, Tianbao Wang, Tao Jin, Shengyu Zhang, Dongjie Fu, Zhe Wang, Jiangjing Lyu, Chengfei Lv, Chaoyue Niu, Zhou Yu, Zhou Zhao, Fei Wu
2024 J jnl
Multi-Granularity Relational Attention Network for Audio-Visual Question Answering.
IEEE Trans. Circuits Syst. Video Technol.
Linjun Li, Tao Jin, Wang Lin, Hao Jiang, Wenwen Pan, Jian Wang, Shuwen Xiao, Yan Xia, Weihao Jiang, Zhou Zhao
2024 — conf
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition.
ACL (1)
Zirun Guo, Tao Jin, Zhou Zhao
2024 J jnl
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition.
CoRR
Zirun Guo, Tao Jin, Zhou Zhao
2024 A* conf
Non-confusing Generation of Customized Concepts in Diffusion Models.
ICML
Wang Lin, Jingyuan Chen, Jiaxin Shi, Yichen Zhu, Chen Liang, Junzhong Miao, Tao Jin, Zhou Zhao, Fei Wu, Shuicheng Yan, Hanwang Zhang
2024 J jnl
Non-confusing Generation of Customized Concepts in Diffusion Models.
CoRR
Wang Lin, Jingyuan Chen, Jiaxin Shi, Yichen Zhu, Chen Liang, Junzhong Miao, Tao Jin, Zhou Zhao, Fei Wu, Shuicheng Yan, Hanwang Zhang
2024 J jnl
OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup.
CoRR
Xize Cheng, Siqi Zheng, Zehan Wang, Minghui Fang, Ziang Zhang, Rongjie Huang, Ziyang Ma, Shengpeng Ji, Jialong Zuo, Tao Jin, Zhou Zhao
2024 — conf
Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt.
NAACL-HLT
Yongqi Wang, Ruofan Hu, Rongjie Huang, Zhiqing Hong, Ruiqi Li, Wenrui Liu, Fuming You, Tao Jin, Zhou Zhao
2024 J jnl
Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt.
CoRR
Yongqi Wang, Ruofan Hu, Rongjie Huang, Zhiqing Hong, Ruiqi Li, Wenrui Liu, Fuming You, Tao Jin, Zhou Zhao
2024 — conf
Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment.
ACL (1)
Tao Jin, Wang Lin, Ye Wang, Linjun Li, Xize Cheng, Zhou Zhao
2024 J jnl
Speech Watermarking with Discrete Intermediate Representations.
CoRR
Shengpeng Ji, Ziyue Jiang, Jialong Zuo, Minghui Fang, Yifu Chen, Tao Jin, Zhou Zhao
2024 A* conf
SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning.
ACM Multimedia
Xiaoda Yang, Xize Cheng, Dongjie Fu, Minghui Fang, Jialong Zuo, Shengpeng Ji, Zhou Zhao, Tao Jin
2024 — conf
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation.
ACL (Findings)
Xize Cheng, Rongjie Huang, Linjun Li, Zehan Wang, Tao Jin, Aoxiong Yin, Feiyang Chen, Xinyu Duan, Baoxing Huai, Zhou Zhao
2024 — conf
Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation.
ACL (1)
Songju Lei, Xize Cheng, Mengjiao Lyu, Jianqiao Hu, Jintao Tan, Runlin Liu, Lingyu Xiong, Tao Jin, Xiandong Li, Zhou Zhao
2023 J jnl
Chat-3D v2: Bridging 3D Scene and Large Language Models with Object Identifiers.
CoRR
Haifeng Huang, Zehan Wang, Rongjie Huang, Luping Liu, Xize Cheng, Yang Zhao, Tao Jin, Zhou Zhao
2023 — conf
Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation.
ACL (Findings)
Linjun Li, Tao Jin, Xize Cheng, Ye Wang, Wang Lin, Rongjie Huang, Zhou Zhao
2023 A* conf
DATE: Domain Adaptive Product Seeker for E-Commerce.
CVPR
Haoyuan Li, Hao Jiang, Tao Jin, Mengyan Li, Yan Chen, Zhijie Lin, Yang Zhao, Zhou Zhao
2023 J jnl
DATE: Domain Adaptive Product Seeker for E-commerce.
CoRR
Haoyuan Li, Hao Jiang, Tao Jin, Mengyan Li, Yan Chen, Zhijie Lin, Yang Zhao, Zhou Zhao
2023 J jnl
Electromagnetic Imaging Boosted Visual Object Recognition Under Difficult Visual Conditions.
IEEE Trans. Geosci. Remote. Sens.
Min Tan, Tao Jin, Danhui Ye, Kuiwen Xu, Xiaoling Gu, Jun Yu
2023 A* conf
Exploring Group Video Captioning with Efficient Relational Approximation.
ICCV
Wang Lin, Tao Jin, Ye Wang, Wenwen Pan, Linjun Li, Xize Cheng, Zhou Zhao
2023 J jnl
Extending Multi-modal Contrastive Representations.
CoRR
Zehan Wang, Ziang Zhang, Luping Liu, Yang Zhao, Haifeng Huang, Tao Jin, Zhou Zhao
2023 A* conf
Gloss Attention for Gloss-free Sign Language Translation.
CVPR
Aoxiong Yin, Tianyun Zhong, Li Tang, Weike Jin, Tao Jin, Zhou Zhao
2023 J jnl
Gloss Attention for Gloss-free Sign Language Translation.
CoRR
Aoxiong Yin, Tianyun Zhong, Li Tang, Weike Jin, Tao Jin, Zhou Zhao
2023 A* conf
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition.
ICCV
Xize Cheng, Tao Jin, Rongjie Huang, Linjun Li, Wang Lin, Zehan Wang, Ye Wang, Huadai Liu, Aoxiong Yin, Zhou Zhao
2023 J jnl
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition.
CoRR
Xize Cheng, Linjun Li, Tao Jin, Rongjie Huang, Wang Lin, Zehan Wang, Huangdai Liu, Ye Wang, Aoxiong Yin, Zhou Zhao
2023 — conf
OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment.
ACL (1)
Xize Cheng, Tao Jin, Linjun Li, Wang Lin, Xinyu Duan, Zhou Zhao
2023 J jnl
OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment.
CoRR
Xize Cheng, Tao Jin, Linjun Li, Wang Lin, Xinyu Duan, Zhou Zhao
2023 A* conf
Rethinking Missing Modality Learning from a Decoding Perspective.
ACM Multimedia
Tao Jin, Xize Cheng, Linjun Li, Wang Lin, Ye Wang, Zhou Zhao
2023 — conf
Semantic-conditioned Dual Adaptation for Cross-domain Query-based Visual Segmentation.
ACL (Findings)
Ye Wang, Tao Jin, Wang Lin, Xize Cheng, Linjun Li, Zhou Zhao
2023 — conf
TAVT: Towards Transferable Audio-Visual Text Generation.
ACL (1)
Wang Lin, Tao Jin, Wenwen Pan, Linjun Li, Xize Cheng, Ye Wang, Zhou Zhao
2023 J jnl
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation.
CoRR
Xize Cheng, Rongjie Huang, Linjun Li, Tao Jin, Zehan Wang, Aoxiong Yin, Minglei Li, Xinyu Duan, Changpeng Yang, Zhou Zhao
2023 — conf
Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning.
ACL (1)
Ye Wang, Wang Lin, Shengyu Zhang, Tao Jin, Linjun Li, Xize Cheng, Zhou Zhao
2022 J jnl
Interaction augmented transformer with decoupled decoding for video captioning.
Neurocomputing
Tao Jin, Zhou Zhao, Peng Wang, Jun Yu, Fei Wu
2022 A* conf
MC-SLT: Towards Low-Resource Signer-Adaptive Sign Language Translation.
ACM Multimedia
Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng
2022 — conf
Prior Knowledge and Memory Enriched Transformer for Sign Language Translation.
ACL (Findings)
Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng
2021 A* conf
Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation.
ACM Multimedia
Tao Jin, Zhou Zhao
2021 A* conf
Generalizable Multi-linear Attention Network.
NeurIPS
Tao Jin, Zhou Zhao
2020 — conf
Dual Low-Rank Multimodal Fusion.
EMNLP (Findings)
Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang
2020 A* conf
SBAT: Video Captioning with Sparse Boundary-Aware Transformer.
IJCAI
Tao Jin, Siyu Huang, Ming Chen, Yingming Li, Zhongfei Zhang
2020 J jnl
SBAT: Video Captioning with Sparse Boundary-Aware Transformer.
CoRR
Tao Jin, Siyu Huang, Ming Chen, Yingming Li, Zhongfei Zhang
2019 — conf
Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning.
EMNLP/IJCNLP (1)
Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang
2019 J jnl
Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning.
CoRR
Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang
2019 J jnl
Recurrent convolutional video captioning with global and local attention.
Neurocomputing
Tao Jin, Yingming Li, Zhongfei Zhang