Yuki Mitsufuji

292 papers A* 30A 5B 6Misc 36Journal 188Unranked 27
YearRankTypeTitle / Venue / Authors
2026 J jnl
A Unified View of Drifting and Score-Based Models.
CoRR
Chieh-Hsin Lai, Bac Nguyen, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon, Molei Tao
2026 J jnl
Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion.
Trans. Mach. Learn. Res.
Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji
2026 J jnl
Echoes Over Time: Unlocking Length Generalization in Video-to-Audio Generation Models.
CoRR
Christian Simon, Masato Ishii, Wei-Yao Wang, Koichi Saito, Akio Hayakawa, Dongseok Shim, Zhi Zhong, Shuyang Cui, Shusuke Takahashi, Takashi Shibuya, Yuki Mitsufuji
2026 A* conf
Emergent, not Immanent: A Baradian Reading of Explainable AI.
CHI
Fabio Morreale, Joan Serrà, Yuki Mitsufuji
2026 J jnl
Emergent, not Immanent: A Baradian Reading of Explainable AI.
CoRR
Fabio Morreale, Joan Serrà, Yuki Mitsufuji
2026 J jnl
GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning.
CoRR
Naoki Murata, Yuhta Takida, Chieh-Hsin Lai, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji
2026 J jnl
Improved Object-Centric Diffusion Learning with Registers and Contrastive Alignment.
CoRR
Bac Nguyen, Yuhta Takida, Naoki Murata, Chieh-Hsin Lai, Toshimitsu Uesaka, Stefano Ermon, Yuki Mitsufuji
2026 J jnl
Information-Guided Noise Allocation for Efficient Diffusion Training.
CoRR
Gabriel Raya, Bac Nguyen, Georgios Batzolis, Yuhta Takida, Dejan Stancevic, Naoki Murata, Chieh-Hsin Lai, Yuki Mitsufuji, Luca Ambrogioni
2026 A* conf
SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing.
AAAI
Xinlei Niu, Kin Wai Cheuk, Jing Zhang, Naoki Murata, Chieh-Hsin Lai, Michele Mancusi, Woosung Choi, Giorgio Fabbro, Wei-Hsiang Liao, Charles Patrick Martin, Yuki Mitsufuji
2026 J jnl
Summary of The Inaugural Music Source Restoration Challenge.
CoRR
Yongyi Zang, Jiarui Hai, Wanying Ge, Qiuqiang Kong, Zheqi Dai, Helin Wang, Yuki Mitsufuji, Mark D. Plumbley
2026 A* conf
Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry.
AAAI
Junyoung Seo, Jisang Han, Jaewoo Jung, Siyoon Jin, Joungbin Lee, Takuya Narihira, Kazumi Fukuda, Takashi Shibuya, Donghoon Ahn, Shoukang Hu, Seungryong Kim, Yuki Mitsufuji
2025 J jnl
'Studies for': A Human-AI Co-Creative Sound Artwork Using a Real-time Multi-channel Sound Generation Model.
CoRR
Chihiro Nagashima, Akira Takahashi, Zhi Zhong, Shusuke Takahashi, Yuki Mitsufuji
2025 Misc conf
30+ Years of Source Separation Research: Achievements and Future Challenges.
ICASSP
Shoko Araki, Nobutaka Ito, Reinhold Haeb-Umbach, Gordon Wichern, Zhong-Qiu Wang, Yuki Mitsufuji
2025 J jnl
30+ Years of Source Separation Research: Achievements and Future Challenges.
CoRR
Shoko Araki, Nobutaka Ito, Reinhold Haeb-Umbach, Gordon Wichern, Zhong-Qiu Wang, Yuki Mitsufuji
2025 J jnl
3D Scene Prompting for Scene-Consistent Camera-Controllable Video Generation.
CoRR
Joungbin Lee, Jaewoo Jung, Jisang Han, Takuya Narihira, Kazumi Fukuda, Junyoung Seo, Sunghwan Hong, Yuki Mitsufuji, Seungryong Kim
2025 A conf
A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?
INTERSPEECH
Yigitcan Özer, Woosung Choi, Joan Serrà, Mayank Kumar Singh, Wei-Hsiang Liao, Yuki Mitsufuji
2025 J jnl
A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?
CoRR
Yigitcan Özer, Woosung Choi, Joan Serrà, Mayank Kumar Singh, Wei-Hsiang Liao, Yuki Mitsufuji
2025 B conf
A Simple but Strong Baseline for Sounding Video Generation: Effective Adaptation of Audio and Video Diffusion Models for Joint Generation.
IJCNN
Masato Ishii, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji
2025 — conf
Aligning Text-to-Music Evaluation with Human Preferences.
ISMIR
Yichen Huang, Zachary Novack, Koichi Saito, Jiatong Shi, Shinji Watanabe, Yuki Mitsufuji, John Thickstun, Chris Donahue
2025 J jnl
Aligning Text-to-Music Evaluation with Human Preferences.
CoRR
Yichen Huang, Zachary Novack, Koichi Saito, Jiatong Shi, Shinji Watanabe, Yuki Mitsufuji, John Thickstun, Chris Donahue
2025 J jnl
Attribution-by-design: Ensuring Inference-Time Provenance in Generative Music Systems.
CoRR
Fabio Morreale, Wiebke Hutiri, Joan Serrà, Alice Xiang, Yuki Mitsufuji
2025 J jnl
AutoRefiner: Improving Autoregressive Video Diffusion Models via Reflective Refinement Over the Stochastic Sampling Path.
CoRR
Zhengyang Yu, Akio Hayakawa, Masato Ishii, Qingtao Yu, Takashi Shibuya, Jing Zhang, Yuki Mitsufuji
2025 J jnl
Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation.
Trans. Mach. Learn. Res.
Yutong He, Alexander Robey, Naoki Murata, Yiding Jiang, Joshua Nathaniel Williams, George J. Pappas, Hamed Hassani, Yuki Mitsufuji, Ruslan Salakhutdinov, J. Zico Kolter
2025 J jnl
Automatic Music Mixing using a Generative Model of Effect Embeddings.
CoRR
Eloi Moliner, Marco A. Martínez Ramírez, Junghyun Koo, Wei-Hsiang Liao, Kin Wai Cheuk, Joan Serrà, Vesa Välimäki, Yuki Mitsufuji
2025 J jnl
Automatic Music Sample Identification with Multi-Track Contrastive Learning.
CoRR
Alain Riou, Joan Serrà, Yuki Mitsufuji
2025 J jnl
C3G: Learning Compact 3D Representations with 2K Gaussians.
CoRR
Honggyu An, Jaewoo Jung, Mungyeom Kim, Sunghwan Hong, Chaehyun Kim, Kazumi Fukuda, Minkyeong Jeon, Jisang Han, Takuya Narihira, Hyuna Ko, Junsu Kim, Yuki Mitsufuji, Seungryong Kim
2025 J jnl
CARE: Aligning Language Models for Regional Cultural Awareness.
CoRR
Geyang Guo, Tarek Naous, Hiromi Wakaki, Yukiko Nishimura, Yuki Mitsufuji, Alan Ritter, Wei Xu
2025 A* conf
CARE: Multilingual Human Preference Learning for Cultural Awareness.
EMNLP
Geyang Guo, Tarek Naous, Hiromi Wakaki, Yukiko Nishimura, Yuki Mitsufuji, Alan Ritter, Wei Xu
2025 A* conf
CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation.
ACM Multimedia
Yuanhong Chen, Kazuki Shimada, Christian Simon, Yukara Ikemiya, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation.
CoRR
Yuanhong Chen, Kazuki Shimada, Christian Simon, Yukara Ikemiya, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Models.
CoRR
Zheyuan Hu, Chieh-Hsin Lai, Yuki Mitsufuji, Stefano Ermon
2025 — conf
Can Large Language Models Predict Audio Effects Parameters from Natural Language?
WASPAA
Seungheon Doh, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Juhan Nam, Yuki Mitsufuji
2025 J jnl
Can Large Language Models Predict Audio Effects Parameters from Natural Language?
CoRR
Seungheon Doh, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Juhan Nam, Yuki Mitsufuji
2025 A* conf
Classifier-Free Guidance Inside the Attraction Basin May Cause Memorization.
CVPR
Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir D. Memon, Julian Togelius, Yuki Mitsufuji
2025 J jnl
Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Edits.
CoRR
Masato Ishii, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attribution.
CoRR
Yong-Hyun Park, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Woosung Choi, Kin Wai Cheuk, Junghyun Koo, Yuki Mitsufuji
2025 J jnl
Cross-Modal Learning for Music-to-Music-Video Description Generation.
CoRR
Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Zhi Zhong, Wei-Hsiang Liao, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
D^2USt3R: Enhancing 3D Reconstruction with 4D Pointmaps for Dynamic Scenes.
CoRR
Jisang Han, Honggyu An, Jaewoo Jung, Takuya Narihira, Junyoung Seo, Kazumi Fukuda, Chaehyun Kim, Sunghwan Hong, Yuki Mitsufuji, Seungryong Kim
2025 A* conf
DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning.
EMNLP
Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning.
CoRR
Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion.
CoRR
Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
Denoising Multi-Beta VAE: Representation Learning for Disentanglement and Generation.
CoRR
Anshuk Uppal, Yuhta Takida, Chieh-Hsin Lai, Yuki Mitsufuji
2025 J jnl
DiffVox: A Differentiable Model for Capturing and Analysing Professional Effects Distributions.
CoRR
Chin-Yun Yu, Marco A. Martínez Ramírez, Junghyun Koo, Ben Hayes, Wei-Hsiang Liao, György Fazekas, Yuki Mitsufuji
2025 J jnl
Distill, Forget, Repeat: A Framework for Continual Unlearning in Text-to-Image Diffusion Models.
CoRR
Naveen George, Naoki Murata, Yuhta Takida, Konda Reddy Mopuri, Yuki Mitsufuji
2025 A* conf
Distillation of Discrete Diffusion through Dimensional Correlations.
ICML
Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
Do Foundational Audio Encoders Understand Music Structure?
CoRR
Keisuke Toyama, Zhi Zhong, Akira Takahashi, Shusuke Takahashi, Yuki Mitsufuji
2025 — conf
Dyadic Mamba: Long-term Dyadic Human Motion Synthesis.
CVPR Workshops
Julian Tanke, Takashi Shibuya, Kengo Uchida, Koichi Saito, Yuki Mitsufuji
2025 J jnl
Dyadic Mamba: Long-term Dyadic Human Motion Synthesis.
CoRR
Julian Tanke, Takashi Shibuya, Kengo Uchida, Koichi Saito, Yuki Mitsufuji
2025 B conf
Efficiency without Compromise: CLIP-aided Text-to-Image GANs with Increased Diversity.
IJCNN
Yuya Kobayashi, Yuhta Takida, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
Efficiency without Compromise: CLIP-aided Text-to-Image GANs with Increased Diversity.
CoRR
Yuya Kobayashi, Yuhta Takida, Takashi Shibuya, Yuki Mitsufuji
2025 — conf
Enhancing Neural Audio Fingerprint Robustness to Audio Degradation for Music Identification.
ISMIR
Recep Oguz Araz, Guillem Cortès-Sebastià, Emilio Molina, Joan Serrà, Xavier Serra, Yuki Mitsufuji, Dmitry Bogdanov
2025 J jnl
Enhancing Neural Audio Fingerprint Robustness to Audio Degradation for Music Identification.
CoRR
Recep Oguz Araz, Guillem Cortès-Sebastià, Emilio Molina, Joan Serrà, Xavier Serra, Yuki Mitsufuji, Dmitry Bogdanov
2025 J jnl
FoleyBench: A Benchmark For Video-to-Audio Models.
CoRR
Satvik Dixit, Koichi Saito, Zhi Zhong, Yuki Mitsufuji, Chris Donahue
2025 J jnl
Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Image.
CoRR
Anubhav Jain, Yuya Kobayashi, Naoki Murata, Yuhta Takida, Takashi Shibuya, Yuki Mitsufuji, Niv Cohen, Nasir D. Memon, Julian Togelius
2025 — conf
Fx-Encoder++: Extracting Instrument-Wise Audio Effects Representations from Mixtures.
ISMIR
Yen-Tung Yeh, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yi-Hsuan Yang, Yuki Mitsufuji
2025 J jnl
Fx-Encoder++: Extracting Instrument-Wise Audio Effects Representations from Mixtures.
CoRR
Yen-Tung Yeh, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yi-Hsuan Yang, Yuki Mitsufuji
2025 J jnl
G2D2: Gradient-Guided Discrete Diffusion for Inverse Problem Solving.
Trans. Mach. Learn. Res.
Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji
2025 J jnl
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models.
Trans. Mach. Learn. Res.
Muhammad Jehanzeb Mirza, Mengjie Zhao, Zhuoyuan Mao, Sivan Doveh, Wei Lin, Paul Gavrikov, Michael Dorkenwald, Shiqi Yang, Saurav Jha, Hiromi Wakaki, Yuki Mitsufuji, Horst Possegger, Rogério Feris, Leonid Karlinsky, James R. Glass
2025 A* conf
HERO: Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning.
ICLR
Ayano Hiranaka, Shang-Fu Chen, Chieh-Hsin Lai, Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao, Shao-Hua Sun, Yuki Mitsufuji
2025 J jnl
HumanGif: Single-View Human Diffusion with Generative Prior.
CoRR
Shoukang Hu, Takuya Narihira, Kazumi Fukuda, Ryosuke Sawata, Takashi Shibuya, Yuki Mitsufuji
2025 — conf
ITO-Master: Inference-Time Optimization for Audio Effects Modeling of Music Mastering Processors.
ISMIR
Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Michele Mancusi, Yuki Mitsufuji
2025 J jnl
ITO-Master: Inference-Time Optimization for Audio Effects Modeling of Music Mastering Processors.
CoRR
Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Michele Mancusi, Yuki Mitsufuji
2025 — conf
Improving Inference-Time Optimisation for Vocal Effects Style Transfer with a Gaussian Prior.
WASPAA
Chin-Yun Yu, Marco A. Martínez Ramírez, Junghyun Koo, Wei-Hsiang Liao, Yuki Mitsufuji, György Fazekas
2025 J jnl
Improving Inference-Time Optimisation for Vocal Effects Style Transfer with a Gaussian Prior.
CoRR
Chin-Yun Yu, Marco A. Martínez Ramírez, Junghyun Koo, Wei-Hsiang Liao, Yuki Mitsufuji, György Fazekas
2025 B conf
Improving Vector-Quantized Image Modeling with Latent Consistency-Matching Diffusion.
IJCNN
Bac Nguyen, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Stefano Ermon, Yuki Mitsufuji
2025 — conf
Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning.
ISMIR
Yixiao Zhang, Yukara Ikemiya, Woosung Choi, Naoki Murata, Marco A. Martínez Ramírez, Liwei Lin, Gus Xia, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon
2025 A* conf
Jump Your Steps: Optimizing Sampling Schedule of Discrete Diffusion Models.
ICLR
Yong-Hyun Park, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Yuki Mitsufuji
2025 J jnl
LLM2Fx-Tools: Tool Calling For Music Post-Production.
CoRR
Seungheon Doh, Junghyun Koo, Marco A. Martínez Ramírez, Woosung Choi, Wei-Hsiang Liao, Qiyu Wu, Juhan Nam, Yuki Mitsufuji
2025 J jnl
Large-Scale Training Data Attribution for Music Generative Models via Unlearning.
CoRR
Woosung Choi, Junghyun Koo, Kin Wai Cheuk, Joan Serrà, Marco A. Martínez Ramírez, Yukara Ikemiya, Naoki Murata, Yuhta Takida, Wei-Hsiang Liao, Yuki Mitsufuji
2025 Misc conf
Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer.
ICASSP
Michele Mancusi, Yurii Halychanskyi, Kin Wai Cheuk, Eloi Moliner, Chieh-Hsin Lai, Stefan Uhlich, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Yuki Mitsufuji
2025 J jnl
Leveraging Whisper Embeddings for Audio-based Lyrics Matching.
CoRR
Eleonora Mancini, Joan Serrà, Paolo Torroni, Yuki Mitsufuji
2025 J jnl
MCA: Modality Composition Awareness for Robust Composed Multimodal Retrieval.
CoRR
Qiyu Wu, Shuyang Cui, Satoshi Hayakawa, Wei-Yao Wang, Hiromi Wakaki, Yuki Mitsufuji
2025 A* conf
MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis.
CVPR
Ho Kei Cheng, Masato Ishii, Akio Hayakawa, Takashi Shibuya, Alexander G. Schwing, Yuki Mitsufuji
2025 J jnl
MMAudioSep: Taming Video-to-Audio Generative Model Towards Video/Text-Queried Sound Separation.
CoRR
Akira Takahashi, Shusuke Takahashi, Yuki Mitsufuji
2025 A* conf
MMDisCo: Multi-Modal Discriminator-Guided Cooperative Diffusion for Joint Audio and Video Generation.
ICLR
Akio Hayakawa, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
MSRBench: A Benchmarking Dataset for Music Source Restoration.
CoRR
Yongyi Zang, Jiarui Hai, Wanying Ge, Qiuqiang Kong, Zheqi Dai, Helin Wang, Yuki Mitsufuji, Mark D. Plumbley
2025 J jnl
MeanFlow Transformers with Representation Autoencoders.
CoRR
Zheyuan Hu, Chieh-Hsin Lai, Ge Wu, Yuki Mitsufuji, Stefano Ermon
2025 A* conf
Mining your own secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models.
ICLR
Saurav Jha, Shiqi Yang, Masato Ishii, Mengjie Zhao, Christian Simon, Muhammad Jehanzeb Mirza, Dong Gong, Lina Yao, Shusuke Takahashi, Yuki Mitsufuji
2025 — conf
MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training.
CVPR Workshops
Kengo Uchida, Takashi Shibuya, Yuhta Takida, Naoki Murata, Julian Tanke, Shusuke Takahashi, Yuki Mitsufuji
2025 J jnl
Music Arena: Live Evaluation for Text-to-Music.
CoRR
Yonghyun Kim, Wayne Chi, Anastasios N. Angelopoulos, Wei-Lin Chiang, Koichi Saito, Shinji Watanabe, Yuki Mitsufuji, Chris Donahue
2025 J jnl
Music Foundation Model as Generic Booster for Music Downstream Tasks.
Trans. Mach. Learn. Res.
Wei-Hsiang Liao, Yuhta Takida, Yukara Ikemiya, Zhi Zhong, Chieh-Hsin Lai, Giorgio Fabbro, Kazuki Shimada, Keisuke Toyama, Kin Wai Cheuk, Marco A. Martínez Ramírez, Shusuke Takahashi, Stefan Uhlich, Taketo Akama, Woosung Choi, Yuichiro Koyama, Yuki Mitsufuji
2025 J jnl
PAVAS: Physics-Aware Video-to-Audio Synthesis.
CoRR
Oh Hyun-Bin, Yuhta Takida, Toshimitsu Uesaka, Tae-Hyun Oh, Yuki Mitsufuji
2025 — conf
Performance Analysis of Active Noise Control Over a Spatial Region.
APSIPA
Jihui Aimee Zhang, Thushara D. Abhayapala, Naoki Murata, Prasanga N. Samarasinghe, Yu Maeno, Yuki Mitsufuji
2025 J jnl
Reductive, Exclusionary, Normalising: The Limits of Generative AI Music.
Trans. Int. Soc. Music. Inf. Retr.
Fabio Morreale, Marco A. Martínez Ramírez, Raul Masu, Wei-Hsiang Liao, Yuki Mitsufuji
2025 J jnl
Reverse Engineering of Music Mixing Graphs with Differentiable Processors and Iterative Pruning.
CoRR
Sungho Lee, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Giorgio Fabbro, Kyogu Lee, Yuki Mitsufuji
2025 J jnl
SONA: Learning Conditional, Unconditional, and Mismatching-Aware Discriminator.
CoRR
Yuhta Takida, Satoshi Hayakawa, Takashi Shibuya, Masaaki Imaizumi, Naoki Murata, Bac Nguyen, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuki Mitsufuji
2025 J jnl
Schrodinger Audio-Visual Editor: Object-Level Audiovisual Removal.
CoRR
Weihan Xu, Kan Jen Cheng, Koichi Saito, Muhammad Jehanzeb Mirza, Tingle Li, Yisi Liu, Alexander H. Liu, Liming Wang, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji, Gopala Anumanchipalli, Paul Pu Liang
2025 — conf
Schrödinger Bridge Consistency Trajectory Models for Speech Enhancement.
WASPAA
Shuichiro Nishigori, Koichi Saito, Naoki Murata, Masato Hirano, Shusuke Takahashi, Yuki Mitsufuji
2025 J jnl
Schrödinger Bridge Consistency Trajectory Models for Speech Enhancement.
CoRR
Shuichiro Nishigori, Koichi Saito, Naoki Murata, Masato Hirano, Shusuke Takahashi, Yuki Mitsufuji
2025 A* conf
SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation.
ICLR
Koichi Saito, Dongjun Kim, Takashi Shibuya, Chieh-Hsin Lai, Zhi Zhong, Yuhta Takida, Yuki Mitsufuji
2025 J jnl
SoundReactor: Frame-level Online Video-to-Audio Generation.
CoRR
Koichi Saito, Julian Tanke, Christian Simon, Masato Ishii, Kazuki Shimada, Zachary Novack, Zhi Zhong, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji
2025 — conf
SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet.
WASPAA
Zhi Zhong, Akira Takahashi, Shuyang Cui, Keisuke Toyama, Shusuke Takahashi, Yuki Mitsufuji
2025 J jnl
SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet.
CoRR
Zhi Zhong, Akira Takahashi, Shuyang Cui, Keisuke Toyama, Shusuke Takahashi, Yuki Mitsufuji
2025 J jnl
SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing.
CoRR
Xinlei Niu, Kin Wai Cheuk, Jing Zhang, Naoki Murata, Chieh-Hsin Lai, Michele Mancusi, Woosung Choi, Giorgio Fabbro, Wei-Hsiang Liao, Charles Patrick Martin, Yuki Mitsufuji
2025 J jnl
Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance.
CoRR
Akio Hayakawa, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
Stereo Sound Event Localization and Detection with Onscreen/offscreen Classification.
CoRR
Kazuki Shimada, Archontis Politis, Irán R. Román, Parthasaarathy Sudarsanam, David Diaz-Guerra, Ruchi Pandey, Kengo Uchida, Yuichiro Koyama, Naoya Takahashi, Takashi Shibuya, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji
2025 B conf
StereoSync: Spatially-Aware Stereo Audio Generation from Video.
IJCNN
Christian Marinoni, Riccardo F. Gramaccioni, Kazuki Shimada, Takashi Shibuya, Yuki Mitsufuji, Danilo Comminiello
2025 J jnl
StereoSync: Spatially-Aware Stereo Audio Generation from Video.
CoRR
Christian Marinoni, Riccardo Fosco Gramaccioni, Kazuki Shimada, Takashi Shibuya, Yuki Mitsufuji, Danilo Comminiello
2025 A* conf
Supervised Contrastive Learning from Weakly-Labeled Audio Segments for Musical Version Matching.
ICML
Joan Serrà, Recep Oguz Araz, Dmitry Bogdanov, Yuki Mitsufuji
2025 J jnl
Supervised contrastive learning from weakly-labeled audio segments for musical version matching.
CoRR
Joan Serrà, Recep Oguz Araz, Dmitry Bogdanov, Yuki Mitsufuji
2025 J jnl
TITAN-Guide: Taming Inference-Time AligNment for Guided Text-to-Video Diffusion Models.
CoRR
Christian Simon, Masato Ishii, Akio Hayakawa, Zhi Zhong, Shusuke Takahashi, Takashi Shibuya, Yuki Mitsufuji
2025 J jnl
TalkCuts: A Large-Scale Dataset for Multi-Shot Human Speech Video Generation.
CoRR
Jiaben Chen, Zixin Wang, Ailing Zeng, Yang Fu, Xueyang Yu, Siyuan Cen, Julian Tanke, Yihang Chen, Koichi Saito, Yuki Mitsufuji, Chuang Gan
2025 J jnl
The Principles of Diffusion Models.
CoRR
Chieh-Hsin Lai, Yang Song, Dongjun Kim, Yuki Mitsufuji, Stefano Ermon
2025 J jnl
Theoretical Refinement of CLIP by Utilizing Linear Structure of Optimal Similarity.
CoRR
Naoki Yoshida, Satoshi Hayakawa, Yuhta Takida, Toshimitsu Uesaka, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
Theory-Informed Improvements to Classifier-Free Guidance for Discrete Diffusion Models.
CoRR
Kevin Rojas, Ye He, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji, Molei Tao
2025 — conf
Towards Reporting Bias in Visual-Language Datasets: Bi-Modal Data Augmentation by Decoupling Object-Attribute Association.
ICCVW
Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, Yuki Mitsufuji
2025 J jnl
Training Consistency Models with Variational Noise Coupling.
CoRR
Gianluigi Silvestri, Luca Ambrogioni, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji
2025 J jnl
Transformed Low-rank Adaptation via Tensor Decomposition and Its Applications to Text-to-image Models.
CoRR
Zerui Tao, Yuhta Takida, Naoki Murata, Qibin Zhao, Yuki Mitsufuji
2025 Misc conf
Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges.
ICASSP
Geoffroy Peeters, Zafar Rafii, Magdalena Fuentes, Zhiyao Duan, Emmanouil Benetos, Juhan Nam, Yuki Mitsufuji
2025 J jnl
Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges.
CoRR
Geoffroy Peeters, Zafar Rafii, Magdalena Fuentes, Zhiyao Duan, Emmanouil Benetos, Juhan Nam, Yuki Mitsufuji
2025 A* conf
VCT: Training Consistency Models with Variational Noise Coupling.
ICML
Gianluigi Silvestri, Luca Ambrogioni, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji
2025 J jnl
VIRTUE: Visual-Interactive Text-Image Universal Embedder.
CoRR
Wei-Yao Wang, Kazuya Tateishi, Qiyu Wu, Shusuke Takahashi, Yuki Mitsufuji
2025 Misc conf
Variable Bitrate Residual Vector Quantization for Audio Coding.
ICASSP
Yunkee Chae, Woosung Choi, Yuhta Takida, Junghyun Koo, Yukara Ikemiya, Zhi Zhong, Kin Wai Cheuk, Marco A. Martínez Ramírez, Kyogu Lee, Wei-Hsiang Liao, Yuki Mitsufuji
2025 J jnl
Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry.
CoRR
Junyoung Seo, Jisang Han, Jaewoo Jung, Siyoon Jin, Joungbin Lee, Takuya Narihira, Kazumi Fukuda, Takashi Shibuya, Donghoon Ahn, Shoukang Hu, Seungryong Kim, Yuki Mitsufuji
2025 A* conf
VinaBench: Benchmark for Faithful and Consistent Visual Narratives.
CVPR
Silin Gao, Sheryl Mathew, Li Mi, Sepideh Mamooler, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Syrielle Montariol, Antoine Bosselut
2025 J jnl
VinaBench: Benchmark for Faithful and Consistent Visual Narratives.
CoRR
Silin Gao, Sheryl Mathew, Li Mi, Sepideh Mamooler, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Syrielle Montariol, Antoine Bosselut
2025 A* conf
Weighted Point Set Embedding for Multimodal Contrastive Learning Toward Optimal Similarity Metric.
ICLR
Toshimitsu Uesaka, Taiji Suzuki, Yuhta Takida, Chieh-Hsin Lai, Naoki Murata, Yuki Mitsufuji
2024 J jnl
A Simple but Strong Baseline for Sounding Video Generation: Effective Adaptation of Audio and Video Diffusion Models for Joint Generation.
CoRR
Masato Ishii, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji
2024 J jnl
A Survey on Diffusion Models for Inverse Problems.
CoRR
Giannis Daras, Hyungjin Chung, Chieh-Hsin Lai, Yuki Mitsufuji, Jong Chul Ye, Peyman Milanfar, Alexandros G. Dimakis, Mauricio Delbracio
2024 J jnl
Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation.
CoRR
Yutong He, Alexander Robey, Naoki Murata, Yiding Jiang, Joshua Williams, George J. Pappas, Hamed Hassani, Yuki Mitsufuji, Ruslan Salakhutdinov, J. Zico Kolter
2024 Misc conf
BIGVSAN: Enhancing Gan-Based Neural Vocoders with Slicing Adversarial Network.
ICASSP
Takashi Shibuya, Yuhta Takida, Yuki Mitsufuji
2024 J jnl
Bellman Diffusion: Generative Modeling as Learning a Linear Operator in the Distribution Space.
CoRR
Yangming Li, Chieh-Hsin Lai, Carola-Bibiane Schönlieb, Yuki Mitsufuji, Stefano Ermon
2024 J jnl
Blind Inverse Problem Solving Made Easy by Text-to-Image Latent Diffusion.
CoRR
Michail Dontas, Yutong He, Naoki Murata, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov
2024 J jnl
Classifier-Free Guidance inside the Attraction Basin May Cause Memorization.
CoRR
Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir D. Memon, Julian Togelius, Yuki Mitsufuji
2024 J jnl
ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmark.
CoRR
Hiromi Wakaki, Yuki Mitsufuji, Yoshinori Maeda, Yukiko Nishimura, Silin Gao, Mengjie Zhao, Keiichi Yamada, Antoine Bosselut
2024 A* conf
Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion.
ICLR
Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yutong He, Yuki Mitsufuji, Stefano Ermon
2024 — conf
DiffuCOMET: Contextual Commonsense Knowledge Diffusion.
ACL (1)
Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
2024 J jnl
DiffuCOMET: Contextual Commonsense Knowledge Diffusion.
CoRR
Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
2024 Misc conf
Diffusion-Based Speech Enhancement with Joint Generative and Predictive Decoders.
ICASSP
Hao Shi, Kazuki Shimada, Masato Hirano, Takashi Shibuya, Yuichiro Koyama, Zhi Zhong, Shusuke Takahashi, Tatsuya Kawahara, Yuki Mitsufuji
2024 J jnl
DisMix: Disentangling Mixtures of Musical Instruments for Source-level Pitch and Timbre Manipulation.
CoRR
Yin-Jyun Luo, Kin Wai Cheuk, Woosung Choi, Toshimitsu Uesaka, Keisuke Toyama, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Wei-Hsiang Liao, Simon Dixon, Yuki Mitsufuji
2024 J jnl
Discriminator-Guided Cooperative Diffusion for Joint Audio and Video Generation.
CoRR
Akio Hayakawa, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji
2024 J jnl
Distillation of Discrete Diffusion through Dimensional Correlations.
CoRR
Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji
2024 Misc conf
Enhancing Semantic Communication with Deep Generative Models: An Overview.
ICASSP
Eleonora Grassucci, Yuki Mitsufuji, Ping Zhang, Danilo Comminiello
2024 J jnl
G2D2: Gradient-guided Discrete Diffusion for image inverse problem solving.
CoRR
Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji
2024 J jnl
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models.
CoRR
Muhammad Jehanzeb Mirza, Mengjie Zhao, Zhuoyuan Mao, Sivan Doveh, Wei Lin, Paul Gavrikov, Michael Dorkenwald, Shiqi Yang, Saurav Jha, Hiromi Wakaki, Yuki Mitsufuji, Horst Possegger, Rogério Feris, Leonid Karlinsky, James R. Glass
2024 J jnl
GRAFX: An Open-Source Library for Audio Processing Graphs in PyTorch.
CoRR
Sungho Lee, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Giorgio Fabbro, Kyogu Lee, Yuki Mitsufuji
2024 A* conf
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping.
NeurIPS
Junyoung Seo, Kazumi Fukuda, Takashi Shibuya, Takuya Narihira, Naoki Murata, Shoukang Hu, Chieh-Hsin Lai, Seungryong Kim, Yuki Mitsufuji
2024 J jnl
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping.
CoRR
Junyoung Seo, Kazumi Fukuda, Takashi Shibuya, Takuya Narihira, Naoki Murata, Shoukang Hu, Chieh-Hsin Lai, Seungryong Kim, Yuki Mitsufuji
2024 J jnl
HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayes.
CoRR
Yuhta Takida, Yukara Ikemiya, Takashi Shibuya, Kazuki Shimada, Woosung Choi, Chieh-Hsin Lai, Naoki Murata, Toshimitsu Uesaka, Kengo Uchida, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayes.
Trans. Mach. Learn. Res.
Yuhta Takida, Yukara Ikemiya, Takashi Shibuya, Kazuki Shimada, Woosung Choi, Chieh-Hsin Lai, Naoki Murata, Toshimitsu Uesaka, Kengo Uchida, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning.
CoRR
Ayano Hiranaka, Shang-Fu Chen, Chieh-Hsin Lai, Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao, Shao-Hua Sun, Yuki Mitsufuji
2024 J jnl
Improving Unsupervised Clean-to-Rendered Guitar Tone Transformation Using GANs and Integrated Unaligned Clean Data.
CoRR
Yu-Hua Chen, Woosung Choi, Wei-Hsiang Liao, Marco A. Martínez Ramírez, Kin Wai Cheuk, Yuki Mitsufuji, Jyh-Shing Roger Jang, Yi-Hsuan Yang
2024 J jnl
Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning.
CoRR
Yixiao Zhang, Yukara Ikemiya, Woosung Choi, Naoki Murata, Marco A. Martínez Ramírez, Liwei Lin, Gus Xia, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon
2024 J jnl
LOCKEY: A Novel Approach to Model Authentication and Deepfake Tracking.
CoRR
Mayank Kumar Singh, Naoya Takahashi, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer.
CoRR
Michele Mancusi, Yurii Halychanskyi, Kin Wai Cheuk, Chieh-Hsin Lai, Stefan Uhlich, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Yuki Mitsufuji
2024 J jnl
MR-MT3: Memory Retaining Multi-Track Music Transcription to Mitigate Instrument Leakage.
CoRR
Hao Hao Tan, Kin Wai Cheuk, Taemin Cho, Wei-Hsiang Liao, Yuki Mitsufuji
2024 A* conf
Manifold Preserving Guided Diffusion.
ICLR
Yutong He, Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Dongjun Kim, Wei-Hsiang Liao, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov, Stefano Ermon
2024 J jnl
Mining Your Own Secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models.
CoRR
Saurav Jha, Shiqi Yang, Masato Ishii, Mengjie Zhao, Christian Simon, Muhammad Jehanzeb Mirza, Dong Gong, Lina Yao, Shusuke Takahashi, Yuki Mitsufuji
2024 J jnl
Mitigating Embedding Collapse in Diffusion Models for Categorical Data.
CoRR
Bac Nguyen, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Stefano Ermon, Yuki Mitsufuji
2024 J jnl
MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training.
CoRR
Kengo Uchida, Takashi Shibuya, Yuhta Takida, Naoki Murata, Shusuke Takahashi, Yuki Mitsufuji
2024 J jnl
Music Foundation Model as Generic Booster for Music Downstream Tasks.
CoRR
Wei-Hsiang Liao, Yuhta Takida, Yukara Ikemiya, Zhi Zhong, Chieh-Hsin Lai, Giorgio Fabbro, Kazuki Shimada, Keisuke Toyama, Kin Wai Cheuk, Marco A. Martínez Ramírez, Shusuke Takahashi, Stefan Uhlich, Taketo Akama, Woosung Choi, Yuichiro Koyama, Yuki Mitsufuji
2024 A* conf
MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models.
IJCAI
Yixiao Zhang, Yukara Ikemiya, Gus Xia, Naoki Murata, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon
2024 J jnl
MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models.
CoRR
Yixiao Zhang, Yukara Ikemiya, Gus Xia, Naoki Murata, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon
2024 — conf
On the Language Encoder of Contrastive Cross-modal Models.
ACL (Findings)
Mengjie Zhao, Junya Ono, Zhi Zhong, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Takashi Shibuya, Hiromi Wakaki, Yuki Mitsufuji
2024 J jnl
OpenMU: Your Swiss Army Knife for Music Understanding.
CoRR
Mengjie Zhao, Zhi Zhong, Zhuoyuan Mao, Shiqi Yang, Wei-Hsiang Liao, Shusuke Takahashi, Hiromi Wakaki, Yuki Mitsufuji
2024 A* conf
PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher.
NeurIPS
Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
2024 J jnl
PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher.
CoRR
Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
2024 A* conf
SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer.
ICLR
Yuhta Takida, Masaaki Imaizumi, Takashi Shibuya, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji
2024 J jnl
SAVGBench: Benchmarking Spatially Aligned Audio-Video Generation.
CoRR
Kazuki Shimada, Christian Simon, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2024 J jnl
Searching For Music Mixing Graphs: A Pruning Approach.
CoRR
Sungho Lee, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Giorgio Fabbro, Kyogu Lee, Yuki Mitsufuji
2024 A conf
SilentCipher: Deep Audio Watermarking.
INTERSPEECH
Mayank Kumar Singh, Naoya Takahashi, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
SilentCipher: Deep Audio Watermarking.
CoRR
Mayank Kumar Singh, Naoya Takahashi, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
SoundCTM: Uniting Score-based and Consistency Models for Text-to-Sound Generation.
CoRR
Koichi Saito, Dongjun Kim, Takashi Shibuya, Chieh-Hsin Lai, Zhi Zhong, Yuhta Takida, Yuki Mitsufuji
2024 — conf
SpecMaskGIT: Masked Generative Modeling of Audio Spectrogram for Efficient Audio Synthesis and Beyond.
ISMIR
Marco Comunità, Zhi Zhong, Akira Takahashi, Shiqi Yang, Mengjie Zhao, Koichi Saito, Yukara Ikemiya, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2024 J jnl
SpecMaskGIT: Masked Generative Modeling of Audio Spectrograms for Efficient Audio Synthesis and Beyond.
CoRR
Marco Comunità, Zhi Zhong, Akira Takahashi, Shiqi Yang, Mengjie Zhao, Koichi Saito, Yukara Ikemiya, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2024 J jnl
Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis.
CoRR
Ho Kei Cheng, Masato Ishii, Akio Hayakawa, Takashi Shibuya, Alexander G. Schwing, Yuki Mitsufuji
2024 J jnl
The Sound Demixing Challenge 2023 - Cinematic Demixing Track.
Trans. Int. Soc. Music. Inf. Retr.
Stefan Uhlich, Giorgio Fabbro, Masato Hirano, Shusuke Takahashi, Gordon Wichern, Jonathan Le Roux, Dipam Chakraborty, Sharada Mohanty, Kai Li, Yi Luo, Jianwei Yu, Rongzhi Gu, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Mikhail Sukhovei, Yuki Mitsufuji
2024 J jnl
The Sound Demixing Challenge 2023 - Music Demixing Track.
Trans. Int. Soc. Music. Inf. Retr.
Giorgio Fabbro, Stefan Uhlich, Chieh-Hsin Lai, Woosung Choi, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Igor Gadelha, Geraldo Ramos, Eddie Hsu, Hugo Rodrigues, Fabian-Robert Stöter, Alexandre Défossez, Yi Luo, Jianwei Yu, Dipam Chakraborty, Sharada P. Mohanty, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Nabarun Goswami, Tatsuya Harada, Minseok Kim, Jun Hyung Lee, Yuanliang Dong, Xinran Zhang, Jiafeng Liu, Yuki Mitsufuji
2024 J jnl
The whole is greater than the sum of its parts: improving music source separation by bridging networks.
EURASIP J. Audio Speech Music. Process.
Ryosuke Sawata, Naoya Takahashi, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji
2024 Misc conf
Timbre-Trap: A Low-Resource Framework for Instrument-Agnostic Music Transcription.
ICASSP
Frank Cwitkowitz, Kin Wai Cheuk, Woosung Choi, Marco A. Martínez Ramírez, Keisuke Toyama, Wei-Hsiang Liao, Yuki Mitsufuji
2024 — conf
Towards Assessing Data Replication in Music Generation With Music Similarity Metrics on Raw Audio.
ISMIR
Roser Batlle-Roca, Wei-Hsiang Liao, Xavier Serra, Yuki Mitsufuji, Emilia Gómez
2024 J jnl
Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio.
CoRR
Roser Batlle-Roca, Wei-Hsiang Liao, Xavier Serra, Yuki Mitsufuji, Emilia Gómez
2024 J jnl
TraSCE: Trajectory Steering for Concept Erasure.
CoRR
Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir D. Memon, Julian Togelius, Yuki Mitsufuji
2024 J jnl
Understanding Multimodal Contrastive Learning Through Pointwise Mutual Information.
CoRR
Toshimitsu Uesaka, Taiji Suzuki, Yuhta Takida, Chieh-Hsin Lai, Naoki Murata, Yuki Mitsufuji
2024 Misc conf
VRDMG: Vocal Restoration via Diffusion Posterior Sampling with Multiple Guidance.
ICASSP
Carlos Hernandez-Olivan, Koichi Saito, Naoki Murata, Chieh-Hsin Lai, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
VRVQ: Variable Bitrate Residual Vector Quantization for Audio Compression.
CoRR
Yunkee Chae, Woosung Choi, Yuhta Takida, Junghyun Koo, Yukara Ikemiya, Zhi Zhong, Kin Wai Cheuk, Marco A. Martínez Ramírez, Kyogu Lee, Wei-Hsiang Liao, Yuki Mitsufuji
2024 J jnl
Visual Echoes: A Simple Unified Transformer for Audio-Visual Generation.
CoRR
Shiqi Yang, Zhi Zhong, Mengjie Zhao, Shusuke Takahashi, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji
2024 Misc conf
Zero- and Few-Shot Sound Event Localization and Detection.
ICASSP
Kazuki Shimada, Kengo Uchida, Yuichiro Koyama, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji, Tatsuya Kawahara
2023 J jnl
Adversarially Slicing Generative Networks: Discriminator Slices Feature for One-Dimensional Optimal Transport.
CoRR
Yuhta Takida, Masaaki Imaizumi, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji
2023 Misc conf
An Attention-Based Approach to Hierarchical Multi-Label Music Instrument Classification.
ICASSP
Zhi Zhong, Masato Hirano, Kazuki Shimada, Kazuya Tateishi, Shusuke Takahashi, Yuki Mitsufuji
2023 J jnl
An Attention-based Approach to Hierarchical Multi-label Music Instrument Classification.
CoRR
Zhi Zhong, Masato Hirano, Kazuki Shimada, Kazuya Tateishi, Shusuke Takahashi, Yuki Mitsufuji
2023 — conf
Automatic Piano Transcription With Hierarchical Frequency-Time Transformer.
ISMIR
Keisuke Toyama, Taketo Akama, Yukara Ikemiya, Yuhta Takida, Wei-Hsiang Liao, Yuki Mitsufuji
2023 J jnl
Automatic Piano Transcription with Hierarchical Frequency-Time Transformer.
CoRR
Keisuke Toyama, Taketo Akama, Yukara Ikemiya, Yuhta Takida, Wei-Hsiang Liao, Yuki Mitsufuji
2023 J jnl
BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network.
CoRR
Takashi Shibuya, Yuhta Takida, Yuki Mitsufuji
2023 A* conf
CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos.
ICLR
Hao-Wen Dong, Naoya Takahashi, Yuki Mitsufuji, Julian J. McAuley, Taylor Berg-Kirkpatrick
2023 J jnl
Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion.
CoRR
Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yutong He, Yuki Mitsufuji, Stefano Ermon
2023 J jnl
Cross-modal Face- and Voice-style Transfer.
CoRR
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2023 A conf
Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement.
INTERSPEECH
Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2023 Misc conf
Diffroll: Diffusion-Based Generative Music Transcription with Unsupervised Pretraining Capability.
ICASSP
Kin Wai Cheuk, Ryosuke Sawata, Toshimitsu Uesaka, Naoki Murata, Naoya Takahashi, Shusuke Takahashi, Dorien Herremans, Yuki Mitsufuji
2023 J jnl
Diffusion-Based Speech Enhancement with Joint Generative and Predictive Decoders.
CoRR
Hao Shi, Kazuki Shimada, Masato Hirano, Takashi Shibuya, Yuichiro Koyama, Zhi Zhong, Shusuke Takahashi, Tatsuya Kawahara, Yuki Mitsufuji
2023 J jnl
Diffusion-based Signal Refiner for Speech Separation.
CoRR
Masato Hirano, Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Yuki Mitsufuji
2023 J jnl
Enhancing Semantic Communication with Deep Generative Models - An ICASSP Special Session Overview.
CoRR
Eleonora Grassucci, Yuki Mitsufuji, Ping Zhang, Danilo Comminiello
2023 J jnl
Extending Audio Masked Autoencoders Toward Audio Restoration.
CoRR
Zhi Zhong, Hao Shi, Masato Hirano, Kazuki Shimada, Kazuya Tateishi, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2023 — conf
Extending Audio Masked Autoencoders toward Audio Restoration.
WASPAA
Zhi Zhong, Hao Shi, Masato Hirano, Kazuki Shimada, Kazuya Tateishi, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2023 A* conf
FP-Diffusion: Improving Score-based Diffusion Models by Enforcing the Underlying Score Fokker-Planck Equation.
ICML
Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
2023 A* conf
GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration.
ICML
Naoki Murata, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
2023 J jnl
GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration.
CoRR
Naoki Murata, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
2023 Misc conf
Hierarchical Diffusion Models for Singing Voice Neural Vocoder.
ICASSP
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2023 J jnl
Manifold Preserving Guided Diffusion.
CoRR
Yutong He, Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Dongjun Kim, Wei-Hsiang Liao, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov, Stefano Ermon
2023 Misc conf
Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effects.
ICASSP
Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Kyogu Lee, Yuki Mitsufuji
2023 J jnl
On the Equivalence of Consistency-Type Models: Consistency Models, Consistent Diffusion Models, and Fokker-Planck Regularization.
CoRR
Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji, Stefano Ermon
2023 J jnl
On the Language Encoder of Contrastive Cross-modal Models.
CoRR
Mengjie Zhao, Junya Ono, Zhi Zhong, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Takashi Shibuya, Hiromi Wakaki, Yuki Mitsufuji
2023 — conf
PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives.
ACL (1)
Silin Gao, Beatriz Borges, Soyoung Oh, Deniz Bayazit, Saya Kanno, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
2023 J jnl
PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives.
CoRR
Silin Gao, Beatriz Borges, Soyoung Oh, Deniz Bayazit, Saya Kanno, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
2023 A* conf
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events.
NeurIPS
Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam, Daniel Aleksander Krause, Kengo Uchida, Sharath Adavanne, Aapo Hakala, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji
2023 J jnl
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events.
CoRR
Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam, Daniel Krause, Kengo Uchida, Sharath Adavanne, Aapo Hakala, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji
2023 J jnl
The Sound Demixing Challenge 2023 - Cinematic Demixing Track.
CoRR
Stefan Uhlich, Giorgio Fabbro, Masato Hirano, Shusuke Takahashi, Gordon Wichern, Jonathan Le Roux, Dipam Chakraborty, Sharada P. Mohanty, Kai Li, Yi Luo, Jianwei Yu, Rongzhi Gu, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Mikhail Sukhovei, Yuki Mitsufuji
2023 J jnl
The Sound Demixing Challenge 2023 - Music Demixing Track.
CoRR
Giorgio Fabbro, Stefan Uhlich, Chieh-Hsin Lai, Woosung Choi, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Igor Gadelha, Geraldo Ramos, Eddie Hsu, Hugo Rodrigues, Fabian-Robert Stöter, Alexandre Défossez, Yi Luo, Jianwei Yu, Dipam Chakraborty, Sharada P. Mohanty, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Nabarun Goswami, Tatsuya Harada, Minseok Kim, Jun Hyung Lee, Yuanliang Dong, Xinran Zhang, Jiafeng Liu, Yuki Mitsufuji
2023 J jnl
The Whole Is Greater than the Sum of Its Parts: Improving DNN-based Music Source Separation.
CoRR
Ryosuke Sawata, Naoya Takahashi, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji
2023 J jnl
Timbre-Trap: A Low-Resource Framework for Instrument-Agnostic Music Transcription.
CoRR
Frank Cwitkowitz, Kin Wai Cheuk, Woosung Choi, Marco A. Martínez Ramírez, Keisuke Toyama, Wei-Hsiang Liao, Yuki Mitsufuji
2023 J jnl
Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association.
CoRR
Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, Yuki Mitsufuji
2023 Misc conf
Unsupervised Vocal Dereverberation with Diffusion-Based Generative Models.
ICASSP
Koichi Saito, Naoki Murata, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuhta Takida, Takao Fukui, Yuki Mitsufuji
2023 J jnl
VRDMG: Vocal Restoration via Diffusion Posterior Sampling with Multiple Guidance.
CoRR
Carlos Hernandez-Olivan, Koichi Saito, Naoki Murata, Chieh-Hsin Lai, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yuki Mitsufuji
2023 J jnl
Zero- and Few-shot Sound Event Localization and Detection.
CoRR
Kazuki Shimada, Kengo Uchida, Yuichiro Koyama, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji, Tatsuya Kawahara
2022 J jnl
A Versatile Diffusion-based Generative Refiner for Speech Enhancement.
CoRR
Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
2022 Misc conf
Amicable Examples for Informed Source Separation.
ICASSP
Naoya Takahashi, Yuki Mitsufuji
2022 Misc conf
Amicable Examples for Informed Source Separation.
ICASSP
Naoya Takahashi, Yuki Mitsufuji
2022 Misc conf
Automatic DJ Transitions with Differentiable Audio Effects and Generative Adversarial Networks.
ICASSP
Bo-Yu Chen, Wei-Han Hsu, Wei-Hsiang Liao, Marco A. Martínez Ramírez, Yuki Mitsufuji, Yi-Hsuan Yang
2022 — conf
Automatic music mixing with deep learning and out-of-domain data.
ISMIR
Marco A. Martínez Ramírez, Wei-Hsiang Liao, Chihiro Nagashima, Giorgio Fabbro, Stefan Uhlich, Yuki Mitsufuji
2022 J jnl
Automatic music mixing with deep learning and out-of-domain data.
CoRR
Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Stefan Uhlich, Chihiro Nagashima, Yuki Mitsufuji
2022 J jnl
CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos.
CoRR
Hao-Wen Dong, Naoya Takahashi, Yuki Mitsufuji, Julian J. McAuley, Taylor Berg-Kirkpatrick
2022 — conf
ComFact: A Benchmark for Linking Contextual Commonsense Knowledge.
EMNLP (Findings)
Silin Gao, Jena D. Hwang, Saya Kanno, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
2022 J jnl
ComFact: A Benchmark for Linking Contextual Commonsense Knowledge.
CoRR
Silin Gao, Jena D. Hwang, Saya Kanno, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut
2022 J jnl
DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability.
CoRR
Kin Wai Cheuk, Ryosuke Sawata, Toshimitsu Uesaka, Naoki Murata, Naoya Takahashi, Shusuke Takahashi, Dorien Herremans, Yuki Mitsufuji
2022 — conf
Distortion Audio Effects: Learning How to Recover the Clean Signal.
ISMIR
Johannes Imort, Giorgio Fabbro, Marco A. Martínez Ramírez, Stefan Uhlich, Yuichiro Koyama, Yuki Mitsufuji
2022 J jnl
Hierarchical Diffusion Models for Singing Voice Neural Vocoder.
CoRR
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2022 Misc conf
Multi-ACCDOA: Localizing And Detecting Overlapping Sounds From The Same Class With Auxiliary Duplicating Permutation Invariant Training.
ICASSP
Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Naoya Takahashi, Emiru Tsunoo, Yuki Mitsufuji
2022 J jnl
Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effects.
CoRR
Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Kyogu Lee, Yuki Mitsufuji
2022 Misc conf
Music Source Separation With Deep Equilibrium Models.
ICASSP
Yuichiro Koyama, Naoki Murata, Stefan Uhlich, Giorgio Fabbro, Shusuke Takahashi, Yuki Mitsufuji
2022 J jnl
Preventing oversmoothing in VAE via generalized variance parameterization.
Neurocomputing
Yuhta Takida, Wei-Hsiang Liao, Chieh-Hsin Lai, Toshimitsu Uesaka, Shusuke Takahashi, Yuki Mitsufuji
2022 J jnl
Regularizing Score-based Models with Score Fokker-Planck Equations.
CoRR
Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
2022 J jnl
Removing Distortion Effects in Music Using Deep Neural Networks.
CoRR
Johannes Imort, Giorgio Fabbro, Marco A. Martínez Ramírez, Stefan Uhlich, Yuichiro Koyama, Yuki Mitsufuji
2022 J jnl
Robust One-Shot Singing Voice Conversion.
CoRR
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2022 A* conf
SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantization.
ICML
Yuhta Takida, Takashi Shibuya, Wei-Hsiang Liao, Chieh-Hsin Lai, Junki Ohmura, Toshimitsu Uesaka, Naoki Murata, Shusuke Takahashi, Toshiyuki Kumakura, Yuki Mitsufuji
2022 J jnl
SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantization.
CoRR
Yuhta Takida, Takashi Shibuya, Wei-Hsiang Liao, Chieh-Hsin Lai, Junki Ohmura, Toshimitsu Uesaka, Naoki Murata, Shusuke Takahashi, Toshiyuki Kumakura, Yuki Mitsufuji
2022 — conf
STARSS22: A Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events.
DCASE
Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam, Sharath Adavanne, Daniel Krause, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji, Tuomas Virtanen
2022 J jnl
STARSS22: A dataset of spatial recordings of real scenes with spatiotemporal annotations of sound events.
CoRR
Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam, Sharath Adavanne, Daniel Krause, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji, Tuomas Virtanen
2022 Misc conf
Spatial Data Augmentation with Simulated Room Impulse Responses for Sound Event Localization and Detection.
ICASSP
Yuichiro Koyama, Kazuhide Shigemi, Masafumi Takahashi, Kazuki Shimada, Naoya Takahashi, Emiru Tsunoo, Shusuke Takahashi, Yuki Mitsufuji
2022 Misc conf
Spatial Mixup: Directional Loudness Modification as Data Augmentation for Sound Event Localization and Detection.
ICASSP
Ricardo Falcón Pérez, Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Yuki Mitsufuji
2022 J jnl
Unsupervised vocal dereverberation with diffusion-based generative models.
CoRR
Koichi Saito, Naoki Murata, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuhta Takida, Takao Fukui, Yuki Mitsufuji
2021 Misc conf
Accdoa: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization And Detection.
ICASSP
Kazuki Shimada, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji
2021 Misc conf
Adversarial Attacks on Audio Source Separation.
ICASSP
Naoya Takahashi, Shota Inoue, Yuki Mitsufuji
2021 Misc conf
All For One And One For All: Improving Music Separation By Bridging Networks.
ICASSP
Ryosuke Sawata, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji
2021 J jnl
Amicable examples for informed source separation.
CoRR
Naoya Takahashi, Yuki Mitsufuji
2021 J jnl
Automatic DJ Transitions with Differentiable Audio Effects and Generative Adversarial Networks.
CoRR
Bo-Yu Chen, Wei-Han Hsu, Wei-Hsiang Liao, Marco A. Martínez Ramírez, Yuki Mitsufuji, Yi-Hsuan Yang
2021 A* conf
Densely Connected Multi-Dilated Convolutional Networks for Dense Prediction Tasks.
CVPR
Naoya Takahashi, Yuki Mitsufuji
2021 J jnl
Ensemble of ACCDOA- and EINV2-based Systems with D3Nets and Impulse Response Simulation for Sound Event Localization and Detection.
CoRR
Kazuki Shimada, Naoya Takahashi, Yuichiro Koyama, Shusuke Takahashi, Emiru Tsunoo, Masafumi Takahashi, Yuki Mitsufuji
2021 B conf
Hierarchical disentangled representation learning for singing voice conversion.
IJCNN
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2021 J jnl
Hierarchical disentangled representation learning for singing voice conversion.
CoRR
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2021 J jnl
Multi-ACCDOA: Localizing and Detecting Overlapping Sounds from the Same Class with Auxiliary Duplicating Permutation Invariant Training.
CoRR
Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Naoya Takahashi, Emiru Tsunoo, Yuki Mitsufuji
2021 J jnl
Multichannel Blind Source Separation Based on Evanescent-Region-Aware Non-Negative Tensor Factorization in Spherical Harmonic Domain.
IEEE ACM Trans. Audio Speech Lang. Process.
Yuki Mitsufuji, Norihiro Takamune, Shoichi Koyama, Hiroshi Saruwatari
2021 J jnl
Music Demixing Challenge at ISMIR 2021.
CoRR
Yuki Mitsufuji, Giorgio Fabbro, Stefan Uhlich, Fabian-Robert Stöter
2021 J jnl
Music Source Separation with Deep Equilibrium Models.
CoRR
Yuichiro Koyama, Naoki Murata, Stefan Uhlich, Giorgio Fabbro, Shusuke Takahashi, Yuki Mitsufuji
2021 J jnl
Preventing Posterior Collapse Induced by Oversmoothing in Gaussian VAE.
CoRR
Yuhta Takida, Wei-Hsiang Liao, Toshimitsu Uesaka, Shusuke Takahashi, Yuki Mitsufuji
2021 B conf
Psychophysiological Effect of Immersive Spatial Audio Experience Enhanced Using Sound Field Synthesis.
ACII
Yasuhide Hyodo, Chihiro Sugai, Junya Suzuki, Masafumi Takahashi, Masahiko Koizumi, Asako Tomura, Yuki Mitsufuji, Yota Komoriya
2021 J jnl
Source Mixing and Separation Robust Audio Steganography.
CoRR
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
2021 J jnl
Spatial Data Augmentation with Simulated Room Impulse Responses for Sound Event Localization and Detection.
CoRR
Yuichiro Koyama, Kazuhide Shigemi, Masafumi Takahashi, Kazuki Shimada, Naoya Takahashi, Emiru Tsunoo, Shusuke Takahashi, Yuki Mitsufuji
2021 J jnl
Spatial mixup: Directional loudness modification as data augmentation for sound event localization and detection.
CoRR
Ricardo Falcón Pérez, Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Yuki Mitsufuji
2021 J jnl
Training Speech Enhancement Systems with Noisy Speech Datasets.
CoRR
Koichi Saito, Stefan Uhlich, Giorgio Fabbro, Yuki Mitsufuji
2020 J jnl
ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection.
CoRR
Kazuki Shimada, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji
2020 J jnl
Adversarial attacks on audio source separation.
CoRR
Naoya Takahashi, Shota Inoue, Yuki Mitsufuji
2020 J jnl
All for One and One for All: Improving Music Separation by Bridging Networks.
CoRR
Ryosuke Sawata, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji
2020 Misc conf
Array-Geometry-Aware Spatial Active Noise Control Based on Direction-of-Arrival Weighting.
ICASSP
Yu Maeno, Yuhta Takida, Naoki Murata, Yuki Mitsufuji
2020 J jnl
D3Net: Densely connected multidilated DenseNet for music source separation.
CoRR
Naoya Takahashi, Yuki Mitsufuji
2020 J jnl
Densely connected multidilated convolutional networks for dense prediction tasks.
CoRR
Naoya Takahashi, Yuki Mitsufuji
2020 Misc conf
Improving Voice Separation by Incorporating End-To-End Speech Recognition.
ICASSP
Naoya Takahashi, Mayank Kumar Singh, Sakya Basak, Sudarsanam Parthasaarathy, Sriram Ganapathy, Yuki Mitsufuji
2020 J jnl
Multichannel Non-Negative Matrix Factorization Using Banded Spatial Covariance Matrices in Wavenumber Domain.
IEEE ACM Trans. Audio Speech Lang. Process.
Yuki Mitsufuji, Stefan Uhlich, Norihiro Takamune, Daichi Kitamura, Shoichi Koyama, Hiroshi Saruwatari
2020 J jnl
Sound Event Localization and Detection Using Activity-Coupled Cartesian DOA Vector and RD3net.
CoRR
Kazuki Shimada, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji
2020 J jnl
Spherical-Harmonic-Domain Feedforward Active Noise Control Using Sparse Decomposition of Reference Signals from Distributed Sensor Arrays.
IEEE ACM Trans. Audio Speech Lang. Process.
Yu Maeno, Yuki Mitsufuji, Prasanga N. Samarasinghe, Naoki Murata, Thushara D. Abhayapala
2019 J jnl
Closing the Training/Inference Gap for Deep Attractor Networks.
CoRR
Cyril Cadoux, Stefan Uhlich, Marc Ferras, Yuki Mitsufuji
2019 Misc conf
Global and Local Mode-domain Adaptive Algorithms for Spatial Active Noise Control Using Higher-order Sources.
ICASSP
Naoki Murata, Jihui Zhang, Yu Maeno, Yuki Mitsufuji
2019 J jnl
Improving Voice Separation by Incorporating End-to-end Speech Recognition.
CoRR
Naoya Takahashi, Mayank Kumar Singh, Sakya Basak, Sudarsanam Parthasaarathy, Sriram Ganapathy, Yuki Mitsufuji
2019 J jnl
Open-Unmix - A Reference Implementation for Music Source Separation.
J. Open Source Softw.
Fabian-Robert Stöter, Stefan Uhlich, Antoine Liutkus, Yuki Mitsufuji
2019 A conf
Recursive Speech Separation for Unknown Number of Speakers.
INTERSPEECH
Naoya Takahashi, Sudarsanam Parthasaarathy, Nabarun Goswami, Yuki Mitsufuji
2019 J jnl
Recursive speech separation for unknown number of speakers.
CoRR
Naoya Takahashi, Sudarsanam Parthasaarathy, Nabarun Goswami, Yuki Mitsufuji
2018 J jnl
Improving DNN-based Music Source Separation using Phase Features.
CoRR
Joachim Muth, Stefan Uhlich, Nathanaël Perraudin, Thomas Kemp, Fabien Cardinaux, Yuki Mitsufuji
2018 J jnl
MMDenseLSTM: An efficient combination of convolutional and recurrent neural networks for audio source separation.
CoRR
Naoya Takahashi, Nabarun Goswami, Yuki Mitsufuji
2018 — conf
Mmdenselstm: An Efficient Combination of Convolutional and Recurrent Neural Networks for Audio Source Separation.
IWAENC
Naoya Takahashi, Nabarun Goswami, Yuki Mitsufuji
2018 Misc conf
Mode Domain Spatial Active Noise Control Using Sparse Signal Representation.
ICASSP
Yu Maeno, Yuki Mitsufuji, Thushara D. Abhayapala
2018 J jnl
Mode Domain Spatial Active Noise Control Using Sparse Signal Representation.
CoRR
Yu Maeno, Yuki Mitsufuji, Thushara D. Abhayapala
2018 — conf
Mode-Domain Spatial Active Noise Control Using Multiple Circular Arrays.
IWAENC
Yu Maeno, Yuki Mitsufuji, Prasanga N. Samarasinghe, Thushara D. Abhayapala
2018 A conf
PhaseNet: Discretized Phase Modeling with Deep Neural Networks for Audio Source Separation.
INTERSPEECH
Naoya Takahashi, Purvi Agrawal, Nabarun Goswami, Yuki Mitsufuji
2017 Misc conf
Improving music source separation based on deep neural networks through data augmentation and network blending.
ICASSP
Stefan Uhlich, Marcello Porcu, Franck Giron, Michael Enenkl, Thomas Kemp, Naoya Takahashi, Yuki Mitsufuji
2017 — conf
Multi-Scale multi-band densenets for audio source separation.
WASPAA
Naoya Takahashi, Yuki Mitsufuji
2017 J jnl
Multi-scale Multi-band DenseNets for Audio Source Separation.
CoRR
Naoya Takahashi, Yuki Mitsufuji
2017 Misc conf
Supervised monaural source separation based on autoencoders.
ICASSP
Keiichi Osako, Yuki Mitsufuji, Rita Singh, Bhiksha Raj
2016 Misc conf
Multichannel blind source separation based on non-negative tensor factorization in wavenumber domain.
ICASSP
Yuki Mitsufuji, Shoichi Koyama, Hiroshi Saruwatari
2015 Misc conf
Deep neural network based instrument extraction from music.
ICASSP
Stefan Uhlich, Franck Giron, Yuki Mitsufuji
2015 Misc conf
NMF-based blind source separation using a linear predictive coding error clustering criterion.
ICASSP
Xin Guo, Stefan Uhlich, Yuki Mitsufuji
2014 J jnl
On the use of a spatial cue as prior information for stereo sound source separation based on spatially weighted non-negative tensor factorization.
EURASIP J. Adv. Signal Process.
Yuki Mitsufuji, Axel Roebel
2014 Misc conf
Online NON-negative Tensor Deconvolution for source detection in 3DTV audio.
ICASSP
Yuki Mitsufuji, Marco Liuni, Alex Baker, Axel Roebel
2013 Misc conf
Sound source separation based on non-negative tensor factorization incorporating spatial cue as prior knowledge.
ICASSP
Yuki Mitsufuji, Axel Roebel