Oriol Nieto

69 papers A* 8A 2B 1Misc 8Journal 30Unranked 19
YearRankTypeTitle / Venue / Authors
2026 J jnl
AudioChat: Unified Audio Storytelling, Editing, and Understanding with Transfusion Forcing.
CoRR
William Chen, Prem Seetharaman, Rithesh Kumar, Oriol Nieto, Shinji Watanabe, Justin Salamon, Zeyu Jin
2026 J jnl
Audiocards: Structured Metadata Improves Audio Language Models For Sound Design.
CoRR
Sripathi Sridhar, Prem Seetharaman, Oriol Nieto, Mark Cartwright, Justin Salamon
2026 J jnl
Generative Audio Extension and Morphing.
CoRR
Prem Seetharaman, Oriol Nieto, Justin Salamon
2026 J jnl
Mix2Morph: Learning Sound Morphing from Noisy Mixes.
CoRR
Annie Chu, Hugo Flores García, Oriol Nieto, Justin Salamon, Bryan Pardo, Prem Seetharaman
2026 A* conf
SoundStager: Interactive Design of Story-Driven GenAI Soundscapes for Video.
CHI
Suhyeon Yoo, Adolfo Hernandez Santisteban, Prem Seetharaman, Justin Salamon, Oriol Nieto, Anh Truong
2026 J jnl
TAC: Timestamped Audio Captioning.
CoRR
Sonal Kumar, Prem Seetharaman, Ke Chen, Oriol Nieto, Jiaqi Su, Zhepei Wang, Rithesh Kumar, Dinesh Manocha, Nicholas J. Bryan, Zeyu Jin, Justin Salamon
2025 A* conf
FLAM: Frame-Wise Language-Audio Modeling.
ICML
Yusong Wu, Christos Tsirigotis, Ke Chen, Cheng-Zhi Anna Huang, Aaron C. Courville, Oriol Nieto, Prem Seetharaman, Justin Salamon
2025 J jnl
FLAM: Frame-Wise Language-Audio Modeling.
CoRR
Yusong Wu, Christos Tsirigotis, Ke Chen, Cheng-Zhi Anna Huang, Aaron C. Courville, Oriol Nieto, Prem Seetharaman, Justin Salamon
2025 A* conf
MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark.
ICLR
S. Sakshi, Utkarsh Tyagi, Sonal Kumar, Ashish Seth, Ramaneswaran Selvakumar, Oriol Nieto, Ramani Duraiswami, Sreyan Ghosh, Dinesh Manocha
2025 J jnl
Multi-Domain Audio Question Answering Toward Acoustic Content Reasoning in The DCASE 2025 Challenge.
CoRR
Chao-Han Huck Yang, Sreyan Ghosh, Qing Wang, Jaeyeon Kim, Hengyi Hong, Sonal Kumar, Guirui Zhong, Zhifeng Kong, Sakshi Singh, Vaibhavi Lokegaonkar, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha, Gunhee Kim, Jun Du, Rafael Valle, Bryan Catanzaro
2025 J jnl
PromptSep: Generative Audio Separation via Multimodal Prompting.
CoRR
Yutong Wen, Ke Chen, Prem Seetharaman, Oriol Nieto, Jiaqi Su, Rithesh Kumar, Minje Kim, Paris Smaragdis, Zeyu Jin, Justin Salamon
2025 Misc conf
ReCLAP: Improving Zero Shot Audio Classification by Describing Sounds.
ICASSP
Sreyan Ghosh, Sonal Kumar, Chandra Kiran Reddy Evuru, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
2025 — conf
SILA: Signal-to-Language Augmentation for Enhanced Control in Text-to-Audio Generation.
WASPAA
Sonal Kumar, Prem Seetharaman, Justin Salamon, Dinesh Manocha, Oriol Nieto
2025 Misc conf
Sketch2Sound: Controllable Audio Generation via Time-Varying Signals and Sonic Imitations.
ICASSP
Hugo Flores García, Oriol Nieto, Justin Salamon, Bryan Pardo, Prem Seetharaman
2025 A* conf
Video-Guided Foley Sound Generation with Multimodal Controls.
CVPR
Ziyang Chen, Prem Seetharaman, Bryan C. Russell, Oriol Nieto, David Bourgin, Andrew Owens, Justin Salamon
2025 A* conf
Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs.
ICLR
Sreyan Ghosh, Chandra Kiran Reddy Evuru, Sonal Kumar, Utkarsh Tyagi, Oriol Nieto, Zeyu Jin, Dinesh Manocha
2024 — conf
Augment, Drop & Swap: Improving Diversity in LLM Captions for Efficient Music-Text Representation Learning.
ISMIR
Ilaria Manco, Justin Salamon, Oriol Nieto
2024 J jnl
Augment, Drop & Swap: Improving Diversity in LLM Captions for Efficient Music-Text Representation Learning.
CoRR
Ilaria Manco, Justin Salamon, Oriol Nieto
2024 A* conf
CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models.
ICLR
Sreyan Ghosh, Ashish Seth, Sonal Kumar, Utkarsh Tyagi, Chandra Kiran Reddy Evuru, Ramaneswaran S., Sakshi Singh, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
2024 A* conf
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities.
EMNLP
Sreyan Ghosh, Sonal Kumar, Ashish Seth, Chandra Kiran Reddy Evuru, Utkarsh Tyagi, S. Sakshi, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
2024 J jnl
GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities.
CoRR
Sreyan Ghosh, Sonal Kumar, Ashish Seth, Chandra Kiran Reddy Evuru, Utkarsh Tyagi, Sakshi Singh, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
2024 J jnl
MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark.
CoRR
S. Sakshi, Utkarsh Tyagi, Sonal Kumar, Ashish Seth, Ramaneswaran Selvakumar, Oriol Nieto, Ramani Duraiswami, Sreyan Ghosh, Dinesh Manocha
2024 — ed.
Proceedings of the 25th International Society for Music Information Retrieval Conference, ISMIR 2024, San Francisco, California, USA and Online, November 10-14, 2024.
ISMIR
Blair Kaneshiro, Gautham J. Mysore, Oriol Nieto, Chris Donahue, Cheng-Zhi Anna Huang, Jin Ha Lee, Brian McFee, Matthew C. McCallum
2024 J jnl
ReCLAP: Improving Zero Shot Audio Classification by Describing Sounds.
CoRR
Sreyan Ghosh, Sonal Kumar, Chandra Kiran Reddy Evuru, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
2024 J jnl
SILA: Signal-to-Language Augmentation for Enhanced Control in Text-to-Audio Generation.
CoRR
Sonal Kumar, Prem Seetharaman, Justin Salamon, Dinesh Manocha, Oriol Nieto
2024 J jnl
Sketch2Sound: Controllable Audio Generation via Time-Varying Signals and Sonic Imitations.
CoRR
Hugo Flores García, Oriol Nieto, Justin Salamon, Bryan Pardo, Prem Seetharaman
2024 J jnl
VDGD: Mitigating LVLM Hallucinations in Cognitive Prompts by Bridging the Visual Perception Gap.
CoRR
Sreyan Ghosh, Chandra Kiran Reddy Evuru, Sonal Kumar, Utkarsh Tyagi, Oriol Nieto, Zeyu Jin, Dinesh Manocha
2024 J jnl
Video-Guided Foley Sound Generation with Multimodal Controls.
CoRR
Ziyang Chen, Prem Seetharaman, Bryan C. Russell, Oriol Nieto, David Bourgin, Andrew Owens, Justin Salamon
2023 Misc conf
Audio-Text Models Do Not Yet Leverage Natural Language.
ICASSP
Ho-Hsiang Wu, Oriol Nieto, Juan Pablo Bello, Justin Salamon
2023 J jnl
Audio-Text Models Do Not Yet Leverage Natural Language.
CoRR
Ho-Hsiang Wu, Oriol Nieto, Juan Pablo Bello, Justin Salamon
2023 — conf
Bridging High-Quality Audio and Video Via Language for Sound Effects Retrieval from Visual Queries.
WASPAA
Julia Wilkins, Justin Salamon, Magdalena Fuentes, Juan Pablo Bello, Oriol Nieto
2023 J jnl
Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries.
CoRR
Julia Wilkins, Justin Salamon, Magdalena Fuentes, Juan Pablo Bello, Oriol Nieto
2023 J jnl
CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models.
CoRR
Sreyan Ghosh, Ashish Seth, Sonal Kumar, Utkarsh Tyagi, Chandra Kiran Reddy Evuru, Ramaneswaran S., Sakshi Singh, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
2023 A conf
Efficient Spoken Language Recognition via Multilabel Classification.
INTERSPEECH
Oriol Nieto, Zeyu Jin, Franck Dernoncourt, Justin Salamon
2023 J jnl
Efficient Spoken Language Recognition via Multilabel Classification.
CoRR
Oriol Nieto, Zeyu Jin, Franck Dernoncourt, Justin Salamon
2023 A* conf
Language-Guided Audio-Visual Source Separation via Trimodal Consistency.
CVPR
Reuben Tan, Arijit Ray, Andrea Burns, Bryan A. Plummer, Justin Salamon, Oriol Nieto, Bryan C. Russell, Kate Saenko
2023 J jnl
Language-Guided Audio-Visual Source Separation via Trimodal Consistency.
CoRR
Reuben Tan, Arijit Ray, Andrea Burns, Bryan A. Plummer, Justin Salamon, Oriol Nieto, Bryan C. Russell, Kate Saenko
2022 Misc conf
Music Enhancement via Image Translation and Vocoding.
ICASSP
Nikhil Kandpal, Oriol Nieto, Zeyu Jin
2022 J jnl
Music Enhancement via Image Translation and Vocoding.
CoRR
Nikhil Kandpal, Oriol Nieto, Zeyu Jin
2021 — conf
Deep Embeddings and Section Fusion Improve Music Segmentation.
ISMIR
Justin Salamon, Oriol Nieto, Nicholas J. Bryan
2021 Misc conf
Multimodal Metric Learning for Tag-Based Music Retrieval.
ICASSP
Minz Won, Sergio Oramas, Oriol Nieto, Fabien Gouyon, Xavier Serra
2020 J jnl
Audio-Based Music Structure Analysis: Current Trends, Open Challenges, and Applications.
Trans. Int. Soc. Music. Inf. Retr.
Oriol Nieto, Gautham J. Mysore, Cheng-i Wang, Jordan B. L. Smith, Jan Schlüter, Thomas Grill, Brian McFee
2020 Misc conf
Data-Driven Harmonic Filters for Audio Representation Learning.
ICASSP
Minz Won, Sanghyuk Chun, Oriol Nieto, Xavier Serra
2020 — conf
Mood Classification Using Listening Data.
ISMIR
Filip Korzeniowski, Oriol Nieto, Matthew C. McCallum, Minz Won, Sergio Oramas, Erik M. Schmidt
2020 J jnl
Mood Classification Using Listening Data.
CoRR
Filip Korzeniowski, Oriol Nieto, Matthew C. McCallum, Minz Won, Sergio Oramas, Erik M. Schmidt
2020 J jnl
Multimodal Metric Learning for Tag-based Music Retrieval.
CoRR
Minz Won, Sergio Oramas, Oriol Nieto, Fabien Gouyon, Xavier Serra
2019 — conf
The Harmonix Set: Beats, Downbeats, and Functional Segment Annotations of Western Popular Music.
ISMIR
Oriol Nieto, Matthew C. McCallum, Matthew E. P. Davies, Andrew Robertson, Adam M. Stark, Eran Egozy
2018 — conf
End-to-end Learning for Music Audio Tagging at Scale.
ISMIR
Jordi Pons, Oriol Nieto, Matthew Prockup, Erik M. Schmidt, Andreas F. Ehmann, Xavier Serra
2018 J jnl
Multimodal Deep Learning for Music Genre Classification.
Trans. Int. Soc. Music. Inf. Retr.
Sergio Oramas, Francesco Barbieri, Oriol Nieto, Xavier Serra
2018 A conf
Predicting Audio Advertisement Quality.
WSDM
Samaneh Ebrahimi, Hossein Vahabi, Matthew Prockup, Oriol Nieto
2018 J jnl
Predicting Audio Advertisement Quality.
CoRR
Samaneh Ebrahimi, Hossein Vahabi, Matthew Prockup, Oriol Nieto
2017 — conf
A Deep Multimodal Approach for Cold-start Music Recommendation.
DLRS@RecSys
Sergio Oramas, Oriol Nieto, Mohamed Sordo, Xavier Serra
2017 J jnl
A Deep Multimodal Approach for Cold-start Music Recommendation.
CoRR
Sergio Oramas, Oriol Nieto, Mohamed Sordo, Xavier Serra
2017 J jnl
End-to-end learning for music audio tagging at scale.
CoRR
Jordi Pons, Oriol Nieto, Matthew Prockup, Erik M. Schmidt, Andreas F. Ehmann, Xavier Serra
2017 — conf
Multi-Label Music Genre Classification from Audio, Text and Images Using Deep Features.
ISMIR
Sergio Oramas, Oriol Nieto, Francesco Barbieri, Xavier Serra
2017 J jnl
Multi-label Music Genre Classification from Audio, Text, and Images Using Deep Features.
CoRR
Sergio Oramas, Oriol Nieto, Francesco Barbieri, Xavier Serra
2016 — conf
Systematic Exploration of Computational Music Structure Research.
ISMIR
Oriol Nieto, Juan Pablo Bello
2015 — conf
Hierarchical Evaluation of Segment Boundary Detection.
ISMIR
Brian McFee, Oriol Nieto, Juan Pablo Bello
2015 — conf
librosa: Audio and Music Signal Analysis in Python.
SciPy
Brian McFee, Colin Raffel, Dawen Liang, Daniel P. W. Ellis, Matt McVicar, Eric Battenberg, Oriol Nieto
2014 B conf
Embodying Theoretical Research in Music Cognition: Four Proposals for Theory-Driven Experimentation.
CogSci
Andreu Ballus, Eric Arnau, Oriol Nieto, Frederic Font, Alba Torrents
2014 — conf
Identifying Polyphonic Musical Patterns From Audio Recordings Using Music Segmentation Techniques.
ISMIR
Oriol Nieto, Morwaread Mary Farbood
2014 — conf
JAMS: A JSON Annotated Music Specification for Reproducible MIR Research.
ISMIR
Eric J. Humphrey, Justin Salamon, Oriol Nieto, Jon Forsyth, Rachel M. Bittner, Juan Pablo Bello
2014 — conf
MIR_EVAL: A Transparent Implementation of Common MIR Metrics.
ISMIR
Colin Raffel, Brian McFee, Eric J. Humphrey, Justin Salamon, Oriol Nieto, Dawen Liang, Daniel P. W. Ellis
2014 Misc conf
Music segment similarity using 2D-Fourier Magnitude Coefficients.
ICASSP
Oriol Nieto, Juan Pablo Bello
2014 — conf
Perceptual Analysis of the F-Measure to Evaluate Section Boundaries in Music.
ISMIR
Oriol Nieto, Morwaread Mary Farbood, Tristan Jehan, Juan Pablo Bello
2013 Misc conf
Convex non-negative matrix factorization for automatic music structure identification.
ICASSP
Oriol Nieto, Tristan Jehan
2013 — conf
Data Driven and Discriminative Projections for Large-Scale Cover Song Identification.
ISMIR
Eric J. Humphrey, Oriol Nieto, Juan Pablo Bello
2013 — conf
Fortissimo: Force-Feedback for Mobile Devices.
NIME
Tae Hong Park, Oriol Nieto
2012 — conf
Compressing Music Recordings into Audio Summaries.
ISMIR
Oriol Nieto, Eric J. Humphrey, Juan Pablo Bello