Papers by Gus Xia
CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages (2025.findings-acl)
Copied to clipboard
Shangda Wu, Guo Zhancheng, Ruibin Yuan, Junyan Jiang, SeungHeon Doh, Gus Xia, Juhan Nam, Xiaobing Li, Feng Yu, Maosong Sun
| Challenge: | Music information retrieval (MIR) is a field that aims at developing computational tools for processing, organizing, and accessing music data. |
| Approach: | They propose a framework that aligns music modalities with multilingual text in a shared representation space. |
| Outcome: | Experiments show CLaMP 3 performs state-of-the-art on multiple MIR tasks . it surpasses baselines and shows excellent generalization in multimodal and multilingual contexts . |
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)
Copied to clipboard
Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
Detecting AI-Generated Video: A Vision–Language Dual-View Survey (2026.findings-acl)
Copied to clipboard
| Challenge: | realism of AI-generated Videos (AIGC-V) rendering artifact-centric detection insufficient, authors argue . a vision–language dual-view taxonomy is proposed to systematize this rapidly evolving field . |
| Approach: | They propose a Vision–Language Dual-View taxonomy to systematize AIGC-V detection . they propose realism of AI-generated Videos is rendering traditional inspection insufficient . |
| Outcome: | The proposed model aims to show that the existing methods are consistent with real-world facts. |
Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing music generation models are limited in their coverage of the musical genres and cultures of the world. |
| Approach: | They propose to use parametric fine tuning techniques to mitigat the bias in existing music datasets. |
| Outcome: | The proposed models are able to perform well across genres and cultures. |