MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training (2021.findings-acl)
Copied to clipboard
| Challenge: | Symbolic music understanding is useful for many music applications, but lack of training data hinders representation learning. |
| Approach: | They propose a pre-trained model for music understanding that uses symbolic music data to train music representations. |
| Outcome: | The proposed model improves on four music understanding tasks. |
Similar Papers
MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models (2023.emnlp-demo)
Copied to clipboard
| Challenge: | MusicAgent integrates numerous music-related tools and an autonomous workflow to address user requirements. |
| Approach: | a new system is built to integrate music-related tools and an autonomous workflow . the system is based on large language models (LLMs) that can be used to organize and decompose requests . |
| Outcome: | the proposed system integrates numerous music-related tools and an autonomous workflow to address user requirements. |
Byte Pair Encoding for Symbolic Music (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on reducing the overall sequence length by merging embeddings or combining tokens. |
| Approach: | They propose to convert music into a sequence of discrete tokens using Byte Pair Encoding . they propose to combine tokens with embeddings to improve the results . |
| Outcome: | The proposed method reduces the sequence length while increasing the vocabulary size. |
Amadeus: Autoregressive Model with Bidirectional Attribute Modelling for Symbolic Music (2026.acl-long)
Copied to clipboard
| Challenge: | Existing symbolic music generation models represent musical notes as a sequence of attribute tokens with fixed unidirectional dependencies. |
| Approach: | They propose a symbolic music generation framework that adopts a autoregressive and a discrete diffusion architectures for note attributes. |
| Outcome: | The proposed framework improves state-of-the-art models across objective and subjective metrics. |
NOTA: Multimodal Music Notation Understanding for Visual Large Language Model (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing general-domain visual language models lack ability of music notation understanding . Symbolic music is represented in two distinct forms: auditory music and symbolic music . |
| Approach: | They propose to train a multimodal music notation model using a large-scale dataset . they use cross-modal alignment to train the model for music notations analysis . |
| Outcome: | The proposed model improves on music understanding by training with a multimodal music notation model. |
SpanBERT: Improving Pre-training by Representing and Predicting Spans (2020.tacl-1)
Copied to clipboard
| Challenge: | Pre-training methods like BERT mask individual words or subword units, but many tasks involve reasoning about relationships between two or more spans of text. |
| Approach: | They propose a pre-training method that masks contiguous random spans instead of random tokens to train the span boundary representations to predict the entire content of the masked span. |
| Outcome: | The proposed method outperforms BERT and its better-tuned baselines on span selection tasks and on coreference resolution tasks. |
Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning general-purpose audio representations are limited in scope and coverage of audio attributes. |
| Approach: | They propose to use a 10.7M caption dataset to compare ALP with captioning . they find that contrastive learning yields competitive, transferable representations . |
| Outcome: | The proposed model yields competitive, transferable representations, while captioning exhibits better scalability. |
SciBERT: A Pretrained Language Model for Scientific Text (D19-1)
Copied to clipboard
| Challenge: | SciBERT is a pretrained language model based on BERT to improve performance on scientific NLP tasks. |
| Approach: | They propose a pretrained language model based on BERT to improve NLP performance . they evaluate on sequence tagging, sentence classification and dependency parsing . |
| Outcome: | The proposed model improves on sequence tagging, sentence classification and dependency parsing tasks with datasets from a variety of scientific domains. |
WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities across various vision-language tasks. |
| Approach: | They propose a systematic taxonomy to evaluate MLLMs' ability to interpret real-world music scores and answer complex musicological queries. |
| Outcome: | The proposed model is based on real-world music scores and user-generated questions and discussions, and is scalable and controlled. |
Neuro-Symbolic Natural Language Processing (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations in terms of safe and controlled reasoning, interpretability and adaptability . this tutorial aims to bridge the gap between the practical performance of LLMs and the principled modelling of language and inference of formal methods. |
| Approach: | This tutorial aims to bridge the gap between the practical performance of Large Language Models and the principled modelling of language and inference of formal methods. |
| Outcome: | This tutorial aims to bridge the gap between the performance of LLMs and the principled modelling of language and inference of formal methods. |
Learning Musical Representations for Music Performance Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for audio-visual learning fail to consider the distinctive characteristics of instruments and music. |
| Approach: | They propose to integrate multimodal interactions within the context of music data and annotate and release rhythmic and music sources in the current music datasets to enable the model to learn music characteristics. |
| Outcome: | The proposed model can learn music characteristics from the current music datasets and align its predictions with the temporal dimension. |