Challenge: Recent advances in neural song generation have enabled high-quality synthesis from lyrics and global textual prompts.
Approach: They propose a framework that allows users to specify local musical descriptions aligned to song segments.
Outcome: The proposed framework outperforms baselines in musicality and controllability.

Similar Papers

Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling (2026.acl-long)

Copied to clipboard

Challenge: Recent efforts on text-to-audio generation are exploring fine-grained controllability . however, their performance at scale is limited due to data scarcity .
Approach: They propose a multi-task learning problem for high-controllability text-to-audio generation . they propose scalable diffusion transformers that augment condition information in sequence .
Outcome: The proposed method outperforms existing methods on objective and subjective evaluations.
SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition (2025.acl-long)

Copied to clipboard

Challenge: Creating lyrics and melodies in symbolic format requires expert knowledge of melody and an advanced understanding of lyrics.
Approach: They introduce SongComposer, a music-specialized large language model that can create symbolic lyrics and melodies following instructions.
Outcome: The proposed model outperforms existing models in symbolic song composition tasks.
Rigid Formats Controlled Text Generation (2020.acl-main)

Copied to clipboard

Challenge: Neural text generation is a challenging task that requires rigid formats to be controlled . a framework called SongNet is designed to tackle this problem .
Approach: They propose a framework to tackle a task called rigid formats controlled text generation . they propose rhyming schemes and a transformer-based auto-regressive language model to improve the modeling performance .
Outcome: The proposed framework improves the performance on format, rhyme, and sentence integrity.
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment.
Approach: VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control.
Outcome: Experimental results show that VersBand performs better than baseline models across multiple song generation tasks.
DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis.
Approach: They propose a controllable data synthesis framework based on variational autoencoder which leverages diffusion models to reserve more information of original distribution and format structure in the learned latent distribution.
Outcome: The proposed framework generates high-quality data with performance exceeding that of real data by 2%–7% on seven real-world datasets.
Unsupervised Melody-to-Lyrics Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for automatic melody-to-lyric generation are limited due to the limited amount of melody-lyrical aligned data.
Approach: They propose a method for automatic melody-to-lyric generation without training on any aligned melody-lyr data.
Outcome: The proposed model generates high-quality lyrics that are singable, intelligible, and coherent than baseline models.
Generative Music Models’ Alignment with Professional and Amateur Users’ Expectations (2025.findings-acl)

Copied to clipboard

Challenge: Recent years have witnessed rapid advances in text-to-music generation using large language models.
Approach: They propose a task to align AI-generated music with human expressions . they use a dataset of over 1.5 million songs to analyze their content .
Outcome: The proposed framework outperforms baseline models and facilitates end-to-end generation of songs audio.
Fine-Grained Controllable Text Generation Using Non-Residual Prompting (2022.acl-long)

Copied to clipboard

Challenge: Existing approaches to control the text generation process are not expressive enough.
Approach: They propose an encoder-decoder architecture that enables intermediate text prompts at arbitrary time steps.
Outcome: The proposed architecture is expressive and versatile on multiple experimental settings.
Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Models (2025.acl-long)

Copied to clipboard

Challenge: Diffusion models have shown promise in text generation, but often struggle with generating long, coherent, and contextually accurate text.
Approach: They propose a framework that enhances diffusion-based text generation through text segmentation, robust representation training with adversarial and contrastive learning, and improved latent-space guidance.
Outcome: The proposed framework improves diffusion-based text generation and improves scalability and fluency.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations