Kento Watanabe, Yuichiroh Matsubayashi, Satoru Fukayama, Masataka Goto, Kentaro Inui, Tomoyasu Nakano
| Challenge: | Existing models for lyrics generation are insufficient to capture relationship between lyrics and melody. |
| Approach: | They propose a data-driven language model that generates entire lyrics for a given melody. |
| Outcome: | The proposed model generates fluent lyrics while maintaining compatibility between lyrics and melodies. |
Similar Papers
Syllable-level lyrics generation from melody exploiting character-level language model (2024.findings-eacl)
Copied to clipboard
| Challenge: | Pre-trained language models specifically designed at the syllable level are not available. |
| Approach: | They propose to exploit character-level language models for syllable-level lyrics generation from symbolic melody. |
| Outcome: | The proposed system improves coherence and correctness of generated lyrics without training expensive language models. |
Unsupervised Melody-to-Lyrics Generation (2023.acl-long)
Copied to clipboard
Yufei Tian, Anjali Narayan-Chen, Shereen Oraby, Alessandra Cervone, Gunnar Sigurdsson, Chenyang Tao, Wenbo Zhao, Tagyoung Chung, Jing Huang, Nanyun Peng
| Challenge: | Existing methods for automatic melody-to-lyric generation are limited due to the limited amount of melody-lyrical aligned data. |
| Approach: | They propose a method for automatic melody-to-lyric generation without training on any aligned melody-lyr data. |
| Outcome: | The proposed model generates high-quality lyrics that are singable, intelligible, and coherent than baseline models. |
SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition (2025.acl-long)
Copied to clipboard
Shuangrui Ding, Zihan Liu, Xiaoyi Dong, Pan Zhang, Rui Qian, Junhao Huang, Conghui He, Dahua Lin, Jiaqi Wang
| Challenge: | Creating lyrics and melodies in symbolic format requires expert knowledge of melody and an advanced understanding of lyrics. |
| Approach: | They introduce SongComposer, a music-specialized large language model that can create symbolic lyrics and melodies following instructions. |
| Outcome: | The proposed model outperforms existing models in symbolic song composition tasks. |
Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyrics (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Song translation requires both translation of lyrics and alignment of music notes . human translators of songs need to have a mastery of cultural traditions and the poetic usage of both source and target languages . |
| Approach: | They propose a model that can model lyric translation and lyrics-melody alignment . they use an encoder-decoder framework that can translate lyrics and determine number of aligned notes . |
| Outcome: | The proposed framework can translate lyrics and determine the number of aligned notes at each decoding step. |
K-pop Lyric Translation: Dataset, Analysis, and Neural-Modelling (2024.lrec-main)
Copied to clipboard
| Challenge: | lyric translation studies have focused on Western genres and languages, with no previous study centering on K-pop despite its popularity. |
| Approach: | They propose a singable lyric translation dataset that aligns Korean and English lyrics line-by-line and section-by section. |
| Outcome: | The proposed dataset reveals unique characteristics of K-pop lyric translation, distinguishing it from other extensively studied genres, and constructs a neural lyrical translation model. |
Scansion-based Lyrics Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | a new method for generating lyrics for Mandarin songs is based on scansion . the number of syllables required is variable due to the number and number of notes . |
| Approach: | They propose a method to generate Mandarin lyrics with a good match between melody and tonal contour. |
| Outcome: | The proposed system outperforms all other systems in lyric-melody fit and uses proxies for quantifying creativity. |
ToneCraft: Cantonese Lyrics Generation with Harmony of Tones and Pitches (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current research has not addressed the challenge of generating harmonious Cantonese lyrics. |
| Approach: | They propose a framework for generating Cantonese lyrics that ensures tonal and melodic harmony. |
| Outcome: | The proposed framework ensures tonal and melodic harmony while preserving character count and quality. |
UniLG: A Unified Structure-aware Framework for Lyrics Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing works ignore musical attributes hidden behind lyrics and structure of lyrics . existing works ignore structure of generated lyrics and do not consider structure of songs . |
| Approach: | They propose a framework for conditional lyrics generation that considers structure and relationship between lyrics and music. |
| Outcome: | The proposed framework improves the structure modeling and unifies different conditions for different types of lyrics generation. |
REFFLY: Melody-Constrained Lyrics Editing Model (2025.naacl-long)
Copied to clipboard
| Challenge: | Automatic melody-to-lyric (M2L) generation aims to create lyrics that align with a given melody. |
| Approach: | They propose a framework for automatic melody-to-lyric generation that allows for a more flexible approach to creating lyrics from plain text. |
| Outcome: | The proposed framework outperforms baselines Lyra and GPT-4 in musicality and text quality. |
SongRewriter: A Chinese Song Rewriting System with Controllable Content and Rhyme Scheme (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods of generating singable lyrics are based on a given melody, but there are two main challenges: generating the lyrics without knowing the melody and composing compatible melodies. |
| Approach: | They propose a Chinese lyric generation and editing system which rewrites lyrics of an existing song such that they are compatible with the rhythm of the existing melody. |
| Outcome: | The proposed system is based on a randomized multi-level masking strategy and can generate new lyrics or edit fragments without prior knowledge of melody composition. |