ARIA: Audio-Driven Melody-Tone Relation Modeling for Cantonese Lyric Authoring

Excerpt

arXiv:2610.07902v1 Announce Type: new Abstract: Cantonese lyric writing requires close alignment between lexical tones and melodic pitch. Existing melody-guided lyric generation methods typically rely on symbolic melody to generate lyrics. However, in real songwriting scenarios, melodies are often expressed as raw singing audio or hummed recordings, where pitch is implicit, noisy, and unstructured, making these methods difficult to apply directly. To address this limitation, we propose ARIA, a t