JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment

AI Voice SynthesisVoice, Speech & Audio AIOpen Source

About

JAM is a rectified flow-based model for lyrics-to-song generation that addresses the lack of fine-grained word-level controllability in existing lyrics-to-song models. Built on a compact 530M-parameter architecture with 16 LLaMA-style Transformer layers as the Diffusion Transformer (DiT) backbone, JAM enables precise vocal control that musicians desire in their workflows. Unlike previous models, JAM provides word and phoneme-level timing control, allowing musicians to specify the exact placement of each vocal sound for improved rhythmic flexibility and expressive timing.

Open Source Health

Not enough history
Stars
169
Forks
19
License
Not stated
Last commit
1 years ago
Python

Resources & Links

Related Categories

Using Jamify?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Deep Cognition and Language Research (DeCLaRe) Lab

Open-source projects on GitHub: Conv Emotion, Tango and MELD

View vendor profile

More by Deep Cognition and Language Research (DeCLaRe) Lab