HunyuanCustom

HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generation

Video EditingVideo EditingOpen Source

About

Customized video generation aims to produce videos featuring specific subjects under flexible user-defined conditions, yet existing methods often struggle with identity consistency and limited input modalities. In this paper, we propose HunyuanCustom, a multi-modal customized video generation framework that emphasizes subject consistency while supporting image, audio, video, and text conditions. Built upon HunyuanVideo, our model first addresses the image-text conditioned generation task by introducing a text-image fusion module based on LLaVA for enhanced multi-modal understanding, along with an image ID enhancement module that leverages temporal concatenation to reinforce identity features across frames. To enable audio- and video-conditioned generation, we further propose modality-specific condition injection mechanisms: an AudioNet module that achieves hierarchical alignment via spatial cross-attention, and a video-driven injection module that integrates latent-compressed conditional video through a patchify-based feature-alignment network.

Open Source Health

Not enough history
Stars
1,229
Forks
110
License
Not stated
Last commit
1 years ago
Python

Related Categories

Using HunyuanCustom?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Tencent-Hunyuan

Open-source projects on GitHub: HunyuanVideo, HunyuanVideo-1.5 and HunyuanOCR

View vendor profile

More by Tencent-Hunyuan