HunyuanCustom
HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generation
About
Customized video generation aims to produce videos featuring specific subjects under flexible user-defined conditions, yet existing methods often struggle with identity consistency and limited input modalities. In this paper, we propose HunyuanCustom, a multi-modal customized video generation framework that emphasizes subject consistency while supporting image, audio, video, and text conditions. Built upon HunyuanVideo, our model first addresses the image-text conditioned generation task by introducing a text-image fusion module based on LLaVA for enhanced multi-modal understanding, along with an image ID enhancement module that leverages temporal concatenation to reinforce identity features across frames. To enable audio- and video-conditioned generation, we further propose modality-specific condition injection mechanisms: an AudioNet module that achieves hierarchical alignment via spatial cross-attention, and a video-driven injection module that integrates latent-compressed conditional video through a patchify-based feature-alignment network.
Open Source Health
- Stars
- 1,229
- Forks
- 110
- License
- Not stated
- Last commit
- 1 years ago
Alternatives to HunyuanCustom
React Native Video Processingby Shahen HovhannisyanNative Video editing/trimming/compressing :movie_camera: library for React-Native
Lossless Cutby Mikael FinstadThe swiss army knife of lossless video/audio editing
LivePortraitby KlingAI ResearchBring portraits to life!
mux.jsby VideojsA collection of lightweight utilities for inspecting and manipulating video container formats.
Waifu2x Extension GUIby Aaron FengVideo, Image and GIF upscale/enlarge(Super-Resolution) and Video frame interpolation. Achieved with Waifu2x, Real-ESRGAN, Real-CUGAN, RTX Video Super Resolution VSR, SRMD, RealSR, Anime4K, RIFE, IFRNet, CAIN, DAIN, and ACNet.
Resources & Links
Related Categories
Using HunyuanCustom?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Tencent-Hunyuan
Open-source projects on GitHub: HunyuanVideo, HunyuanVideo-1.5 and HunyuanOCR