OmniWeaving

Official Implementation of OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

AI Video CreationOpen Source AI & Machine LearningOpen Source

About

We propose OmniWeaving, an omni-level video generation model featuring powerful multimodal composition and reasoning-informed capabilities. By leveraging a massive-scale pretraining dataset that encompasses diverse compositional and reasoning-augmented scenarios, OmniWeaving learns to temporally bind interleaved text, multi-image, and video inputs while acting as an intelligent agent to infer complex user intentions for sophisticated video creation. Furthermore, we introduce IntelligentVBench, the first comprehensive benchmark designed to rigorously assess next-level intelligent unified video generation. Extensive experiments demonstrate that OmniWeaving achieves SoTA performance among open-source unified models.

Open Source Health

Not enough history
Stars
811
Forks
27
License
Not stated
Last commit
6 months ago
Python

Related Categories

Using OmniWeaving?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Tencent-Hunyuan

Open-source projects on GitHub: HunyuanVideo, HunyuanVideo-1.5 and HunyuanOCR

View vendor profile

More by Tencent-Hunyuan