Sa2VA
Official Repo For Pixel-LLM Codebase: Sa2VA (T-PAMI-26), SAMTok (CVPR-26), VRT (Arxiv-25), SaSaSa2VA (1-st solution for LSVOS)
About
Pixel LLMs is a family of projects that bring pixel-level, dense grounded understanding to multimodal LLMs. It is anchored by Sa2VA — a unified model that marries SAM-2 with MLLMs for dense grounded understanding of images and videos — together with a growing set of research projects built on top of it.
Open Source Health
- Stars
- 1,670
- Forks
- 131
- License
- Apache-2.0
- Last commit
- 1 months ago
Related Categories
Vendor
ByteDance
Publisher of UI TARS Desktop, Trae Agent and danmu.js
Quick Links
Open Source
More by ByteDance
Related Products
Rclip
Semantic photo search for the command line
Top category match
ChineseNER
A neural network model for Chinese named entity recognition
Top category match
Head Pose Estimation
Realtime human head pose estimation with ONNXRuntime and OpenCV.
Top category match
Video Subtitle Extractor
视频硬字幕提取，生成srt文件。无需申请第三方API，本地实现文本识别。基于深度学习的视频字幕提取框架，包含字幕区域检测、字幕内容提取。A GUI tool for extracting hard-coded subtitle (hardsub) from videos and generating srt files.
Top category match
U 2 Net
The code for our newly accepted paper in Pattern Recognition 2020: "U^2-Net: Going Deeper with Nested U-Structure for Salient Object Detection."
Top category match