Perception Models
State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
LLM OrchestrationOpen Source AI & Machine LearningOpen Source
About
This repo is the home to the state-of-the-art for image and video perception: Perception Encoder (PE) for image, video, audio encoding, and Perception Language Model (PLM) for decoding.
Open Source Health
- Stars
- 2,361
- Forks
- 162
- License
- Apache-2.0
- Last commit
- 6 months ago
Jupyter Notebook
Alternatives to Perception Models
- RPG_KDD2025by FacebookresearchThis repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
- Seamless Communicationby FacebookresearchFoundational Models for State-of-the-Art Speech and Text Translation
- OrienterNetby FacebookresearchSource Code for Paper "OrienterNet Visual Localization in 2D Public Maps with Neural Matching"
- Matrixby FacebookresearchMatrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data generation.
- Spiderby FacebookresearchA general physic-based retargeting framework.
Resources & Links
Related Categories
Using Perception Models?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Facebookresearch
Publisher of Fairseq
