AutoModel
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
About
Nemo AutoModel is a Pytorch DTensor‑native SPMD open-source training library under NVIDIA NeMo Framework, designed to streamline and scale training and finetuning for LLMs, VLMs, diffusion models, and retrieval models. Designed for flexibility, reproducibility, and scale, NeMo AutoModel enables both small-scale experiments and massive multi-GPU, multi-node deployments for fast experimentation in research and production environments.
Open Source Health
- Stars
- 944
- Forks
- 305
- License
- Apache-2.0
- Last commit
- 26 days ago
Related Categories
Vendor
NVIDIA-NeMo
Open-source projects on GitHub: Speech, Guardrails and Switchyard
Quick Links
Open Source
More by NVIDIA-NeMo
Related Products
Peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Top category match
Sophia Script For Windows
zap: The most powerful PowerShell module for fine-tuning Windows 10 & Windows 11 on GitHub
Top category match
KTransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Top category match
LongWriter
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Top category match
Regress Lm
Library for sequence-to-sequence numeric prediction, applicable to any tokenizable input, and allows pretraining and fine-tuning over multiple tasks.
Top category match