Megatron LM
Ongoing research training transformer models at scale
About
Megatron-LM is designed for research teams and machine learning engineers looking to train large transformer models efficiently. It includes pre-configured training scripts and is built on top of Megatron Core, which offers GPU-optimized building blocks for custom training frameworks. The library supports various parallelism strategies and mixed precision, making it suitable for both quick experimentation and advanced model development.
Open Source Health
- Stars
- 17,871
- Forks
- 4,497
- License
- Not stated
- Last commit
- 26 days ago
Related Categories
Vendor
NVIDIA
Publisher of DALI (NVIDIA Data Loading Library) and Tensorrt
Quick Links
Open Source
More by NVIDIA
Related Products
SkillSpector
Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, security risks, prompt injection, data exfiltration, and supply-chain risks in Claude Code, Codex, and MCP skills before you install them.
More from this vendor
Nvbench
CUDA Kernel Benchmarking Library
More from this vendor
OSMO
The developer-first platform for scaling complex Physical AI workloads across heterogeneous compute—unifying training GPUs, simulation clusters, and edge devices in a simple YAML
More from this vendor
The Algorithm
Source code for the X Recommendation Algorithm
Shared categories
Recommenders
TensorFlow Recommenders is a library for building recommender system models using TensorFlow.
Shared categories