NVIDIA

Client side integration example source code and libraries for AI-Assisted Annotation SDK

AIStore: scalable storage for AI applications

An SDK (Software Development Kit) for building commercial-grade, AI-native, 3GPP, and O-RAN compliant 5G/6G gNB software on NVIDIA-accelerated computing platforms.

A toolchain for generating high-performance, GPU-accelerated 5G/6G pipelines from Python and a modular, real-time runtime for executing the pipelines on NVIDIA Aerial™ RAN Computer platforms.

Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

NVIDIA Asset Harvester is a generative AI model for autonomous vehicle simulation that extracts reusable 3D Gaussian assets directly from captured driving scenes, even from partial or obstructed views.

High-performance C++/CUDA SDK for running Audio2Emotion and Audio2Face inference with integrated post-processing.

Run cloud native workloads on NVIDIA GPUs

Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Large Language Models.

A tool for testing and validating container requirements against versioned manifests

NVIDIA Cosmos is an open platform of world models, datasets, and tools that enables developers to build Physical AI for robots, autonomous vehicles, smart infrastructure, and more.

Cosmos Curator is a powerful video curation system that processes, analyzes, and organizes video content using advanced AI models and distributed computing.

Our inference and training framework to run on the Cosmos Models

NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs

NVIDIA DALI is a library designed for efficient data loading and preprocessing in machine learning workflows.

NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs

NVIDIA Dataset Utilities (NVDU)

NVIDIA DeepStream SDK Developer Guide — DeepStream documentation

NVIDIA EDK2 platform support

A simple yet powerful tool to turn traditional container/OS images into unprivileged sandboxes.

Transformer related optimization, including BERT, GPT

High-performance streaming video diffusion framework with pluggable model backends

Flowtron is an auto-regressive flow-based generative network for text to speech synthesis with control over speech variation and style transfer

A toolkit showing GPU's all-round capability in video processing

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

the LLM vulnerability scanner

NVIDIA GPUDirect Storage Driver

Simple but powerful dependency injection container for Go projects!

A set of training recipes for AI Quantum Error Correction Decoders

NVIDIA device plugin for Kubernetes

An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.

NVIDIA k8s device plugin for Kubevirt

LLM KV cache compression made easy

NVIDIA container runtime library

NVIDIA Material Definition Language SDK

Magnum IO community repo

Ongoing research training transformer models at scale

Megatron's multi-modal data loader

Mellotron: a multispeaker voice synthesis model based on Tacotron 2 GST that can make a voice emote and sing without emotive or singing training data

Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors

NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process communication and coordination overheads by allowing programmers to perform one-sided communication from within CUDA kernels and on CUDA streams.

NVSentinel detects and remediates GPU faults on Kubernetes nodes

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

The NVIDIA NeMo Agent Toolkit UI streamlines interacting with NeMo Agent Toolkit workflows in an easy-to-use web application.

Core Rust SDK for NeMo Relay observability, scope management, and runtime instrumentation.

NeMo-Retriever is a Python library for scalable document content and metadata extraction.

NeMo-Speech.cpp is a lightweight C++ inference runtime for Speech models

A toolkit for processing speech data and creating speech datasets

NeMo text processing for ASR and TTS

Run agents like Hermes, LangChain Deep Agents, and OpenClaw more securely inside NVIDIA OpenShell with managed inference

Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench

Python GPU kernel profiling interface

Training material for Nsight developer tools

ALCHEMI Toolkit is a developer toolkit for accelerating training and inference for AI in chemistry and material science.

A tool for bandwidth measurements on NVIDIA GPUs.

CUDA Kernel Benchmarking Library

Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

Build and run containers leveraging NVIDIA GPUs

NVIDIA Resiliency Package

The developer-first platform for scaling complex Physical AI workloads across heterogeneous compute—unifying training GPUs, simulation clusters, and edge devices in a simple YAML

OpenShell is the safe, private runtime for autonomous AI agents.

OpenShell is the safe, private runtime for autonomous AI agents.

L​ibrary for using the models trained in PhysicsNeMo in Engineering and CFD workflows

A GPU performance profiling tool for PyTorch models

Container plugin for Slurm Workload Manager

Unsupervised Language Modeling at scale for robust sentiment classification

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, security risks, prompt injection, data exfiltration, and supply-chain risks in Claude Code, Codex, and MCP skills before you install them.

Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.

SOMA BVH to humanoid robot motion retargeting library built with Newton and NVIDIA Warp

TensorRT Extension for Stable Diffusion Web UI

Efficient LLM Inference over Long Sequences

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

Welcome to TensorRT LLM’s Documentation! — TensorRT LLM

From PyTorch model to end-to-end TensorRT inference experience in two commands—AI-native, cross-platform, and built for the best possible user experience.

TensorRT is a toolkit for optimizing deep learning inference applications.

A toolkit for discovering cluster network topology.

Differentiable signal processing on the sphere for PyTorch

Transformer Engine documentation — Transformer Engine 2.19.0

This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.

NVIDIA vGPU Device Manager manages NVIDIA vGPU devices on top of Kubernetes

A Flow-based Generative Network for Speech Synthesis

cuDF - GPU DataFrame Library

cuEquivariance is a math library that is a collective of low-level primitives and tensor ops to accelerate widely-used models, like DiffDock, MACE, Allegro and NEQUIP, based on equivariant neural networks. Also includes kernels for accelerated structure prediction.

GPU accelerated decision optimization

cuVS - a library for vector search and clustering on the GPU

A nvImageCodec library of GPU- and CPU- accelerated codecs featuring a unified interface

Synthesizing and manipulating 2048x1024 images with conditional GANs