TensorRT-LLM
Welcome to TensorRT LLM’s Documentation! — TensorRT LLM
About
TensorRT LLM TensorRT LLM optimizes inference for LLMs and Visual Gen models with specialized kernels for common operations, an efficient runtime, and a pythonic framework that enables you to customize and extend the system.
Open Source Health
- Stars
- 14,613
- Forks
- 2,739
- License
- Not stated
- Last commit
- 27 days ago
Related Categories
Vendor
NVIDIA
Publisher of DALI (NVIDIA Data Loading Library) and Tensorrt
Quick Links
Open Source
More by NVIDIA
Related Products
SkillSpector
Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, security risks, prompt injection, data exfiltration, and supply-chain risks in Claude Code, Codex, and MCP skills before you install them.
More from this vendor
Nvbench
CUDA Kernel Benchmarking Library
More from this vendor
OSMO
The developer-first platform for scaling complex Physical AI workloads across heterogeneous compute—unifying training GPUs, simulation clusters, and edge devices in a simple YAML
More from this vendor
The Algorithm
Source code for the X Recommendation Algorithm
Shared categories
Recommenders
TensorFlow Recommenders is a library for building recommender system models using TensorFlow.
Shared categories