AI API Tool
NVIDIA TensorRT
Visit website- Introduction
- NVIDIA TensorRT is an SDK ecosystem for optimizing and deploying high-performance deep learning inference on NVIDIA GPUs.
- Added on
- 11/17/2026
- Pricing
- Freemium
- Official links
- Website, company & support ↗

PRODUCT OVERVIEW
What is NVIDIA TensorRT?
NVIDIA TensorRT is an ecosystem of tools for developers to achieve high-performance deep learning inference. It includes inference compilers, runtimes, and model optimizations that deliver low latency and high throughput for production applications. The ecosystem includes TensorRT SDK, TensorRT LLM, NVIDIA Model Optimizer, and TensorRT for NVIDIA RTX. Built on the NVIDIA CUDA parallel programming model, TensorRT optimizes neural network models trained on major frameworks using quantization, layer and tensor fusion, and kernel tuning. It integrates with PyTorch, Hugging Face, ONNX, and MATLAB, and supports deployment to data centers, workstations, laptops, and edge devices. TensorRT-LLM is available for free on GitHub, and TensorRT Model Optimizer is free on NVIDIA PyPI. A free 90-day license for NVIDIA AI Enterprise is available for production evaluation.
How to use NVIDIA TensorRT
- 1
Download the TensorRT SDK
Download the TensorRT SDK from the official NVIDIA developer site or pull the TensorRT container from the NGC catalog.
- 2
Optimize your model
Use TensorRT's inference compiler and NVIDIA Model Optimizer to apply quantization, layer and tensor fusion, and kernel tuning to models trained on major frameworks.
- 3
Integrate with your framework
Use Torch-TensorRT, the ONNX parser, or MATLAB GPU Coder to import models from PyTorch, Hugging Face, ONNX, or MATLAB into TensorRT.
- 4
Deploy and scale
Deploy optimized models with NVIDIA Dynamo and Triton Inference Server, which includes TensorRT as a backend, to data centers, workstations, laptops, and edge devices.
NVIDIA TensorRT Features
Inference compiler and runtime for deep learning models
Quantization, layer and tensor fusion, and kernel tuning optimizations
TensorRT-LLM for large language model inference
NVIDIA Model Optimizer for quantization, pruning, and distillation
TensorRT for RTX for inference on RTX GPUs
Integrations with PyTorch, Hugging Face, ONNX, and MATLAB
Deployment to data centers, workstations, laptops, and edge devices
Deployment and scaling with NVIDIA Dynamo and Triton Inference Server
NVIDIA TensorRT Use Cases
Optimizing deep learning models for low-latency, high-throughput production inference
Accelerating large language model inference on NVIDIA GPUs
Compressing models with quantization for real-time services and embedded applications
Deploying inference to data centers, workstations, laptops, and edge devices
Building inference engines for RTX PCs during app installation or first run
NVIDIA TensorRT FAQs
NVIDIA TensorRT is an ecosystem of tools for developers to achieve high-performance deep learning inference, including inference compilers, runtimes, and model optimizations.
The ecosystem includes TensorRT SDK, TensorRT LLM, NVIDIA Model Optimizer, and TensorRT for NVIDIA RTX.
TensorRT integrates directly with PyTorch and Hugging Face, provides an ONNX parser, and is integrated with MATLAB through GPU Coder.
TensorRT optimizes inference using quantization, layer and tensor fusion, and kernel tuning techniques.
TensorRT-LLM is available for free on GitHub.
TensorRT Model Optimizer is free on NVIDIA PyPI, with examples and recipes on GitHub.
A free license to try NVIDIA AI Enterprise in production for 90 days is available using your existing infrastructure.
Documentation is available at https://docs.nvidia.com/deeplearning/tensorrt/.
NVIDIA TensorRT Official Information
- Company
- NVIDIA
- Website
- https://developer.nvidia.com/tensorrt
- Documentation
- https://docs.nvidia.com/deeplearning/tensorrt/
- Contact
- https://developer.nvidia.com/contact
NVIDIA TensorRT Pricing
Official developer page checked 2026-11-09. Software downloads are free; hardware, cloud compute and commercial support are separate. NVIDIA AI Enterprise offers a 90-day evaluation, not a permanently free enterprise license.
TensorRT Model Optimizer
COMMUNITY REVIEWS
NVIDIA TensorRT User Reviews
No reviews yet.
