A high performance deep learning inference library

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nvidia from gravatar.com nvidia

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Other/Proprietary License (Proprietary)
  • Author: NVIDIA Corporation
  • Tags nvidia, tensorrt, deeplearning, inference
  • Requires: Python >=3.6
Classifiers
Report project as malware

Project description

NVIDIA TensorRT is an SDK that facilitates high-performance machine learning inference. It is designed to work in a complementary fashion with training frameworks such as TensorFlow, PyTorch, and MXNet. It focuses specifically on running an already-trained network quickly and efficiently on NVIDIA hardware.

IMPORTANT: This is a special release of TensorRT designed to work only with TensorRT-LLM. Please refrain from upgrading to this version if you are not using TensorRT-LLM.

To install, please execute the following:

pip install tensorrt --extra-index-url https://pypi.nvidia.com

Or add the index URL to the (space-separated) PIP_EXTRA_INDEX_URL environment variable:

export PIP_EXTRA_INDEX_URL='https://pypi.nvidia.com'
pip install tensorrt

When the extra index url does not contain https://pypi.nvidia.com, a nested pip install will run with the proper extra index url hard-coded.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page