Wikitopia
TensorRT-LLM
productllm_inference
Try in Playground →
Overview
Developed byNVIDIA
LicenseApache 2.0
Open source✓ Open Source
Use caseHigh-performance inference for Large Language Models
Technical
API compatible
Hugging Face Transformers
Protocols
Python API
Also see
Alternative to
Text Generation InferencevLLM
Based onTensorRT
Competes with
vLLM
Knowledge graph stats
Claims24
Avg confidence93%
Avg freshness99%
Last updatedUpdated 4 days ago
Trust distribution
100% unverified
Governance
Not assessed
Contribute governance data →

TensorRT-LLM

product

NVIDIA Apache 2.0 library for optimized LLM inference on NVIDIA GPUs

Compare with...

primary use case

ValueTrustConfidenceFreshnessSources
High-performance inference for Large Language Models○UnverifiedHighFresh1
Large Language Model inference optimization○UnverifiedHighFresh1
High-performance LLM inference optimization○UnverifiedHighFresh1
optimized inference for large language models○UnverifiedHighFresh1

developed by

ValueTrustConfidenceFreshnessSources
NVIDIA○UnverifiedHighFresh1

based on

ValueTrustConfidenceFreshnessSources
TensorRT○UnverifiedHighFresh1

open source

ValueTrustConfidenceFreshnessSources
true○UnverifiedHighFresh1

requires

ValueTrustConfidenceFreshnessSources
CUDA○UnverifiedHighFresh1
NVIDIA GPU○UnverifiedHighFresh1

supports protocol

ValueTrustConfidenceFreshnessSources
Python API○UnverifiedHighFresh1

maintained by

ValueTrustConfidenceFreshnessSources
NVIDIA○UnverifiedHighFresh1

pricing model

ValueTrustConfidenceFreshnessSources
free○UnverifiedHighFresh1

license type

ValueTrustConfidenceFreshnessSources
Apache 2.0○UnverifiedHighFresh1
Apache License 2.0○UnverifiedHighFresh1

integrates with

ValueTrustConfidenceFreshnessSources
Triton Inference Server○UnverifiedHighFresh1
Hugging Face Transformers○UnverifiedHighFresh1

supports model

ValueTrustConfidenceFreshnessSources
BLOOM○UnverifiedHighFresh1
GPT○UnverifiedModerateFresh1
LLaMA○UnverifiedModerateFresh1
BERT○UnverifiedModerateFresh1

api compatible with

ValueTrustConfidenceFreshnessSources
Hugging Face Transformers○UnverifiedHighFresh1

alternative to

ValueTrustConfidenceFreshnessSources
Text Generation Inference○UnverifiedModerateFresh1
vLLM○UnverifiedModerateFresh1

competes with

ValueTrustConfidenceFreshnessSources
vLLM○UnverifiedModerateFresh1

Alternatives & Similar Tools

Text Generation Inference
alternative to
Compare →
vLLM
competes with
Compare →
vLLM
alternative to
Compare →

Commonly Used With

Triton Inference ServerHugging Face Transformers

Related entities

Claim count: 24Last updated: 4/5/2026Edit history