An easy to use PyTorch to TensorRT converter

🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

Simple samples for TensorRT programming

腾讯云TRTC音视频服务，国内下载镜像：

Real-time pose estimation accelerated with NVIDIA TensorRT

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

TensorFlow models accelerated with NVIDIA TensorRT

Image classification with NVIDIA TensorRT from TensorFlow models.

ROS2 TensorRT Node for Monocular Metric Depth estimation and Point Cloud generation from camera images with Depth Anything V3

TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例

Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

A pytorch to tensorrt convert with dynamic shape support

Real-time hand pose estimation and gesture classification using TensorRT

基于yolo-trt的穿越火线ai自瞄

OpenAI compatible API for TensorRT LLM triton backend

:zap::zap::zap:NVIDIA-阿里2021 TRT比赛 `二等奖` 代码提交 团队：美迪康 AI Lab :rocket::rocket::rocket:

A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt

A sample for onnxparser working with trt user defined plugins for TRT7.0

Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming modes. It is dual-language compatible with Python and C++, offering scalability, extensibility, and high performance. It helps users quickly deploy models and provide services through HTTP/RPC interfaces.

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

Tencent RTC Web SDK — Real-time video calls, voice calls, live streaming, and conferencing for web apps. Powers TUICallKit, TUIRoomKit, and TUILiveKit.

Python sample for referencing object detection model with TensorRT

Distilled coarse part of LoFTR adapted for compatibility with TensorRT and embedded divices

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

TensorFlow Lite models for MIRNet for low-light image enhancement.

This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.

learning-cuda-trt

ROS 2 packages for PyTorch and TensorRT for real-time classification and object detection on Jetson Platforms

YOLOv4 object detector using TensorRT engine

AI自瞄项目，支持yolov5,yolov7,yolov8,yolox ，使用tensorrt和DML