ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

Open source real-time translation app for Android that runs locally

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

Effortless data labeling with AI support from Segment Anything and other awesome models.

📄 Awesome OCR multiple programing languages toolkits based on ONNX Runtime, OpenVINO, MNN, PaddlePaddle, TensorRT and PyTorch.

An Engine-Agnostic Deep Learning Framework in Java

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

OpenMMLab Model Deployment Framework

QualityScaler - image/video AI upscaler app

Local AI API Platform

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

TTS with kokoro and onnx runtime

Lightweight nudity detection

Fast ML inference & training for ONNX models in Rust

Voice activity detector (VAD) for the browser with a simple API

Robust realtime face and facial landmark tracking on CPU with Unity integration

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

Examples for using ONNX Runtime for machine learning inferencing.

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Realtime human head pose estimation with ONNXRuntime and OpenCV.

支持按轴凹总力战, 无缝制造三解, 用于实现蔚蓝档案自动化的程序( Steam已适配 )

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

多个SVC/TTS的C++推理库

Generative AI extensions for onnxruntime

ONNX Model Exporter for PaddlePaddle