:fire: An extremely fast, React-like JavaScript library for building modern user interfaces

A static analyzer for Java, C, C++, and Objective-C

Large Language Model Text Generation Inference

Official inference library for Mistral models

High-speed Large Language Model Serving for Local Deployment

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

A blazing fast inference solution for text embeddings models

校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

A static, type inferred and embeddable language written in Rust.

Metal shaders for SwiftUI.

A pytorch implementation of Detectron. Both training from scratch and inferring directly from pretrained Detectron weights are available.

A Python library that helps data scientists to infer causation rather than observing correlation.

Fast, dependency-free Go package to infer binary file types based on the magic numbers header signature

InferSent sentence embeddings

Turn any computer or edge device into a command center for your computer vision projects.

A Rust port of FlameGraph

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

统计 Git 项目的 commit 时间分布，进而推导出项目的编码工作强度。 Analyzes the commit time distribution of Git projects to infer coding work intensity.

The inference module for AgiBot X1.

Infer TS types from JSON schemas 📝

Examples for using ONNX Runtime for machine learning inferencing.

Infer.NET is a framework for running Bayesian inference in graphical models

Reference implementations of MLPerf® inference benchmarks

Proof of Inference - Trustless AI verification

Yolov5 deepsort inference，使用YOLOv5+Deepsort实现车辆行人追踪和计数，代码封装成一个Detector类，更容易嵌入到自己的项目中

Python code for part 2 of the book Causal Inference: What If, by Miguel Hernán and James Robins

wireless hacking - This is automated wireless hacking tool

A curated list of causal inference libraries, resources, and applications.