A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

从零实现一个小参数量中文大语言模型。

[ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices

A tiny experimental language designed to be targeted by coding LLMs

A tiny implementation of an autonomous agent powered by LLMs (OpenAI GPT-4)

Tiny truly local voice-activated LLM Agent that runs on a Raspberry Pi

Setup and run a local LLM and Chatbot using consumer grade hardware.

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

No description available

Tiny MCP server with cryptography tools, sufficient to establish end-to-end encryption between LLM agents

Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit

Tiny C++ LLM inference implementation from scratch

Tiny client for LLMs with vision and tool calling. As simple as it gets.

Turn any Kiwix ZIM archive (offline Wikipedia, Stack Exchange, DevDocs, etc.) into an instant knowledge source for LLMs with a tiny CLI + Python server exposing searchable chunks, metadata and citations.

Tiny Agents: LLM + MCP Tools

A tiny LLM Agent with minimal dependencies, focused on local inference.

Bringing Language Models to the Most Resource Constrained Devices

One tiny lib for LLM token + cost math

Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an LLM (with low latency overhead!)

A C++ port of karpathy/llm.c features a tiny torch library while maintaining overall simplicity.

STAR: Similarity-guided Teacher-Assisted Refinement for Super-Tiny Function Calling Models

tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.

Train a 29M parameter GPT from Scratch

Tiny Agent: Production-Ready LLM Agent SDK for Every Developer

One Tiny RAG-Powered LLM Framework: Knowledge-Enhanced Generative AI Demo

No description available

Responsive CTF (Capture The Flag) website with a proper backend system + Tiny-LLM interface

Tiny Semantic Versioning (SemVer) library with LLMs and GitHub CI, that doesn't depend on 300K lines of JavaScript code and fits in a single Python file

a collection of tiny llms with usecases

Smallest LLM I can fine tune for coding websites