Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.

Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends

Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap

Multi-LLM agent framework with Claude Code-like tools. Use DeepSeek, Claude, GPT, Llama, or any model — same tools, same skills, swap freely. Includes file editing, code search, shell execution, sub-agents, and a production-ready API. The missing SDK between your LLM and your codebase.

Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.

ClaraCore extends llama-swap with intelligent automation, bringing zero-configuration setup to llama.cpp deployments.

Proof-of-concept Aider w. local (24GB vram) QwQ+Qwen2.5-Coder using litellm-proxy / llama-swap / llama.cpp

A robust, production-ready Python toolkit to automate the synchronization between a directory of .gguf model files and a llama-swap config.yaml

homebrew tap for llama-swap

Unified LLM + STT container for AMD Strix Halo (ROCm)

A container for CUDA 12 enabled llama-swap and llama.cpp server built on a distroless base

Reliable model swapping for any local OpenAI compatible server - llama.cpp, vllm, etc

CLI for creating a configuration to be consumed by llama-swap for existing Ollama model blobs

Ansible playbook to configure AMD Strix Halo machines (e.g. Framework Desktop or GMKtec EVO-X2) as local AI inference servers running Fedora 43. Sets up llama.cpp with llama-swap and Open WebUI and downloads GGUF models. With NGINX reverse proxy and TLS via ACME or self-signed certificate.

A ComfyUI custom node for llama-swap the hot-swap model manager for llama.cpp.

Container iamges for running llama-swap and llama-cpp on AMD hardware

Local LLM server setup with OpenWebUI and llama-swap + llama.cpp

A NVIDIA PyTorch image based Dockerfile with ComfyUI, vLLM, llama.cpp, llama-swap, OpenWebUI, ollama and a downloader for models.

Like Claude Code Router, but intended for use with Anthropic-compatible endpoints (LiteLLM, Llama Swap, vLLM)

llama-swap config

Custom Llama Swap Container Image

Documentation Site for llama-swap

Configuration Examples for llama-swap

No description available

llama.cpp and llama-swap installer and updater powershell script

Swiftbar plugin providing MacOS menubar icon for llama-swap

Auto-discover GGUF models from directories for llama-swap config

A simple wrapper for llama-swap to make it easy to use with KoboldCpp

Auto-configure opencode to use a local llama-swap instance with model and context detection