Found 58 repositories(showing 30)
vllm-project
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
ulab-uiuc
LLMRouter: An Open-Source Library for LLM Routing
ynulihao
[Findings@ACL'26] LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
alexrudloff
A LLM proxy that uses a lightweight model to determine which larger model to use for each message.
paularlott
Simple router to aggregate multiple LLM providers with optional smart routing and MCP aggretation.
LuSwordman
LLMRouter是一个面向高并发场景的多模型智能调度系统，基于 LangChain4j构建，支持 OpenAI、DeepSeek、智谱 GLM等多源大语言模型接入。系统内置 轮询、权重、故障转移 三种动态路由策略，采用线程池与异步 Future 并发架构，在高并发下依然保持稳定吞吐与智能容错能力。
artnoage
Creatin a small LLMRouter
chandrasaripaka
LLMRouter
Heht571
API Trade Platform
logsv
LLM router and Load balancer
schedion
No description available
Furion-cn
llmrouter is a lightweight Python SDK that acts as a layer-4 proxy for routing requests to LLM (Large Language Model) APIs with built-in rate limiting and flexible forwarding. Designed for developers who need fast, secure, and controlled access to various AI models — locally or remotely.
cppwfs
Provides a demo of a agentic router flow using SI and Spring AI
pickettd
Smallest example of UIUC's LLMRouter using Ollama LLMs and embedding (starting from LiteLLM semantic-routing config.yaml)
radlab-dev-group
No description available
JavierEdev
No description available
Fyras-Solutions
A LLM routing service that is a package, allowing for prompts to be routed to various LLMs
AnnemetteBP
A modular, domain-aware language model router for multi-agent LLMs
Chongshan0Lin
No description available
skamalj
No description available
bitesports
No description available
Axaxin
No description available
kllmeslow
No description available
uuzinger
Scripts for provisioning LLM router and telemetry VMs
MuKuL-DiXiT
No description available
atharva2001
No description available
georgefs
No description available
Gomez12
No description available
vivekh-git
No description available
benzfy
No description available