High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
Stars
182
Forks
22
Watchers
182
Open Issues
20
Overall repository health assessment
No package.json found
This might not be a Node.js project
Merge upstream/main into main — resolve conflicts in application.go and config_test.go
a5100f8View on GitHubstyle: address CodeRabbit nitpicks — comment explains why, tighten docs prose
862fe46View on GitHubfix: replace regex model rewrite with json.Decoder token scanner
96b67ebView on GitHubMerge pull request #113 from thushan/feature/anthropic-agents
eef52eeView on GitHub