Fast Local Agents with Tools (mcp-client edition) is a lightweight package for connecting local (self-hosted) LLMs to tooling+data and for prototyping agentic flows. The philosophy behind this codebase is streamlined invocation of standard inferencing APIs (ollama, vllm via OpenAI interface compatibility) without relying on other agent frameworks!
Stars
1
Forks
0
Watchers
1
Open Issues
1
Overall repository health assessment
No package.json found
This might not be a Node.js project
11
commits
perf(tools): Simplified tool definition and schema generation, with the bonus that stateful tools are equally straightforward to introduce
5ef6f08View on GitHubfeat: inference statistics (including TTFT, TPS, total inference time), computed by default
db07156View on GitHubfeat: automated logging (to file), and colorful {debug, warning, and errors printed to screen}, with removal of all but streaming-response-related print() statements
54824c1View on GitHubfix: proper parameterization of thinking (enabled/disabled, low/med/hi reasoning effort) and a simple CLI arg --minimize-thinking, and squashing of small bugs related to tool calling
c191611View on GitHubfeat: added support for running models served by llama.cpp, and in the process fixed some minor defects such as missing tool_call_ids in the chat message as well as expanded the example tools towards benchmarking model performance
74b87c3View on GitHubfeat: simple CLI (documented), leading to a code restructure (also documented) and fixes to a number of issues related to streaming and tool-calling, now with vLLM-served models fully tested and supported
a037824View on GitHubfeat: tools (both python functions and mcp-server-provided) are now in the flow, with weather and web crawling as examples in flat_mcp_client.tool_defs. Minimal 3-line example stands in for a more configurable main(), which can in turn be invoked by: geolocal_info
1fc1cdcView on GitHubfeat: basic structure, tested and working, with streaming chat loop standing in for a generalized flow, and tools and resources to come next
99c3ec5View on GitHub