The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
Stars
625
Forks
70
Watchers
625
Open Issues
25
Overall repository health assessment
No package.json found
This might not be a Node.js project
480
commits
35
commits
11
commits
5
commits
4
commits
2
commits
2
commits
1
commits
1
commits
1
commits
Merge pull request #77 from jkawamoto/grammar-verbosity
226e194View on GitHubMerge pull request #87 from Dakantz/fix-gbnf-generation-trailing-bracket
b4f2e52View on GitHubUpdate `llama_cpp_server.py` fixing bugs with non-streaming response
574c2c0View on GitHub