LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
Stars
133
Forks
14
Watchers
Open Issues
6
Overall repository health assessment
No package.json found
This might not be a Node.js project
User
16
commits
update to work with latest pyllamacpp (#10)
1191e40
Update __init__.py
b9cb40b
update server api to work with chatbotui (#8)
7bc9a2d
simplify implementation with new pyllamacpp apis (#7)
9f184f1
Update README.md
ce3d19a
upload better streaming demo
6cde22d
fix publish trigger (#5)
e0c4892
fix build pipeline (#4)
caad579
Refactor with pyllamacpp (#3)
f66f0d7
minor improvement of current approach
d43f68e
2d508b6
0958188
support streaming with server-sent events
8831337
ec848f6
serve llama models with llama.cpp
b6f6bcc