This project is a web-based LLM (Large Language Model) chat tool developed using Rust, the Dioxus framework, and the Candle framework. It supports multiple open-source LLM models and features dynamic model loading architecture. Each LLM operates as an independent process and communicates via ipc_channel
Stars
102
Forks
10
Watchers
102
Open Issues
0
Overall repository health assessment
^2.3.0^3.4.347
commits
Implemented user login and the function of deleting conversations.
2c7f502View on GitHubFixed the issue that messages cannot be sent normally after executing /load and /unload commands
43f10c3View on GitHub