Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Stars
2.9k
Forks
222
Watchers
2.9k
Open Issues
46
Overall repository health assessment
No package.json found
This might not be a Node.js project
383
commits
5
commits
2
commits
2
commits
2
commits
1
commits
1
commits
1
commits
1
commits
1
commits