Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
Stars
7.9k
Forks
976
Watchers
7.9k
Open Issues
36
Overall repository health assessment
No package.json found
This might not be a Node.js project
554
commits
529
commits
139
commits
86
commits
53
commits
48
commits
25
commits
13
commits
8
commits
5
commits
feat: add tutorial for LFM2-24B-A2B-Preview-GGUF model and include related assets (#1049)
3dbb97fView on GitHubfeat(runner): enhance update command for Linux global installation support (#1043)
14c76a8View on GitHubMerge pull request #1040 from NexaAI/fix/mengsheng/win-redeclaration-warning
5e7f280View on GitHubfix: warnning dll-attribute-on-redeclaration on windows
aaa64d9View on GitHubMerge pull request #1037 from NexaAI/pr/kashyapkale/1033-1
1376a0eView on GitHub