Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Stars
2.0k
Forks
180
Watchers
2.0k
Open Issues
22
Overall repository health assessment
^0.5.6^1.3.3^3.1.2^5.6.2^1.0.2^8.0.0^7.0.6^7.5.0^6.0.0^11.3.4^7.0.4^3.9.5^2.1.0^3.1.1^7.0.1^5.1.6^8.6.0^9.3.0^9.3.0^4.1.2^7.7.1^3.33.0^8.0.0^4.0.1^7.2.0^7.0.2^6.0.1^17.7.2^20.4.1^20.4.1^2.0.2^5.2.8^2.18.2^2.18.2^2.6.2^7.1.0^12.0.6^13.1.5^3.22.0^5.8.0^1.4.9^3.1.5^6.0.6^11.0.4^20.19.33^4.1.4^7.7.1^4.0.2^3.0.4^17.0.33^4.1.0^4.1.0^40.4.1^9.39.2^4.4.4^2.32.0^62.5.5^17.24.0^5.2.0^9.1.7^13.0.2^6.1.3^25.0.3^0.34.5^2.8.1^0.28.17^4.10.0^5.1.1^1.1.2^5.9.3^8.56.0^6.0.0^1.6.4^1.11.0^4.1.0^8.8.5>=5.0.0229
commits
7
commits
1
commits
1
commits
1
commits
1
commits
1
commits
1
commits
1
commits
1
commits
fix(`resolveModelFile`): deduplicate concurrent downloads (#570)
cc105b9View on GitHubfix: correct Vulkan URL casing in documentation links (#568)
5a44506View on GitHub