Found 2 repositories(showing 2)
EmbeddedLLM
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
Faris-Faiz
added EmbeddedLLM integration
All 2 repositories loaded