EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
Stars
51
Forks
4
Watchers
51
Open Issues
8
Overall repository health assessment
No package.json found
This might not be a Node.js project
[BUG] Fix pydantic bug which causes the PyInstaller Binary to fail to run (#44)
d695bcaView on GitHub[FEAT] [DML] Update the `requirements-directml.txt` to the latest version (#42)
0abb889View on GitHubMove `ov_phi3_vision.py` from engine folder to mutlimodal_models/openvino
3ad496dView on GitHubAdd try-catch block in openvino_genine to handle non phi3vision model pass to OvPhi3Vision
ee5d5e9View on GitHub[BUG FIXED] Update gradio version in requirements-webui.txt
5504f88View on GitHubchange max_new_tokens to max_tokens so to follow the webui token adjustment
7fe7f74View on GitHub