Found 23 repositories(showing 23)
Tiiny-AI
High-speed Large Language Model Serving for Local Deployment
SJTU-IPADS
Bamboo-7B Large Language Model
hodlen
Gradio demo server for PowerInfer
AIAnytime
PowerInfer Colab Demo
haozixu
experiments based on powerinfer
seanslab-org
Fork of Tiiny-AI/PowerInfer — studying libaz + MoE sparse pipeline for Jetson Orin + Houmo M50 heterogeneous inference
cecil-the-coder
PowerInfer with ROCm for AMD Strix Halo & Strix Point APUs (gfx1151/gfx1150)
aaaDrown
No description available
YuMJie
No description available
AliceRayLu
A fast and easy powerinfer deployment tool.
Indie365
No description available
NeverComeBackHBG
No description available
AliceRayLu
No description available
rickylin1
No description available
xuan301
No description available
PowerInfer
No description available
wfloveiu
基于IPADS的PowerInfer，进行一些测试与修改
AliceRayLu
No description available
Pradeep-Vanapalli
No description available
SmartEst74
Neuron-level sparse LLM inference engine in pure Rust
AsVoider
No description available
amadeobonde
NVMe-PowerInfer: SSD-accelerated LLM inference engine for Jetson Orin Nano
swesmith
No description available
All 23 repositories loaded