Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using ipex-llm

Intel 185H Kubernetes with SR-IOV GPU Passthrough to cluster w/ various projects. Now with working Intel SR-IOV to KubeVirt!

IPEX-LLM是一个PyTorch库，用于在英特尔CPU和GPU（例如，带有集成GPU的本地PC、像Arc、Flex和Max这样的独立GPU）上以非常低的延迟运行LLM。

Docker image providing fastchat (webui and api) for Intel Arc GPUs

Ollama with Intel iGPU acceleration via IPEX-LLM — Docker container for Unraid

No description available

including ollama, vllm, xft, ipex-llm, tensorrt-llm

智博AI - 基于Intel IPEX-LLM 的博物馆智能体/敦煌博物馆问答多模态智能体

No description available

实现Qwen2-1.5B和简单RAG（langchain）的ipex_llm、openvino推理加速以及性能对比

openedai-whisper-openvino

This project provides an OpenAI-compatible API wrapper for local inference using llama-gemma3-cli.exe, enabling smooth integration with Open WebUI to interact with Gemma 3 models such as Gemma 3 27B.

Align LLMs with human preferences using DPO on Intel GPUs with IPEX-LLM 4-bit quantization and LoRA adapters

Run Qwen2.5-Omni-7B with ipex-llm on Intel platform

Home Assistant Add-on: Ollama Portable on Intel GPU with IPEX-LLM

Collection of AI Containers - Prebuilt and Ready-to-Use

IPEX-LLM on Modelscope

No description available

No description available

No description available

No description available

some multimodal llm examples accelerated with ipex-llm backend

Study: LLM setup for the intelanalytics IPEX library to use the Intel Arc GPU for LLM

run moonlight-16B-A3B-instruct by intel ipex-llm-transformers python

No description available

No description available

Intel's patched Ollama for Ipex-LLM in nix format

No description available

No description available