Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

chatglm 6b finetuning and alpaca finetuning

chatglm_rlhf_finetuning

本项目主要针对ChatGLM、ChatGLM2和ChatGLM3模型进行不同方式的微调（Freeze方法、Lora方法、P-Tuning方法、全量参数等），并对比大模型在不同微调方法上的效果，主要针对信息抽取任务、生成任务、分类任务等。

基于 ChatGLM3-6B 的 LORA-Finetuning

No description available

ChatGLM-6B-finetuning

qlora,finetuning,chatglm3,peft,compare

LLM PEFT finetuning scripts for llama2 and Chatglm

Use various low resource based fine-tuning techniques

Model: ChatGLM-6B-base Dataset: Yelp-full

LLM PEFT finetuning scripts for llama2 and ChatGLM (2,3)

chatglm2 6b finetuning and alpaca finetuning

No description available

No description available

No description available

No description available

新进的ChatGLM微调方案。

A chinese finetuning example code for ChatGLM3 model, offering traing and predict code and basic usage.

LLM PEFT finetuning scripts for llama2 and Chatglm

NLP Course Project: Instruction Finetuning of ChatGLM-6B with LORA from SHIEN-MING WU SCHOOL OF INTELLIGENT ENGINEERING, July 2023