Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Learn AI and LLMs from scratch using free resources

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

Implement a reasoning LLM in PyTorch from scratch, step by step

LLMs-from-scratch项目中文翻译

Code and Slides

Demystify RAG by building it from scratch. Local LLMs, no black boxes - real understanding of embeddings, vector search, retrieval, and context-augmented generation.

No description available

An LLM-powered advanced RAG pipeline built from scratch

[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!

From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% attention fidelity.

Train a 1B LLM with 1T tokens from scratch by personal

Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"

A straightforward method for training your LLM, from downloading data to generating text.

从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)

~950 line, minimal, extensible LLM inference engine built from scratch.

Building LLM-Enabled Multi Agent Applications from Scratch

该系列的目的是让读者可以在基础的pytorch上，不依赖任何其他现成的外部库，从零开始理解并实现一个大语言模型的所有组成部分，以及训练微调代码，因此读者仅需python，pytorch和最基础深度学习背景知识即可。

🤖 State-of-the-art, production ready LLM apps made mega-easy, so you don't have to build them from scratch 🤯 Create a bot, now 🫵

Building a GPT-like LLM from scratch with PyTorch.

A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.

一些 LLM 方面的从零复现笔记

Mastering Large Language Models: Build Your Own LLM from Scratch

Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.

My Solution and Notes for the Stanford CS336: LLM from scratch

Build a Large Language Model (From Scratch) book and Finetuned Models

nanoRLHF: from-scratch journey into how LLMs and RLHF really work.

a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model

使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力

🎤💬 Full example of implementing ChatGPT's realtime voice from scratch with VAD + STT + LLM + TTS technology stack within almost one file!