FareedKhan-dev/train-llm-from-scratch - GitHub Explorer | GitHub Explorer | Trending

Stars

548

Forks

109

Watchers

548

Open Issues

4

Repository Health Score

💛

72/100

Good

Overall repository health assessment

Score Breakdown

Activity

Active development - updated this week

30/30

100%

Recent Commits

Merge pull request #9 from konglingfan/main

Fareed Khan•8 months ago

15fe516View on GitHub

Update generate_text.py to use config[]

lingfank•8 months ago

0fbf878View on GitHub

Simple SFT RLHF Guide

Fareed Khan•10 months ago

163ba68View on GitHub

Merge pull request #6 from its-not-rocket-science/main

Fareed Khan•12 months ago

f7e9aeeView on GitHub

Update README.md

Schleiferdyne Systems•12 months ago

9cdfe80View on GitHub

Update attention.py

TianyiQ•1 year ago

9acf1f3View on GitHub

Merge pull request #4 from FareedKhan-dev/revert-3-main

Fareed Khan•1 year ago

99358bdView on GitHub

Revert "Fix attention scaling factor"

Fareed Khan•1 year ago

8e1fbb7View on GitHub

Merge pull request #3 from TianyiQ/main

Fareed Khan•1 year ago

e90143bView on GitHub

chore: reduce model depth

Tianyi (Alex) Qiu•1 year ago

55949c9View on GitHub

chore: restore original model size

Tianyi (Alex) Qiu•1 year ago

0ee6461View on GitHub

fix: moving tensors to cuda in evaluation

Tianyi (Alex) Qiu•1 year ago

5b22ab7View on GitHub

fix: robustly moving model to cuda

Tianyi (Alex) Qiu•1 year ago

c546347View on GitHub

chore: add eval progress bar

Tianyi (Alex) Qiu•1 year ago

f59754bView on GitHub

fix: ensure entire model is on same device

Tianyi (Alex) Qiu•1 year ago

a4e2f60View on GitHub

View all commits

GitHub Explorer

train-llm-from-scratch

Score Breakdown

Issues Activity: Last 6 months

Hottest Issues