🦐 A minimal pretraining trainer for LLMs — from scratch.
Stars
6
Forks
1
Watchers
6
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
134
commits
1
commits
fix: update muon implementation in optimizer and adjust parameter grouping
3fd7ef9View on GitHubfix: correct flash-attn version in project dependencies and update authors format
3aec9d1View on GitHubImplement code changes to enhance functionality and improve performance
5c4ca0eView on GitHubMerge pull request #19 from minpeter/feat/resume-checkpoint-support
ddc378cView on GitHubrefactor: improve error handling in checkpoint validation functions
4167da8View on GitHubMerge branch 'feat/resume-checkpoint-support' of https://github.com/minpeter/krill into feat/resume-checkpoint-support
2334a26View on GitHubrefactor: improve error handling for remote checkpoint validation and retrieval
78852beView on GitHubrefactor: improve comments and error handling in text processing functions
ad7ce10View on GitHubfeat: add comprehensive testing suite for resume functionality, including unit and integration tests
5c6290eView on GitHubrefactor: update resume checkpoint handling to use HF cache method
0c49c17View on GitHubrefactor: replace temporary checkpoint download with HF cache method
6d59f1eView on GitHub