Building my first GPT model.
Stars
0
Forks
Watchers
Open Issues
Overall repository health assessment
No package.json found
This might not be a Node.js project
User
35
commits
updated causal mask
48d65b2
saving fine tunned model
44fd626
Added W&B for the model
9edf0d8
adding some mode info
487310e
fixing main model
75f3322
type
3da12d7
added training to fine-tuning
8fe1e31
Added fine-tuning notebook
08786e1
adding training
f42ca6a
added requirements
6efb39f
added config to get a batch
ca31f70
adding larger gpt models
df4ec60
adding pretraining..
c0da8d4
changing names to align with GPT-2 at HuggingFace
161a0cd
initalization of weights
63b3840