D-Adaptation for SGD, Adam and AdaGrad
Stars
531
Forks
23
Watchers
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
User
34
commits
3
1
FSDP all-reduce fix (#43)
c984980
Support layer-wise scaling (#40)
64bf300
change default according to doc string (#39)
c7f81ef
Added citation box
2e32676
Readme
b9ff472
doc and print fixes (#34)
665dab0
Fix for dhat (#32)
b9a2457
Added badges and missing headers
e001828
Fixed eps docs
ad62f55
Removed PDF
ccd668e
Read Me fix
d6c8a38
V3 (#23)
514df73
Remove betas from DAdaptSGD documentation (#28)
13ec38e
SGD default momentum is 0 (#27)
5c0b350
No momentum for DAdaptAdam (#26)
b0f7393