Official Pytorch implementation of "DBS: Dynamic Batch Size for Distributed Deep Neural Network Training"
Stars
23
Forks
4
Watchers
23
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
replace batchnorm layer to groupnorm layer to maintain parameter consistency between different workers
3c87d03View on GitHubMerge branch 'master' of https://github.com/Soptq/Dynamic_Batch-Size_DistributedDNN
fec61aeView on GitHubimplemented one cycle policy, weighted ssgd and statistic data outputing
7e0db07View on GitHub