An implementation of masked language modeling for Pytorch, made as concise and simple as possible
Stars
181
Forks
24
Watchers
181
Open Issues
3
Overall repository health assessment
No package.json found
This might not be a Node.js project
14
commits
1
commits
fix random token prob to be correct by removing from the mask those tokens that were already randomly replaced
9cc4c00View on GitHubdefault the probability of token staying the same to 10% as in paper
34a50f8View on GitHub