Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
Stars
53
Forks
8
Watchers
53
Open Issues
17
Overall repository health assessment
No package.json found
This might not be a Node.js project
Merge pull request #114 from tensorops/encoder_block_example
2fea0acView on GitHubrefactor: removed unnecessary sequence package under the masks and moved the padding and lookahead masks to their respective files under the main masks package.
f540920View on GitHubtest: comment out the dilated attention tests as they are not implemented yet.
4aea16bView on GitHubtest: the PaddingMask works and supports scores and padding_mask as intput
af1c0c2View on GitHubtest: Lookahead works fine and its test case is correct
3c45b71View on GitHubrefactor: remove obsolete masking system in the dot_product_attention.py
c9f0d7cView on GitHub