tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Stars
17.8k
Forks
1.4k
Watchers
17.8k
Open Issues
98
Overall repository health assessment
No package.json found
This might not be a Node.js project
44
commits
2
commits
2
commits
1
commits
1
commits
1
commits
1
commits
1
commits
1
commits
1
commits