SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.
Stars
255
Forks
19
Watchers
255
Open Issues
7
Overall repository health assessment
No package.json found
This might not be a Node.js project
54
commits
2
commits
1
commits
1
commits
1
commits
1
commits
1
commits
[duplicate] Support for o200k_base and gpt-4o (omni) model (#43)
27eef74View on GitHubPr 33 (Feature/performance: This PR introduces a high number of performance improvements) (#36)
086544dView on GitHubAdded test to run all encoding/decoding subtests at once in parallel to prove threadsafety (#31)
1cae79cView on GitHub