Back to search
TokenLens is a Python‑based web app that helps you visualize how large language models tokenize text right in your browser. Instead of guessing how a prompt is broken up into tokens (which drives cost and behavior in services like OpenAI), TokenLens shows it live with colors and counts.
Stars
1
Forks
0
Watchers
1
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
9
commits
1
commits