Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
Stars
287
Forks
51
Watchers
287
Open Issues
17
Overall repository health assessment
No package.json found
This might not be a Node.js project
39
commits
17
commits
10
commits
9
commits
9
commits
8
commits
6
commits
3
commits
3
commits
3
commits
fix: support vLLM Harmony reasoning field in streaming response parsing (#205)
ef148f2View on GitHub[Feature] Add text-to-image API support for OpenAI user (#141)
5893a41View on GitHubfix(ci): use uv sync and tighten ruff pin to prevent version drift (#196)
2a6c3c9View on GitHub[Core] Update awsbedrock user to report reasoning tokens (#189)
81ccb82View on GitHub[Core] Update together user to report reasoning tokens (#188)
0cd8b46View on GitHub