A framework for benchmarking and evaluating locally running LLMs across latency, throughput, and structured output reliability.
Stars
0
Forks
0
Watchers
0
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
9
commits
Complete offline LLM benchmark project: add phase 3 evaluation, results, and final README
522eaddView on GitHubPhase 3: structured generation reliability benchmarking
412b574View on GitHubPhase 2: Structured generation framework with schema validation and retry logic
774978fView on GitHubPhase 1 complete: local LLM benchmarking with CPU vs GPU comparison, documentation, and system design
33386dcView on GitHubAdd project folder structure for benchmarking framework
2518837View on GitHub