Found 41 repositories(showing 30)
DeutscheKI
These are performance benchmarks we did to prepare for our own privacy-preserving and NDA-compliant in-house AI coding assistant. If by any chance, you're a German KMU, and you want strong in-house AI, too, feel free to contact us.
RuleEarth336123
infra-perf-bench is an open-source benchmarking tool focused on performance testing of inference frameworks for large language models (LLMs). It aims to evaluate the performance of different inference frameworks.
tohnee
Any LLM Perf Test
HanqingAWS
LLM- PerformanceTest
lnxtree
No description available
AnaTodorov86
Performance and quality testing framework for LLM APIs
qingxi
A lightweight tool to benchmark latency and token throughput for OpenAI/Azure-compatible LLM chat completions. It collects per-request metrics, aggregates statistics, and can export Markdown summaries.
DifficultA
This repository contains the source code for testing large models on given datasets, developed by the Network Information Center of Shanghai Jiao Tong University. The testing script is based on the official dataset code from GitHub, with modifications made only to the model to adapt it to the new large model architecture.
Kasi-Vishwanathan
sdfff
ghzatomic
No description available
TechNavii
No description available
charleybin
a performance test tool.
lephuhai
No description available
HyungJiny
vLLM으로 배포한 Local LLM의 성능을 쉽게 측정하기 위해 Antigravity를 이용해서 간단한 툴을 만들어봤습니다.
arunk2493
No description available
JerryCa0
llm performance test tools
Efesasa0
exploring some popular llm models and their speeds with ollama
GroupLabs
No description available
duck3244
local llm performance testing
puritysb
[Archived] LLM Performance Benchmark for Mac Studio (mlx-omni-server, Ollama)
AyushVaish
No description available
harsh-a-parihar
Test and find the best LLM modes or agents for your specific workflow.
davivc
This goal is to test and compare the main llm providers available there about latency and cost.
xiehust
No description available
wuhaowen0714
No description available
MalikZu
No description available
fra-itc
TRAPDOOR ELEVATOR LOGIC TEST
sara4dev
Test various inference engines & hardwares for LLM inference
CyrusTC
No description available
一个同时支持云端DeepSeek API和本地Ollama部署模型的性能与成本测试平台，通过JMeter压测+Jenkins CI，实现响应时间、TPS、Token消耗、预算控制的全自动化测试