aws-samples/llm-evaluation-methodology - GitHub Explorer | GitHub Explorer | Trending

Stars

47

Forks

8

Watchers

47

Open Issues

3

Repository Health Score

❤️

35/100

Poor

Overall repository health assessment

Score Breakdown

Activity

Slow updates - updated within 3 months

10/30

33%

Recent Commits

feat(data): Update nb for separate SM+BR manifest

Alex Thewsey•1 year ago

8bdb132View on GitHub

feat(data): Human eval manifest for Bedrock

Alex Thewsey•1 year ago

b7a7eb2View on GitHub

feat(infra): Create Bedrock role for eval jobs

Alex Thewsey•1 year ago

68b15a7View on GitHub

Merge #7 Upgrade Llama 3->3.1

Alex Thewsey•1 year ago

5d90c95View on GitHub

chore: Upgrade Llama to v3.1

Alex Thewsey•1 year ago

0b2b00bView on GitHub

feat(infra): Add descriptions to CFn stacks

Alex Thewsey•1 year ago

bbad588View on GitHub

Merge #6 Notebook for LLMeter and FMBench

Alex Thewsey•1 year ago

ad8e2c8View on GitHub

feat: Upgrade LLMeter, error note, reduce outlens

Alex Thewsey•1 year ago

757e8c5View on GitHub

doc(nbs): Add note on perf resource saturation

Alex Thewsey•1 year ago

8d708ceView on GitHub

feat(nbs): Add notebook for LLMeter+FMBench

Alex Thewsey•1 year ago

ac04b15View on GitHub

fix(perf): Ignore missing FMBench configs

Alex Thewsey•1 year ago

d2404b2View on GitHub

Merge #4 dependabot streamlit->1.37.0

Alex Thewsey•1 year ago

d2d94bfView on GitHub

build(deps): Bump streamlit in /infra/prompt_app/src

dependabot[bot]•1 year ago

c65f1d5View on GitHub

doc(readme): Add link to workshop

Alex Thewsey•1 year ago

03eaf89View on GitHub

Merge #5 Latency/performance testing with FMBench

Alex Thewsey•1 year ago

ebff996View on GitHub

View all commits

GitHub Explorer

llm-evaluation-methodology

Score Breakdown

Issues Activity: Last 6 months

Hottest Issues