Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda
Stars
11
Forks
0
Watchers
Open Issues
Overall repository health assessment
^9.3.1
^4.52.2
User
52
commits
Use no warmup
7af2398
Note about warmup issues
a723d49
Update README.
63f2a5b
Revert "Revert "Revert "AWS Lambda Provided Image"""
c7bc80a
Revert "Revert "AWS Lambda Provided Image""
736663c
Revert "AWS Lambda Provided Image"
943f541
AWS Lambda Provided Image
6dc6750
More in/out for bench.
6a3e470
Finish testing all server options.
2276706
Notes for Harold.
47aeb9f
Move back to llamafile for Gemma2.
c4e2b52
Try Gemma2 with gguf file & patched llamafile.
e04b543
Gemma2 Working Well
e3fa136
Notes Update
3c0e5e9
Fast Gemma2 Running.
55bf5f6