LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Stars
7.8k
Forks
680
Watchers
7.8k
Open Issues
587
Overall repository health assessment
No package.json found
This might not be a Node.js project
346
commits
307
commits
190
commits
164
commits
133
commits
100
commits
70
commits
68
commits
40
commits
31
commits
[Fix][Feat] Fix worker sorting with external pg bundles & Support persistent buffer for update_params (#4397)
8067e90View on GitHubAssign sequential api_server ports when proxy_url is unset (#4416)
e486086View on GitHubsplit docker wheel preparation into staged build steps and use python 3.12 as the default version (#4476)
9653304View on GitHub