The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching of inference workloads.
Stars
160
Forks
13
Watchers
160
Open Issues
1
Overall repository health assessment
No package.json found
This might not be a Node.js project