Distributed model and API infrastructure for PyTorch and Hugging Face.
Stars
10
Forks
1
Watchers
10
Open Issues
17
Overall repository health assessment
No package.json found
This might not be a Node.js project
Merge pull request #106 from tensorlink-lab/testnet-v2
75cd5c4View on GitHubIncreased connection.py parameters for faster P2P comms.
9417dc8View on GitHubSwitched custom serialization to safetensors save. Fixed key error in /models api endpoint.
f63d9e2View on GitHubAdded hidden buffer loading for worker and host modules.
f6ab8feView on GitHubImproved tied module identification and loading on host.
ea233afView on GitHubAPI Request lifetime management and some refactoring to active model endpoint
9f45a27View on GitHubMerge pull request #104 from tensorlink-lab/mattjhawken-patch-1
4589081View on GitHubImproved layer module loading fallbacks for mismatched keys.
f750d44View on GitHubAdded layer group fallbacks for mismatched keys during weight loading.
230af42View on GitHubAdded ram fallback when no cuda for worker memory. Fixed tied weight module loading by forcing host to tied weights.
bcca9bbView on GitHubFixed memory estimation bug in worker. Modularized model skeleton loading for use in graphing, worker, and module. Fixed llama model path resolution.
9ae4d23View on GitHub