AI-powered web scraping CLI. Describe what you want, get a production-ready Scrapy spider. Write once, reuse forever.
Stars
103
Forks
10
Watchers
103
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
188
commits
Add curl_cffi TLS impersonation handler and S3 stats to crawl-stats.sh
15eb8c9View on GitHubAdd proxy escalation for browser CF bypass and fix DB/spider bugs
a03f044View on GitHubAdd SITEMAP_SINCE date filtering and fix batch insert duplicate race condition
363fa2aView on GitHubAdd iterate support to callback system for listing-to-detail workflows
90f6621View on GitHub