AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Stars
2.8k
Forks
289
Watchers
2.8k
Open Issues
6
Overall repository health assessment
^1.12.2^0.0.1^1.3.6^2.9.19^5.47.0^3.5.3^4.19.4^2.4.45.8.2✨ feat: enhance template handling in ScheduledTasksController and Scheduler
0a80560View on GitHub✨ feat: enhance search functionality with template support and credit model updates
d338436View on GitHub✨ feat: add Chinese and Traditional Chinese documentation for AnyCrawl
2122083View on GitHub✨ test: update default engine in AnyCrawlClient tests from "playwright" to "auto"
ff502a3View on GitHub✨ feat: introduce "auto" engine option for dynamic scraping and crawling
4a6fe4eView on GitHub✨ feat: enhance screenshot handling and resource blocking in EngineConfigurator and ScreenshotTransformer
b38d4a7View on GitHub