Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

No description available

No description available

n8n custom node to crawl and scrape website with crawlee

Web Recon & Exploitation Tool.

Production-ready web scraping in a single function call. Built on Crawlee.

TS-email-scraper is a data extraction software that is designed to scrape email addresses from websites. It is coded in JavaScript using the Crawlee library and runs on the Node.js platform. The software can scrape email addresses by using either google search keywords or individual domain URLs.

Intelligent web scraping Claude Code skill with automatic strategy selection and TypeScript-first Apify Actor development

Crawlee dev repo

This is the ultimate web scraping tool for extracting the most relevant data points from products on Walmart.com! this powerful scraper is built on top of the Crawlee library and is written in TypeScript, making it a fast and reliable tool.

one stack for all needs

Self-hosted, open-source platform for running Apify Actors. Drop-in compatible with the Apify SDK.

Apify actor extracting data from Zalando

Advanced and experimental functionality for Apify Actors and Crawlee. Use with caution!

This template is a production ready boilerplate for developing with `PlaywrightCrawler`. Use this to bootstrap your projects using the most up-to-date code.

Crawl and analyse your website for errors and issues that affect your site's SEO inside a self contained MCP - interact in your AI assistant or in terminal for later AI SEO analysis in chat.

This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.

This web scraper is intended to extract data from The Home Depot Website, it could be run locally or in the Apify platform, the latter is the preferred way. It was made using Apify SDK V3 (Crawlee) with Typescript.

:spider_web: Awesome scenario based crawler

No description available

An example repository showcasing how you can scrape in parallel using one request queue

No description available

Crawl public notes and images at the speed of light

Proxy Port provider for Crawlee

crawlee 中文文档

let's build containerized crawlee - work repository for test.

Monorepo for What's New Games Crawlee Actors

🌲 use Pino to log within Crawlee

基于 Crawlee 的低代码爬虫平台