GitHub Explorer

by Alexey Ratnikov

GitHub Explorer

GitHub Explorer|TRENDING COMPARE|FEEDBACK

Back to search

Copyright (c) 2026 Alexey Ratnikov

apify/crawlee - GitHub Explorer | GitHub Explorer | Trending | Compare

crawlee

apify•PUBLIC

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

apifyautomationcrawlercrawlingheadlessheadless-chrome

Apache License 2.0

Created on Aug 26, 2016

Updated on Apr 3, 2026

Stars

22.6k

Forks

1.3k

Watchers

22.6k

Open Issues

174

Repository Health Score

💚

98/100

Excellent

Overall repository health assessment

Score Breakdown

Activity

Active development - updated this week

30/30

100%

javascript

nodejs

npm

playwright

puppeteer

scraper

scraping

typescript

web-crawler

web-crawling

web-scraping

Community

22,639 stars, 1,300 forks

28/30

93%

Documentation

Has description, wiki, license

20/20

100%

Maintenance

0.8% issue ratio

20/20

100%

Health score is calculated based on activity, community engagement, documentation quality, and maintenance practices

Languages

TypeScript

59.5%

MDX

31.3%

JavaScript

7.1%

CSS

1.2%

Dockerfile

0.9%

Python

0.0%

HTML

0.0%

Issues Analytics

16

Total Issues

All time

5

Open

31% of total

11

Closed

Dependencies59 total

0

Production

59

Development

Development Dependencies (59)

@apify/eslint-config^1.0.0

@apify/log^2.4.0

@apify/tsconfig^0.1.0

@biomejs/biome^2.3.11

@commitlint/config-conventional^20.0.0

@playwright/browser-chromium1.58.1

@playwright/browser-firefox1.58.1

@playwright/browser-webkit1.58.1

@stylistic/eslint-plugin^5.0.0

@types/content-type^1.1.5

@types/deep-equal^1.0.1

@types/domhandler^2.4.2

@types/express^5.0.0

@types/fs-extra^11.0.0

@types/inquirer^8.2.1

@types/is-ci^3.0.1

@types/lodash.isequal^4.5.8

@types/lodash.merge^4.6.7

@types/mime-types^2.1.1

@types/node^24.0.0

@types/proper-lockfile^4.1.2

@types/ps-tree^1.1.2

@types/rimraf^4.0.0

@types/sax^1.0.0

@types/semver^7.3.12

@types/stream-json^1.7.2

@types/yargs^17.0.26

@vitest/coverage-v8^4.0.16

apify*

apify-node-curl-impersonate^1.0.15

basic-auth-parser^0.0.2

body-parser^2.0.0

camoufox-js^0.9.3

commitlint^20.0.0

cross-env^10.0.0

deep-equal^2.0.5

eslint^9.23.0

eslint-config-prettier^10.1.1

express^4.18.1

fs-extra^11.0.0

gen-esm-wrapper^1.1.3

globals^17.0.0

globby^15.0.0

got^13.0.0

husky^9.0.11

is-ci^4.0.0

lerna^9.0.0

lint-staged^16.0.0

nock^13.4.0

playwright1.58.1

portastic^1.0.1

proxy^1.0.2

puppeteer24.36.1

rimraf^6.0.0

tsx^4.4.0

turbo^2.1.0

typescript^6.0.0

typescript-eslint^8.28.0

vitest^4.0.16

@crawlee/root

69% of total

1w

Avg Close Time

Avg response

Issues Activity: Last 6 months

Top Labels

Hottest Issues

1

#3459 Resolve last direct apify/log calls

t-tooling

13

closed

2

#3450 SiteMap.load or Sitemap.tryCommonNames fails to return urls with Node 25

bugt-tooling

3

3

#3532 Versioned docs: links for versions 1.3 and 2.2 point to JS SDK

bugdocumentationt-tooling

4

#3479 RequestQueue marks requests as handled without firing requestHandler under high concurrency/load

bug

2

closed

5

#3456 v4: add `AbortSignal` option to the `BaseHttpClient` interface

t-tooling

1

1

closed

1

closed

2

closed

Top Contributors

1

mnmkng

User

1.1k

commits

2

renovate[bot]

Bot

863

commits

3

jancurn

User

711

commits

4

B4nan

User

603

commits

5

mtrunkat

User

444

commits

6

petrpatek

User

242

commits

7

barjin

User

175

commits

8

vladfrangu

User

107

commits

9

janbuchar

User

60

commits

10

szmarczak

User

47

commits

Recent Commits

feat: Modularize SystemStatus to allow custom backpressure mechanisms (#3529)

Jan Buchar•1 day ago

7159a13View on GitHub

ci: use standalone apify-cli binary in E2E tests (#3543)

Martin Adámek•2 days ago

be6dbc4View on GitHub

docs: port docs fixes from apify-docs (#3544)

Martin Adámek•3 days ago

863dbcaView on GitHub

docs: serve markdown via Accept header in nginx (#3542)

Martin Adámek•3 days ago

9586a6aView on GitHub

chore(deps): bump handlebars from 4.7.8 to 4.7.9 (#3539)

dependabot[bot]•4 days ago

a2d34a4View on GitHub

chore(deps): update dependency typescript to v6 (#3516)

renovate[bot]•5 days ago

1d48644View on GitHub

chore(deps): bump brace-expansion from 1.1.12 to 1.1.13 in /website/versioned_docs/version-3.16 (#3536)

dependabot[bot]•6 days ago

c7c8d30View on GitHub

chore(deps): bump path-to-regexp from 0.1.12 to 0.1.13 in /website (#3537)

dependabot[bot]•6 days ago

6d30b47View on GitHub

chore(deps): update dependency impit to ^0.13.0 (#3534)

renovate[bot]•6 days ago

516908aView on GitHub

chore(deps): update actions/configure-pages action to v6 (#3535)

renovate[bot]•6 days ago

5637fd2View on GitHub

feat: add abortDownload context helper to FileDownload (#3528)

nikitachapovskii-dev•6 days ago

3b3d8f6View on GitHub

fix(e2e): resolve flaky Camoufox tests due to GitHub rate limits (#3527)

Jindřich Bär•1 week ago

08c98cfView on GitHub

fix: Correctly track the number of requests handled by a crawler (#3410)

Jan Buchar•1 week ago

b2296ceView on GitHub

chore(deps): bump yaml from 2.8.2 to 2.8.3 in /website (#3522)

dependabot[bot]•1 week ago

abece11View on GitHub

chore(deps): update actions/deploy-pages action to v5 (#3523)

renovate[bot]•1 week ago

364bf03View on GitHub

View all commits