Found 71,519 repositories(showing 30)
unclecode
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
gocolly
Elegant Scraper and Crawler Framework for Golang
ScrapeGraphAI
Python scraper based on AI
FriendsOfPHP
Goutte, a simple PHP Web Scraper
alirezamika
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
matthewmueller
The next web scraper. See through the <html> noise.
JustAnotherArchivist
A social networking service scraper in Python
drawrowfly
TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.
omkarcloud
The All in One Framework to Build Undefeatable Scrapers
d60
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
rchipka
Web scraper for NodeJS
IonicaBizau
🔮 A Node.js scraper for humans.
ruipgil
A complete and versatile web scraper.
sqzw-x
Movie metadata scraper
speedyapply
Jobs scraper library for LinkedIn, Indeed, Glassdoor, Google, ZipRecruiter & more
harismuneer
🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos, contact information, followers, following and much more.
x0rz
Tweets metadata scraper & activity analyzer
itsOwen
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
oxylabs
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
oxylabs
Easily collect responses from ChatGPT scraper by providing a prompt along with valid Web Scraper API credentials.
facundoolano
Node.js scraper to get data from Google Play
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
oxylabs
Use Google News Scraper API to obtain the latest global news for your project, including a wide range of sources, headlines, URLs, and publication dates from the Google News platform.
omkarcloud
Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API access, and no recurring fees
oxylabs
Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.
spider-rs
Web crawler and scraper for Rust
anaskhan96
Web Scraper in Go, similar to BeautifulSoup
minimaxir
Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis
hhursev
Python package for scraping recipes data
apify
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.