Found 52,390 repositories(showing 30)
unclecode
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
FriendsOfPHP
Goutte, a simple PHP Web Scraper
alirezamika
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
matthewmueller
The next web scraper. See through the <html> noise.
rchipka
Web scraper for NodeJS
ruipgil
A complete and versatile web scraper.
itsOwen
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
oxylabs
Easily collect responses from ChatGPT scraper by providing a prompt along with valid Web Scraper API credentials.
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
spider-rs
Web crawler and scraper for Rust
anaskhan96
Web Scraper in Go, similar to BeautifulSoup
website-scraper
Download website to local directory (including all css, images, js, etc.)
martinsbalodis
Web data extraction tool implemented as chrome extension
felipecsl
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
techwithtim
An automated price tracker that uses bright data, playwright, react and flask.
tholian-network
:rocket: Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
vifreefly
Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.
fredwu
A high performance web crawler / scraper in Elixir.
oxylabs
Use Web Scraper API to extract data from Google Finance, including stock titles, pricing, and price changes in percentages.
austin-weeks
Trap AI web scrapers in an endless poison pit.
DataHenHQ
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
ulixee
The web scraper that's nearly impossible to block - now called @ulixee/hero
cassidoo
A list of scrapers from around the web.
cosmos
The Swiss Army knife to power JavaScript based client solutions ranging from Web apps/explorers over browser extensions to server-side clients like faucets/scrapers.
adamschwartz
Scrape websites for text by CSS selector.
ScrapeGraphAI
🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
noncent
Instagram Data Scraper, Instagram Web Scraper, Instagram Super Scraper is a PHP script which takes @user-name or #keywords as input and returns all information related to user or hash-tags e.g. likes, comments, post count, images, likes on images etc... You can search @account information and #hash-tag simultaneously by using space separated words in search box jQuery is using to build the Awesome View, to handle each and every request separately. I hope you like this small chunk of code All code is well commented to understand the flow and functionality, if I missed something or any improvement/suggestion you have, kindly let me know..
itstyren
:frog: 知网(CNKI)文献下载及文献速览爬虫 (Web Scraper for Extracting Data)
jaebradley
NBA Stats API via Basketball Reference
clemlesne
Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.