🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

Turn any webpage into structured data using LLMs

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Easily collect responses from ChatGPT scraper by providing a prompt along with valid Web Scraper API credentials.

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.

Perplexity Scraper Track brand mentions, analyze rankings, and gain competitor intelligence from Perplexity. Get started in minutes.

Transform Web Content into LLM-Ready Data

Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.

Use LLMs to robustly extract web data

A list of useful Open Source tools and scrapers to gather data for LLMs

AI tool for automating Upwork job applications using AI agents to find and qualify jobs, write personalized cover letters, and prepare for interviews based on your skills and experience.

Web scraping AI that leverages the crawl4ai library to extract structured data from web pages using various large language models (LLMs).

No description available

Demo of a LLM Scraper with Nuxt & Cloudflare AI & Browser rendering to return structured output.

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio JS SDK for intelligent web data gathering.

Extract structured data from any unstructured web page

Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.

Web Scraper and Crawler for LLM Apps and AI Workflows with NoCode / LowCode. Plug and play with your own logic and customize it flexibly and scalably on BuildShip.

⚡️ Real-time Knowledge Graph for AI Agents. Connect LLMs to verified weather, stock, and currency data via instant tool-calling. No API keys, no scrapers, just grounded facts in <100ms.

[IEEE S&P'26] WebCloak: Characterizing and Mitigating the Threats of LLM-Driven Web Agents as Intelligent Scrapers

🕵️‍♂️ Privacy-focused AI job scraper, local storage, and interactive dashboard. Auto-scrapes AI/ML roles from top companies using ScrapeGraph-AI + LLM and LangGraph Agents, filters for relevance, and provides a Streamlit UI for tracking applications. Built for developers seeking AI careers.

Scrape the twitter and chat with tweets!

Archiving and transforming official Italian General Election text-only polls into machine readable data using Large Language Models

A collection of intelligent AI agents built using Ollama, LangChain, and local LLMs — including chatbots, voice assistants, web scrapers, document readers, and custom tools. No APIs required. Fully offline.

pocketbase LLM docs scraper

Apple app store reviews and ratings scraper. Use LLM, unmaintained.

Modern web scraper with LLM-enhanced extraction, extensible pipeline, and pluggable parsers.

absolute dog shit, but it exists

markdown LLM web scraper on cloudflare workers

A Python tool that scrapes chat content from **live share URLs** of **ChatGPT, Claude, and Grok**.