Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.

Examples of web scrapers in Ruby, Python and Perl

Samples of Web Scraper using Mechanize, Delayed Job, Parallel, Mongo, etc.

A web application built on Ruby on Rails as a clone of Change.org, a petition site. Integrates with several APIs as well as two custom built web-scrapers in Ruby to fetch photos of legislators, and to get their descriptions from Wikipedia.org and persist them to the database.

Library for custom ruby on rails web scrapers

Extremely simple scriptable Ruby web browser for use with crawlers/scrapers/automators.

No description available

Simple Web scrapers made with Ruby

Ruby library providing DSL for describing custom Web scrapers

Web scraper framework and media scrapers written in Ruby.

A collection of small ruby projects, like web scrapers, password strength checkers, etc.

dirty little python and ruby web scrapers rescued from the old days of scraperwiki

A practical starter project for web scraping with ruby using Nokogiri, HTTParty, and Selenium. Includes modular structure, error handling, logging, and sample scrapers.