Add curl_cffi to requirements.txt

Format curl_cffi_handler.py with black

Add curl_cffi TLS impersonation handler and S3 stats to crawl-stats.sh

Enforce queue completion verification and improve CF detection

Add proxy escalation for browser CF bypass and fix DB/spider bugs

Add SITEMAP_SINCE date filtering and fix batch insert duplicate race condition

Switch license from AGPL-3.0 to Apache-2.0

Revert "Switch license from AGPL-3.0 to Apache-2.0"

Switch license from AGPL-3.0 to Apache-2.0

Add Contributor License Agreement for dual-licensing

Auto-wrap inspect --browser with xvfb-run on headless servers

Include iterate listing_data fields in show and export output

Document iterate feature in callbacks guide

Improve spider name mismatch validation to use source_url

Add iterate support to callback system for listing-to-detail workflows