Merge pull request #30 from any4ai/dev

📝 docs(README): update README.md

✨ docs(README): update project overview and usage examples; enhance clarity and structure; add LLM extraction section and improve parameter descriptions.

✨ feat(scrape, api): enhance credit deduction logic for structured extraction; add support for JSON extraction credits in ScrapeController and ProgressManager; update .env.example with new configuration variable.

Merge pull request #29 from any4ai/dev

🐞 fix\(scrape): add getEngine method to BaseEngine.

✨ refactor(scrape): reorganize exports in index.ts for clarity; update engine factory to use type-only imports and improve dynamic loading of engine implementations.

Merge pull request #27 from any4ai/dev

✨ fix(Dockerfile.puppeteer): correct path for libs package.json copy in Dockerfile.

✨ chore(dependencies): update pnpm-lock.yaml.

✨ chore(db, scrape): add @types/node dependency to db package; update Dockerfiles to include db and ai packages in build process.

✨ chore: update changelog for v0.0.1-beta.1。

✨ chore(docs): reorganize meta.json to include 'docker' and 'proxy-rule' under 'Self Host' section; add note about default proxy quality in scrape.mdx for clarity.

✨ feat(api, docs): update OpenAPI documentation to include new crawl endpoints; enhance JSON schema definitions for better clarity; add support for new scraping formats and constants; refactor schema imports for improved organization.

✨ feat(api,scrape): implement job results retrieval in CrawlController; enhance job cancellation logic to prevent cancelling finished jobs; update routes for better clarity; add jobId to request context for credit deduction tracking; update credit deduction for crawl.