Merge pull request #482 from Zhubaoheng/develop_max_2024_dec_2

Feat: Add version information and update README.md

Feat: Refactored the logic for compatibility with older versions, supporting more legacy parameters.

Fix: exports typo

Feat: Add comments to code.

Feat: Add support for legacy code written using crawler v1

Merge pull request #480 from Zhubaoheng/develop_max_2024_dec_2

feat: add test for binary data stream.

Merge pull request #477 from bda-research/beta

promote on test and types

update test

update dependencies & types

change defaults

Merge pull request #476 from bda-research/beta

update changes