A pure-Python robots.txt parser with support for modern conventions.
Stars
85
Forks
29
Watchers
85
Open Issues
7
Overall repository health assessment
No package.json found
This might not be a Node.js project
58
commits
33
commits
25
commits
18
commits
9
commits
4
commits
2
commits
2
commits
1
commits
1
commits
Drop Python 3.9 and PyPy 3.10, bump tools (#67)
8bc70e6View on GitHubMigrate tests to plain asserts and remove unittest usage.
3ee883bView on GitHubMerge pull request #63 from scrapy/relnotes-0.5.0
13f7ca5View on GitHub