Include content type, less buggy parsing, use urllib

Merge pull request #1 from alegemaate/add-license-1

Create LICENSE

Renamed script

Merge remote-tracking branch 'origin/master'

Update README.md

Added optional debug param

Output json, external links per node

Update README.md

Update README.md

Update README.md

Basic crawler written

Initial commit