GitHub - hchen98/web-crawling-python: Web Crawling in Python

Web Crawling in Python - Example

A simple, efficient and multi-threads web crawling in Python

So far, this application only crawling of given domain.

Bug: When the domain has ".co.za" then this application will not work.

Note: This is based on thenewboston tutorial

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
.idea		.idea
.gitignore		.gitignore
README.md		README.md
SLD_listing.txt		SLD_listing.txt
domain.py		domain.py
general.py		general.py
link_finder.py		link_finder.py
main.py		main.py
spider.py		spider.py