Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proxy List Exception #10

Open
ReemOmer opened this issue Feb 23, 2023 · 1 comment
Open

Proxy List Exception #10

ReemOmer opened this issue Feb 23, 2023 · 1 comment

Comments

@ReemOmer
Copy link

Hi, thanks for sharing this great project. While I am trying to test it using Tor browser configuration, and setting:
USE_PROXY = False in crawler.py file. I keep getting the following error:

raise ProxyListException("list is empty") http_request_randomizer.requests.errors.ProxyListException.ProxyListException: list is empty
in the requestProxy.py file. Anything that probably went wrong?
Also, is there any tutorial that covers the configuration when using Tor as a browser to collect data?

Thanks

@18520339
Copy link
Owner

18520339 commented Apr 2, 2023

Hi, sorry for the late replying. You can solve it according to this link and tell me if it works.
About the tutorial, I cant find any as you mentioned, so I just did lots of research by myself to implement these scripts.
Btw, you can try the first method, I think it's the easiest way to extract data now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants