Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added function to scrape domains on https://temp-mail.org #165

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

techux
Copy link

@techux techux commented Mar 23, 2024

https://temp-mail.org/ changes their domains regularly and already mentioned endpoints get only old domains but not the new ones.
To get new domains, I scrape the website directly and the function returns the latest 7 to 10 domains listed on https://temp-mail.org/ website.

ps : I checked and find that many of the temp-mail.org domains are not listed as disposable and I am able to use it as legit.
Thanks

@techux techux changed the title Added https://temp-mail.org/ domains by scraping Added function to scrape domains on https://temp-mail.org Mar 23, 2024
@smeinecke
Copy link
Collaborator

hi! Thank you for your contribution. I just took a look at your code, seems to be fine, but it requires an external proxy service. I am not sure if that is a valid "solution" as the linked account would be probably abused for other stuff if its published, right?

@techux
Copy link
Author

techux commented Mar 24, 2024

hi! Thank you for your contribution. I just took a look at your code, seems to be fine, but it requires an external proxy service. I am not sure if that is a valid "solution" as the linked account would be probably abused for other stuff if its published, right?

hello there,
Actually, the proxy account used here is free tier account offered by webshare.io. Those proxy IPs are shared.
Without proxy rotation, I will manage to get only 5 to 6 domains listed on website. But with proxy, its something between 6 to 8, depending upon the available domains.
So, i modify the code and remove proxies from it.

Thank you for your feedback .

@smeinecke
Copy link
Collaborator

I'll add a config file for the proxies so it can be configured if more/other proxies should be used.

If its okay for your I would like to use the 2 "trial accounts" you've already added to generate our static list on https://github.com/disposable/disposable-email-domains

@techux
Copy link
Author

techux commented Mar 26, 2024

I'll add a config file for the proxies so it can be configured if more/other proxies should be used.

If its okay for your I would like to use the 2 "trial accounts" you've already added to generate our static list on https://github.com/disposable/disposable-email-domains

Yes, Of course. I am okay with that. You may use those Accounts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants