Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't resolve big domain lists #378

Open
oldDuDe124 opened this issue May 21, 2023 · 4 comments
Open

Can't resolve big domain lists #378

oldDuDe124 opened this issue May 21, 2023 · 4 comments
Labels
Investigation Something to Investigate Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors.

Comments

@oldDuDe124
Copy link

Hi
I'm trying to resolve a wordlist containing roughly 2.2 million domains , i know some domains must be resolved and are valid but when I pass the list to dnsx it just doesn't seem to be resolving them and finishes the scan after 10 seconds.
I've tried using stdin input like:
cat list.txt | dnsx -silent
and also using -l option:
dnsx -l list.txt -silent
but no luck!
I also tried reducing the list to 1k lines and it worked. so I guess the size of the list is the main problem here.

@oldDuDe124 oldDuDe124 added the Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors. label May 21, 2023
@MetzinAround
Copy link

Does anything happen when you use -stats during a run?

@ehsandeep
Copy link
Member

@oldDuDe124 do you see any error that you can share when you run with -v option

@NotoriousRebel
Copy link

NotoriousRebel commented Sep 4, 2023

Same error occurs with tlsx as it does here, when giving it a file with IP ranges. At least 60,000+ IPs in total via a few subnets causes the process to get killed after around 10 seconds of running. Running with -v does not give any errors, but should be easy to replicate as you just need a few subnets in a file. For tlsx: tlsx -c 72 -v -l ip_ranges.txt -ro -san and dnsx: dnsx -t 72 -l ip_ranges.txt -ptr -resp-only May just be caused by too many IP ranges being expanded at once, I notice a huge spike in CPU usage before crashing.

@ehsandeep ehsandeep added the Investigation Something to Investigate label Sep 4, 2023
@hastalamuerte
Copy link

same , no errors but output just for a bit of list . in dnsx , in httpx with asn flag same

dnsx -l URL.txt -asn -v
httpx ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Investigation Something to Investigate Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors.
Projects
None yet
Development

No branches or pull requests

5 participants