Performance discrepancy: dnsx as library lag compared to CLI

[iamnihal]

dnsx version: v1.1.6

Current Behavior:

I'm utilizing dnsx as a library in my program, generating subdomains from alterx, and resolving them through dnsx. The problem arises when I use dnsx as a library; the time it takes to resolve 691 subdomains is 1 minute and 14 seconds. However, when I perform the same operation using the dnsx binary CLI, it takes only 1.75 seconds. As suggested by @dogancanbakir, I've attempted passing default values, but that doesn't seem to resolve the issue.

Expected Behavior:

When used as a library, dnsx should resolve the subdomains in the same time as when used as a CLI utility."

Steps To Reproduce:

I'm using dnsx in my program as below:

package main

import (
	"fmt"
	"time"

	"github.com/projectdiscovery/dnsx/libs/dnsx"
)

func DnsxEnrich(subdomains []string) ([]string, error) {

	var result []string

	dnsClient, err := dnsx.New(dnsx.Options{
		BaseResolvers: []string{
			"udp:1.1.1.1:53",         // Cloudflare
			"udp:1.0.0.1:53",         // Cloudflare
			"udp:8.8.8.8:53",         // Google
			"udp:8.8.4.4:53",         // Google
			"udp:9.9.9.9:53",         // Quad9
			"udp:149.112.112.112:53", // Quad9
			"udp:208.67.222.222:53",  // Open DNS
			"udp:208.67.220.220:53",  // Open DNS
		},
		MaxRetries:        2,
		QuestionTypes:     dnsx.DefaultOptions.QuestionTypes,
		Trace:             false,
		TraceMaxRecursion: dnsx.DefaultOptions.TraceMaxRecursion,
		Hostsfile:         false,
		OutputCDN:         false,
	})
	if err != nil {
		fmt.Printf("err: %v\n", err)
		return []string{}, fmt.Errorf("error creating dnsx client: %v", err)
	}

	timeStart := time.Now()

	for _, subdomain := range subdomains {
		res, _ := dnsClient.Lookup(subdomain)

		if len(res) > 1 {
			result = append(result, subdomain)
		}
	}

	fmt.Println("\nCompleted in", time.Since(timeStart))
	return result, nil
}

When I pass 691 subdomains to the DnsxEnrich function, it takes approximately 1 minute and 14 seconds to resolve all the subdomains. In contrast, using dnsx as the CLI tool completes the process in just 1.75 seconds.

Output:

dnsx as CLI

dnsx as library

[lordsky]

dnsx version: v1.1.6

Current Behavior:

I'm utilizing dnsx as a library in my program, generating subdomains from alterx, and resolving them through dnsx. The problem arises when I use dnsx as a library; the time it takes to resolve 691 subdomains is 1 minute and 14 seconds. However, when I perform the same operation using the dnsx binary CLI, it takes only 1.75 seconds. As suggested by @dogancanbakir, I've attempted passing default values, but that doesn't seem to resolve the issue.

Expected Behavior:

When used as a library, dnsx should resolve the subdomains in the same time as when used as a CLI utility."

Steps To Reproduce:

I'm using dnsx in my program as below:

package main

import (
	"fmt"
	"time"

	"github.com/projectdiscovery/dnsx/libs/dnsx"
)

func DnsxEnrich(subdomains []string) ([]string, error) {

	var result []string

	dnsClient, err := dnsx.New(dnsx.Options{
		BaseResolvers: []string{
			"udp:1.1.1.1:53",         // Cloudflare
			"udp:1.0.0.1:53",         // Cloudflare
			"udp:8.8.8.8:53",         // Google
			"udp:8.8.4.4:53",         // Google
			"udp:9.9.9.9:53",         // Quad9
			"udp:149.112.112.112:53", // Quad9
			"udp:208.67.222.222:53",  // Open DNS
			"udp:208.67.220.220:53",  // Open DNS
		},
		MaxRetries:        2,
		QuestionTypes:     dnsx.DefaultOptions.QuestionTypes,
		Trace:             false,
		TraceMaxRecursion: dnsx.DefaultOptions.TraceMaxRecursion,
		Hostsfile:         false,
		OutputCDN:         false,
	})
	if err != nil {
		fmt.Printf("err: %v\n", err)
		return []string{}, fmt.Errorf("error creating dnsx client: %v", err)
	}

	timeStart := time.Now()

	for _, subdomain := range subdomains {
		res, _ := dnsClient.Lookup(subdomain)

		if len(res) > 1 {
			result = append(result, subdomain)
		}
	}

	fmt.Println("\nCompleted in", time.Since(timeStart))
	return result, nil
}

When I pass 691 subdomains to the DnsxEnrich function, it takes approximately 1 minute and 14 seconds to resolve all the subdomains. In contrast, using dnsx as the CLI tool completes the process in just 1.75 seconds.

Output:

dnsx as CLI

dnsx as library

Same question. I read the code, CLI options.Threads default is 100, but use the library don't have the thread option to set.