forked from mordax7/flathunter
-
Notifications
You must be signed in to change notification settings - Fork 174
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Time restrictions #522
Comments
Hi @Scrapnon,
We don't have explicit support for that in Flathunter, but if you're
running the crawler out of cron or systemd, you can obviously configure the
frequency of the runs there. Doing that on a per-site basis would be more
complicated.
We have had other requests to limit the rate of crawling. It would
certainly be an interesting feature to have.
Scrapnon ***@***.***> schrieb am Do., 25. Jan. 2024, 15:50:
… Hello,
Are there any available details regarding time restrictions, such as
requests per hour or per day, and on which sites, in order to adjust sleep
timers accordingly to those limitations?
Best
—
Reply to this email directly, view it on GitHub
<#522>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAAEK5VLOIBWTX6IEMAH3NDYQJWK7AVCNFSM6AAAAABCKU4V6OVHI2DSMVQWIX3LMV43ASLTON2WKOZSGEYDANJVHA4DGNY>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello,
Are there any available details regarding time restrictions, such as requests per hour or per day, and on which sites, in order to adjust sleep timers accordingly to those limitations?
Edit: Talking of the bot detection by ImmoScout24.
Best
The text was updated successfully, but these errors were encountered: