-
Notifications
You must be signed in to change notification settings - Fork 48
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TaskInstances- "get instance batch" is getting timeout after 1 minute, status code- 504 (~1000 records) #95
Comments
Hey @litalkat, we're likely going to need a little more info for this. Is there any stack trace with the error or any indication of a line number we can use to track it down? |
@ferruzzi sure. its important to mention that I am monitoring a lot of other airflow instances in the same time but I didn't saw any thing about rate limit the exception is returning EXACTLY 1 min after the API call is sent the request is using the airflow_client.get_task_instances_batch(ListTaskInstancesForm(...),_check_return_type=False) |
@ferruzzi |
This is due to the webserver timeout. More info here: Maybe we need to improve performance of this particular endpoint, but if you have a really huge task instance table, this is king of expected I believe. |
is there a way to increase this timeout?
Does pulling data for other airflow instances affect it?
I tried to use _request_timeout=180 but it didn't help
The text was updated successfully, but these errors were encountered: