-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement job restart policies #157
Comments
At my previous company i simply put the Spark driver Pod within a Deployment and health-checked port 4040. |
That requires For streaming jobs, we might want indeed to use a |
Yes, it is. I mentioned it for the sake of completeness, and our approach is likely better :) |
Description
Some Spark jobs are idempotent and can be resubmitted without problems especially if they fail due to external constraints (like endpoints not being ready and such)
The user should be able to configure such jobs with a restart policy.
The text was updated successfully, but these errors were encountered: