-
Notifications
You must be signed in to change notification settings - Fork 317
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve how Test failures are summarized #9729
Comments
radeusgd
added
x-chore
Type: chore
-libs
Libraries: New libraries to be implemented
labels
Apr 17, 2024
Possible solutions:
|
5 tasks
Make REPORT_ONLY_FAILED default to true -> REPORT_ALL_TESTS |
4 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
As suggested in a comment by @JaroslavTulach:
This indeed reminds us of a problem that I imagine every developer trying to figure out failed library tests has encountered - especially on the CI the log of tests that are run is HUGE and it is hard to browse it.
Locally we have the
REPORT_ONLY_FAILED
env var that allows to only print failures. I don't think it's viable to enable that flag on the CI by default because we do want to also see which tests are run.As part of this task, one should design what is the best way to summarize the failed tests and implement it.
It may be the 'display up to 10 failed test cases at the end' as suggested, but it may be something else - the goal is to make it easy to find test failures when running a huge test suite.
The text was updated successfully, but these errors were encountered: