Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flank should record fatal exception outcome and or details from a matrix execution #2341

Open
AaronMT opened this issue Dec 19, 2022 · 0 comments
Labels

Comments

@AaronMT
Copy link

AaronMT commented Dec 19, 2022

Hello,

I've noticed that when a Fatal exception occurs on Firebase Test Lab (e.g,
Screenshot 2022-12-19 at 10 54 50 AM These are simply recorded in the matrix_ids.json file as {"outcome": "failure"}. For the purposes of daily reporting on test executions, I would love if Flank were to capture any other keys indicative of crashes when they happen. I know this is possible through the Cloud Tool Results API, but I would like if Flank could do that, as we simply parse artifacts. Even if it's a simple boolean from FailureDetail ({"crashed": true}) that would be helpful.

https://firebase.google.com/docs/test-lab/reference/toolresults/rest/v1beta3/Outcome#FailureDetail

https://firebase.google.com/docs/test-lab/reference/toolresults/rest/v1beta3/Outcome

@AaronMT AaronMT added the Bug label Dec 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant