Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoCluster - NBomber context.StopCurrentTest() - do not save properly FinalStats #694

Open
daveharris1 opened this issue May 14, 2024 · 4 comments
Assignees
Labels
5.7 bug Something isn't working

Comments

@daveharris1
Copy link

The following issues has been raised after talking with Anton Moldovan.

NBomber NuGet package version: 5.6.0
NBomber.Sinks.InfluxDB NuGet package version: 5.0.2

When Running NBomber via AutoCluster in a distributed manner, the generated 'Session' Coordinator reports i.e csv, HTML5 report looks to be duplicating the request count information.

This has been seen after every distributed run and doesn't seem to be affect by agent count. The data generated in the reports is at odds with what is reported via the Grafana dash board.

Example Bombing run Grafana output (after test completion):

image

Example of the HTML5 report showing what looks to be the duplication of requests and RPS data along with the fact the data doesn't match the Grafana output above:

image

@AntyaDev AntyaDev added bug Something isn't working 5.7 labels May 14, 2024
@AntyaDev AntyaDev self-assigned this May 30, 2024
@AntyaDev
Copy link
Contributor

AntyaDev commented May 31, 2024

Hi @daveharris1 ,

Are you sure that the HTML report was taken from the Coordinator? I have tried to reproduce this behavior several times locally but have had no luck so far.

@AntyaDev
Copy link
Contributor

image

image

@AntyaDev
Copy link
Contributor

I have tried to run 3 min load test with cluster of 2-3 nodes but the results are always consistent.

@daveharris1
Copy link
Author

Hi @daveharris1 ,

Are you sure that the HTML report was taken from the Coordinator? I have tried to reproduce this behavior several times locally but have had no luck so far.

Yes this is the Coordinator. This is from the generated txt that is in the same 'session' folder generated for the Coordinator with the HTML report:

image

image

As mentioned on the other issues I have open, we do not wait for the scenario to complete but exit the test early via:

void StopCurrentTest(string reason);
(https://nbomber.com/docs/using-nbomber/basic-api/scenario/#scenario-context)

I am also using multiple steps in the test via https://nbomber.com/docs/using-nbomber/basic-api/step

The latest run again shows a mismatch between the report generated data and what is shown in the Grafana dashboard. I have noted the RPS looks to match between the two sources.

image

image

@AntyaDev AntyaDev changed the title AutoCluster - NBomber generated reports duplicating step data information AutoCluster - NBomber context.StopCurrentTest() do not save properly latest Final Stats Jun 8, 2024
@AntyaDev AntyaDev changed the title AutoCluster - NBomber context.StopCurrentTest() do not save properly latest Final Stats AutoCluster - NBomber context.StopCurrentTest() - do not save properly FinalStats Jun 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
5.7 bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants