-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Differing scaling factors across the same benchmark misrepresented in comaprisons. #236
Comments
Thanks for the report, unfortunately away for a couple of weeks and won't have time to check on this until then, sorry for delay. |
Had a Quick Look at this now, this is not expected - will have a look at it, in the meantime generating a new baseline with the new factor should make things work. |
Note to self: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I refactored a benchmark by adding a non-unit scaling factor to reduce variance, i.e. from this
to
This shows up like so when using
swift package benchmark baseline compare
It appears that the new benchmark is not scaled and this caused some confusion. Is this the intended behavior?
The text was updated successfully, but these errors were encountered: