Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparison View: Indicates Missing Data, but data should be complete #172

Open
smarr opened this issue Dec 3, 2023 · 1 comment
Open
Labels
bug Something isn't working

Comments

@smarr
Copy link
Owner

smarr commented Dec 3, 2023

These indicate missing data:

While the previous comparison on master looks complete: https://rebench.dev/TruffleSOM/compare/20f8545e990e4c82524885b8942f66bfea7d9b55..a33ffee806522eda1d9ab2405717fac3d1b91fb9#micro-steady-TruffleSOM-graal

The missing data is from yuria and yuria3, could theoretically be a race condition, but might also be another bug, for instance, identifying matching data correctly...

@smarr smarr added the bug Something isn't working label Dec 3, 2023
@smarr
Copy link
Owner Author

smarr commented Jan 21, 2024

For the ReBenchDB project, there was a change in path for the Node.js binary since changing the underlying Docker image.
However, there's only those things to compare directly, so, we should really be able to see the difference. In an ideal world, of course, we would know the change in software as well, and be able to display it, but that's not implemented.

https://rebench.dev/ReBenchDB/compare/1245e6bdd20bc0fe9b630fafe5e4ccd27512a8dd..bab07f534511c0a2009aadaca0573a8c3edfd819

(the situation here is also a little more complicated, because I manually changed the runIds for a subset of the data)

@smarr smarr moved this to Backlog ReBenchDB in ReBench Summer 2024 May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Backlog ReBenchDB
Development

No branches or pull requests

1 participant