Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky domain test by adding more retries for producing bundle in test #2517

Merged
merged 5 commits into from
Feb 16, 2024

Conversation

NingLin-P
Copy link
Member

Another attempt to fix the flaky domain tests in CI.

After #2220 it seems still possible for bundle production to fail due to race condition. Instead of strictly requiring bundle production to succeed, this PR simply adds more retry, it should mitigate most of the failure since the failure is not very frequent in CI.

The only notable change is in the subspace-test-service, all other changes are just adjustments for the test infra API change.

Code contributor checklist:

@@ -170,8 +170,7 @@ async fn benchmark_bundle_with_evm_tx(
const TX_TYPES: u32 = 4;
let mut thread_rng = rand::thread_rng();
let between = Uniform::from(0..TX_TYPES);
let (slot, bundle) = ferdie.produce_slot_and_wait_for_bundle_submission().await;
assert!(bundle.is_some());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

confused with this change. Dont we want to ensure the bundle is submitted anyway?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, but produce_slot_and_wait_for_bundle_submission will panic instead if bundle is not submitted after a few tries, so we don't need the assert here.

test/subspace-test-service/src/lib.rs Outdated Show resolved Hide resolved
@NingLin-P NingLin-P enabled auto-merge February 16, 2024 10:06
vedhavyas
vedhavyas previously approved these changes Feb 16, 2024
@NingLin-P NingLin-P added this pull request to the merge queue Feb 16, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 16, 2024
@NingLin-P NingLin-P added this pull request to the merge queue Feb 16, 2024
Merged via the queue into main with commit 978b354 Feb 16, 2024
11 checks passed
@NingLin-P NingLin-P deleted the fix-ci-test branch February 16, 2024 17:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants