Skip to content

Stabilize EVM throughput integration test#3465

Merged
masih merged 2 commits into
mainfrom
masih/flake-not-evm-it-timeout
May 19, 2026
Merged

Stabilize EVM throughput integration test#3465
masih merged 2 commits into
mainfrom
masih/flake-not-evm-it-timeout

Conversation

@masih
Copy link
Copy Markdown
Collaborator

@masih masih commented May 19, 2026

Submit deterministic in-order nonces instead of shuffling, and filter block transactions to only those sent by this test. Randomized same-account nonce gaps were causing the CI smoke test to hang waiting on receipts, which isn't the behavior under test here. Also bumps the timeout to 120s.

Flakes often, and on unrelated changes; example.

Submit deterministic in-order nonces instead of shuffling, and filter
block transactions to only those sent by this test. Randomized
same-account nonce gaps were causing the CI smoke test to hang waiting
on receipts, which isn't the behavior under test here. Also bumps the
timeout to 120s.
@masih masih marked this pull request as ready for review May 19, 2026 17:05
@masih masih requested review from Kbhat1 and cody-littley May 19, 2026 17:05
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2026

The latest Buf updates on your PR. Results from workflow Buf / buf (pull_request).

BuildFormatLintBreakingUpdated (UTC)
✅ passed✅ passed✅ passed✅ passedMay 19, 2026, 5:14 PM

@cursor
Copy link
Copy Markdown

cursor Bot commented May 19, 2026

PR Summary

Low Risk
Low risk: changes are confined to an integration test and primarily remove nondeterminism/timeouts; failures would only affect CI signal, not runtime behavior.

Overview
Stabilizes the EVM throughput integration test by removing randomized nonce ordering and instead submitting the 100 same-account transactions with deterministic, in-order nonces (plus a 120s timeout).

Updates the nonce-order validation to wait receipts in bulk and filter block transactions to only hashes sent by this test, avoiding hangs/noise from unrelated block transactions; also drops the unused lodash shuffle import and helper.

Reviewed by Cursor Bugbot for commit defb5d9. Bugbot is set up for automated code reviews on this repo. Configure here.

@masih masih enabled auto-merge May 19, 2026 17:12
@codecov
Copy link
Copy Markdown

codecov Bot commented May 19, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 59.32%. Comparing base (f87766f) to head (defb5d9).

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #3465      +/-   ##
==========================================
- Coverage   59.32%   59.32%   -0.01%     
==========================================
  Files        2127     2127              
  Lines      175898   175898              
==========================================
- Hits       104354   104353       -1     
- Misses      62456    62457       +1     
  Partials     9088     9088              
Flag Coverage Δ
sei-db 70.41% <ø> (-0.22%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 1 file with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@masih masih added this pull request to the merge queue May 19, 2026
Merged via the queue into main with commit c0df1b6 May 19, 2026
59 of 61 checks passed
@masih masih deleted the masih/flake-not-evm-it-timeout branch May 19, 2026 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants