Skip to content

Drop wall-clock assertions from TestPoolPerf - #12

Merged
umputun merged 1 commit into
masterfrom
fix/flaky-perf-assertions
Aug 19, 2026
Merged

Drop wall-clock assertions from TestPoolPerf#12
umputun merged 1 commit into
masterfrom
fix/flaky-perf-assertions

Conversation

@paskal

@paskal paskal commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

Each pool configuration in TestPoolPerf was asserted to finish faster than a one-off errgroup baseline measured in the same run. That fails whenever the machine is loaded: locally it came in at 3.71s against a 3.37s baseline, roughly one run in five, and it is the same class of failure as an arbitrary sleep.

The four assert.Less calls and the egDuration variable are removed. The elapsed times are still logged, the correctness assertions are untouched, and BenchmarkPoolCompare already covers the pool against errgroup comparison, which is where a wall-clock measurement belongs.

@paskal
paskal requested a review from umputun as a code owner August 19, 2026 05:12
each pool configuration was asserted to finish faster than a one-off errgroup
baseline measured in the same run, which fails whenever the machine is loaded:
seen locally at 3.71s against a 3.37s baseline, roughly one run in five.

the timings are still logged, and BenchmarkPoolCompare already covers the
comparison properly. the correctness assertions are untouched.
@paskal
paskal force-pushed the fix/flaky-perf-assertions branch from 3bfd977 to 8281a6a Compare August 19, 2026 05:37
@umputun
umputun merged commit 8f466f7 into master Aug 19, 2026
4 checks passed
@umputun
umputun deleted the fix/flaky-perf-assertions branch August 19, 2026 05:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants