ci(bench): drop Clickbench Sorted from the "pr" SQL benchmark preset - #9784
ci(bench): drop Clickbench Sorted from the "pr" SQL benchmark preset#9784joseph-isaacs wants to merge 1 commit into
4 benchmarks regressed
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 4 improved benchmarks
❌ 4 regressed benchmarks
✅ 2191 untouched benchmarks
⏩ 206 skipped benchmarks1
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | random_i8[0.5] |
67.3 µs | 91.4 µs | -26.35% |
| ❌ | Simulation | decompress[u64, (4000, 1024)] |
70.4 µs | 85.5 µs | -17.69% |
| ❌ | WallTime | words_gather_scalar_avx2[65536] |
8.3 µs | 9.4 µs | -11.72% |
| ❌ | Simulation | allocate_drop_bytes[0] |
466 ns | 520.2 ns | -10.41% |
| ⚡ | WallTime | arrow_checked_add_u32_neon[16384] |
20.5 µs | 12.8 µs | +60.82% |
| ⚡ | Simulation | random_i8[0.8] |
99.2 µs | 69.9 µs | +41.99% |
| ⚡ | WallTime | filtered_owned_i64_neon[NineNullsInTen] |
29 µs | 26.1 µs | +11.38% |
| ⚡ | WallTime | filtered_sink_i64_neon[NineNullsInTen] |
28.8 µs | 25.8 µs | +11.36% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing claude/disable-clickbench-sorted-precommit-ke7orh (f6a2971) with develop (dc1b355)
Footnotes
-
206 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩