Skip to content

Fix DataFusion expression conversion and pushdown semantics - #9785

Open
AdamGS wants to merge 10 commits into
developfrom
adamg/df-fix-bugs-conversion
Open

Fix DataFusion expression conversion and pushdown semantics#9785
AdamGS wants to merge 10 commits into
developfrom
adamg/df-fix-bugs-conversion

Conversation

@AdamGS

@AdamGS AdamGS commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Fix native pushdown in vortex-datafusion to preserve DataFusion semantics and fall back for unsupported expressions. Replace separate eligibility and conversion checks with schema-aware try_convert, preserving SQL null semantics for IN/NOT IN and rejecting pushdown where casts, short-circuit evaluation, or nullable struct access could differ. Partially supported projections now run entirely in DataFusion over deduplicated raw columns.

  • Re-split filters after each file’s schema adaptation: Vortex evaluates supported conjuncts, and DataFusion evaluates residuals before projection and limit. Disable scan limits whenever filters exist, include file and predicate context in errors, and fix v2 pushdown after projection swapping.

  • Add conversion and residual-filter regression tests, plus 16 SQL cases compared against an Arrow MemTable with pushdown enabled and disabled.

  • Rename Convertor to Converter

LLMS were used as part of this work

@AdamGS AdamGS added the changelog/fix A bug fix label Sep 7, 2026
@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 01bc390 to 47d4415 Compare September 7, 2026 11:57
@codspeed-hq

codspeed-hq Bot commented Sep 7, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 5.69%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 2 regressed benchmarks
✅ 2184 untouched benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decompress[u64, (4000, 1024)] 70.8 µs 86.2 µs -17.81%
WallTime mul_i32_nonnull_avx512 7.1 µs 7.9 µs -10.04%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/df-fix-bugs-conversion (26fd045) with develop (bffdca1)

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 47d4415 to 4d7f747 Compare September 7, 2026 11:58
@AdamGS AdamGS added ext/datafusion Relates to the DataFusion integration action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 7, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 7, 2026
@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 26fd045 clickbench-nvme 1 Explore Profiling Data
🟢 Done 26fd045 polarsignals 1 Explore Profiling Data
🟢 Done 26fd045 tpch-nvme 1 Explore Profiling Data
🟢 Done 26fd045 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 26fd045 statpopgen 1 Explore Profiling Data
🟢 Done 26fd045 fineweb-s3 1 Explore Profiling Data
🟢 Done 26fd045 fineweb 1 Explore Profiling Data
🟢 Done 26fd045 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 26fd045 tpcds-nvme 1 Explore Profiling Data
🟢 Done 26fd045 tpch-s3 1 Explore Profiling Data
Previous Runs (30)
Status Commit Job Attempt Link
🟢 Done d37c4e1 tpch-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 tpch-s3 1 Explore Profiling Data
🟢 Done d37c4e1 statpopgen 1 Explore Profiling Data
🟢 Done d37c4e1 tpch-nvme-10 1 Explore Profiling Data
🟢 Done d37c4e1 fineweb-s3 1 Explore Profiling Data
🟢 Done d37c4e1 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 fineweb 1 Explore Profiling Data
🟢 Done d37c4e1 clickbench-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 tpcds-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 polarsignals 1 Explore Profiling Data
🟢 Done 55e1679 statpopgen 1 Explore Profiling Data
🟢 Done 55e1679 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 55e1679 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 55e1679 fineweb 1 Explore Profiling Data
🟢 Done 55e1679 fineweb-s3 1 Explore Profiling Data
🟢 Done 55e1679 clickbench-nvme 1 Explore Profiling Data
🟢 Done 55e1679 tpcds-nvme 1 Explore Profiling Data
🟢 Done 55e1679 polarsignals 1 Explore Profiling Data
🟢 Done 55e1679 tpch-s3 1 Explore Profiling Data
🟢 Done 55e1679 tpch-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 statpopgen 1 Explore Profiling Data
🟢 Done 095b9a4 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 095b9a4 fineweb 1 Explore Profiling Data
🟢 Done 095b9a4 fineweb-s3 1 Explore Profiling Data
🟢 Done 095b9a4 tpcds-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 clickbench-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 polarsignals 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-s3 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 26fd045a vs base bffdca11
Vortex (geomean): hot 1.008x ➖ · cold 1.020x ➖


datafusion / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45469909 / 45294548 / +0.4% 93564343 / 89764560 / +4.2% 0.49 / 0.50 / -3.7%
polarsignals_q01/datafusion:vortex-file-compressed 50761674 / 50854873 / -0.2% 114215097 / 112100280 / +1.9% 0.44 / 0.45 / -2.0%
polarsignals_q02/datafusion:vortex-file-compressed 39503043 / 39201264 / +0.8% 84366617 / 78538607 / +7.4% 0.47 / 0.50 / -6.2%
polarsignals_q03/datafusion:vortex-file-compressed 53416934 / 53704880 / -0.5% 117750736 / 116763801 / +0.8% 0.45 / 0.46 / -1.4%
polarsignals_q04/datafusion:vortex-file-compressed 9670682 / 9663039 / +0.1% 51289804 / 51435564 / -0.3% 0.19 / 0.19 / +0.4%
polarsignals_q05/datafusion:vortex-file-compressed 11752038 / 11295282 / +4.0% 55395982 / 53678753 / +3.2% 0.21 / 0.21 / +0.8%
polarsignals_q06/datafusion:vortex-file-compressed 22225600 / 20912888 / +6.3% 64249607 / 63299989 / +1.5% 0.35 / 0.33 / +4.7%
polarsignals_q07/datafusion:vortex-file-compressed 11022734 / 11219970 / -1.8% 53375656 / 54724788 / -2.5% 0.21 / 0.21 / +0.7%
polarsignals_q08/datafusion:vortex-file-compressed 99503120 / 100082562 / -0.6% 165133729 / 163279590 / +1.1% 0.60 / 0.61 / -1.7%
polarsignals_q09/datafusion:vortex-file-compressed 9995018 / 10012446 / -0.2% 51366363 / 50156289 / +2.4% 0.19 / 0.20 / -2.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.975x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.995x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16184933 / 16494844 / -1.9% 42211025 / 46022276 / -8.3% 0.38 / 0.36 / +7.0%
tpch_q02/datafusion:vortex-file-compressed 17631613 / 17562650 / +0.4% 35886462 / 37036081 / -3.1% 0.49 / 0.47 / +3.6%
tpch_q03/datafusion:vortex-file-compressed 19532055 / 19399779 / +0.7% 45824788 / 51546186 / -11.1% 🟢 0.43 / 0.38 / +13.3%
tpch_q04/datafusion:vortex-file-compressed 10253508 / 10349689 / -0.9% 31418103 / 33948120 / -7.5% 0.33 / 0.30 / +7.0%
tpch_q05/datafusion:vortex-file-compressed 37425581 / 37338221 / +0.2% 63208425 / 64004817 / -1.2% 0.59 / 0.58 / +1.5%
tpch_q06/datafusion:vortex-file-compressed 6391677 / 6195752 / +3.2% 29226863 / 30470833 / -4.1% 0.22 / 0.20 / +7.6%
tpch_q07/datafusion:vortex-file-compressed 51850117 / 52463078 / -1.2% 79830615 / 75635786 / +5.5% 0.65 / 0.69 / -6.4%
tpch_q08/datafusion:vortex-file-compressed 52294855 / 51495624 / +1.6% 81775152 / 73158481 / +11.8% 🔴 0.64 / 0.70 / -9.1%
tpch_q09/datafusion:vortex-file-compressed 49410398 / 49646219 / -0.5% 79242620 / 77124488 / +2.7% 0.62 / 0.64 / -3.1%
tpch_q10/datafusion:vortex-file-compressed 17471399 / 17270252 / +1.2% 46949663 / 50271819 / -6.6% 0.37 / 0.34 / +8.3%
tpch_q11/datafusion:vortex-file-compressed 14899413 / 14910657 / -0.1% 32481677 / 34112103 / -4.8% 0.46 / 0.44 / +4.9%
tpch_q12/datafusion:vortex-file-compressed 23051258 / 23034260 / +0.1% 47070896 / 47541932 / -1.0% 0.49 / 0.48 / +1.1%
tpch_q13/datafusion:vortex-file-compressed 20191053 / 19897336 / +1.5% 40435218 / 42317462 / -4.4% 0.50 / 0.47 / +6.2%
tpch_q14/datafusion:vortex-file-compressed 15139985 / 15124311 / +0.1% 39313499 / 39067878 / +0.6% 0.39 / 0.39 / -0.5%
tpch_q15/datafusion:vortex-file-compressed 18680013 / 18800205 / -0.6% 46732006 / 45191227 / +3.4% 0.40 / 0.42 / -3.9%
tpch_q16/datafusion:vortex-file-compressed 18495859 / 18699492 / -1.1% 36315283 / 37074929 / -2.0% 0.51 / 0.50 / +1.0%
tpch_q17/datafusion:vortex-file-compressed 28148951 / 28540020 / -1.4% 58890858 / 57373154 / +2.6% 0.48 / 0.50 / -3.9%
tpch_q18/datafusion:vortex-file-compressed 37068577 / 37364754 / -0.8% 57923133 / 57656360 / +0.5% 0.64 / 0.65 / -1.2%
tpch_q19/datafusion:vortex-file-compressed 14284050 / 13716580 / +4.1% 38252092 / 40478910 / -5.5% 0.37 / 0.34 / +10.2%
tpch_q20/datafusion:vortex-file-compressed 20842693 / 20948500 / -0.5% 43458066 / 45676415 / -4.9% 0.48 / 0.46 / +4.6%
tpch_q21/datafusion:vortex-file-compressed 40325397 / 39577534 / +1.9% 65798379 / 66132412 / -0.5% 0.61 / 0.60 / +2.4%
tpch_q22/datafusion:vortex-file-compressed 11253884 / 11067895 / +1.7% 30891093 / 31952732 / -3.3% 0.36 / 0.35 / +5.2%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67127525 / 66601659 / +0.8% 84035787 / 85038957 / -1.2% 0.80 / 0.78 / +2.0%
tpch_q02/datafusion:parquet 52335870 / 52175609 / +0.3% 69476580 / 73938994 / -6.0% 0.75 / 0.71 / +6.7%
tpch_q03/datafusion:parquet 72044936 / 72744157 / -1.0% 97911946 / 96618201 / +1.3% 0.74 / 0.75 / -2.3%
tpch_q04/datafusion:parquet 39939323 / 39887389 / +0.1% 58873159 / 62682202 / -6.1% 0.68 / 0.64 / +6.6%
tpch_q05/datafusion:parquet 87341012 / 87447758 / -0.1% 115870947 / 115982264 / -0.1% 0.75 / 0.75 / -0.0%
tpch_q06/datafusion:parquet 28283010 / 27779675 / +1.8% 47818961 / 48859847 / -2.1% 0.59 / 0.57 / +4.0%
tpch_q07/datafusion:parquet 95361059 / 95816076 / -0.5% 123166875 / 122964785 / +0.2% 0.77 / 0.78 / -0.6%
tpch_q08/datafusion:parquet 96080133 / 97261748 / -1.2% 124641896 / 126414710 / -1.4% 0.77 / 0.77 / +0.2%
tpch_q09/datafusion:parquet 114484955 / 113634409 / +0.7% 144667784 / 147567187 / -2.0% 0.79 / 0.77 / +2.8%
tpch_q10/datafusion:parquet 78947972 / 79020723 / -0.1% 110002045 / 110349762 / -0.3% 0.72 / 0.72 / +0.2%
tpch_q11/datafusion:parquet 38558807 / 38135570 / +1.1% 61859216 / 64277613 / -3.8% 0.62 / 0.59 / +5.1%
tpch_q12/datafusion:parquet 62049079 / 61986729 / +0.1% 86208958 / 86934792 / -0.8% 0.72 / 0.71 / +0.9%
tpch_q13/datafusion:parquet 159759375 / 159659151 / +0.1% 180849546 / 180909637 / -0.0% 0.88 / 0.88 / +0.1%
tpch_q14/datafusion:parquet 39535497 / 39323137 / +0.5% 65162247 / 64267154 / +1.4% 0.61 / 0.61 / -0.8%
tpch_q15/datafusion:parquet 46223100 / 45753991 / +1.0% 67575363 / 70899708 / -4.7% 0.68 / 0.65 / +6.0%
tpch_q16/datafusion:parquet 38139579 / 38580122 / -1.1% 55510234 / 58034461 / -4.3% 0.69 / 0.66 / +3.4%
tpch_q17/datafusion:parquet 118081510 / 117732351 / +0.3% 141235807 / 143092212 / -1.3% 0.84 / 0.82 / +1.6%
tpch_q18/datafusion:parquet 115230700 / 115141536 / +0.1% 139577276 / 141656562 / -1.5% 0.83 / 0.81 / +1.6%
tpch_q19/datafusion:parquet 49347811 / 50199110 / -1.7% 78396325 / 79239317 / -1.1% 0.63 / 0.63 / -0.6%
tpch_q20/datafusion:parquet 57220369 / 58111333 / -1.5% 85163033 / 83352074 / +2.2% 0.67 / 0.70 / -3.6%
tpch_q21/datafusion:parquet 98386977 / 98262547 / +0.1% 121813303 / 121103600 / +0.6% 0.81 / 0.81 / -0.5%
tpch_q22/datafusion:parquet 41517174 / 41928078 / -1.0% 59611392 / 61016983 / -2.3% 0.70 / 0.69 / +1.4%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11976813 / 11837137 / +1.2% 20950907 / 22719402 / -7.8% 0.57 / 0.52 / +9.7%
tpch_q02/duckdb:vortex-file-compressed 17820358 / 17652073 / +1.0% 25571585 / 27912028 / -8.4% 0.70 / 0.63 / +10.2%
tpch_q03/duckdb:vortex-file-compressed 18621976 / 18974855 / -1.9% 33394397 / 35398657 / -5.7% 0.56 / 0.54 / +4.0%
tpch_q04/duckdb:vortex-file-compressed 16882422 / 16848479 / +0.2% 28106052 / 29671944 / -5.3% 0.60 / 0.57 / +5.8%
tpch_q05/duckdb:vortex-file-compressed 22096146 / 22765564 / -2.9% 34859870 / 35873164 / -2.8% 0.63 / 0.63 / -0.1%
tpch_q06/duckdb:vortex-file-compressed 5691105 / 5666965 / +0.4% 14179716 / 13806737 / +2.7% 0.40 / 0.41 / -2.2%
tpch_q07/duckdb:vortex-file-compressed 20871215 / 21051383 / -0.9% 40348070 / 38573809 / +4.6% 0.52 / 0.55 / -5.2%
tpch_q08/duckdb:vortex-file-compressed 23976247 / 23595362 / +1.6% 41296687 / 39255051 / +5.2% 0.58 / 0.60 / -3.4%
tpch_q09/duckdb:vortex-file-compressed 30070114 / 29843246 / +0.8% 49806427 / 50912555 / -2.2% 0.60 / 0.59 / +3.0%
tpch_q10/duckdb:vortex-file-compressed 28910156 / 28731893 / +0.6% 47040202 / 46191265 / +1.8% 0.61 / 0.62 / -1.2%
tpch_q11/duckdb:vortex-file-compressed 8151598 / 8293104 / -1.7% 19361990 / 17456417 / +10.9% 🔴 0.42 / 0.48 / -11.4%
tpch_q12/duckdb:vortex-file-compressed 16311820 / 15905600 / +2.6% 28180057 / 26384691 / +6.8% 0.58 / 0.60 / -4.0%
tpch_q13/duckdb:vortex-file-compressed 22881062 / 23672425 / -3.3% 39168936 / 40491596 / -3.3% 0.58 / 0.58 / -0.1%
tpch_q14/duckdb:vortex-file-compressed 13069703 / 13186125 / -0.9% 22538225 / 25994585 / -13.3% 🟢 0.58 / 0.51 / +14.3%
tpch_q15/duckdb:vortex-file-compressed 9773639 / 9974486 / -2.0% 17420319 / 18248431 / -4.5% 0.56 / 0.55 / +2.6%
tpch_q16/duckdb:vortex-file-compressed 18500036 / 18339502 / +0.9% 23602863 / 24372807 / -3.2% 0.78 / 0.75 / +4.2%
tpch_q17/duckdb:vortex-file-compressed 16120594 / 16400220 / -1.7% 30896516 / 32137615 / -3.9% 0.52 / 0.51 / +2.2%
tpch_q18/duckdb:vortex-file-compressed 25427564 / 25445538 / -0.1% 35961489 / 42683131 / -15.7% 🟢 0.71 / 0.60 / +18.6%
tpch_q19/duckdb:vortex-file-compressed 22868787 / 23779573 / -3.8% 36835120 / 40759658 / -9.6% 0.62 / 0.58 / +6.4%
tpch_q20/duckdb:vortex-file-compressed 17782046 / 17316014 / +2.7% 33207466 / 34799609 / -4.6% 0.54 / 0.50 / +7.6%
tpch_q21/duckdb:vortex-file-compressed 66879861 / 65996721 / +1.3% 84841060 / 78906147 / +7.5% 0.79 / 0.84 / -5.8%
tpch_q22/duckdb:vortex-file-compressed 14340417 / 12172253 / +17.8% 🔴 23304760 / 26345447 / -11.5% 🟢 0.62 / 0.46 / +33.2%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60424354 / 60218009 / +0.3% 66834125 / 66601978 / +0.3% 0.90 / 0.90 / -0.0%
tpch_q02/duckdb:parquet 35248060 / 34773551 / +1.4% 43993913 / 42497771 / +3.5% 0.80 / 0.82 / -2.1%
tpch_q03/duckdb:parquet 62705262 / 62071561 / +1.0% 74045243 / 72918021 / +1.5% 0.85 / 0.85 / -0.5%
tpch_q04/duckdb:parquet 43474192 / 45766704 / -5.0% 53485961 / 55011264 / -2.8% 0.81 / 0.83 / -2.3%
tpch_q05/duckdb:parquet 60933792 / 60852005 / +0.1% 72693541 / 73390660 / -0.9% 0.84 / 0.83 / +1.1%
tpch_q06/duckdb:parquet 20166149 / 20152954 / +0.1% 25188637 / 25325608 / -0.5% 0.80 / 0.80 / +0.6%
tpch_q07/duckdb:parquet 61243554 / 60941792 / +0.5% 72034078 / 75715075 / -4.9% 0.85 / 0.80 / +5.6%
tpch_q08/duckdb:parquet 74037647 / 73367562 / +0.9% 87130433 / 87033800 / +0.1% 0.85 / 0.84 / +0.8%
tpch_q09/duckdb:parquet 114470697 / 113714555 / +0.7% 127609000 / 127347323 / +0.2% 0.90 / 0.89 / +0.5%
tpch_q10/duckdb:parquet 110384214 / 108380032 / +1.8% 122274511 / 121043547 / +1.0% 0.90 / 0.90 / +0.8%
tpch_q11/duckdb:parquet 20254821 / 19984671 / +1.4% 24572298 / 24230042 / +1.4% 0.82 / 0.82 / -0.1%
tpch_q12/duckdb:parquet 41810112 / 41482653 / +0.8% 49910257 / 49416628 / +1.0% 0.84 / 0.84 / -0.2%
tpch_q13/duckdb:parquet 239867359 / 240039394 / -0.1% 247762401 / 248484501 / -0.3% 0.97 / 0.97 / +0.2%
tpch_q14/duckdb:parquet 43772622 / 43729817 / +0.1% 52474394 / 52033830 / +0.8% 0.83 / 0.84 / -0.7%
tpch_q15/duckdb:parquet 25025915 / 24978838 / +0.2% 31189651 / 31348511 / -0.5% 0.80 / 0.80 / +0.7%
tpch_q16/duckdb:parquet 50564928 / 50174944 / +0.8% 58578969 / 56606617 / +3.5% 0.86 / 0.89 / -2.6%
tpch_q17/duckdb:parquet 44939781 / 44604936 / +0.8% 54517780 / 54261928 / +0.5% 0.82 / 0.82 / +0.3%
tpch_q18/duckdb:parquet 90813689 / 90133486 / +0.8% 100843292 / 101226736 / -0.4% 0.90 / 0.89 / +1.1%
tpch_q19/duckdb:parquet 61494315 / 61368676 / +0.2% 71520437 / 71293150 / +0.3% 0.86 / 0.86 / -0.1%
tpch_q20/duckdb:parquet 58963252 / 58821291 / +0.2% 71930423 / 70375134 / +2.2% 0.82 / 0.84 / -1.9%
tpch_q21/duckdb:parquet 138264560 / 136917661 / +1.0% 155573633 / 148140557 / +5.0% 0.89 / 0.92 / -3.8%
tpch_q22/duckdb:parquet 50622201 / 50487758 / +0.3% 57980072 / 58097685 / -0.2% 0.87 / 0.87 / +0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-3.2%, low confidence) · DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): hot 1.029x ➖ · cold 1.029x ➖
Parquet (geomean): hot 1.034x ➖ · cold 0.982x ➖
Shifts: Parquet (control) +3.4% · Median polish +3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.028x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6929003 / 6966380 / -0.5% 20548660 / 20057039 / +2.5% 0.34 / 0.35 / -2.9%
fineweb_q01/datafusion:vortex-file-compressed 13341796 / 13284987 / +0.4% 47735370 / 46997943 / +1.6% 0.28 / 0.28 / -1.1%
fineweb_q02/datafusion:vortex-file-compressed 12692083 / 12639906 / +0.4% 53190332 / 50078538 / +6.2% 0.24 / 0.25 / -5.5%
fineweb_q03/datafusion:vortex-file-compressed 21100168 / 20602035 / +2.4% 98239927 / 106105506 / -7.4% 0.21 / 0.19 / +10.6%
fineweb_q04/datafusion:vortex-file-compressed 75936516 / 73040072 / +4.0% 155301672 / 153721381 / +1.0% 0.49 / 0.48 / +2.9%
fineweb_q05/datafusion:vortex-file-compressed 60810074 / 57364978 / +6.0% 137256633 / 135712791 / +1.1% 0.44 / 0.42 / +4.8%
fineweb_q06/datafusion:vortex-file-compressed 19869544 / 19227412 / +3.3% 97916296 / 107412816 / -8.8% 0.20 / 0.18 / +13.4%
fineweb_q07/datafusion:vortex-file-compressed 18360602 / 17848104 / +2.9% 98291543 / 102694202 / -4.3% 0.19 / 0.17 / +7.5%
fineweb_q08/datafusion:vortex-file-compressed 10068994 / 9455526 / +6.5% 45210655 / 42490676 / +6.4% 0.22 / 0.22 / +0.1%
datafusion / parquet / ns (1.062x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9385083 / 9219880 / +1.8% 32974293 / 33399239 / -1.3% 0.28 / 0.28 / +3.1%
fineweb_q01/datafusion:parquet 73823101 / 69590050 / +6.1% 142238374 / 154989485 / -8.2% 0.52 / 0.45 / +15.6%
fineweb_q02/datafusion:parquet 74618050 / 70756131 / +5.5% 152397658 / 152766862 / -0.2% 0.49 / 0.46 / +5.7%
fineweb_q03/datafusion:parquet 73758496 / 69253660 / +6.5% 140420805 / 157340080 / -10.8% 🟢 0.53 / 0.44 / +19.3%
fineweb_q04/datafusion:parquet 80969180 / 76096414 / +6.4% 152227000 / 155806306 / -2.3% 0.53 / 0.49 / +8.9%
fineweb_q05/datafusion:parquet 80891752 / 74106732 / +9.2% 146043459 / 153658149 / -5.0% 0.55 / 0.48 / +14.8%
fineweb_q06/datafusion:parquet 76056964 / 71227088 / +6.8% 138823006 / 153711722 / -9.7% 0.55 / 0.46 / +18.2%
fineweb_q07/datafusion:parquet 73603138 / 68203250 / +7.9% 148769676 / 149567101 / -0.5% 0.49 / 0.46 / +8.5%
fineweb_q08/datafusion:parquet 73901480 / 70022055 / +5.5% 142724721 / 150802916 / -5.4% 0.52 / 0.46 / +11.5%
duckdb / vortex-file-compressed / ns (1.030x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 4672738 / 3523375 / +32.6% 🔴 8487953 / 6227770 / +36.3% 🔴 0.55 / 0.57 / -2.7%
fineweb_q01/duckdb:vortex-file-compressed 17846148 / 21415491 / -16.7% 🟢 56356803 / 55764990 / +1.1% 0.32 / 0.38 / -17.5%
fineweb_q02/duckdb:vortex-file-compressed 19936434 / 16842618 / +18.4% 🔴 53896385 / 45327612 / +18.9% 🔴 0.37 / 0.37 / -0.5%
fineweb_q03/duckdb:vortex-file-compressed 23072324 / 21996554 / +4.9% 90148123 / 94252042 / -4.4% 0.26 / 0.23 / +9.7%
fineweb_q04/duckdb:vortex-file-compressed 80821517 / 80730308 / +0.1% 134676129 / 133198625 / +1.1% 0.60 / 0.61 / -1.0%
fineweb_q05/duckdb:vortex-file-compressed 61875788 / 62176242 / -0.5% 124929247 / 115898962 / +7.8% 0.50 / 0.54 / -7.7%
fineweb_q06/duckdb:vortex-file-compressed 23234948 / 27030356 / -14.0% 🟢 104249792 / 100228114 / +4.0% 0.22 / 0.27 / -17.4%
fineweb_q07/duckdb:vortex-file-compressed 23303098 / 22355848 / +4.2% 88493561 / 93841114 / -5.7% 0.26 / 0.24 / +10.5%
fineweb_q08/duckdb:vortex-file-compressed 11166302 / 10510917 / +6.2% 47743290 / 46414369 / +2.9% 0.23 / 0.23 / +3.3%
duckdb / parquet / ns (1.007x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24337439 / 22052436 / +10.4% 🔴 23980491 / 23591913 / +1.6% 1.01 / 0.93 / +8.6%
fineweb_q01/duckdb:parquet 45361292 / 46754950 / -3.0% 56513346 / 53827948 / +5.0% 0.80 / 0.87 / -7.6%
fineweb_q02/duckdb:parquet 44142737 / 43502454 / +1.5% 54905259 / 53210958 / +3.2% 0.80 / 0.82 / -1.7%
fineweb_q03/duckdb:parquet 94945964 / 95579000 / -0.7% 187848520 / 180330377 / +4.2% 0.51 / 0.53 / -4.6%
fineweb_q04/duckdb:parquet 150001284 / 152411138 / -1.6% 199922819 / 202528345 / -1.3% 0.75 / 0.75 / -0.3%
fineweb_q05/duckdb:parquet 143031040 / 142864609 / +0.1% 206814281 / 187330201 / +10.4% 🔴 0.69 / 0.76 / -9.3%
fineweb_q06/duckdb:parquet 71574701 / 72067233 / -0.7% 118653008 / 127952729 / -7.3% 0.60 / 0.56 / +7.1%
fineweb_q07/duckdb:parquet 72003734 / 72180314 / -0.2% 154776601 / 160118878 / -3.3% 0.47 / 0.45 / +3.2%
fineweb_q08/duckdb:parquet 23231812 / 23039564 / +0.8% 24212126 / 23997238 / +0.9% 0.96 / 0.96 / -0.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+2.2%, environment too noisy confidence)
Vortex (geomean): hot 1.015x ➖ · cold 0.962x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.938x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 262115670 / 251933678 / +4.0% 564905517 / 641541718 / -11.9% 🟢 0.46 / 0.39 / +18.2%
clickbench-sorted_q24/datafusion:vortex-file-compressed 13643022 / 13679710 / -0.3% 48544471 / 51813862 / -6.3% 0.28 / 0.26 / +6.4%
clickbench-sorted_q26/datafusion:vortex-file-compressed 14358022 / 13138567 / +9.3% 48668311 / 50203206 / -3.1% 0.30 / 0.26 / +12.7%
clickbench-sorted_q36/datafusion:vortex-file-compressed 29848891 / 29309894 / +1.8% 65328782 / 65131900 / +0.3% 0.46 / 0.45 / +1.5%
clickbench-sorted_q37/datafusion:vortex-file-compressed 23911852 / 24814257 / -3.6% 62552746 / 62406185 / +0.2% 0.38 / 0.40 / -3.9%
clickbench-sorted_q38/datafusion:vortex-file-compressed 35089542 / 36011462 / -2.6% 69982239 / 75062850 / -6.8% 0.50 / 0.48 / +4.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed 92820773 / 87872320 / +5.6% 119503658 / 119405372 / +0.1% 0.78 / 0.74 / +5.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 15810826 / 16019196 / -1.3% 45914545 / 52838309 / -13.1% 🟢 0.34 / 0.30 / +13.6%
clickbench-sorted_q41/datafusion:vortex-file-compressed 15112676 / 15795733 / -4.3% 44734790 / 48483166 / -7.7% 0.34 / 0.33 / +3.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed 13491234 / 13176899 / +2.4% 38049777 / 39912115 / -4.7% 0.35 / 0.33 / +7.4%
datafusion / parquet / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 759480050 / 755262073 / +0.6% 946587173 / 946034842 / +0.1% 0.80 / 0.80 / +0.5%
clickbench-sorted_q24/datafusion:parquet 9418554 / 8693911 / +8.3% 71693180 / 73376732 / -2.3% 0.13 / 0.12 / +10.9%
clickbench-sorted_q26/datafusion:parquet 8833461 / 8865838 / -0.4% 70972552 / 71979844 / -1.4% 0.12 / 0.12 / +1.0%
clickbench-sorted_q36/datafusion:parquet 94217239 / 93360016 / +0.9% 167928737 / 169776079 / -1.1% 0.56 / 0.55 / +2.0%
clickbench-sorted_q37/datafusion:parquet 64889487 / 64194708 / +1.1% 132344874 / 132700727 / -0.3% 0.49 / 0.48 / +1.4%
clickbench-sorted_q38/datafusion:parquet 87682312 / 87530256 / +0.2% 160207747 / 163658794 / -2.1% 0.55 / 0.53 / +2.3%
clickbench-sorted_q39/datafusion:parquet 159381348 / 159343764 / +0.0% 235307743 / 237285854 / -0.8% 0.68 / 0.67 / +0.9%
clickbench-sorted_q40/datafusion:parquet 44943258 / 44345862 / +1.3% 110758038 / 118003008 / -6.1% 0.41 / 0.38 / +8.0%
clickbench-sorted_q41/datafusion:parquet 42144242 / 42004087 / +0.3% 108853979 / 115759885 / -6.0% 0.39 / 0.36 / +6.7%
clickbench-sorted_q42/datafusion:parquet 26571516 / 26325193 / +0.9% 87446098 / 86101006 / +1.6% 0.30 / 0.31 / -0.6%
duckdb / vortex-file-compressed / ns (1.020x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 67822474 / 67073094 / +1.1% 87106914 / 95964474 / -9.2% 0.78 / 0.70 / +11.4%
clickbench-sorted_q24/duckdb:vortex-file-compressed 22482584 / 18231055 / +23.3% 🔴 34491694 / 31357730 / +10.0% 0.65 / 0.58 / +12.1%
clickbench-sorted_q26/duckdb:vortex-file-compressed 13905806 / 15576370 / -10.7% 🟢 22683525 / 27415477 / -17.3% 🟢 0.61 / 0.57 / +7.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed 42092790 / 43973935 / -4.3% 77968447 / 71045882 / +9.7% 0.54 / 0.62 / -12.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 39030670 / 37394622 / +4.4% 60355299 / 64695342 / -6.7% 0.65 / 0.58 / +11.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed 51631918 / 50528904 / +2.2% 75382316 / 72916058 / +3.4% 0.68 / 0.69 / -1.2%
clickbench-sorted_q39/duckdb:vortex-file-compressed 114696033 / 110318963 / +4.0% 142706954 / 146792105 / -2.8% 0.80 / 0.75 / +6.9%
clickbench-sorted_q40/duckdb:vortex-file-compressed 21322299 / 20805940 / +2.5% 39528869 / 43046325 / -8.2% 0.54 / 0.48 / +11.6%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21577963 / 20951718 / +3.0% 39897572 / 40882608 / -2.4% 0.54 / 0.51 / +5.5%
clickbench-sorted_q42/duckdb:vortex-file-compressed 17910123 / 18385056 / -2.6% 35406550 / 33658228 / +5.2% 0.51 / 0.55 / -7.4%
duckdb / parquet / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 126550597 / 130189146 / -2.8% 154979958 / 147329279 / +5.2% 0.82 / 0.88 / -7.6%
clickbench-sorted_q24/duckdb:parquet 17293151 / 18148814 / -4.7% 26901678 / 26787054 / +0.4% 0.64 / 0.68 / -5.1%
clickbench-sorted_q26/duckdb:parquet 13530381 / 12013124 / +12.6% 🔴 22679810 / 27303899 / -16.9% 🟢 0.60 / 0.44 / +35.6%
clickbench-sorted_q36/duckdb:parquet 46437346 / 45823888 / +1.3% 59796841 / 65615413 / -8.9% 0.78 / 0.70 / +11.2%
clickbench-sorted_q37/duckdb:parquet 30439037 / 32148370 / -5.3% 46533044 / 53623532 / -13.2% 🟢 0.65 / 0.60 / +9.1%
clickbench-sorted_q38/duckdb:parquet 38316163 / 40929408 / -6.4% 55251113 / 65162656 / -15.2% 🟢 0.69 / 0.63 / +10.4%
clickbench-sorted_q39/duckdb:parquet 77532884 / 73469477 / +5.5% 85967090 / 96304065 / -10.7% 🟢 0.90 / 0.76 / +18.2%
clickbench-sorted_q40/duckdb:parquet 17320974 / 17373074 / -0.3% 35591802 / 45555815 / -21.9% 🟢 0.49 / 0.38 / +27.6%
clickbench-sorted_q41/duckdb:parquet 17016948 / 16549246 / +2.8% 35154801 / 44072998 / -20.2% 🟢 0.48 / 0.38 / +28.9%
clickbench-sorted_q42/duckdb:parquet 11092180 / 11517325 / -3.7% 25013981 / 24532923 / +2.0% 0.44 / 0.47 / -5.5%

File Size Changes (100 files changed, -0.0% overall, 49↑ 51↓)
File Scale Format Base HEAD Change %
hits_023.vortex 1.0 vortex-file-compressed 194.32 MB 196.18 MB +1.85 MB +1.0%
hits_018.vortex 1.0 vortex-file-compressed 197.98 MB 199.38 MB +1.40 MB +0.7%
hits_071.vortex 1.0 vortex-file-compressed 138.68 MB 139.43 MB +771.04 KB +0.5%
hits_099.vortex 1.0 vortex-file-compressed 170.60 MB 171.44 MB +855.72 KB +0.5%
hits_074.vortex 1.0 vortex-file-compressed 197.73 MB 198.62 MB +911.18 KB +0.5%
hits_042.vortex 1.0 vortex-file-compressed 200.33 MB 201.08 MB +759.26 KB +0.4%
hits_039.vortex 1.0 vortex-file-compressed 160.05 MB 160.57 MB +527.90 KB +0.3%
hits_047.vortex 1.0 vortex-file-compressed 153.60 MB 154.07 MB +477.58 KB +0.3%
hits_040.vortex 1.0 vortex-file-compressed 142.41 MB 142.82 MB +418.65 KB +0.3%
hits_029.vortex 1.0 vortex-file-compressed 199.05 MB 199.60 MB +570.03 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 158.50 MB 158.94 MB +450.48 KB +0.3%
hits_011.vortex 1.0 vortex-file-compressed 198.21 MB 198.72 MB +530.29 KB +0.3%
hits_026.vortex 1.0 vortex-file-compressed 130.30 MB 130.63 MB +332.69 KB +0.2%
hits_055.vortex 1.0 vortex-file-compressed 198.60 MB 199.01 MB +423.91 KB +0.2%
hits_093.vortex 1.0 vortex-file-compressed 130.69 MB 130.95 MB +268.14 KB +0.2%
hits_000.vortex 1.0 vortex-file-compressed 130.51 MB 130.75 MB +254.97 KB +0.2%
hits_025.vortex 1.0 vortex-file-compressed 171.05 MB 171.38 MB +329.75 KB +0.2%
hits_052.vortex 1.0 vortex-file-compressed 129.79 MB 130.01 MB +224.13 KB +0.2%
hits_064.vortex 1.0 vortex-file-compressed 189.89 MB 190.20 MB +324.47 KB +0.2%
hits_019.vortex 1.0 vortex-file-compressed 139.65 MB 139.85 MB +201.73 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 159.50 MB 159.72 MB +226.65 KB +0.1%
hits_061.vortex 1.0 vortex-file-compressed 159.75 MB 159.97 MB +221.27 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 146.02 MB 146.21 MB +199.86 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.27 MB 130.44 MB +178.12 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 179.87 MB 180.07 MB +205.37 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 138.57 MB 138.71 MB +149.88 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 199.33 MB 199.53 MB +205.59 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 166.49 MB 166.66 MB +171.42 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 198.29 MB 198.48 MB +192.51 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.24 MB 199.42 MB +186.96 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 138.88 MB 138.99 MB +120.56 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.08 MB 130.18 MB +97.37 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 171.74 MB 171.85 MB +115.03 KB +0.1%
hits_070.vortex 1.0 vortex-file-compressed 199.38 MB 199.50 MB +128.27 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.68 MB 153.78 MB +94.49 KB +0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.20 MB 159.28 MB +83.27 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.24 MB 191.33 MB +84.58 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.56 MB 153.61 MB +50.80 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.82 MB 130.86 MB +37.30 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 180.76 MB 180.81 MB +47.90 KB +0.0%
hits_066.vortex 1.0 vortex-file-compressed 162.33 MB 162.36 MB +34.53 KB +0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.86 MB 130.87 MB +17.25 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.09 MB 146.11 MB +18.97 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.85 MB 125.86 MB +14.11 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.19 MB 154.20 MB +8.27 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.21 MB 126.21 MB +4.02 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 160.05 MB 160.06 MB +3.81 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.63 MB 100.63 MB +1.59 KB +0.0%
hits_033.vortex 1.0 vortex-file-compressed 199.50 MB 199.50 MB +176 B +0.0%
hits_096.vortex 1.0 vortex-file-compressed 198.71 MB 198.71 MB 1.60 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 199.47 MB 199.46 MB 4.40 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.70 MB 135.70 MB 3.34 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.67 MB 101.66 MB 7.49 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 134.56 MB 134.55 MB 12.55 KB -0.0%
hits_027.vortex 1.0 vortex-file-compressed 188.91 MB 188.88 MB 25.05 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.50 MB 130.48 MB 17.94 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 188.92 MB 188.90 MB 26.19 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 198.29 MB 198.26 MB 29.59 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.64 MB 130.62 MB 25.07 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 150.73 MB 150.70 MB 29.69 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.39 MB 179.36 MB 37.25 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 159.95 MB 159.91 MB 36.35 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.52 MB 176.47 MB 47.69 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.67 MB 141.62 MB 48.80 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.85 MB 145.79 MB 54.26 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 160.06 MB 160.00 MB 59.75 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 171.84 MB 171.77 MB 73.55 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 157.98 MB 157.91 MB 67.65 KB -0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.15 MB 159.08 MB 69.48 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.86 MB 153.78 MB 74.08 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.70 MB 125.64 MB 61.77 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 190.44 MB 190.35 MB 94.29 KB -0.0%
hits_090.vortex 1.0 vortex-file-compressed 191.67 MB 191.58 MB 95.20 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 191.85 MB 191.75 MB 102.22 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 160.25 MB 160.16 MB 86.20 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 130.97 MB 130.89 MB 79.50 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 171.44 MB 171.33 MB 107.66 KB -0.1%
hits_065.vortex 1.0 vortex-file-compressed 160.33 MB 160.22 MB 108.30 KB -0.1%
hits_045.vortex 1.0 vortex-file-compressed 139.51 MB 139.42 MB 98.94 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 170.87 MB 170.75 MB 122.41 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.23 MB 168.09 MB 143.98 KB -0.1%
hits_012.vortex 1.0 vortex-file-compressed 189.98 MB 189.78 MB 201.70 KB -0.1%
hits_050.vortex 1.0 vortex-file-compressed 160.12 MB 159.91 MB 213.49 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.28 MB 169.98 MB 303.95 KB -0.2%
hits_048.vortex 1.0 vortex-file-compressed 198.01 MB 197.65 MB 373.91 KB -0.2%
hits_073.vortex 1.0 vortex-file-compressed 172.28 MB 171.92 MB 373.97 KB -0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.77 MB 130.48 MB 295.57 KB -0.2%
hits_009.vortex 1.0 vortex-file-compressed 100.84 MB 100.57 MB 273.36 KB -0.3%
hits_095.vortex 1.0 vortex-file-compressed 153.90 MB 153.45 MB 458.01 KB -0.3%
hits_083.vortex 1.0 vortex-file-compressed 156.56 MB 156.07 MB 501.59 KB -0.3%
hits_098.vortex 1.0 vortex-file-compressed 137.08 MB 136.52 MB 571.20 KB -0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.05 MB 171.31 MB 756.73 KB -0.4%
hits_060.vortex 1.0 vortex-file-compressed 193.24 MB 192.09 MB 1.14 MB -0.6%
hits_035.vortex 1.0 vortex-file-compressed 102.74 MB 102.10 MB 658.13 KB -0.6%
hits_081.vortex 1.0 vortex-file-compressed 199.36 MB 197.99 MB 1.37 MB -0.7%
hits_094.vortex 1.0 vortex-file-compressed 157.50 MB 156.36 MB 1.14 MB -0.7%
hits_092.vortex 1.0 vortex-file-compressed 199.29 MB 197.51 MB 1.78 MB -0.9%
hits_038.vortex 1.0 vortex-file-compressed 191.21 MB 189.39 MB 1.83 MB -1.0%
hits_001.vortex 1.0 vortex-file-compressed 190.48 MB 187.99 MB 2.49 MB -1.3%
hits_075.vortex 1.0 vortex-file-compressed 191.25 MB 188.47 MB 2.78 MB -1.5%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.87 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.7%
Engines: DataFusion No clear signal (-6.1%, environment too noisy confidence) · DuckDB No clear signal (-7.3%, environment too noisy confidence)
Vortex (geomean): hot 0.964x ➖ · cold 1.019x ➖
Parquet (geomean): hot 1.034x ➖ · cold 1.035x ➖
Shifts: Parquet (control) +3.4% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.954x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 74586209 / 37037920 / +101.4% 🔴 187893544 / 106729309 / +76.0% 🔴 0.40 / 0.35 / +14.4%
fineweb_q01/datafusion:vortex-file-compressed 395261975 / 403007344 / -1.9% 730090599 / 609304490 / +19.8% 0.54 / 0.66 / -18.1%
fineweb_q02/datafusion:vortex-file-compressed 400464673 / 367153932 / +9.1% 628298631 / 535825921 / +17.3% 0.64 / 0.69 / -7.0%
fineweb_q03/datafusion:vortex-file-compressed 535996813 / 502353269 / +6.7% 738920035 / 826499853 / -10.6% 0.73 / 0.61 / +19.3%
fineweb_q04/datafusion:vortex-file-compressed 445866699 / 451587586 / -1.3% 533216550 / 476356208 / +11.9% 0.84 / 0.95 / -11.8%
fineweb_q05/datafusion:vortex-file-compressed 441394928 / 655989091 / -32.7% 🟢 482179516 / 675028623 / -28.6% 0.92 / 0.97 / -5.8%
fineweb_q06/datafusion:vortex-file-compressed 693525008 / 966084720 / -28.2% 685214847 / 916526373 / -25.2% 1.01 / 1.05 / -4.0%
fineweb_q07/datafusion:vortex-file-compressed 491234063 / 875407083 / -43.9% 🟢 467278477 / 579734252 / -19.4% 1.05 / 1.51 / -30.4%
fineweb_q08/datafusion:vortex-file-compressed 203295054 / 190319298 / +6.8% 225984100 / 190116044 / +18.9% 0.90 / 1.00 / -10.1%
datafusion / parquet / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 514073328 / 458799773 / +12.0% 833952317 / 708670048 / +17.7% 0.62 / 0.65 / -4.8%
fineweb_q01/datafusion:parquet 776008194 / 744214338 / +4.3% 989515134 / 839658597 / +17.8% 0.78 / 0.89 / -11.5%
fineweb_q02/datafusion:parquet 730682717 / 776334310 / -5.9% 630137836 / 746625288 / -15.6% 1.16 / 1.04 / +11.5%
fineweb_q03/datafusion:parquet 721970214 / 713231089 / +1.2% 595483870 / 731009512 / -18.5% 1.21 / 0.98 / +24.3%
fineweb_q04/datafusion:parquet 891584842 / 878271644 / +1.5% 1000035600 / 800152283 / +25.0% 0.89 / 1.10 / -18.8%
fineweb_q05/datafusion:parquet 757185657 / 760605086 / -0.4% 896596659 / 892082059 / +0.5% 0.84 / 0.85 / -1.0%
fineweb_q06/datafusion:parquet 771485174 / 819921590 / -5.9% 807964270 / 793748378 / +1.8% 0.95 / 1.03 / -7.6%
fineweb_q07/datafusion:parquet 782854323 / 743595056 / +5.3% 739736356 / 700859175 / +5.5% 1.06 / 1.06 / -0.3%
fineweb_q08/datafusion:parquet 802414953 / 774617648 / +3.6% 773053550 / 775243287 / -0.3% 1.04 / 1.00 / +3.9%
duckdb / vortex-file-compressed / ns (0.974x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 51041597 / 68261399 / -25.2% 61555328 / 72088562 / -14.6% 0.83 / 0.95 / -12.4%
fineweb_q01/duckdb:vortex-file-compressed 449035792 / 419527111 / +7.0% 462132088 / 470160390 / -1.7% 0.97 / 0.89 / +8.9%
fineweb_q02/duckdb:vortex-file-compressed 599925418 / 561730012 / +6.8% 772428105 / 596895854 / +29.4% 0.78 / 0.94 / -17.5%
fineweb_q03/duckdb:vortex-file-compressed 1017015282 / 1027391967 / -1.0% 1237691559 / 1082097893 / +14.4% 0.82 / 0.95 / -13.5%
fineweb_q04/duckdb:vortex-file-compressed 971152822 / 979154938 / -0.8% 951962260 / 1086979568 / -12.4% 1.02 / 0.90 / +13.2%
fineweb_q05/duckdb:vortex-file-compressed 868578503 / 875745618 / -0.8% 948400875 / 937401126 / +1.2% 0.92 / 0.93 / -2.0%
fineweb_q06/duckdb:vortex-file-compressed 1148217046 / 1171904903 / -2.0% 1193338238 / 1226306749 / -2.7% 0.96 / 0.96 / +0.7%
fineweb_q07/duckdb:vortex-file-compressed 981864860 / 962873223 / +2.0% 983595492 / 988286938 / -0.5% 1.00 / 0.97 / +2.5%
fineweb_q08/duckdb:vortex-file-compressed 404732942 / 426681174 / -5.1% 489901793 / 468464133 / +4.6% 0.83 / 0.91 / -9.3%
duckdb / parquet / ns (1.051x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 485218716 / 545855130 / -11.1% 536618006 / 534854667 / +0.3% 0.90 / 1.02 / -11.4%
fineweb_q01/duckdb:parquet 614005158 / 555138852 / +10.6% 560384405 / 645560455 / -13.2% 1.10 / 0.86 / +27.4%
fineweb_q02/duckdb:parquet 601200758 / 546481494 / +10.0% 582163310 / 561357233 / +3.7% 1.03 / 0.97 / +6.1%
fineweb_q03/duckdb:parquet 1385266440 / 1315407648 / +5.3% 1455975028 / 1334119515 / +9.1% 0.95 / 0.99 / -3.5%
fineweb_q04/duckdb:parquet 884243242 / 787784162 / +12.2% 1103458170 / 762752795 / +44.7% 🔴 0.80 / 1.03 / -22.4%
fineweb_q05/duckdb:parquet 919151520 / 880854159 / +4.3% 876911243 / 899698080 / -2.5% 1.05 / 0.98 / +7.1%
fineweb_q06/duckdb:parquet 1649009164 / 1684317484 / -2.1% 1621601509 / 1602048742 / +1.2% 1.02 / 1.05 / -3.3%
fineweb_q07/duckdb:parquet 1079058474 / 1062558370 / +1.6% 1255019660 / 1158533972 / +8.3% 0.86 / 0.92 / -6.3%
fineweb_q08/duckdb:parquet 578999150 / 489880064 / +18.2% 502137443 / 528735455 / -5.0% 1.15 / 0.93 / +24.5%

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 1.030x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.021x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1274450 / 1228824 / +3.7% 22059867 / 20869531 / +5.7% 0.06 / 0.06 / -1.9%
clickbench_q01/datafusion:vortex-file-compressed 6691219 / 6849518 / -2.3% 35727694 / 34285181 / +4.2% 0.19 / 0.20 / -6.3%
clickbench_q02/datafusion:vortex-file-compressed 13079878 / 12618847 / +3.7% 40599369 / 42781043 / -5.1% 0.32 / 0.29 / +9.2%
clickbench_q03/datafusion:vortex-file-compressed 13004460 / 12506676 / +4.0% 54035049 / 49348270 / +9.5% 0.24 / 0.25 / -5.0%
clickbench_q04/datafusion:vortex-file-compressed 56882953 / 56256750 / +1.1% 93005566 / 91309811 / +1.9% 0.61 / 0.62 / -0.7%
clickbench_q05/datafusion:vortex-file-compressed 79050744 / 77245789 / +2.3% 112762142 / 117059999 / -3.7% 0.70 / 0.66 / +6.2%
clickbench_q06/datafusion:vortex-file-compressed 1253725 / 1262086 / -0.7% 20926278 / 20312485 / +3.0% 0.06 / 0.06 / -3.6%
clickbench_q07/datafusion:vortex-file-compressed 13051039 / 13306120 / -1.9% 37866413 / 37316792 / +1.5% 0.34 / 0.36 / -3.3%
clickbench_q08/datafusion:vortex-file-compressed 80986646 / 78385838 / +3.3% 118116071 / 115753159 / +2.0% 0.69 / 0.68 / +1.3%
clickbench_q09/datafusion:vortex-file-compressed 175818484 / 171319392 / +2.6% 208603528 / 205029196 / +1.7% 0.84 / 0.84 / +0.9%
clickbench_q10/datafusion:vortex-file-compressed 39794470 / 40400728 / -1.5% 70215069 / 68772120 / +2.1% 0.57 / 0.59 / -3.5%
clickbench_q11/datafusion:vortex-file-compressed 50802299 / 57387357 / -11.5% 🟢 82449859 / 83440115 / -1.2% 0.62 / 0.69 / -10.4%
clickbench_q12/datafusion:vortex-file-compressed 75853323 / 79249370 / -4.3% 120051700 / 116696856 / +2.9% 0.63 / 0.68 / -7.0%
clickbench_q13/datafusion:vortex-file-compressed 123602348 / 124574314 / -0.8% 180452827 / 180201854 / +0.1% 0.68 / 0.69 / -0.9%
clickbench_q14/datafusion:vortex-file-compressed 85560334 / 87569582 / -2.3% 123046432 / 127418382 / -3.4% 0.70 / 0.69 / +1.2%
clickbench_q15/datafusion:vortex-file-compressed 62877197 / 63311204 / -0.7% 100337778 / 93663804 / +7.1% 0.63 / 0.68 / -7.3%
clickbench_q16/datafusion:vortex-file-compressed 155084124 / 159381188 / -2.7% 197818793 / 201499547 / -1.8% 0.78 / 0.79 / -0.9%
clickbench_q17/datafusion:vortex-file-compressed 153450495 / 154797554 / -0.9% 209478300 / 205022552 / +2.2% 0.73 / 0.76 / -3.0%
clickbench_q18/datafusion:vortex-file-compressed 309390816 / 302377053 / +2.3% 378560732 / 364231150 / +3.9% 0.82 / 0.83 / -1.6%
clickbench_q19/datafusion:vortex-file-compressed 8520138 / 8180537 / +4.2% 47734379 / 45812604 / +4.2% 0.18 / 0.18 / -0.0%
clickbench_q20/datafusion:vortex-file-compressed 68179048 / 68591110 / -0.6% 228028994 / 229995612 / -0.9% 0.30 / 0.30 / +0.3%
clickbench_q21/datafusion:vortex-file-compressed 98390618 / 99381825 / -1.0% 262146168 / 266090062 / -1.5% 0.38 / 0.37 / +0.5%
clickbench_q22/datafusion:vortex-file-compressed 119181370 / 120903232 / -1.4% 340880031 / 342270188 / -0.4% 0.35 / 0.35 / -1.0%
clickbench_q23/datafusion:vortex-file-compressed 340864491 / 368612896 / -7.5% 629523770 / 647927802 / -2.8% 0.54 / 0.57 / -4.8%
clickbench_q24/datafusion:vortex-file-compressed 21337545 / 21394687 / -0.3% 63820869 / 59947963 / +6.5% 0.33 / 0.36 / -6.3%
clickbench_q25/datafusion:vortex-file-compressed 26762952 / 25040815 / +6.9% 59022527 / 57447677 / +2.7% 0.45 / 0.44 / +4.0%
clickbench_q26/datafusion:vortex-file-compressed 21098064 / 21797860 / -3.2% 68099978 / 62023449 / +9.8% 0.31 / 0.35 / -11.8%
clickbench_q27/datafusion:vortex-file-compressed 101384202 / 103463716 / -2.0% 249012038 / 244016688 / +2.0% 0.41 / 0.42 / -4.0%
clickbench_q28/datafusion:vortex-file-compressed 571277356 / 560840242 / +1.9% 627912374 / 650816150 / -3.5% 0.91 / 0.86 / +5.6%
clickbench_q29/datafusion:vortex-file-compressed 24341462 / 25263342 / -3.6% 52104926 / 50636918 / +2.9% 0.47 / 0.50 / -6.4%
clickbench_q30/datafusion:vortex-file-compressed 89335942 / 85617837 / +4.3% 125019373 / 117708646 / +6.2% 0.71 / 0.73 / -1.8%
clickbench_q31/datafusion:vortex-file-compressed 84759334 / 84681566 / +0.1% 150563868 / 151588354 / -0.7% 0.56 / 0.56 / +0.8%
clickbench_q32/datafusion:vortex-file-compressed 292924466 / 298532409 / -1.9% 374312452 / 373148943 / +0.3% 0.78 / 0.80 / -2.2%
clickbench_q33/datafusion:vortex-file-compressed 338351388 / 327598339 / +3.3% 412521764 / 410770147 / +0.4% 0.82 / 0.80 / +2.8%
clickbench_q34/datafusion:vortex-file-compressed 333328292 / 332215309 / +0.3% 418601041 / 423930094 / -1.3% 0.80 / 0.78 / +1.6%
clickbench_q35/datafusion:vortex-file-compressed 56815253 / 57356920 / -0.9% 91660268 / 90572966 / +1.2% 0.62 / 0.63 / -2.1%
clickbench_q36/datafusion:vortex-file-compressed 37819295 / 37507894 / +0.8% 66482605 / 65794107 / +1.0% 0.57 / 0.57 / -0.2%
clickbench_q37/datafusion:vortex-file-compressed 22191544 / 21978096 / +1.0% 48491450 / 46961511 / +3.3% 0.46 / 0.47 / -2.2%
clickbench_q38/datafusion:vortex-file-compressed 12439877 / 12520116 / -0.6% 39832990 / 39601414 / +0.6% 0.31 / 0.32 / -1.2%
clickbench_q39/datafusion:vortex-file-compressed 78925156 / 79356188 / -0.5% 111965350 / 109793609 / +2.0% 0.70 / 0.72 / -2.5%
clickbench_q40/datafusion:vortex-file-compressed 11724192 / 11114669 / +5.5% 37393261 / 36952475 / +1.2% 0.31 / 0.30 / +4.2%
clickbench_q41/datafusion:vortex-file-compressed 10928502 / 10665457 / +2.5% 35806886 / 35722250 / +0.2% 0.31 / 0.30 / +2.2%
clickbench_q42/datafusion:vortex-file-compressed 11066220 / 11028888 / +0.3% 36776292 / 35812172 / +2.7% 0.30 / 0.31 / -2.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1269732 / 1267179 / +0.2% 50501191 / 48897128 / +3.3% 0.03 / 0.03 / -3.0%
clickbench_q01/datafusion:parquet 15908737 / 16476994 / -3.4% 70528642 / 71810928 / -1.8% 0.23 / 0.23 / -1.7%
clickbench_q02/datafusion:parquet 18619746 / 19667650 / -5.3% 83429448 / 81939375 / +1.8% 0.22 / 0.24 / -7.0%
clickbench_q03/datafusion:parquet 16849843 / 16844478 / +0.0% 84780199 / 77775932 / +9.0% 0.20 / 0.22 / -8.2%
clickbench_q04/datafusion:parquet 62153862 / 62182769 / -0.0% 128053532 / 124750731 / +2.6% 0.49 / 0.50 / -2.6%
clickbench_q05/datafusion:parquet 86618381 / 87131332 / -0.6% 157094329 / 154127749 / +1.9% 0.55 / 0.57 / -2.5%
clickbench_q06/datafusion:parquet 1265220 / 1284305 / -1.5% 50305496 / 48120942 / +4.5% 0.03 / 0.03 / -5.8%
clickbench_q07/datafusion:parquet 16761352 / 17093708 / -1.9% 69531247 / 68036563 / +2.2% 0.24 / 0.25 / -4.1%
clickbench_q08/datafusion:parquet 83728674 / 84400649 / -0.8% 166606705 / 162254383 / +2.7% 0.50 / 0.52 / -3.4%
clickbench_q09/datafusion:parquet 187652556 / 183562754 / +2.2% 275654199 / 257460682 / +7.1% 0.68 / 0.71 / -4.5%
clickbench_q10/datafusion:parquet 35720382 / 35489980 / +0.6% 105422050 / 98889684 / +6.6% 0.34 / 0.36 / -5.6%
clickbench_q11/datafusion:parquet 42049206 / 41966875 / +0.2% 111840005 / 106906631 / +4.6% 0.38 / 0.39 / -4.2%
clickbench_q12/datafusion:parquet 93902660 / 94186990 / -0.3% 162446197 / 156804702 / +3.6% 0.58 / 0.60 / -3.8%
clickbench_q13/datafusion:parquet 145283650 / 144668972 / +0.4% 223019158 / 222047216 / +0.4% 0.65 / 0.65 / -0.0%
clickbench_q14/datafusion:parquet 100110228 / 99724335 / +0.4% 177122411 / 166613527 / +6.3% 0.57 / 0.60 / -5.6%
clickbench_q15/datafusion:parquet 71715580 / 71644296 / +0.1% 133557234 / 128072880 / +4.3% 0.54 / 0.56 / -4.0%
clickbench_q16/datafusion:parquet 153789162 / 152454928 / +0.9% 230453706 / 229087836 / +0.6% 0.67 / 0.67 / +0.3%
clickbench_q17/datafusion:parquet 152924256 / 155142638 / -1.4% 236419524 / 232635839 / +1.6% 0.65 / 0.67 / -3.0%
clickbench_q18/datafusion:parquet 308552427 / 311654008 / -1.0% 408617730 / 409395593 / -0.2% 0.76 / 0.76 / -0.8%
clickbench_q19/datafusion:parquet 19309994 / 18675335 / +3.4% 76150438 / 69786027 / +9.1% 0.25 / 0.27 / -5.2%
clickbench_q20/datafusion:parquet 170868532 / 168837024 / +1.2% 283901009 / 273792641 / +3.7% 0.60 / 0.62 / -2.4%
clickbench_q21/datafusion:parquet 163841932 / 162309491 / +0.9% 293629971 / 284817414 / +3.1% 0.56 / 0.57 / -2.1%
clickbench_q22/datafusion:parquet 248181086 / 246820594 / +0.6% 424533932 / 409588441 / +3.6% 0.58 / 0.60 / -3.0%
clickbench_q23/datafusion:parquet 951237207 / 974036692 / -2.3% 1168355485 / 1169795471 / -0.1% 0.81 / 0.83 / -2.2%
clickbench_q24/datafusion:parquet 29579244 / 29971328 / -1.3% 88996842 / 86756306 / +2.6% 0.33 / 0.35 / -3.8%
clickbench_q25/datafusion:parquet 35647374 / 35592884 / +0.2% 102611617 / 96842506 / +6.0% 0.35 / 0.37 / -5.5%
clickbench_q26/datafusion:parquet 30588922 / 30519486 / +0.2% 91243843 / 87850110 / +3.9% 0.34 / 0.35 / -3.5%
clickbench_q27/datafusion:parquet 181592496 / 182222441 / -0.3% 281243334 / 268693277 / +4.7% 0.65 / 0.68 / -4.8%
clickbench_q28/datafusion:parquet 621463462 / 614321054 / +1.2% 698161352 / 690691717 / +1.1% 0.89 / 0.89 / +0.1%
clickbench_q29/datafusion:parquet 29416243 / 28611308 / +2.8% 92920864 / 91170416 / +1.9% 0.32 / 0.31 / +0.9%
clickbench_q30/datafusion:parquet 89875869 / 90015678 / -0.2% 171982308 / 165212354 / +4.1% 0.52 / 0.54 / -4.1%
clickbench_q31/datafusion:parquet 99384966 / 100151206 / -0.8% 193074058 / 185608007 / +4.0% 0.51 / 0.54 / -4.6%
clickbench_q32/datafusion:parquet 311999844 / 314304620 / -0.7% 411113626 / 406069469 / +1.2% 0.76 / 0.77 / -2.0%
clickbench_q33/datafusion:parquet 369172165 / 372923973 / -1.0% 457550962 / 459354408 / -0.4% 0.81 / 0.81 / -0.6%
clickbench_q34/datafusion:parquet 368069924 / 372735162 / -1.3% 462296359 / 457439701 / +1.1% 0.80 / 0.81 / -2.3%
clickbench_q35/datafusion:parquet 63997047 / 65362462 / -2.1% 123462940 / 123455317 / +0.0% 0.52 / 0.53 / -2.1%
clickbench_q36/datafusion:parquet 72743090 / 72425824 / +0.4% 135686580 / 134225481 / +1.1% 0.54 / 0.54 / -0.6%
clickbench_q37/datafusion:parquet 35352906 / 35246616 / +0.3% 92176609 / 90880530 / +1.4% 0.38 / 0.39 / -1.1%
clickbench_q38/datafusion:parquet 46808187 / 46940270 / -0.3% 108710801 / 105738873 / +2.8% 0.43 / 0.44 / -3.0%
clickbench_q39/datafusion:parquet 142554488 / 142413936 / +0.1% 211097929 / 206151075 / +2.4% 0.68 / 0.69 / -2.2%
clickbench_q40/datafusion:parquet 19835994 / 19720538 / +0.6% 78811951 / 76484247 / +3.0% 0.25 / 0.26 / -2.4%
clickbench_q41/datafusion:parquet 18660948 / 18514404 / +0.8% 75671949 / 75493208 / +0.2% 0.25 / 0.25 / +0.6%
clickbench_q42/datafusion:parquet 19107082 / 19307409 / -1.0% 74512651 / 74611131 / -0.1% 0.26 / 0.26 / -0.9%
duckdb / vortex-file-compressed / ns (0.986x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1544805 / 1571926 / -1.7% 29071855 / 28130911 / +3.3% 0.05 / 0.06 / -4.9%
clickbench_q01/duckdb:vortex-file-compressed 12293476 / 12176794 / +1.0% 28159736 / 26868830 / +4.8% 0.44 / 0.45 / -3.7%
clickbench_q02/duckdb:vortex-file-compressed 13962556 / 16200667 / -13.8% 🟢 36224148 / 33783921 / +7.2% 0.39 / 0.48 / -19.6%
clickbench_q03/duckdb:vortex-file-compressed 18210356 / 18283416 / -0.4% 48454824 / 41266403 / +17.4% 🔴 0.38 / 0.44 / -15.2%
clickbench_q04/duckdb:vortex-file-compressed 72283256 / 68665522 / +5.3% 103363017 / 94703886 / +9.1% 0.70 / 0.73 / -3.6%
clickbench_q05/duckdb:vortex-file-compressed 68830347 / 68533419 / +0.4% 91396756 / 88689910 / +3.1% 0.75 / 0.77 / -2.5%
clickbench_q06/duckdb:vortex-file-compressed 1812373 / 1888322 / -4.0% 30976206 / 30517023 / +1.5% 0.06 / 0.06 / -5.4%
clickbench_q07/duckdb:vortex-file-compressed 13756785 / 17115076 / -19.6% 🟢 34195356 / 31163335 / +9.7% 0.40 / 0.55 / -26.7%
clickbench_q08/duckdb:vortex-file-compressed 84449148 / 83063782 / +1.7% 126508839 / 120871401 / +4.7% 0.67 / 0.69 / -2.9%
clickbench_q09/duckdb:vortex-file-compressed 112335164 / 106227831 / +5.7% 148933413 / 141770292 / +5.1% 0.75 / 0.75 / +0.7%
clickbench_q10/duckdb:vortex-file-compressed 45316938 / 43672492 / +3.8% 77579261 / 73777497 / +5.2% 0.58 / 0.59 / -1.3%
clickbench_q11/duckdb:vortex-file-compressed 58420910 / 58365795 / +0.1% 96027968 / 85778965 / +11.9% 🔴 0.61 / 0.68 / -10.6%
clickbench_q12/duckdb:vortex-file-compressed 73630696 / 76724044 / -4.0% 105575969 / 108249690 / -2.5% 0.70 / 0.71 / -1.6%
clickbench_q13/duckdb:vortex-file-compressed 147713161 / 141586347 / +4.3% 184287505 / 181004507 / +1.8% 0.80 / 0.78 / +2.5%
clickbench_q14/duckdb:vortex-file-compressed 83226367 / 93890562 / -11.4% 🟢 121871308 / 107437586 / +13.4% 🔴 0.68 / 0.87 / -21.9%
clickbench_q15/duckdb:vortex-file-compressed 93358752 / 93088980 / +0.3% 132361298 / 126612562 / +4.5% 0.71 / 0.74 / -4.1%
clickbench_q16/duckdb:vortex-file-compressed 161994759 / 161582728 / +0.3% 211887327 / 205431751 / +3.1% 0.76 / 0.79 / -2.8%
clickbench_q17/duckdb:vortex-file-compressed 166853738 / 165414144 / +0.9% 233168587 / 233873545 / -0.3% 0.72 / 0.71 / +1.2%
clickbench_q18/duckdb:vortex-file-compressed 326838950 / 316644034 / +3.2% 379825888 / 374070550 / +1.5% 0.86 / 0.85 / +1.7%
clickbench_q19/duckdb:vortex-file-compressed 16983702 / 16121201 / +5.4% 42867017 / 37193701 / +15.3% 🔴 0.40 / 0.43 / -8.6%
clickbench_q20/duckdb:vortex-file-compressed 126649322 / 127230886 / -0.5% 206185888 / 196887800 / +4.7% 0.61 / 0.65 / -4.9%
clickbench_q21/duckdb:vortex-file-compressed 181149052 / 179262182 / +1.1% 323988447 / 299451555 / +8.2% 0.56 / 0.60 / -6.6%
clickbench_q22/duckdb:vortex-file-compressed 286491287 / 282140014 / +1.5% 548253452 / 464056042 / +18.1% 🔴 0.52 / 0.61 / -14.1%
clickbench_q23/duckdb:vortex-file-compressed 70448120 / 73582450 / -4.3% 109638895 / 115503144 / -5.1% 0.64 / 0.64 / +0.9%
clickbench_q24/duckdb:vortex-file-compressed 27660524 / 25542612 / +8.3% 46795561 / 41350679 / +13.2% 🔴 0.59 / 0.62 / -4.3%
clickbench_q25/duckdb:vortex-file-compressed 35172365 / 36414020 / -3.4% 53033144 / 52441349 / +1.1% 0.66 / 0.69 / -4.5%
clickbench_q26/duckdb:vortex-file-compressed 20075502 / 23274278 / -13.7% 🟢 38592644 / 34667674 / +11.3% 🔴 0.52 / 0.67 / -22.5%
clickbench_q27/duckdb:vortex-file-compressed 171370690 / 171328485 / +0.0% 276023334 / 264730927 / +4.3% 0.62 / 0.65 / -4.1%
clickbench_q28/duckdb:vortex-file-compressed 596644279 / 662791307 / -10.0% 690994460 / 684980788 / +0.9% 0.86 / 0.97 / -10.8%
clickbench_q29/duckdb:vortex-file-compressed 17666038 / 17802920 / -0.8% 38632755 / 41008311 / -5.8% 0.46 / 0.43 / +5.3%
clickbench_q30/duckdb:vortex-file-compressed 92140974 / 91701600 / +0.5% 133310815 / 125790486 / +6.0% 0.69 / 0.73 / -5.2%
clickbench_q31/duckdb:vortex-file-compressed 141405836 / 141100319 / +0.2% 226100697 / 207975543 / +8.7% 0.63 / 0.68 / -7.8%
clickbench_q32/duckdb:vortex-file-compressed 445737376 / 441156992 / +1.0% 478981867 / 475215656 / +0.8% 0.93 / 0.93 / +0.2%
clickbench_q33/duckdb:vortex-file-compressed 410305612 / 398307368 / +3.0% 532184221 / 507007878 / +5.0% 0.77 / 0.79 / -1.9%
clickbench_q34/duckdb:vortex-file-compressed 418992596 / 425687592 / -1.6% 581796232 / 537535790 / +8.2% 0.72 / 0.79 / -9.1%
clickbench_q35/duckdb:vortex-file-compressed 103667212 / 103873996 / -0.2% 142646928 / 144752402 / -1.5% 0.73 / 0.72 / +1.3%
clickbench_q36/duckdb:vortex-file-compressed 18589646 / 17809708 / +4.4% 36893266 / 33365726 / +10.6% 🔴 0.50 / 0.53 / -5.6%
clickbench_q37/duckdb:vortex-file-compressed 12782728 / 13372723 / -4.4% 26497355 / 30172818 / -12.2% 🟢 0.48 / 0.44 / +8.8%
clickbench_q38/duckdb:vortex-file-compressed 14104896 / 14670064 / -3.9% 32571928 / 29425454 / +10.7% 🔴 0.43 / 0.50 / -13.1%
clickbench_q39/duckdb:vortex-file-compressed 26869586 / 27747328 / -3.2% 42928186 / 42514008 / +1.0% 0.63 / 0.65 / -4.1%
clickbench_q40/duckdb:vortex-file-compressed 11031258 / 11785936 / -6.4% 27304994 / 27922561 / -2.2% 0.40 / 0.42 / -4.3%
clickbench_q41/duckdb:vortex-file-compressed 14688486 / 14395812 / +2.0% 28375674 / 27255924 / +4.1% 0.52 / 0.53 / -2.0%
clickbench_q42/duckdb:vortex-file-compressed 13884186 / 13681622 / +1.5% 28607028 / 31274933 / -8.5% 0.49 / 0.44 / +10.9%
duckdb / parquet / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8154597 / 9043872 / -9.8% 21013880 / 22119576 / -5.0% 0.39 / 0.41 / -5.1%
clickbench_q01/duckdb:parquet 9909860 / 9443946 / +4.9% 20130857 / 23603399 / -14.7% 🟢 0.49 / 0.40 / +23.0%
clickbench_q02/duckdb:parquet 15275483 / 16953998 / -9.9% 32568511 / 33715194 / -3.4% 0.47 / 0.50 / -6.7%
clickbench_q03/duckdb:parquet 15891021 / 16953328 / -6.3% 55257054 / 48924972 / +12.9% 🔴 0.29 / 0.35 / -17.0%
clickbench_q04/duckdb:parquet 70209634 / 69848512 / +0.5% 95066862 / 92254755 / +3.0% 0.74 / 0.76 / -2.5%
clickbench_q05/duckdb:parquet 84022394 / 82569127 / +1.8% 115277373 / 125178494 / -7.9% 0.73 / 0.66 / +10.5%
clickbench_q06/duckdb:parquet 14724149 / 15463020 / -4.8% 24992194 / 23354866 / +7.0% 0.59 / 0.66 / -11.0%
clickbench_q07/duckdb:parquet 11762187 / 11683638 / +0.7% 26782211 / 20416058 / +31.2% 🔴 0.44 / 0.57 / -23.3%
clickbench_q08/duckdb:parquet 85312464 / 82270232 / +3.7% 132157948 / 122346133 / +8.0% 0.65 / 0.67 / -4.0%
clickbench_q09/duckdb:parquet 115660576 / 113205476 / +2.2% 157741201 / 148239692 / +6.4% 0.73 / 0.76 / -4.0%
clickbench_q10/duckdb:parquet 39534404 / 32033430 / +23.4% 🔴 72372263 / 69070549 / +4.8% 0.55 / 0.46 / +17.8%
clickbench_q11/duckdb:parquet 36907254 / 37597668 / -1.8% 77871111 / 74069776 / +5.1% 0.47 / 0.51 / -6.6%
clickbench_q12/duckdb:parquet 96149756 / 91832286 / +4.7% 137932863 / 134841557 / +2.3% 0.70 / 0.68 / +2.4%
clickbench_q13/duckdb:parquet 148364408 / 145002132 / +2.3% 211235518 / 204173331 / +3.5% 0.70 / 0.71 / -1.1%
clickbench_q14/duckdb:parquet 98837417 / 97492423 / +1.4% 140681047 / 142675009 / -1.4% 0.70 / 0.68 / +2.8%
clickbench_q15/duckdb:parquet 91109360 / 94901728 / -4.0% 120645444 / 117069597 / +3.1% 0.76 / 0.81 / -6.8%
clickbench_q16/duckdb:parquet 167271725 / 169833841 / -1.5% 257116407 / 237670635 / +8.2% 0.65 / 0.71 / -9.0%
clickbench_q17/duckdb:parquet 173963316 / 179802202 / -3.2% 226741907 / 243964162 / -7.1% 0.77 / 0.74 / +4.1%
clickbench_q18/duckdb:parquet 325377956 / 319809268 / +1.7% 413148575 / 401364592 / +2.9% 0.79 / 0.80 / -1.2%
clickbench_q19/duckdb:parquet 13453700 / 13574314 / -0.9% 43331632 / 42443942 / +2.1% 0.31 / 0.32 / -2.9%
clickbench_q20/duckdb:parquet 135745974 / 130825931 / +3.8% 244130895 / 247238253 / -1.3% 0.56 / 0.53 / +5.1%
clickbench_q21/duckdb:parquet 186049029 / 189714664 / -1.9% 315881976 / 324569761 / -2.7% 0.59 / 0.58 / +0.8%
clickbench_q22/duckdb:parquet 242136869 / 244751706 / -1.1% 413245370 / 403753083 / +2.4% 0.59 / 0.61 / -3.3%
clickbench_q23/duckdb:parquet 145831340 / 144619736 / +0.8% 166447346 / 164989342 / +0.9% 0.88 / 0.88 / -0.0%
clickbench_q24/duckdb:parquet 44363448 / 44290970 / +0.2% 64465670 / 61066469 / +5.6% 0.69 / 0.73 / -5.1%
clickbench_q25/duckdb:parquet 40542284 / 39310676 / +3.1% 91825054 / 88133679 / +4.2% 0.44 / 0.45 / -1.0%
clickbench_q26/duckdb:parquet 29638828 / 31537275 / -6.0% 47096470 / 44090159 / +6.8% 0.63 / 0.72 / -12.0%
clickbench_q27/duckdb:parquet 147569789 / 148330370 / -0.5% 262526095 / 258636132 / +1.5% 0.56 / 0.57 / -2.0%
clickbench_q28/duckdb:parquet 896542924 / 911127066 / -1.6% 984786709 / 1032834910 / -4.7% 0.91 / 0.88 / +3.2%
clickbench_q29/duckdb:parquet 17830901 / 17498046 / +1.9% 31014249 / 32406454 / -4.3% 0.57 / 0.54 / +6.5%
clickbench_q30/duckdb:parquet 91782380 / 90706432 / +1.2% 177918920 / 174304205 / +2.1% 0.52 / 0.52 / -0.9%
clickbench_q31/duckdb:parquet 147164107 / 145718312 / +1.0% 269745449 / 265013868 / +1.8% 0.55 / 0.55 / -0.8%
clickbench_q32/duckdb:parquet 451247726 / 459110843 / -1.7% 496891074 / 477020771 / +4.2% 0.91 / 0.96 / -5.6%
clickbench_q33/duckdb:parquet 437563481 / 454436070 / -3.7% 475356946 / 479328698 / -0.8% 0.92 / 0.95 / -2.9%
clickbench_q34/duckdb:parquet 467891726 / 446988718 / +4.7% 490787833 / 481870342 / +1.9% 0.95 / 0.93 / +2.8%
clickbench_q35/duckdb:parquet 101097440 / 101829298 / -0.7% 118954302 / 120443177 / -1.2% 0.85 / 0.85 / +0.5%
clickbench_q36/duckdb:parquet 30756618 / 31356786 / -1.9% 40545834 / 46208716 / -12.3% 🟢 0.76 / 0.68 / +11.8%
clickbench_q37/duckdb:parquet 23321688 / 23132620 / +0.8% 32833581 / 31473817 / +4.3% 0.71 / 0.73 / -3.4%
clickbench_q38/duckdb:parquet 23711524 / 23507692 / +0.9% 33686866 / 34123685 / -1.3% 0.70 / 0.69 / +2.2%
clickbench_q39/duckdb:parquet 56103874 / 56309125 / -0.4% 67204290 / 66576951 / +0.9% 0.83 / 0.85 / -1.3%
clickbench_q40/duckdb:parquet 12598303 / 12407348 / +1.5% 22234099 / 21536291 / +3.2% 0.57 / 0.58 / -1.6%
clickbench_q41/duckdb:parquet 12460099 / 12647835 / -1.5% 22840091 / 23314469 / -2.0% 0.55 / 0.54 / +0.6%
clickbench_q42/duckdb:parquet 14745897 / 14802481 / -0.4% 24595615 / 25039154 / -1.8% 0.60 / 0.59 / +1.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.011x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23742906 / 24519696 / -3.2% 42230635 / 41643613 / +1.4% 0.56 / 0.59 / -4.5%
tpcds_q02/datafusion:vortex-file-compressed 45593818 / 46043950 / -1.0% 62402791 / 60429778 / +3.3% 0.73 / 0.76 / -4.1%
tpcds_q03/datafusion:vortex-file-compressed 11661850 / 11330890 / +2.9% 28303538 / 27521353 / +2.8% 0.41 / 0.41 / +0.1%
tpcds_q04/datafusion:vortex-file-compressed 112028358 / 112867550 / -0.7% 137729117 / 141330684 / -2.5% 0.81 / 0.80 / +1.9%
tpcds_q05/datafusion:vortex-file-compressed 59738196 / 60665150 / -1.5% 80678192 / 81174568 / -0.6% 0.74 / 0.75 / -0.9%
tpcds_q06/datafusion:vortex-file-compressed 23445293 / 23353098 / +0.4% 43712971 / 43172878 / +1.3% 0.54 / 0.54 / -0.8%
tpcds_q07/datafusion:vortex-file-compressed 31324257 / 31754501 / -1.4% 54655276 / 55312969 / -1.2% 0.57 / 0.57 / -0.2%
tpcds_q08/datafusion:vortex-file-compressed 26101258 / 26530296 / -1.6% 43295039 / 44226002 / -2.1% 0.60 / 0.60 / +0.5%
tpcds_q09/datafusion:vortex-file-compressed 17817567 / 16853084 / +5.7% 33962317 / 32585620 / +4.2% 0.52 / 0.52 / +1.4%
tpcds_q10/datafusion:vortex-file-compressed 29231661 / 29711905 / -1.6% 48066822 / 49612667 / -3.1% 0.61 / 0.60 / +1.5%
tpcds_q11/datafusion:vortex-file-compressed 60581134 / 60547686 / +0.1% 82588180 / 85878484 / -3.8% 0.73 / 0.71 / +4.0%
tpcds_q12/datafusion:vortex-file-compressed 16611404 / 16360728 / +1.5% 32110353 / 30329613 / +5.9% 0.52 / 0.54 / -4.1%
tpcds_q13/datafusion:vortex-file-compressed 38205380 / 38118220 / +0.2% 60557590 / 56960414 / +6.3% 0.63 / 0.67 / -5.7%
tpcds_q14/datafusion:vortex-file-compressed 91272602 / 90860885 / +0.5% 116769731 / 117858628 / -0.9% 0.78 / 0.77 / +1.4%
tpcds_q15/datafusion:vortex-file-compressed 25126234 / 24937196 / +0.8% 44588856 / 43233603 / +3.1% 0.56 / 0.58 / -2.3%
tpcds_q16/datafusion:vortex-file-compressed 20885218 / 21483214 / -2.8% 40806459 / 41406751 / -1.4% 0.51 / 0.52 / -1.4%
tpcds_q17/datafusion:vortex-file-compressed 53297699 / 58034181 / -8.2% 82254845 / 81912062 / +0.4% 0.65 / 0.71 / -8.5%
tpcds_q18/datafusion:vortex-file-compressed 69065104 / 68577840 / +0.7% 91451833 / 89168924 / +2.6% 0.76 / 0.77 / -1.8%
tpcds_q19/datafusion:vortex-file-compressed 18485644 / 18237288 / +1.4% 40542573 / 39001776 / +4.0% 0.46 / 0.47 / -2.5%
tpcds_q20/datafusion:vortex-file-compressed 17543484 / 17929701 / -2.2% 33659461 / 33141214 / +1.6% 0.52 / 0.54 / -3.7%
tpcds_q21/datafusion:vortex-file-compressed 18199886 / 17272956 / +5.4% 39108038 / 40294652 / -2.9% 0.47 / 0.43 / +8.6%
tpcds_q22/datafusion:vortex-file-compressed 49743094 / 49150162 / +1.2% 71348969 / 70180032 / +1.7% 0.70 / 0.70 / -0.5%
tpcds_q23/datafusion:vortex-file-compressed 72459847 / 72050636 / +0.6% 97089417 / 96548133 / +0.6% 0.75 / 0.75 / +0.0%
tpcds_q24/datafusion:vortex-file-compressed 69815860 / 69997592 / -0.3% 91703031 / 92195962 / -0.5% 0.76 / 0.76 / +0.3%
tpcds_q25/datafusion:vortex-file-compressed 55110271 / 54995010 / +0.2% 82035879 / 76930634 / +6.6% 0.67 / 0.71 / -6.0%
tpcds_q26/datafusion:vortex-file-compressed 31005013 / 30599504 / +1.3% 52815971 / 51406287 / +2.7% 0.59 / 0.60 / -1.4%
tpcds_q27/datafusion:vortex-file-compressed 63921208 / 61717688 / +3.6% 87666983 / 89911044 / -2.5% 0.73 / 0.69 / +6.2%
tpcds_q28/datafusion:vortex-file-compressed 17828700 / 17709414 / +0.7% 37066080 / 35850527 / +3.4% 0.48 / 0.49 / -2.6%
tpcds_q29/datafusion:vortex-file-compressed 56896899 / 60340338 / -5.7% 73984755 / 79971526 / -7.5% 0.77 / 0.75 / +1.9%
tpcds_q30/datafusion:vortex-file-compressed 27938075 / 27626956 / +1.1% 46021446 / 44443984 / +3.5% 0.61 / 0.62 / -2.3%
tpcds_q31/datafusion:vortex-file-compressed 64079713 / 63656782 / +0.7% 90073918 / 88322896 / +2.0% 0.71 / 0.72 / -1.3%
tpcds_q32/datafusion:vortex-file-compressed 13837295 / 13701330 / +1.0% 31353126 / 30299671 / +3.5% 0.44 / 0.45 / -2.4%
tpcds_q33/datafusion:vortex-file-compressed 26547278 / 26860444 / -1.2% 47290653 / 47050477 / +0.5% 0.56 / 0.57 / -1.7%
tpcds_q34/datafusion:vortex-file-compressed 18286047 / 17804882 / +2.7% 34724851 / 35781553 / -3.0% 0.53 / 0.50 / +5.8%
tpcds_q35/datafusion:vortex-file-compressed 35435824 / 35491213 / -0.2% 56453342 / 56883840 / -0.8% 0.63 / 0.62 / +0.6%
tpcds_q36/datafusion:vortex-file-compressed 48437087 / 48106259 / +0.7% 68061329 / 69980076 / -2.7% 0.71 / 0.69 / +3.5%
tpcds_q37/datafusion:vortex-file-compressed 13402746 / 13790253 / -2.8% 35641561 / 34583433 / +3.1% 0.38 / 0.40 / -5.7%
tpcds_q38/datafusion:vortex-file-compressed 30501452 / 30181916 / +1.1% 51602368 / 50095992 / +3.0% 0.59 / 0.60 / -1.9%
tpcds_q39/datafusion:vortex-file-compressed 65795096 / 65406850 / +0.6% 90427031 / 90182881 / +0.3% 0.73 / 0.73 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 25337436 / 25199012 / +0.5% 45828768 / 44652799 / +2.6% 0.55 / 0.56 / -2.0%
tpcds_q41/datafusion:vortex-file-compressed 17973313 / 16581467 / +8.4% 32358560 / 30561991 / +5.9% 0.56 / 0.54 / +2.4%
tpcds_q42/datafusion:vortex-file-compressed 11082127 / 11066636 / +0.1% 26883449 / 27268340 / -1.4% 0.41 / 0.41 / +1.6%
tpcds_q43/datafusion:vortex-file-compressed 12922276 / 13100693 / -1.4% 31741369 / 30973627 / +2.5% 0.41 / 0.42 / -3.7%
tpcds_q44/datafusion:vortex-file-compressed 26267432 / 26845680 / -2.2% 48292939 / 47272732 / +2.2% 0.54 / 0.57 / -4.2%
tpcds_q45/datafusion:vortex-file-compressed 28565420 / 28164478 / +1.4% 48143234 / 46860812 / +2.7% 0.59 / 0.60 / -1.3%
tpcds_q46/datafusion:vortex-file-compressed 24487533 / 23919502 / +2.4% 46894609 / 46544929 / +0.8% 0.52 / 0.51 / +1.6%
tpcds_q47/datafusion:vortex-file-compressed 78107857 / 77539294 / +0.7% 103189889 / 102515631 / +0.7% 0.76 / 0.76 / +0.1%
tpcds_q48/datafusion:vortex-file-compressed 32524425 / 32153851 / +1.2% 53665866 / 51348043 / +4.5% 0.61 / 0.63 / -3.2%
tpcds_q49/datafusion:vortex-file-compressed 60405436 / 60335856 / +0.1% 88624572 / 88643752 / -0.0% 0.68 / 0.68 / +0.1%
tpcds_q50/datafusion:vortex-file-compressed 33754723 / 33307778 / +1.3% 55274237 / 54532169 / +1.4% 0.61 / 0.61 / -0.0%
tpcds_q51/datafusion:vortex-file-compressed 61499566 / 61388275 / +0.2% 81258512 / 81940567 / -0.8% 0.76 / 0.75 / +1.0%
tpcds_q52/datafusion:vortex-file-compressed 11605715 / 11476062 / +1.1% 27569475 / 27854739 / -1.0% 0.42 / 0.41 / +2.2%
tpcds_q53/datafusion:vortex-file-compressed 18897712 / 18463138 / +2.4% 39374863 / 36602972 / +7.6% 0.48 / 0.50 / -4.9%
tpcds_q54/datafusion:vortex-file-compressed 33163022 / 33726284 / -1.7% 58182409 / 54235983 / +7.3% 0.57 / 0.62 / -8.3%
tpcds_q55/datafusion:vortex-file-compressed 11192266 / 11228304 / -0.3% 27454405 / 27251520 / +0.7% 0.41 / 0.41 / -1.1%
tpcds_q56/datafusion:vortex-file-compressed 26669415 / 26260483 / +1.6% 48038509 / 47137870 / +1.9% 0.56 / 0.56 / -0.3%
tpcds_q57/datafusion:vortex-file-compressed 74428830 / 73726556 / +1.0% 97613625 / 96245010 / +1.4% 0.76 / 0.77 / -0.5%
tpcds_q58/datafusion:vortex-file-compressed 40854020 / 40971101 / -0.3% 64763332 / 64434887 / +0.5% 0.63 / 0.64 / -0.8%
tpcds_q59/datafusion:vortex-file-compressed 31056316 / 30999026 / +0.2% 51156365 / 50017718 / +2.3% 0.61 / 0.62 / -2.0%
tpcds_q60/datafusion:vortex-file-compressed 26398726 / 26275658 / +0.5% 47424161 / 46934094 / +1.0% 0.56 / 0.56 / -0.6%
tpcds_q61/datafusion:vortex-file-compressed 23721042 / 22899561 / +3.6% 48285026 / 42945078 / +12.4% 🔴 0.49 / 0.53 / -7.9%
tpcds_q62/datafusion:vortex-file-compressed 17746990 / 17572308 / +1.0% 35943491 / 34336203 / +4.7% 0.49 / 0.51 / -3.5%
tpcds_q63/datafusion:vortex-file-compressed 18916859 / 18518668 / +2.2% 37729711 / 36758640 / +2.6% 0.50 / 0.50 / -0.5%
tpcds_q64/datafusion:vortex-file-compressed 330797357 / 324224808 / +2.0% 355880622 / 353981701 / +0.5% 0.93 / 0.92 / +1.5%
tpcds_q65/datafusion:vortex-file-compressed 74545253 / 74741968 / -0.3% 96376809 / 95265999 / +1.2% 0.77 / 0.78 / -1.4%
tpcds_q66/datafusion:vortex-file-compressed 53221734 / 52653639 / +1.1% 76390432 / 73817006 / +3.5% 0.70 / 0.71 / -2.3%
tpcds_q67/datafusion:vortex-file-compressed 55370021 / 55769504 / -0.7% 83091866 / 82080460 / +1.2% 0.67 / 0.68 / -1.9%
tpcds_q68/datafusion:vortex-file-compressed 23377704 / 23775488 / -1.7% 46982322 / 47179025 / -0.4% 0.50 / 0.50 / -1.3%
tpcds_q69/datafusion:vortex-file-compressed 28556774 / 27471554 / +4.0% 49951016 / 48347108 / +3.3% 0.57 / 0.57 / +0.6%
tpcds_q70/datafusion:vortex-file-compressed 69953072 / 69650774 / +0.4% 89480812 / 88332179 / +1.3% 0.78 / 0.79 / -0.9%
tpcds_q71/datafusion:vortex-file-compressed 18830352 / 18887359 / -0.3% 39974924 / 38724251 / +3.2% 0.47 / 0.49 / -3.4%
tpcds_q72/datafusion:vortex-file-compressed 454819895 / 445357684 / +2.1% 485381264 / 474462605 / +2.3% 0.94 / 0.94 / -0.2%
tpcds_q73/datafusion:vortex-file-compressed 17260622 / 16719100 / +3.2% 36270335 / 36239601 / +0.1% 0.48 / 0.46 / +3.2%
tpcds_q74/datafusion:vortex-file-compressed 45899850 / 45064347 / +1.9% 67779614 / 66248984 / +2.3% 0.68 / 0.68 / -0.4%
tpcds_q75/datafusion:vortex-file-compressed 130565834 / 130086147 / +0.4% 159874952 / 152749978 / +4.7% 0.82 / 0.85 / -4.1%
tpcds_q76/datafusion:vortex-file-compressed 42783638 / 43011418 / -0.5% 61839107 / 61427671 / +0.7% 0.69 / 0.70 / -1.2%
tpcds_q77/datafusion:vortex-file-compressed 34681872 / 34002718 / +2.0% 56347800 / 55025485 / +2.4% 0.62 / 0.62 / -0.4%
tpcds_q78/datafusion:vortex-file-compressed 80424314 / 80010244 / +0.5% 106564900 / 103725684 / +2.7% 0.75 / 0.77 / -2.2%
tpcds_q79/datafusion:vortex-file-compressed 19935141 / 21301612 / -6.4% 39961881 / 41324126 / -3.3% 0.50 / 0.52 / -3.2%
tpcds_q80/datafusion:vortex-file-compressed 77408920 / 77668740 / -0.3% 106228095 / 109072494 / -2.6% 0.73 / 0.71 / +2.3%
tpcds_q81/datafusion:vortex-file-compressed 28242970 / 28431730 / -0.7% 44666695 / 43655938 / +2.3% 0.63 / 0.65 / -2.9%
tpcds_q82/datafusion:vortex-file-compressed 13462892 / 14341087 / -6.1% 34335023 / 36262834 / -5.3% 0.39 / 0.40 / -0.9%
tpcds_q83/datafusion:vortex-file-compressed 36363940 / 35724268 / +1.8% 54952059 / 56810094 / -3.3% 0.66 / 0.63 / +5.2%
tpcds_q84/datafusion:vortex-file-compressed 12479888 / 12072848 / +3.4% 27793891 / 28097733 / -1.1% 0.45 / 0.43 / +4.5%
tpcds_q85/datafusion:vortex-file-compressed 63079038 / 61606455 / +2.4% 86892608 / 82863440 / +4.9% 0.73 / 0.74 / -2.4%
tpcds_q86/datafusion:vortex-file-compressed 16495872 / 16612766 / -0.7% 33512743 / 32008619 / +4.7% 0.49 / 0.52 / -5.2%
tpcds_q87/datafusion:vortex-file-compressed 29247386 / 29952732 / -2.4% 51431531 / 49082527 / +4.8% 0.57 / 0.61 / -6.8%
tpcds_q88/datafusion:vortex-file-compressed 32894910 / 32327044 / +1.8% 61609676 / 61052140 / +0.9% 0.53 / 0.53 / +0.8%
tpcds_q89/datafusion:vortex-file-compressed 20956286 / 20863001 / +0.4% 41444767 / 39258335 / +5.6% 0.51 / 0.53 / -4.9%
tpcds_q90/datafusion:vortex-file-compressed 10874378 / 10309288 / +5.5% 27056424 / 26701615 / +1.3% 0.40 / 0.39 / +4.1%
tpcds_q91/datafusion:vortex-file-compressed 17520505 / 17694078 / -1.0% 36679556 / 35224211 / +4.1% 0.48 / 0.50 / -4.9%
tpcds_q92/datafusion:vortex-file-compressed 14367031 / 14466040 / -0.7% 31087200 / 30673512 / +1.3% 0.46 / 0.47 / -2.0%
tpcds_q93/datafusion:vortex-file-compressed 22767040 / 23176639 / -1.8% 43690629 / 44574585 / -2.0% 0.52 / 0.52 / +0.2%
tpcds_q94/datafusion:vortex-file-compressed 19715996 / 20055794 / -1.7% 38164999 / 37429573 / +2.0% 0.52 / 0.54 / -3.6%
tpcds_q95/datafusion:vortex-file-compressed 45990592 / 46280646 / -0.6% 67262867 / 66512601 / +1.1% 0.68 / 0.70 / -1.7%
tpcds_q96/datafusion:vortex-file-compressed 8179039 / 7947766 / +2.9% 24384064 / 23294309 / +4.7% 0.34 / 0.34 / -1.7%
tpcds_q97/datafusion:vortex-file-compressed 20896853 / 20832370 / +0.3% 41543012 / 40707164 / +2.1% 0.50 / 0.51 / -1.7%
tpcds_q98/datafusion:vortex-file-compressed 16646370 / 16502118 / +0.9% 35039119 / 34760793 / +0.8% 0.48 / 0.47 / +0.1%
tpcds_q99/datafusion:vortex-file-compressed 19758065 / 19965018 / -1.0% 38445768 / 37902485 / +1.4% 0.51 / 0.53 / -2.4%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29510796 / 29401931 / +0.4% 52637759 / 45172187 / +16.5% 🔴 0.56 / 0.65 / -13.9%
tpcds_q02/datafusion:parquet 44663090 / 45189060 / -1.2% 59391909 / 59923051 / -0.9% 0.75 / 0.75 / -0.3%
tpcds_q03/datafusion:parquet 18710687 / 18860772 / -0.8% 32914549 / 30734398 / +7.1% 0.57 / 0.61 / -7.4%
tpcds_q04/datafusion:parquet 195382734 / 194215320 / +0.6% 225031986 / 219088762 / +2.7% 0.87 / 0.89 / -2.1%
tpcds_q05/datafusion:parquet 70196114 / 72903582 / -3.7% 91993579 / 90089686 / +2.1% 0.76 / 0.81 / -5.7%
tpcds_q06/datafusion:parquet 34711180 / 34735990 / -0.1% 51699513 / 49933591 / +3.5% 0.67 / 0.70 / -3.5%
tpcds_q07/datafusion:parquet 44520318 / 45468095 / -2.1% 66842122 / 65297384 / +2.4% 0.67 / 0.70 / -4.3%
tpcds_q08/datafusion:parquet 38986206 / 38996724 / -0.0% 53133815 / 55945913 / -5.0% 0.73 / 0.70 / +5.3%
tpcds_q09/datafusion:parquet 31932178 / 32168251 / -0.7% 46683306 / 41111101 / +13.6% 🔴 0.68 / 0.78 / -12.6%
tpcds_q10/datafusion:parquet 48668844 / 49561194 / -1.8% 69072823 / 69064552 / +0.0% 0.70 / 0.72 / -1.8%
tpcds_q11/datafusion:parquet 96074429 / 93394784 / +2.9% 116192188 / 116821286 / -0.5% 0.83 / 0.80 / +3.4%
tpcds_q12/datafusion:parquet 24316646 / 24379714 / -0.3% 35140351 / 35448746 / -0.9% 0.69 / 0.69 / +0.6%
tpcds_q13/datafusion:parquet 44950596 / 44935828 / +0.0% 66729178 / 63941349 / +4.4% 0.67 / 0.70 / -4.1%
tpcds_q14/datafusion:parquet 140456822 / 140148016 / +0.2% 158580513 / 154092756 / +2.9% 0.89 / 0.91 / -2.6%
tpcds_q15/datafusion:parquet 30456996 / 30628701 / -0.6% 48104153 / 47832815 / +0.6% 0.63 / 0.64 / -1.1%
tpcds_q16/datafusion:parquet 37447188 / 36872835 / +1.6% 56702759 / 53982278 / +5.0% 0.66 / 0.68 / -3.3%
tpcds_q17/datafusion:parquet 74145529 / 73461794 / +0.9% 99594678 / 98187199 / +1.4% 0.74 / 0.75 / -0.5%
tpcds_q18/datafusion:parquet 58523438 / 58366748 / +0.3% 81768029 / 74554471 / +9.7% 0.72 / 0.78 / -8.6%
tpcds_q19/datafusion:parquet 31960270 / 31191054 / +2.5% 49334054 / 48790176 / +1.1% 0.65 / 0.64 / +1.3%
tpcds_q20/datafusion:parquet 25046120 / 25339324 / -1.2% 36935136 / 35845873 / +3.0% 0.68 / 0.71 / -4.1%
tpcds_q21/datafusion:parquet 20040479 / 20017609 / +0.1% 33892431 / 33547706 / +1.0% 0.59 / 0.60 / -0.9%
tpcds_q22/datafusion:parquet 76415398 / 76915796 / -0.7% 90951476 / 90495446 / +0.5% 0.84 / 0.85 / -1.1%
tpcds_q23/datafusion:parquet 115893159 / 115188478 / +0.6% 135316639 / 135363571 / -0.0% 0.86 / 0.85 / +0.6%
tpcds_q24/datafusion:parquet 90172854 / 90098720 / +0.1% 115025132 / 116163365 / -1.0% 0.78 / 0.78 / +1.1%
tpcds_q25/datafusion:parquet 74442296 / 74606914 / -0.2% 98102041 / 98024542 / +0.1% 0.76 / 0.76 / -0.3%
tpcds_q26/datafusion:parquet 42346963 / 42996058 / -1.5% 58417898 / 58841682 / -0.7% 0.72 / 0.73 / -0.8%
tpcds_q27/datafusion:parquet 79068864 / 75444376 / +4.8% 102555708 / 98146833 / +4.5% 0.77 / 0.77 / +0.3%
tpcds_q28/datafusion:parquet 27082472 / 26895350 / +0.7% 44228938 / 42354537 / +4.4% 0.61 / 0.64 / -3.6%
tpcds_q29/datafusion:parquet 76352204 / 74995738 / +1.8% 98921186 / 100927231 / -2.0% 0.77 / 0.74 / +3.9%
tpcds_q30/datafusion:parquet 45825864 / 47520717 / -3.6% 63227335 / 62722564 / +0.8% 0.72 / 0.76 / -4.3%
tpcds_q31/datafusion:parquet 90771000 / 90591434 / +0.2% 107957751 / 102604818 / +5.2% 0.84 / 0.88 / -4.8%
tpcds_q32/datafusion:parquet 25398961 / 26067794 / -2.6% 40431845 / 40921532 / -1.2% 0.63 / 0.64 / -1.4%
tpcds_q33/datafusion:parquet 39309760 / 40551514 / -3.1% 54761666 / 51628191 / +6.1% 0.72 / 0.79 / -8.6%
tpcds_q34/datafusion:parquet 23800890 / 23921040 / -0.5% 38028889 / 37232586 / +2.1% 0.63 / 0.64 / -2.6%
tpcds_q35/datafusion:parquet 54122066 / 53521338 / +1.1% 72410275 / 70550358 / +2.6% 0.75 / 0.76 / -1.5%
tpcds_q36/datafusion:parquet 52049286 / 51970769 / +0.2% 69978426 / 69558892 / +0.6% 0.74 / 0.75 / -0.4%
tpcds_q37/datafusion:parquet 26091562 / 25980825 / +0.4% 38044512 / 39268722 / -3.1% 0.69 / 0.66 / +3.7%
tpcds_q38/datafusion:parquet 44579804 / 42617788 / +4.6% 62011358 / 64853090 / -4.4% 0.72 / 0.66 / +9.4%
tpcds_q39/datafusion:parquet 71910151 / 71009073 / +1.3% 88638464 / 90451370 / -2.0% 0.81 / 0.79 / +3.3%
tpcds_q40/datafusion:parquet 28866736 / 29766433 / -3.0% 49606203 / 48890125 / +1.5% 0.58 / 0.61 / -4.4%
tpcds_q41/datafusion:parquet 20294698 / 19807116 / +2.5% 32510258 / 32610116 / -0.3% 0.62 / 0.61 / +2.8%
tpcds_q42/datafusion:parquet 17760572 / 18090538 / -1.8% 31684823 / 31446860 / +0.8% 0.56 / 0.58 / -2.6%
tpcds_q43/datafusion:parquet 19553076 / 19309378 / +1.3% 33461613 / 32630398 / +2.5% 0.58 / 0.59 / -1.3%
tpcds_q44/datafusion:parquet 34827904 / 32525865 / +7.1% 49623277 / 51627759 / -3.9% 0.70 / 0.63 / +11.4%
tpcds_q45/datafusion:parquet 38314315 / 37833314 / +1.3% 52802395 / 53744409 / -1.8% 0.73 / 0.70 / +3.1%
tpcds_q46/datafusion:parquet 29647893 / 28997474 / +2.2% 47513169 / 47324026 / +0.4% 0.62 / 0.61 / +1.8%
tpcds_q47/datafusion:parquet 98046026 / 98535788 / -0.5% 123486147 / 122454008 / +0.8% 0.79 / 0.80 / -1.3%
tpcds_q48/datafusion:parquet 40999545 / 41323147 / -0.8% 57841645 / 60891243 / -5.0% 0.71 / 0.68 / +4.4%
tpcds_q49/datafusion:parquet 75768007 / 76429338 / -0.9% 99617677 / 92152002 / +8.1% 0.76 / 0.83 / -8.3%
tpcds_q50/datafusion:parquet 47723695 / 47360057 / +0.8% 69615739 / 68105791 / +2.2% 0.69 / 0.70 / -1.4%
tpcds_q51/datafusion:parquet 70977294 / 71051810 / -0.1% 92107705 / 91245722 / +0.9% 0.77 / 0.78 / -1.0%
tpcds_q52/datafusion:parquet 18615366 / 18610789 / +0.0% 33034528 / 32281714 / +2.3% 0.56 / 0.58 / -2.3%
tpcds_q53/datafusion:parquet 22134114 / 22039100 / +0.4% 39526873 / 39462139 / +0.2% 0.56 / 0.56 / +0.3%
tpcds_q54/datafusion:parquet 54665350 / 54258043 / +0.8% 72629088 / 74124758 / -2.0% 0.75 / 0.73 / +2.8%
tpcds_q55/datafusion:parquet 18074248 / 17971578 / +0.6% 29979095 / 31813620 / -5.8% 0.60 / 0.56 / +6.7%
tpcds_q56/datafusion:parquet 45789976 / 47151614 / -2.9% 61701166 / 60155580 / +2.6% 0.74 / 0.78 / -5.3%
tpcds_q57/datafusion:parquet 101059644 / 99987262 / +1.1% 119894173 / 117629194 / +1.9% 0.84 / 0.85 / -0.8%
tpcds_q58/datafusion:parquet 63201516 / 64728094 / -2.4% 82014699 / 80653231 / +1.7% 0.77 / 0.80 / -4.0%
tpcds_q59/datafusion:parquet 46642474 / 46341434 / +0.6% 63880356 / 63316859 / +0.9% 0.73 / 0.73 / -0.2%
tpcds_q60/datafusion:parquet 45395968 / 44400956 / +2.2% 61996077 / 60813473 / +1.9% 0.73 / 0.73 / +0.3%
tpcds_q61/datafusion:parquet 39191336 / 35928859 / +9.1% 58551008 / 53137118 / +10.2% 🔴 0.67 / 0.68 / -1.0%
tpcds_q62/datafusion:parquet 25082746 / 24833702 / +1.0% 40139801 / 38426299 / +4.5% 0.62 / 0.65 / -3.3%
tpcds_q63/datafusion:parquet 22190939 / 22207464 / -0.1% 39880589 / 38566162 / +3.4% 0.56 / 0.58 / -3.4%
tpcds_q64/datafusion:parquet 206266128 / 204365708 / +0.9% 234301150 / 237055734 / -1.2% 0.88 / 0.86 / +2.1%
tpcds_q65/datafusion:parquet 37752554 / 36877868 / +2.4% 57228845 / 56377945 / +1.5% 0.66 / 0.65 / +0.8%
tpcds_q66/datafusion:parquet 62202154 / 61674382 / +0.9% 78537510 / 75546623 / +4.0% 0.79 / 0.82 / -3.0%
tpcds_q67/datafusion:parquet 69882762 / 69261166 / +0.9% 94907765 / 94005777 / +1.0% 0.74 / 0.74 / -0.1%
tpcds_q68/datafusion:parquet 29139892 / 29283700 / -0.5% 48108396 / 48626453 / -1.1% 0.61 / 0.60 / +0.6%
tpcds_q69/datafusion:parquet 47211982 / 49903565 / -5.4% 61793183 / 65038535 / -5.0% 0.76 / 0.77 / -0.4%
tpcds_q70/datafusion:parquet 36676736 / 36570432 / +0.3% 59021027 / 56431306 / +4.6% 0.62 / 0.65 / -4.1%
tpcds_q71/datafusion:parquet 29434880 / 27662552 / +6.4% 42272106 / 41851726 / +1.0% 0.70 / 0.66 / +5.3%
tpcds_q72/datafusion:parquet 556984890 / 547951404 / +1.6% 573512435 / 580831328 / -1.3% 0.97 / 0.94 / +2.9%
tpcds_q73/datafusion:parquet 22890277 / 23025666 / -0.6% 38548325 / 37719470 / +2.2% 0.59 / 0.61 / -2.7%
tpcds_q74/datafusion:parquet 68042253 / 68098880 / -0.1% 90894038 / 87533017 / +3.8% 0.75 / 0.78 / -3.8%
tpcds_q75/datafusion:parquet 145305572 / 145737964 / -0.3% 171610768 / 171388081 / +0.1% 0.85 / 0.85 / -0.4%
tpcds_q76/datafusion:parquet 52910918 / 55267576 / -4.3% 70561208 / 71384272 / -1.2% 0.75 / 0.77 / -3.1%
tpcds_q77/datafusion:parquet 55962618 / 55898857 / +0.1% 76480194 / 74585039 / +2.5% 0.73 / 0.75 / -2.4%
tpcds_q78/datafusion:parquet 91928460 / 90249526 / +1.9% 121934456 / 118200653 / +3.2% 0.75 / 0.76 / -1.3%
tpcds_q79/datafusion:parquet 25837625 / 25814308 / +0.1% 43713567 / 43142150 / +1.3% 0.59 / 0.60 / -1.2%
tpcds_q80/datafusion:parquet 80829948 / 80467848 / +0.4% 109424857 / 109188460 / +0.2% 0.74 / 0.74 / +0.2%
tpcds_q81/datafusion:parquet 41759548 / 41455112 / +0.7% 60778309 / 59694837 / +1.8% 0.69 / 0.69 / -1.1%
tpcds_q82/datafusion:parquet 25871982 / 25910758 / -0.1% 39988171 / 40885836 / -2.2% 0.65 / 0.63 / +2.1%
tpcds_q83/datafusion:parquet 58364698 / 57693625 / +1.2% 73382149 / 78403198 / -6.4% 0.80 / 0.74 / +8.1%
tpcds_q84/datafusion:parquet 30377097 / 30307906 / +0.2% 46246698 / 43428194 / +6.5% 0.66 / 0.70 / -5.9%
tpcds_q85/datafusion:parquet 83246396 / 82915129 / +0.4% 106064170 / 105330313 / +0.7% 0.78 / 0.79 / -0.3%
tpcds_q86/datafusion:parquet 20100788 / 20117576 / -0.1% 34603582 / 33602612 / +3.0% 0.58 / 0.60 / -3.0%
tpcds_q87/datafusion:parquet 47809969 / 45827114 / +4.3% 63561113 / 62694807 / +1.4% 0.75 / 0.73 / +2.9%
tpcds_q88/datafusion:parquet 50795048 / 50251961 / +1.1% 63138608 / 65047292 / -2.9% 0.80 / 0.77 / +4.1%
tpcds_q89/datafusion:parquet 25256856 / 25640232 / -1.5% 43162016 / 43151610 / +0.0% 0.59 / 0.59 / -1.5%
tpcds_q90/datafusion:parquet 19647247 / 19870254 / -1.1% 33721084 / 32604313 / +3.4% 0.58 / 0.61 / -4.4%
tpcds_q91/datafusion:parquet 36659859 / 36196175 / +1.3% 53630386 / 51298626 / +4.5% 0.68 / 0.71 / -3.1%
tpcds_q92/datafusion:parquet 25672892 / 25520917 / +0.6% 41654806 / 39414565 / +5.7% 0.62 / 0.65 / -4.8%
tpcds_q93/datafusion:parquet 27123000 / 26295292 / +3.1% 48283263 / 48564101 / -0.6% 0.56 / 0.54 / +3.7%
tpcds_q94/datafusion:parquet 34159326 / 34148462 / +0.0% 51025508 / 49049017 / +4.0% 0.67 / 0.70 / -3.8%
tpcds_q95/datafusion:parquet 65073948 / 63143098 / +3.1% 82573103 / 77526935 / +6.5% 0.79 / 0.81 / -3.2%
tpcds_q96/datafusion:parquet 16651176 / 16691492 / -0.2% 29776395 / 29441886 / +1.1% 0.56 / 0.57 / -1.4%
tpcds_q97/datafusion:parquet 35935062 / 35698251 / +0.7% 52949325 / 53406772 / -0.9% 0.68 / 0.67 / +1.5%
tpcds_q98/datafusion:parquet 25018650 / 25305892 / -1.1% 39631345 / 38510415 / +2.9% 0.63 / 0.66 / -3.9%
tpcds_q99/datafusion:parquet 29571011 / 29579171 / -0.0% 42930697 / 43546529 / -1.4% 0.69 / 0.68 / +1.4%
duckdb / vortex-file-compressed / ns (0.997x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15541964 / 15559845 / -0.1% 22690651 / 22233698 / +2.1% 0.68 / 0.70 / -2.1%
tpcds_q02/duckdb:vortex-file-compressed 15440323 / 15454078 / -0.1% 21371066 / 20633499 / +3.6% 0.72 / 0.75 / -3.5%
tpcds_q03/duckdb:vortex-file-compressed 12266508 / 12570516 / -2.4% 19677513 / 22763744 / -13.6% 🟢 0.62 / 0.55 / +12.9%
tpcds_q04/duckdb:vortex-file-compressed 52137064 / 51861940 / +0.5% 63362790 / 65439320 / -3.2% 0.82 / 0.79 / +3.8%
tpcds_q05/duckdb:vortex-file-compressed 19446150 / 19165444 / +1.5% 28583431 / 26860163 / +6.4% 0.68 / 0.71 / -4.7%
tpcds_q06/duckdb:vortex-file-compressed 27603508 / 27546862 / +0.2% 40180029 / 38835095 / +3.5% 0.69 / 0.71 / -3.1%
tpcds_q07/duckdb:vortex-file-compressed 16675024 / 16295170 / +2.3% 27334949 / 26754618 / +2.2% 0.61 / 0.61 / +0.2%
tpcds_q08/duckdb:vortex-file-compressed 23247100 / 23453728 / -0.9% 31659738 / 31349780 / +1.0% 0.73 / 0.75 / -1.9%
tpcds_q09/duckdb:vortex-file-compressed 10239839 / 10187052 / +0.5% 19712496 / 18568303 / +6.2% 0.52 / 0.55 / -5.3%
tpcds_q10/duckdb:vortex-file-compressed 30888006 / 30975879 / -0.3% 43081697 / 46085249 / -6.5% 0.72 / 0.67 / +6.7%
tpcds_q11/duckdb:vortex-file-compressed 41216880 / 41135944 / +0.2% 51839067 / 51276833 / +1.1% 0.80 / 0.80 / -0.9%
tpcds_q12/duckdb:vortex-file-compressed 10789186 / 10795332 / -0.1% 18619434 / 16348321 / +13.9% 🔴 0.58 / 0.66 / -12.2%
tpcds_q13/duckdb:vortex-file-compressed 23356399 / 21282006 / +9.7% 32394775 / 34521430 / -6.2% 0.72 / 0.62 / +17.0%
tpcds_q14/duckdb:vortex-file-compressed 58286010 / 59143686 / -1.5% 70736784 / 73407519 / -3.6% 0.82 / 0.81 / +2.3%
tpcds_q15/duckdb:vortex-file-compressed 22406238 / 22211214 / +0.9% 28206762 / 27203981 / +3.7% 0.79 / 0.82 / -2.7%
tpcds_q16/duckdb:vortex-file-compressed 19101169 / 18753924 / +1.9% 31443318 / 29850822 / +5.3% 0.61 / 0.63 / -3.3%
tpcds_q17/duckdb:vortex-file-compressed 31809865 / 32109972 / -0.9% 45695216 / 48872478 / -6.5% 0.70 / 0.66 / +6.0%
tpcds_q18/duckdb:vortex-file-compressed 29532359 / 29482394 / +0.2% 37822441 / 38491517 / -1.7% 0.78 / 0.77 / +1.9%
tpcds_q19/duckdb:vortex-file-compressed 25160046 / 25172873 / -0.1% 39168015 / 36105439 / +8.5% 0.64 / 0.70 / -7.9%
tpcds_q20/duckdb:vortex-file-compressed 11033178 / 11086666 / -0.5% 18803357 / 15798269 / +19.0% 🔴 0.59 / 0.70 / -16.4%
tpcds_q21/duckdb:vortex-file-compressed 12836879 / 10466402 / +22.6% 🔴 18617671 / 21292168 / -12.6% 🟢 0.69 / 0.49 / +40.3%
tpcds_q22/duckdb:vortex-file-compressed 30082982 / 29460200 / +2.1% 39753598 / 41107374 / -3.3% 0.76 / 0.72 / +5.6%
tpcds_q23/duckdb:vortex-file-compressed 35014469 / 36458024 / -4.0% 46227864 / 47232885 / -2.1% 0.76 / 0.77 / -1.9%
tpcds_q24/duckdb:vortex-file-compressed 28522626 / 28242261 / +1.0% 38534542 / 38023154 / +1.3% 0.74 / 0.74 / -0.3%
tpcds_q25/duckdb:vortex-file-compressed 26595708 / 26677394 / -0.3% 39619669 / 37095100 / +6.8% 0.67 / 0.72 / -6.7%
tpcds_q26/duckdb:vortex-file-compressed 15304926 / 14869360 / +2.9% 20623000 / 21049447 / -2.0% 0.74 / 0.71 / +5.1%
tpcds_q27/duckdb:vortex-file-compressed 17363304 / 17206472 / +0.9% 27472905 / 27192669 / +1.0% 0.63 / 0.63 / -0.1%
tpcds_q28/duckdb:vortex-file-compressed 8083627 / 8004363 / +1.0% 12022282 / 12117738 / -0.8% 0.67 / 0.66 / +1.8%
tpcds_q29/duckdb:vortex-file-compressed 30353486 / 30444266 / -0.3% 45429590 / 47226861 / -3.8% 0.67 / 0.64 / +3.6%
tpcds_q30/duckdb:vortex-file-compressed 20105416 / 20034047 / +0.4% 28660261 / 30375904 / -5.6% 0.70 / 0.66 / +6.4%
tpcds_q31/duckdb:vortex-file-compressed 19857890 / 20056987 / -1.0% 29198468 / 31100761 / -6.1% 0.68 / 0.64 / +5.5%
tpcds_q32/duckdb:vortex-file-compressed 10962632 / 10882648 / +0.7% 18109551 / 19209894 / -5.7% 0.61 / 0.57 / +6.9%
tpcds_q33/duckdb:vortex-file-compressed 17566890 / 17810741 / -1.4% 27770536 / 29494303 / -5.8% 0.63 / 0.60 / +4.8%
tpcds_q34/duckdb:vortex-file-compressed 13590561 / 13740686 / -1.1% 20510487 / 23802611 / -13.8% 🟢 0.66 / 0.58 / +14.8%
tpcds_q35/duckdb:vortex-file-compressed 49005088 / 48889952 / +0.2% 62696824 / 65184627 / -3.8% 0.78 / 0.75 / +4.2%
tpcds_q36/duckdb:vortex-file-compressed 15381183 / 15891282 / -3.2% 31184519 / 27291328 / +14.3% 🔴 0.49 / 0.58 / -15.3%
tpcds_q37/duckdb:vortex-file-compressed 14291933 / 14025177 / +1.9% 22187529 / 22001291 / +0.8% 0.64 / 0.64 / +1.0%
tpcds_q38/duckdb:vortex-file-compressed 22134438 / 22397756 / -1.2% 32103016 / 28397705 / +13.0% 🔴 0.69 / 0.79 / -12.6%
tpcds_q39/duckdb:vortex-file-compressed 18886247 / 18761354 / +0.7% 27107911 / 27544669 / -1.6% 0.70 / 0.68 / +2.3%
tpcds_q40/duckdb:vortex-file-compressed 13812082 / 14228196 / -2.9% 21830304 / 19226515 / +13.5% 🔴 0.63 / 0.74 / -14.5%
tpcds_q41/duckdb:vortex-file-compressed 6688485 / 6597586 / +1.4% 11081939 / 9199793 / +20.5% 🔴 0.60 / 0.72 / -15.8%
tpcds_q42/duckdb:vortex-file-compressed 8900590 / 9117608 / -2.4% 16757176 / 16857162 / -0.6% 0.53 / 0.54 / -1.8%
tpcds_q43/duckdb:vortex-file-compressed 11198112 / 12519004 / -10.6% 🟢 18946570 / 18006812 / +5.2% 0.59 / 0.70 / -15.0%
tpcds_q44/duckdb:vortex-file-compressed 14003914 / 13941564 / +0.4% 24988529 / 23654648 / +5.6% 0.56 / 0.59 / -4.9%
tpcds_q45/duckdb:vortex-file-compressed 23804192 / 23855900 / -0.2% 29544550 / 29678574 / -0.5% 0.81 / 0.80 / +0.2%
tpcds_q46/duckdb:vortex-file-compressed 17421529 / 17185617 / +1.4% 28947787 / 27902243 / +3.7% 0.60 / 0.62 / -2.3%
tpcds_q47/duckdb:vortex-file-compressed 30304396 / 30997376 / -2.2% 50820017 / 43985290 / +15.5% 🔴 0.60 / 0.70 / -15.4%
tpcds_q48/duckdb:vortex-file-compressed 20262830 / 19960731 / +1.5% 31728919 / 31360271 / +1.2% 0.64 / 0.64 / +0.3%
tpcds_q49/duckdb:vortex-file-compressed 17729766 / 17911748 / -1.0% 31548537 / 31072577 / +1.5% 0.56 / 0.58 / -2.5%
tpcds_q50/duckdb:vortex-file-compressed 17385239 / 17250766 / +0.8% 30278895 / 27695675 / +9.3% 0.57 / 0.62 / -7.8%
tpcds_q51/duckdb:vortex-file-compressed 52339877 / 52284281 / +0.1% 62399486 / 67246086 / -7.2% 0.84 / 0.78 / +7.9%
tpcds_q52/duckdb:vortex-file-compressed 8825211 / 10702145 / -17.5% 🟢 17044242 / 17265538 / -1.3% 0.52 / 0.62 / -16.5%
tpcds_q53/duckdb:vortex-file-compressed 14232618 / 14273764 / -0.3% 23359978 / 23457996 / -0.4% 0.61 / 0.61 / +0.1%
tpcds_q54/duckdb:vortex-file-compressed 21128174 / 21032278 / +0.5% 33307431 / 29519421 / +12.8% 🔴 0.63 / 0.71 / -11.0%
tpcds_q55/duckdb:vortex-file-compressed 9194222 / 10678799 / -13.9% 🟢 17976063 / 17224591 / +4.4% 0.51 / 0.62 / -17.5%
tpcds_q56/duckdb:vortex-file-compressed 17597432 / 17742314 / -0.8% 28715037 / 29268558 / -1.9% 0.61 / 0.61 / +1.1%
tpcds_q57/duckdb:vortex-file-compressed 24394562 / 27031274 / -9.8% 32818229 / 33762647 / -2.8% 0.74 / 0.80 / -7.2%
tpcds_q58/duckdb:vortex-file-compressed 18245730 / 18625624 / -2.0% 27739728 / 27506467 / +0.8% 0.66 / 0.68 / -2.9%
tpcds_q59/duckdb:vortex-file-compressed 18551202 / 18315743 / +1.3% 25573788 / 26352441 / -3.0% 0.73 / 0.70 / +4.4%
tpcds_q60/duckdb:vortex-file-compressed 18039526 / 18218056 / -1.0% 29881580 / 29619067 / +0.9% 0.60 / 0.62 / -1.8%
tpcds_q61/duckdb:vortex-file-compressed 21526364 / 20604433 / +4.5% 33398461 / 30915209 / +8.0% 0.64 / 0.67 / -3.3%
tpcds_q62/duckdb:vortex-file-compressed 10619850 / 10677716 / -0.5% 18330264 / 18561385 / -1.2% 0.58 / 0.58 / +0.7%
tpcds_q63/duckdb:vortex-file-compressed 13361093 / 13614094 / -1.9% 22912108 / 22664817 / +1.1% 0.58 / 0.60 / -2.9%
tpcds_q64/duckdb:vortex-file-compressed 65597108 / 64414970 / +1.8% 81244369 / 77078057 / +5.4% 0.81 / 0.84 / -3.4%
tpcds_q65/duckdb:vortex-file-compressed 13605232 / 12918132 / +5.3% 21177691 / 22219762 / -4.7% 0.64 / 0.58 / +10.5%
tpcds_q66/duckdb:vortex-file-compressed 23970012 / 23193682 / +3.3% 32784369 / 38204670 / -14.2% 🟢 0.73 / 0.61 / +20.4%
tpcds_q67/duckdb:vortex-file-compressed 65122760 / 65600498 / -0.7% 83566215 / 83395554 / +0.2% 0.78 / 0.79 / -0.9%
tpcds_q68/duckdb:vortex-file-compressed 17134517 / 16951198 / +1.1% 26924732 / 26783959 / +0.5% 0.64 / 0.63 / +0.6%
tpcds_q69/duckdb:vortex-file-compressed 32033036 / 31518018 / +1.6% 46356327 / 44453304 / +4.3% 0.69 / 0.71 / -2.5%
tpcds_q70/duckdb:vortex-file-compressed 18889043 / 19018921 / -0.7% 30070267 / 29661670 / +1.4% 0.63 / 0.64 / -2.0%
tpcds_q71/duckdb:vortex-file-compressed 13876584 / 13747164 / +0.9% 27241581 / 26545386 / +2.6% 0.51 / 0.52 / -1.6%
tpcds_q72/duckdb:vortex-file-compressed 63640208 / 63686576 / -0.1% 78563356 / 78082321 / +0.6% 0.81 / 0.82 / -0.7%
tpcds_q73/duckdb:vortex-file-compressed 13369543 / 13303215 / +0.5% 22471195 / 20015417 / +12.3% 🔴 0.59 / 0.66 / -10.5%
tpcds_q74/duckdb:vortex-file-compressed 28388432 / 28193200 / +0.7% 37472037 / 38475732 / -2.6% 0.76 / 0.73 / +3.4%
tpcds_q75/duckdb:vortex-file-compressed 28724430 / 28373692 / +1.2% 38673415 / 41078158 / -5.9% 0.74 / 0.69 / +7.5%
tpcds_q76/duckdb:vortex-file-compressed 13458312 / 13489958 / -0.2% 24054948 / 24259342 / -0.8% 0.56 / 0.56 / +0.6%
tpcds_q77/duckdb:vortex-file-compressed 16393244 / 16035918 / +2.2% 25027453 / 27862364 / -10.2% 🟢 0.66 / 0.58 / +13.8%
tpcds_q78/duckdb:vortex-file-compressed 37915414 / 38240904 / -0.9% 46859381 / 49797579 / -5.9% 0.81 / 0.77 / +5.4%
tpcds_q79/duckdb:vortex-file-compressed 14400986 / 14576346 / -1.2% 23044074 / 23454611 / -1.8% 0.62 / 0.62 / +0.6%
tpcds_q80/duckdb:vortex-file-compressed 29481741 / 28838588 / +2.2% 45419966 / 42306830 / +7.4% 0.65 / 0.68 / -4.8%
tpcds_q81/duckdb:vortex-file-compressed 23877197 / 23237613 / +2.8% 29813483 / 33507626 / -11.0% 🟢 0.80 / 0.69 / +15.5%
tpcds_q82/duckdb:vortex-file-compressed 32157882 / 32191258 / -0.1% 43130570 / 40378115 / +6.8% 0.75 / 0.80 / -6.5%
tpcds_q83/duckdb:vortex-file-compressed 23113108 / 21668714 / +6.7% 24931284 / 24455285 / +1.9% 0.93 / 0.89 / +4.6%
tpcds_q84/duckdb:vortex-file-compressed 13767646 / 15327296 / -10.2% 🟢 22076467 / 25039509 / -11.8% 🟢 0.62 / 0.61 / +1.9%
tpcds_q85/duckdb:vortex-file-compressed 33049898 / 32797203 / +0.8% 41339029 / 41498891 / -0.4% 0.80 / 0.79 / +1.2%
tpcds_q86/duckdb:vortex-file-compressed 11225886 / 11194914 / +0.3% 20863303 / 18353228 / +13.7% 🔴 0.54 / 0.61 / -11.8%
tpcds_q87/duckdb:vortex-file-compressed 23754958 / 23854020 / -0.4% 30894231 / 33479459 / -7.7% 0.77 / 0.71 / +7.9%
tpcds_q88/duckdb:vortex-file-compressed 35667904 / 36575116 / -2.5% 48266593 / 48923999 / -1.3% 0.74 / 0.75 / -1.2%
tpcds_q89/duckdb:vortex-file-compressed 13733521 / 13666208 / +0.5% 24261835 / 25295438 / -4.1% 0.57 / 0.54 / +4.8%
tpcds_q90/duckdb:vortex-file-compressed 8289070 / 8278878 / +0.1% 13886652 / 13665319 / +1.6% 0.60 / 0.61 / -1.5%
tpcds_q91/duckdb:vortex-file-compressed 17060884 / 17254812 / -1.1% 23240466 / 22517812 / +3.2% 0.73 / 0.77 / -4.2%
tpcds_q92/duckdb:vortex-file-compressed 14241342 / 14405392 / -1.1% 22755833 / 21630190 / +5.2% 0.63 / 0.67 / -6.0%
tpcds_q93/duckdb:vortex-file-compressed 16431295 / 17025012 / -3.5% 23032054 / 22930922 / +0.4% 0.71 / 0.74 / -3.9%
tpcds_q94/duckdb:vortex-file-compressed 17547684 / 17589114 / -0.2% 29196458 / 26889923 / +8.6% 0.60 / 0.65 / -8.1%
tpcds_q95/duckdb:vortex-file-compressed 72412628 / 72237886 / +0.2% 78651555 / 81393117 / -3.4% 0.92 / 0.89 / +3.7%
tpcds_q96/duckdb:vortex-file-compressed 8489964 / 8605394 / -1.3% 14844872 / 15524576 / -4.4% 0.57 / 0.55 / +3.2%
tpcds_q97/duckdb:vortex-file-compressed 23231207 / 23226086 / +0.0% 32360289 / 31658387 / +2.2% 0.72 / 0.73 / -2.1%
tpcds_q98/duckdb:vortex-file-compressed 13760082 / 13876400 / -0.8% 25351879 / 22195490 / +14.2% 🔴 0.54 / 0.63 / -13.2%
tpcds_q99/duckdb:vortex-file-compressed 14378342 / 15826683 / -9.2% 22713972 / 21012339 / +8.1% 0.63 / 0.75 / -16.0%
duckdb / parquet / ns (1.002x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 26018464 / 24816228 / +4.8% 31963672 / 32397655 / -1.3% 0.81 / 0.77 / +6.3%
tpcds_q02/duckdb:parquet 15327593 / 14960780 / +2.5% 20034004 / 21577318 / -7.2% 0.77 / 0.69 / +10.3%
tpcds_q03/duckdb:parquet 8726978 / 8826836 / -1.1% 15463391 / 15997339 / -3.3% 0.56 / 0.55 / +2.3%
tpcds_q04/duckdb:parquet 127223997 / 127970785 / -0.6% 132798319 / 132272491 / +0.4% 0.96 / 0.97 / -1.0%
tpcds_q05/duckdb:parquet 21270614 / 21349562 / -0.4% 26652663 / 25877442 / +3.0% 0.80 / 0.83 / -3.3%
tpcds_q06/duckdb:parquet 26854652 / 26746882 / +0.4% 37123957 / 37615762 / -1.3% 0.72 / 0.71 / +1.7%
tpcds_q07/duckdb:parquet 15218177 / 15345468 / -0.8% 25519301 / 22516712 / +13.3% 🔴 0.60 / 0.68 / -12.5%
tpcds_q08/duckdb:parquet 27320532 / 25751450 / +6.1% 33658148 / 33338611 / +1.0% 0.81 / 0.77 / +5.1%
tpcds_q09/duckdb:parquet 18861764 / 18922308 / -0.3% 21837158 / 24922848 / -12.4% 🟢 0.86 / 0.76 / +13.8%
tpcds_q10/duckdb:parquet 27708026 / 28679948 / -3.4% 42202591 / 38359109 / +10.0% 🔴 0.66 / 0.75 / -12.2%
tpcds_q11/duckdb:parquet 70886874 / 71225150 / -0.5% 76052506 / 76434150 / -0.5% 0.93 / 0.93 / +0.0%
tpcds_q12/duckdb:parquet 12707970 / 12763623 / -0.4% 17023512 / 17188217 / -1.0% 0.75 / 0.74 / +0.5%
tpcds_q13/duckdb:parquet 23830884 / 24051504 / -0.9% 42364003 / 31731349 / +33.5% 🔴 0.56 / 0.76 / -25.8%
tpcds_q14/duckdb:parquet 60783562 / 60453785 / +0.5% 66853445 / 70402526 / -5.0% 0.91 / 0.86 / +5.9%
tpcds_q15/duckdb:parquet 24819754 / 27658084 / -10.3% 🟢 30932653 / 34379029 / -10.0% 🟢 0.80 / 0.80 / -0.3%
tpcds_q16/duckdb:parquet 19933901 / 19745103 / +1.0% 28481422 / 28992002 / -1.8% 0.70 / 0.68 / +2.8%
tpcds_q17/duckdb:parquet 32342892 / 32319973 / +0.1% 40499217 / 40304859 / +0.5% 0.80 / 0.80 / -0.4%
tpcds_q18/duckdb:parquet 39865275 / 39310837 / +1.4% 49964909 / 53567959 / -6.7% 0.80 / 0.73 / +8.7%
tpcds_q19/duckdb:parquet 24514719 / 26005211 / -5.7% 34391429 / 32460911 / +5.9% 0.71 / 0.80 / -11.0%
tpcds_q20/duckdb:parquet 13396366 / 13575696 / -1.3% 17995843 / 18375434 / -2.1% 0.74 / 0.74 / +0.8%
tpcds_q21/duckdb:parquet 9438299 / 9429930 / +0.1% 13804828 / 12450605 / +10.9% 🔴 0.68 / 0.76 / -9.7%
tpcds_q22/duckdb:parquet 36391030 / 34979998 / +4.0% 38853803 / 39203071 / -0.9% 0.94 / 0.89 / +5.0%
tpcds_q23/duckdb:parquet 40756496 / 40536784 / +0.5% 52476539 / 48328066 / +8.6% 0.78 / 0.84 / -7.4%
tpcds_q24/duckdb:parquet 34448358 / 33305244 / +3.4% 47056691 / 44376570 / +6.0% 0.73 / 0.75 / -2.5%
tpcds_q25/duckdb:parquet 29889320 / 30094352 / -0.7% 44182403 / 40604086 / +8.8% 0.68 / 0.74 / -8.7%
tpcds_q26/duckdb:parquet 31157484 / 30913694 / +0.8% 39559141 / 39100865 / +1.2% 0.79 / 0.79 / -0.4%
tpcds_q27/duckdb:parquet 32728710 / 31822130 / +2.8% 44780513 / 40690084 / +10.1% 🔴 0.73 / 0.78 / -6.5%
tpcds_q28/duckdb:parquet 17033206 / 17151514 / -0.7% 20083902 / 19648078 / +2.2% 0.85 / 0.87 / -2.8%
tpcds_q29/duckdb:parquet 30698366 / 31101395 / -1.3% 38852355 / 42811137 / -9.2% 0.79 / 0.73 / +8.8%
tpcds_q30/duckdb:parquet 32420478 / 32500037 / -0.2% 44006886 / 43781834 / +0.5% 0.74 / 0.74 / -0.8%
tpcds_q31/duckdb:parquet 20229520 / 20222326 / +0.0% 28407452 / 25247479 / +12.5% 🔴 0.71 / 0.80 / -11.1%
tpcds_q32/duckdb:parquet 11232218 / 11266378 / -0.3% 17390309 / 16947771 / +2.6% 0.65 / 0.66 / -2.8%
tpcds_q33/duckdb:parquet 15823056 / 15964668 / -0.9% 22995150 / 24448149 / -5.9% 0.69 / 0.65 / +5.4%
tpcds_q34/duckdb:parquet 16076287 / 16046183 / +0.2% 22351194 / 22261642 / +0.4% 0.72 / 0.72 / -0.2%
tpcds_q35/duckdb:parquet 46349849 / 46649248 / -0.6% 56657576 / 57552413 / -1.6% 0.82 / 0.81 / +0.9%
tpcds_q36/duckdb:parquet 15187640 / 14936096 / +1.7% 22674877 / 22899929 / -1.0% 0.67 / 0.65 / +2.7%
tpcds_q37/duckdb:parquet 13400388 / 11558052 / +15.9% 🔴 22208221 / 18192704 / +22.1% 🔴 0.60 / 0.64 / -5.0%
tpcds_q38/duckdb:parquet 26475286 / 26367170 / +0.4% 34093797 / 31301908 / +8.9% 0.78 / 0.84 / -7.8%
tpcds_q39/duckdb:parquet 24495308 / 24597176 / -0.4% 31109934 / 29464988 / +5.6% 0.79 / 0.83 / -5.7%
tpcds_q40/duckdb:parquet 15771749 / 15902515 / -0.8% 21022572 / 21120527 / -0.5% 0.75 / 0.75 / -0.4%
tpcds_q41/duckdb:parquet 7655786 / 7612939 / +0.6% 13703740 / 13559272 / +1.1% 0.56 / 0.56 / -0.5%
tpcds_q42/duckdb:parquet 8408438 / 8423087 / -0.2% 14756174 / 14732846 / +0.2% 0.57 / 0.57 / -0.3%
tpcds_q43/duckdb:parquet 10629688 / 10699910 / -0.7% 18831414 / 15892918 / +18.5% 🔴 0.56 / 0.67 / -16.2%
tpcds_q44/duckdb:parquet 16454033 / 16332490 / +0.7% 22822481 / 23849713 / -4.3% 0.72 / 0.68 / +5.3%
tpcds_q45/duckdb:parquet 23003514 / 22967128 / +0.2% 28852883 / 29367049 / -1.8% 0.80 / 0.78 / +1.9%
tpcds_q46/duckdb:parquet 36439604 / 36085718 / +1.0% 44915995 / 45262793 / -0.8% 0.81 / 0.80 / +1.8%
tpcds_q47/duckdb:parquet 33195996 / 31320565 / +6.0% 40778880 / 37934162 / +7.5% 0.81 / 0.83 / -1.4%
tpcds_q48/duckdb:parquet 21065065 / 21075419 / -0.0% 28993558 / 28401419 / +2.1% 0.73 / 0.74 / -2.1%
tpcds_q49/duckdb:parquet 18982606 / 18971929 / +0.1% 30607183 / 27318775 / +12.0% 🔴 0.62 / 0.69 / -10.7%
tpcds_q50/duckdb:parquet 17617710 / 17650110 / -0.2% 24960321 / 25356701 / -1.6% 0.71 / 0.70 / +1.4%
tpcds_q51/duckdb:parquet 53300338 / 53357588 / -0.1% 60012759 / 61437976 / -2.3% 0.89 / 0.87 / +2.3%
tpcds_q52/duckdb:parquet 8565830 / 8548123 / +0.2% 15022485 / 15251602 / -1.5% 0.57 / 0.56 / +1.7%
tpcds_q53/duckdb:parquet 11470940 / 11603108 / -1.1% 16801930 / 18996193 / -11.6% 🟢 0.68 / 0.61 / +11.8%
tpcds_q54/duckdb:parquet 20030400 / 20744462 / -3.4% 30488152 / 29959019 / +1.8% 0.66 / 0.69 / -5.1%
tpcds_q55/duckdb:parquet 8506712 / 8429710 / +0.9% 15162587 / 14957028 / +1.4% 0.56 / 0.56 / -0.5%
tpcds_q56/duckdb:parquet 16304250 / 16870506 / -3.4% 23028488 / 22801378 / +1.0% 0.71 / 0.74 / -4.3%
tpcds_q57/duckdb:parquet 28837762 / 28891042 / -0.2% 40506326 / 34610857 / +17.0% 🔴 0.71 / 0.83 / -14.7%
tpcds_q58/duckdb:parquet 19065224 / 18806370 / +1.4% 25351353 / 26190587 / -3.2% 0.75 / 0.72 / +4.7%
tpcds_q59/duckdb:parquet 20101467 / 20085112 / +0.1% 25135252 / 24976995 / +0.6% 0.80 / 0.80 / -0.5%
tpcds_q60/duckdb:parquet 16897520 / 16971153 / -0.4% 26898940 / 24753714 / +8.7% 0.63 / 0.69 / -8.4%
tpcds_q61/duckdb:parquet 21611808 / 21677140 / -0.3% 29043165 / 29297923 / -0.9% 0.74 / 0.74 / +0.6%
tpcds_q62/duckdb:parquet 10730050 / 10736740 / -0.1% 15118991 / 14976942 / +0.9% 0.71 / 0.72 / -1.0%
tpcds_q63/duckdb:parquet 10837826 / 11026672 / -1.7% 15746255 / 16147028 / -2.5% 0.69 / 0.68 / +0.8%
tpcds_q64/duckdb:parquet 52618556 / 52598494 / +0.0% 64298865 / 65222661 / -1.4% 0.82 / 0.81 / +1.5%
tpcds_q65/duckdb:parquet 14344625 / 14593470 / -1.7% 20856703 / 21003621 / -0.7% 0.69 / 0.69 / -1.0%
tpcds_q66/duckdb:parquet 24552823 / 27475456 / -10.6% 🟢 33682531 / 33751952 / -0.2% 0.73 / 0.81 / -10.5%
tpcds_q67/duckdb:parquet 77443123 / 77378746 / +0.1% 84310036 / 89946976 / -6.3% 0.92 / 0.86 / +6.8%
tpcds_q68/duckdb:parquet 29052290 / 28962300 / +0.3% 39888866 / 40956282 / -2.6% 0.73 / 0.71 / +3.0%
tpcds_q69/duckdb:parquet 29897992 / 28665482 / +4.3% 38814002 / 38947552 / -0.3% 0.77 / 0.74 / +4.7%
tpcds_q70/duckdb:parquet 16138898 / 15959194 / +1.1% 23300510 / 23118856 / +0.8% 0.69 / 0.69 / +0.3%
tpcds_q71/duckdb:parquet 14586004 / 14573314 / +0.1% 20889924 / 20262874 / +3.1% 0.70 / 0.72 / -2.9%
tpcds_q72/duckdb:parquet 81750387 / 81457926 / +0.4% 86436468 / 85541629 / +1.0% 0.95 / 0.95 / -0.7%
tpcds_q73/duckdb:parquet 13522951 / 13478619 / +0.3% 19587252 / 19469441 / +0.6% 0.69 / 0.69 / -0.3%
tpcds_q74/duckdb:parquet 99631391 / 98885732 / +0.8% 108146953 / 105692171 / +2.3% 0.92 / 0.94 / -1.5%
tpcds_q75/duckdb:parquet 41325323 / 39954509 / +3.4% 51813100 / 49169874 / +5.4% 0.80 / 0.81 / -1.8%
tpcds_q76/duckdb:parquet 13548326 / 14108430 / -4.0% 23487138 / 20411601 / +15.1% 🔴 0.58 / 0.69 / -16.5%
tpcds_q77/duckdb:parquet 16626984 / 17204112 / -3.4% 25637086 / 24887233 / +3.0% 0.65 / 0.69 / -6.2%
tpcds_q78/duckdb:parquet 48161856 / 48145164 / +0.0% 53348025 / 53435986 / -0.2% 0.90 / 0.90 / +0.2%
tpcds_q79/duckdb:parquet 20321215 / 20451532 / -0.6% 28880913 / 29092575 / -0.7% 0.70 / 0.70 / +0.1%
tpcds_q80/duckdb:parquet 31478026 / 31063047 / +1.3% 39263669 / 39651933 / -1.0% 0.80 / 0.78 / +2.3%
tpcds_q81/duckdb:parquet 29779546 / 29696441 / +0.3% 39475057 / 39389469 / +0.2% 0.75 / 0.75 / +0.1%
tpcds_q82/duckdb:parquet 12712184 / 12664638 / +0.4% 18196297 / 20671126 / -12.0% 🟢 0.70 / 0.61 / +14.0%
tpcds_q83/duckdb:parquet 15694698 / 15663068 / +0.2% 20467551 / 24115381 / -15.1% 🟢 0.77 / 0.65 / +18.1%
tpcds_q84/duckdb:parquet 17277961 / 17383680 / -0.6% 23843626 / 24013776 / -0.7% 0.72 / 0.72 / +0.1%
tpcds_q85/duckdb:parquet 34905912 / 34644360 / +0.8% 45185326 / 45945016 / -1.7% 0.77 / 0.75 / +2.4%
tpcds_q86/duckdb:parquet 10921026 / 11113165 / -1.7% 18020053 / 15929506 / +13.1% 🔴 0.61 / 0.70 / -13.1%
tpcds_q87/duckdb:parquet 27985696 / 28080250 / -0.3% 32795605 / 32238548 / +1.7% 0.85 / 0.87 / -2.0%
tpcds_q88/duckdb:parquet 28715769 / 28632662 / +0.3% 31760401 / 35165254 / -9.7% 0.90 / 0.81 / +11.0%
tpcds_q89/duckdb:parquet 12498622 / 12640791 / -1.1% 18838234 / 21534333 / -12.5% 🟢 0.66 / 0.59 / +13.0%
tpcds_q90/duckdb:parquet 7280241 / 6890014 / +5.7% 11529372 / 11634770 / -0.9% 0.63 / 0.59 / +6.6%
tpcds_q91/duckdb:parquet 20759022 / 20724376 / +0.2% 29495611 / 30431096 / -3.1% 0.70 / 0.68 / +3.3%
tpcds_q92/duckdb:parquet 12967338 / 11483150 / +12.9% 🔴 18221701 / 18156645 / +0.4% 0.71 / 0.63 / +12.5%
tpcds_q93/duckdb:parquet 21381124 / 21228767 / +0.7% 28568559 / 28607551 / -0.1% 0.75 / 0.74 / +0.9%
tpcds_q94/duckdb:parquet 15838161 / 15849616 / -0.1% 25235595 / 27029011 / -6.6% 0.63 / 0.59 / +7.0%
tpcds_q95/duckdb:parquet 90053328 / 89861744 / +0.2% 96845055 / 96716429 / +0.1% 0.93 / 0.93 / +0.1%
tpcds_q96/duckdb:parquet 6924636 / 6909496 / +0.2% 10568392 / 10542370 / +0.2% 0.66 / 0.66 / -0.0%
tpcds_q97/duckdb:parquet 25990210 / 26196016 / -0.8% 31534585 / 31878965 / -1.1% 0.82 / 0.82 / +0.3%
tpcds_q98/duckdb:parquet 14898588 / 14992952 / -0.6% 21626738 / 31301822 / -30.9% 🟢 0.69 / 0.48 / +43.8%
tpcds_q99/duckdb:parquet 17233132 / 17344222 / -0.6% 21925287 / 21568671 / +1.7% 0.79 / 0.80 / -2.3%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 84490220 / 90665610 / -6.8% 157558024 / 152201164 / +3.5% 0.54 / 0.60 / -10.0%
tpch_q02/datafusion:vortex-file-compressed 64927830 / 64978143 / -0.1% 94094500 / 97387271 / -3.4% 0.69 / 0.67 / +3.4%
tpch_q03/datafusion:vortex-file-compressed 65757116 / 66333430 / -0.9% 110606010 / 112372235 / -1.6% 0.59 / 0.59 / +0.7%
tpch_q04/datafusion:vortex-file-compressed 35874167 / 36014302 / -0.4% 69201730 / 73584898 / -6.0% 0.52 / 0.49 / +5.9%
tpch_q05/datafusion:vortex-file-compressed 117366476 / 120351259 / -2.5% 171519330 / 176781003 / -3.0% 0.68 / 0.68 / +0.5%
tpch_q06/datafusion:vortex-file-compressed 14849344 / 14480405 / +2.5% 69936622 / 71194235 / -1.8% 0.21 / 0.20 / +4.4%
tpch_q07/datafusion:vortex-file-compressed 140979770 / 141240784 / -0.2% 186442725 / 182337745 / +2.3% 0.76 / 0.77 / -2.4%
tpch_q08/datafusion:vortex-file-compressed 146727492 / 149917697 / -2.1% 201593472 / 201724732 / -0.1% 0.73 / 0.74 / -2.1%
tpch_q09/datafusion:vortex-file-compressed 183386005 / 190429300 / -3.7% 252071614 / 259698765 / -2.9% 0.73 / 0.73 / -0.8%
tpch_q10/datafusion:vortex-file-compressed 75529307 / 76424609 / -1.2% 126894031 / 130440252 / -2.7% 0.60 / 0.59 / +1.6%
tpch_q11/datafusion:vortex-file-compressed 43710902 / 43606942 / +0.2% 67124656 / 66440257 / +1.0% 0.65 / 0.66 / -0.8%
tpch_q12/datafusion:vortex-file-compressed 46325454 / 49777565 / -6.9% 86516297 / 95499072 / -9.4% 0.54 / 0.52 / +2.7%
tpch_q13/datafusion:vortex-file-compressed 47403337 / 47264113 / +0.3% 74251738 / 77980781 / -4.8% 0.64 / 0.61 / +5.3%
tpch_q14/datafusion:vortex-file-compressed 24669402 / 25019821 / -1.4% 95530865 / 93454870 / +2.2% 0.26 / 0.27 / -3.5%
tpch_q15/datafusion:vortex-file-compressed 37549914 / 37544450 / +0.0% 99855270 / 97428187 / +2.5% 0.38 / 0.39 / -2.4%
tpch_q16/datafusion:vortex-file-compressed 38539845 / 37508783 / +2.7% 63957871 / 67869158 / -5.8% 0.60 / 0.55 / +9.0%
tpch_q17/datafusion:vortex-file-compressed 178041699 / 183262354 / -2.8% 223843401 / 220851033 / +1.4% 0.80 / 0.83 / -4.1%
tpch_q18/datafusion:vortex-file-compressed 205138727 / 200461112 / +2.3% 259591144 / 249009485 / +4.2% 0.79 / 0.81 / -1.8%
tpch_q19/datafusion:vortex-file-compressed 35184115 / 38929652 / -9.6% 95131898 / 97946880 / -2.9% 0.37 / 0.40 / -6.9%
tpch_q20/datafusion:vortex-file-compressed 63951894 / 62980417 / +1.5% 125902508 / 129889886 / -3.1% 0.51 / 0.48 / +4.8%
tpch_q21/datafusion:vortex-file-compressed 183064661 / 182841574 / +0.1% 234523323 / 236325930 / -0.8% 0.78 / 0.77 / +0.9%
tpch_q22/datafusion:vortex-file-compressed 25377099 / 25576633 / -0.8% 53316164 / 52889589 / +0.8% 0.48 / 0.48 / -1.6%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83548705 / 82876117 / +0.8% 135522695 / 136429993 / -0.7% 0.62 / 0.61 / +1.5%
tpch_q02/datafusion:parquet 135993048 / 135277889 / +0.5% 162696014 / 161460756 / +0.8% 0.84 / 0.84 / -0.2%
tpch_q03/datafusion:parquet 124091890 / 125178385 / -0.9% 201427188 / 196438926 / +2.5% 0.62 / 0.64 / -3.3%
tpch_q04/datafusion:parquet 53094196 / 52908590 / +0.4% 107337775 / 120015932 / -10.6% 🟢 0.49 / 0.44 / +12.2%
tpch_q05/datafusion:parquet 164092112 / 164748887 / -0.4% 246556593 / 243914162 / +1.1% 0.67 / 0.68 / -1.5%
tpch_q06/datafusion:parquet 31779946 / 32665084 / -2.7% 85588474 / 83829437 / +2.1% 0.37 / 0.39 / -4.7%
tpch_q07/datafusion:parquet 214377300 / 214731710 / -0.2% 298470007 / 300325741 / -0.6% 0.72 / 0.71 / +0.5%
tpch_q08/datafusion:parquet 211495721 / 210654837 / +0.4% 299877177 / 297451077 / +0.8% 0.71 / 0.71 / -0.4%
tpch_q09/datafusion:parquet 282756351 / 279687826 / +1.1% 359947598 / 362759476 / -0.8% 0.79 / 0.77 / +1.9%
tpch_q10/datafusion:parquet 301868010 / 305123198 / -1.1% 361427204 / 370752295 / -2.5% 0.84 / 0.82 / +1.5%
tpch_q11/datafusion:parquet 96798996 / 96570562 / +0.2% 118858942 / 119613252 / -0.6% 0.81 / 0.81 / +0.9%
tpch_q12/datafusion:parquet 78042440 / 78332008 / -0.4% 128903662 / 131426976 / -1.9% 0.61 / 0.60 / +1.6%
tpch_q13/datafusion:parquet 194132077 / 194488662 / -0.2% 227103439 / 226858406 / +0.1% 0.85 / 0.86 / -0.3%
tpch_q14/datafusion:parquet 73872317 / 75080360 / -1.6% 173268038 / 175502550 / -1.3% 0.43 / 0.43 / -0.3%
tpch_q15/datafusion:parquet 77441490 / 78683629 / -1.6% 137352576 / 138540482 / -0.9% 0.56 / 0.57 / -0.7%
tpch_q16/datafusion:parquet 84021793 / 84140228 / -0.1% 112082896 / 110313296 / +1.6% 0.75 / 0.76 / -1.7%
tpch_q17/datafusion:parquet 202208635 / 204108408 / -0.9% 269152900 / 265255390 / +1.5% 0.75 / 0.77 / -2.4%
tpch_q18/datafusion:parquet 261360825 / 263023674 / -0.6% 322738984 / 321083041 / +0.5% 0.81 / 0.82 / -1.1%
tpch_q19/datafusion:parquet 97672505 / 97885317 / -0.2% 173009509 / 174676856 / -1.0% 0.56 / 0.56 / +0.7%
tpch_q20/datafusion:parquet 152331211 / 152806237 / -0.3% 211909668 / 211996798 / -0.0% 0.72 / 0.72 / -0.3%
tpch_q21/datafusion:parquet 229651678 / 228051453 / +0.7% 303976329 / 303130289 / +0.3% 0.76 / 0.75 / +0.4%
tpch_q22/datafusion:parquet 161004276 / 161189140 / -0.1% 184173232 / 183888530 / +0.2% 0.87 / 0.88 / -0.3%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54472783 / 55200316 / -1.3% 88908245 / 95632504 / -7.0% 0.61 / 0.58 / +6.1%
tpch_q02/duckdb:vortex-file-compressed 32763903 / 32955845 / -0.6% 47609529 / 50087588 / -4.9% 0.69 / 0.66 / +4.6%
tpch_q03/duckdb:vortex-file-compressed 60326439 / 60095393 / +0.4% 98528769 / 96208084 / +2.4% 0.61 / 0.62 / -2.0%
tpch_q04/duckdb:vortex-file-compressed 79871936 / 80016056 / -0.2% 109473089 / 112140697 / -2.4% 0.73 / 0.71 / +2.3%
tpch_q05/duckdb:vortex-file-compressed 64190295 / 64386687 / -0.3% 107165071 / 106221170 / +0.9% 0.60 / 0.61 / -1.2%
tpch_q06/duckdb:vortex-file-compressed 20928055 / 20929958 / -0.0% 58918428 / 58662255 / +0.4% 0.36 / 0.36 / -0.4%
tpch_q07/duckdb:vortex-file-compressed 61381049 / 63574613 / -3.5% 119203918 / 131330462 / -9.2% 0.51 / 0.48 / +6.4%
tpch_q08/duckdb:vortex-file-compressed 83838236 / 84826774 / -1.2% 137108112 / 142081953 / -3.5% 0.61 / 0.60 / +2.4%
tpch_q09/duckdb:vortex-file-compressed 167964703 / 169400030 / -0.8% 227010044 / 229186696 / -0.9% 0.74 / 0.74 / +0.1%
tpch_q10/duckdb:vortex-file-compressed 116628013 / 118142936 / -1.3% 189200295 / 179644197 / +5.3% 0.62 / 0.66 / -6.3%
tpch_q11/duckdb:vortex-file-compressed 17306898 / 18091069 / -4.3% 33809930 / 32512867 / +4.0% 0.51 / 0.56 / -8.0%
tpch_q12/duckdb:vortex-file-compressed 54151981 / 55161076 / -1.8% 94713487 / 90693650 / +4.4% 0.57 / 0.61 / -6.0%
tpch_q13/duckdb:vortex-file-compressed 91591253 / 94244426 / -2.8% 131433128 / 130976049 / +0.3% 0.70 / 0.72 / -3.2%
tpch_q14/duckdb:vortex-file-compressed 32605450 / 29948148 / +8.9% 72314250 / 73682980 / -1.9% 0.45 / 0.41 / +10.9%
tpch_q15/duckdb:vortex-file-compressed 39935293 / 39028244 / +2.3% 83711333 / 83483219 / +0.3% 0.48 / 0.47 / +2.0%
tpch_q16/duckdb:vortex-file-compressed 42434106 / 42505985 / -0.2% 53380500 / 53067100 / +0.6% 0.79 / 0.80 / -0.8%
tpch_q17/duckdb:vortex-file-compressed 77869466 / 63092695 / +23.4% 🔴 163307185 / 131850494 / +23.9% 🔴 0.48 / 0.48 / -0.4%
tpch_q18/duckdb:vortex-file-compressed 130262843 / 137905332 / -5.5% 151619962 / 152345039 / -0.5% 0.86 / 0.91 / -5.1%
tpch_q19/duckdb:vortex-file-compressed 43054700 / 42300938 / +1.8% 95330418 / 94634339 / +0.7% 0.45 / 0.45 / +1.0%
tpch_q20/duckdb:vortex-file-compressed 59565087 / 58663647 / +1.5% 114278128 / 112736544 / +1.4% 0.52 / 0.52 / +0.2%
tpch_q21/duckdb:vortex-file-compressed 243983345 / 244674515 / -0.3% 282331687 / 276392394 / +2.1% 0.86 / 0.89 / -2.4%
tpch_q22/duckdb:vortex-file-compressed 40802640 / 40614800 / +0.5% 60314545 / 54334528 / +11.0% 🔴 0.68 / 0.75 / -9.5%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70408960 / 70886291 / -0.7% 96068296 / 89555592 / +7.3% 0.73 / 0.79 / -7.4%
tpch_q02/duckdb:parquet 70512585 / 71172239 / -0.9% 82512335 / 82811704 / -0.4% 0.85 / 0.86 / -0.6%
tpch_q03/duckdb:parquet 115389259 / 119200108 / -3.2% 144669069 / 160379034 / -9.8% 0.80 / 0.74 / +7.3%
tpch_q04/duckdb:parquet 74095853 / 75117464 / -1.4% 97222511 / 99706055 / -2.5% 0.76 / 0.75 / +1.2%
tpch_q05/duckdb:parquet 124707044 / 125417822 / -0.6% 160657826 / 163294925 / -1.6% 0.78 / 0.77 / +1.1%
tpch_q06/duckdb:parquet 34247456 / 35533536 / -3.6% 49709063 / 49514714 / +0.4% 0.69 / 0.72 / -4.0%
tpch_q07/duckdb:parquet 88519189 / 89725161 / -1.3% 129063121 / 132317713 / -2.5% 0.69 / 0.68 / +1.1%
tpch_q08/duckdb:parquet 141997804 / 143910923 / -1.3% 195228670 / 200301561 / -2.5% 0.73 / 0.72 / +1.2%
tpch_q09/duckdb:parquet 221776354 / 224346594 / -1.1% 265570942 / 275295589 / -3.5% 0.84 / 0.81 / +2.5%
tpch_q10/duckdb:parquet 468891478 / 476104249 / -1.5% 516661858 / 519205118 / -0.5% 0.91 / 0.92 / -1.0%
tpch_q11/duckdb:parquet 30706926 / 30831727 / -0.4% 36958861 / 38232905 / -3.3% 0.83 / 0.81 / +3.0%
tpch_q12/duckdb:parquet 75934637 / 75833433 / +0.1% 91229864 / 95761183 / -4.7% 0.83 / 0.79 / +5.1%
tpch_q13/duckdb:parquet 313619598 / 318504585 / -1.5% 330450777 / 333883729 / -1.0% 0.95 / 0.95 / -0.5%
tpch_q14/duckdb:parquet 103422953 / 103127575 / +0.3% 135231300 / 133493962 / +1.3% 0.76 / 0.77 / -1.0%
tpch_q15/duckdb:parquet 44295052 / 43751094 / +1.2% 66216043 / 76920228 / -13.9% 🟢 0.67 / 0.57 / +17.6%
tpch_q16/duckdb:parquet 114879773 / 114534034 / +0.3% 124937888 / 125180816 / -0.2% 0.92 / 0.91 / +0.5%
tpch_q17/duckdb:parquet 73581933 / 76546345 / -3.9% 104039863 / 104510004 / -0.4% 0.71 / 0.73 / -3.4%
tpch_q18/duckdb:parquet 199702984 / 203615815 / -1.9% 165650828 / 178102936 / -7.0% 1.21 / 1.14 / +5.5%
tpch_q19/duckdb:parquet 160424157 / 163408495 / -1.8% 194829067 / 192335319 / +1.3% 0.82 / 0.85 / -3.1%
tpch_q20/duckdb:parquet 129078016 / 128885888 / +0.1% 162996294 / 164083124 / -0.7% 0.79 / 0.79 / +0.8%
tpch_q21/duckdb:parquet 273553126 / 271797493 / +0.6% 281159612 / 292971808 / -4.0% 0.97 / 0.93 / +4.9%
tpch_q22/duckdb:parquet 263138680 / 264077854 / -0.4% 272021259 / 279972561 / -2.8% 0.97 / 0.94 / +2.6%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 8974327 / 8966311 / +0.1% 9377188 / 9473142 / -1.0% 0.96 / 0.95 / +1.1%
statpopgen_q01/duckdb:vortex-file-compressed 10409274 / 10425720 / -0.2% 14513277 / 14608766 / -0.7% 0.72 / 0.71 / +0.5%
statpopgen_q02/duckdb:vortex-file-compressed 377741119 / 380346028 / -0.7% 401526886 / 394142830 / +1.9% 0.94 / 0.96 / -2.5%
statpopgen_q03/duckdb:vortex-file-compressed 887156222 / 897943953 / -1.2% 896014560 / 894479414 / +0.2% 0.99 / 1.00 / -1.4%
statpopgen_q04/duckdb:vortex-file-compressed 885487230 / 895891394 / -1.2% 895963497 / 895232514 / +0.1% 0.99 / 1.00 / -1.2%
statpopgen_q05/duckdb:vortex-file-compressed 421973760 / 422790120 / -0.2% 434177540 / 433088633 / +0.3% 0.97 / 0.98 / -0.4%
statpopgen_q06/duckdb:vortex-file-compressed 1161372648 / 1168332987 / -0.6% 1175583224 / 1170864642 / +0.4% 0.99 / 1.00 / -1.0%
statpopgen_q07/duckdb:vortex-file-compressed 189356698 / 188719586 / +0.3% 211605249 / 212683753 / -0.5% 0.89 / 0.89 / +0.8%
statpopgen_q08/duckdb:vortex-file-compressed 201947996 / 198377119 / +1.8% 223557643 / 217228837 / +2.9% 0.90 / 0.91 / -1.1%
statpopgen_q09/duckdb:vortex-file-compressed 707394084 / 713052230 / -0.8% 727804375 / 721606248 / +0.9% 0.97 / 0.99 / -1.6%
statpopgen_q10/duckdb:vortex-file-compressed 2007316202 / 1993615222 / +0.7% 1957677574 / 1955407876 / +0.1% 1.03 / 1.02 / +0.6%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 246313903 / 248491698 / -0.9% 245218725 / 248539497 / -1.3% 1.00 / 1.00 / +0.5%
statpopgen_q01/duckdb:parquet 302168323 / 304963111 / -0.9% 302456696 / 305128117 / -0.9% 1.00 / 1.00 / -0.0%
statpopgen_q02/duckdb:parquet 569622566 / 548304620 / +3.9% 578381621 / 570113700 / +1.5% 0.98 / 0.96 / +2.4%
statpopgen_q03/duckdb:parquet 858812790 / 861953024 / -0.4% 869528449 / 849174013 / +2.4% 0.99 / 1.02 / -2.7%
statpopgen_q04/duckdb:parquet 859898438 / 896359050 / -4.1% 867564917 / 907856851 / -4.4% 0.99 / 0.99 / +0.4%
statpopgen_q05/duckdb:parquet 571005268 / 573848515 / -0.5% 549235342 / 565277533 / -2.8% 1.04 / 1.02 / +2.4%
statpopgen_q06/duckdb:parquet 733803117 / 718875514 / +2.1% 714518395 / 702767798 / +1.7% 1.03 / 1.02 / +0.4%
statpopgen_q07/duckdb:parquet 612885248 / 616437490 / -0.6% 719080054 / 695861332 / +3.3% 0.85 / 0.89 / -3.8%
statpopgen_q08/duckdb:parquet 622709414 / 618465280 / +0.7% 688777442 / 713532734 / -3.5% 0.90 / 0.87 / +4.3%
statpopgen_q09/duckdb:parquet 790244624 / 834831876 / -5.3% 787786912 / 846818646 / -7.0% 1.00 / 0.99 / +1.8%
statpopgen_q10/duckdb:parquet 1444006420 / 1508186793 / -4.3% 1253243847 / 1267724549 / -1.1% 1.15 / 1.19 / -3.1%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 26fd045a vs base bffdca11
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.7%
Engines: DataFusion No clear signal (-1.9%, environment too noisy confidence) · DuckDB No clear signal (-5.4%, environment too noisy confidence)
Vortex (geomean): hot 1.043x ➖ · cold 1.050x ➖
Parquet (geomean): hot 1.082x ➖ · cold 1.117x ➖
Shifts: Parquet (control) +8.2% · Median polish +5.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.075x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 204531095 / 207056684 / -1.2% 739889806 / 683632519 / +8.2% 0.28 / 0.30 / -8.7%
tpch_q02/datafusion:vortex-file-compressed 365857010 / 332820121 / +9.9% 715045854 / 605163008 / +18.2% 0.51 / 0.55 / -7.0%
tpch_q03/datafusion:vortex-file-compressed 326040372 / 313070433 / +4.1% 1104198183 / 896372840 / +23.2% 0.30 / 0.35 / -15.5%
tpch_q04/datafusion:vortex-file-compressed 174575103 / 159051838 / +9.8% 412671700 / 399712889 / +3.2% 0.42 / 0.40 / +6.3%
tpch_q05/datafusion:vortex-file-compressed 434286083 / 541315695 / -19.8% 735492326 / 646864008 / +13.7% 0.59 / 0.84 / -29.4%
tpch_q06/datafusion:vortex-file-compressed 252762485 / 426184421 / -40.7% 🟢 619292966 / 399179674 / +55.1% 🔴 0.41 / 1.07 / -61.8%
tpch_q07/datafusion:vortex-file-compressed 367121570 / 419929350 / -12.6% 505992797 / 527575693 / -4.1% 0.73 / 0.80 / -8.8%
tpch_q08/datafusion:vortex-file-compressed 481337323 / 453949059 / +6.0% 610532862 / 538843647 / +13.3% 0.79 / 0.84 / -6.4%
tpch_q09/datafusion:vortex-file-compressed 489790147 / 333621354 / +46.8% 🔴 536197568 / 530282535 / +1.1% 0.91 / 0.63 / +45.2%
tpch_q10/datafusion:vortex-file-compressed 336377485 / 338484125 / -0.6% 481291468 / 504120535 / -4.5% 0.70 / 0.67 / +4.1%
tpch_q11/datafusion:vortex-file-compressed 345421778 / 320218092 / +7.9% 522760476 / 483088362 / +8.2% 0.66 / 0.66 / -0.3%
tpch_q12/datafusion:vortex-file-compressed 390359505 / 344481467 / +13.3% 595961992 / 758533244 / -21.4% 0.66 / 0.45 / +44.2%
tpch_q13/datafusion:vortex-file-compressed 102719943 / 101565043 / +1.1% 371701769 / 342686924 / +8.5% 0.28 / 0.30 / -6.8%
tpch_q14/datafusion:vortex-file-compressed 169855155 / 166380655 / +2.1% 320221106 / 298676753 / +7.2% 0.53 / 0.56 / -4.8%
tpch_q15/datafusion:vortex-file-compressed 312578988 / 289082271 / +8.1% 547866149 / 483947260 / +13.2% 0.57 / 0.60 / -4.5%
tpch_q16/datafusion:vortex-file-compressed 169889364 / 154377829 / +10.0% 335676919 / 319702855 / +5.0% 0.51 / 0.48 / +4.8%
tpch_q17/datafusion:vortex-file-compressed 322353358 / 310779267 / +3.7% 562738367 / 426182301 / +32.0% 🔴 0.57 / 0.73 / -21.4%
tpch_q18/datafusion:vortex-file-compressed 331751805 / 230212846 / +44.1% 🔴 704425702 / 395439479 / +78.1% 🔴 0.47 / 0.58 / -19.1%
tpch_q19/datafusion:vortex-file-compressed 352037165 / 323250100 / +8.9% 522452717 / 434170888 / +20.3% 0.67 / 0.74 / -9.5%
tpch_q20/datafusion:vortex-file-compressed 316649075 / 299652019 / +5.7% 555638003 / 881053605 / -36.9% 🟢 0.57 / 0.34 / +67.6%
tpch_q21/datafusion:vortex-file-compressed 475959317 / 414857506 / +14.7% 586340593 / 611123060 / -4.1% 0.81 / 0.68 / +19.6%
tpch_q22/datafusion:vortex-file-compressed 331500595 / 160056661 / +107.1% 🔴 1007791586 / 371734519 / +171.1% 🔴 0.33 / 0.43 / -23.6%
datafusion / parquet / ns (1.096x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 173603361 / 164510723 / +5.5% 779654131 / 457783044 / +70.3% 🔴 0.22 / 0.36 / -38.0%
tpch_q02/datafusion:parquet 305220238 / 273281519 / +11.7% 721245927 / 579202209 / +24.5% 0.42 / 0.47 / -10.3%
tpch_q03/datafusion:parquet 289136321 / 280710997 / +3.0% 845724462 / 830073398 / +1.9% 0.34 / 0.34 / +1.1%
tpch_q04/datafusion:parquet 146969732 / 145282610 / +1.2% 387120086 / 351600875 / +10.1% 0.38 / 0.41 / -8.1%
tpch_q05/datafusion:parquet 352689034 / 341453078 / +3.3% 464355823 / 495740508 / -6.3% 0.76 / 0.69 / +10.3%
tpch_q06/datafusion:parquet 150983121 / 128434465 / +17.6% 259802749 / 220123309 / +18.0% 0.58 / 0.58 / -0.4%
tpch_q07/datafusion:parquet 452005945 / 361384990 / +25.1% 721937260 / 468240520 / +54.2% 🔴 0.63 / 0.77 / -18.9%
tpch_q08/datafusion:parquet 428354313 / 449828921 / -4.8% 542930009 / 570262585 / -4.8% 0.79 / 0.79 / +0.0%
tpch_q09/datafusion:parquet 435604863 / 429483744 / +1.4% 640878515 / 630507190 / +1.6% 0.68 / 0.68 / -0.2%
tpch_q10/datafusion:parquet 383876481 / 402685573 / -4.7% 562193978 / 518734521 / +8.4% 0.68 / 0.78 / -12.0%
tpch_q11/datafusion:parquet 259200752 / 297189375 / -12.8% 421145079 / 466290022 / -9.7% 0.62 / 0.64 / -3.4%
tpch_q12/datafusion:parquet 187657378 / 170810731 / +9.9% 441775344 / 416985079 / +5.9% 0.42 / 0.41 / +3.7%
tpch_q13/datafusion:parquet 414856393 / 395964112 / +4.8% 617967699 / 609582681 / +1.4% 0.67 / 0.65 / +3.3%
tpch_q14/datafusion:parquet 177635367 / 163882396 / +8.4% 289809574 / 258976681 / +11.9% 0.61 / 0.63 / -3.1%
tpch_q15/datafusion:parquet 324125286 / 314655826 / +3.0% 475922298 / 471050843 / +1.0% 0.68 / 0.67 / +2.0%
tpch_q16/datafusion:parquet 115029071 / 135034302 / -14.8% 312301016 / 456486736 / -31.6% 🟢 0.37 / 0.30 / +24.5%
tpch_q17/datafusion:parquet 323122473 / 274629977 / +17.7% 439426203 / 392062410 / +12.1% 0.74 / 0.70 / +5.0%
tpch_q18/datafusion:parquet 421534724 / 390319972 / +8.0% 546818495 / 551895926 / -0.9% 0.77 / 0.71 / +9.0%
tpch_q19/datafusion:parquet 194681068 / 156882736 / +24.1% 341517389 / 273147049 / +25.0% 0.57 / 0.57 / -0.7%
tpch_q20/datafusion:parquet 260911559 / 252459939 / +3.3% 461969509 / 407232518 / +13.4% 0.56 / 0.62 / -8.9%
tpch_q21/datafusion:parquet 388675314 / 348310937 / +11.6% 551951113 / 510621512 / +8.1% 0.70 / 0.68 / +3.2%
tpch_q22/datafusion:parquet 421831485 / 168166886 / +150.8% 🔴 988303518 / 333361483 / +196.5% 🔴 0.43 / 0.50 / -15.4%
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 198302001 / 195476951 / +1.4% 247444235 / 316127022 / -21.7% 0.80 / 0.62 / +29.6%
tpch_q02/duckdb:vortex-file-compressed 466102364 / 405146743 / +15.0% 546289143 / 489265804 / +11.7% 0.85 / 0.83 / +3.0%
tpch_q03/duckdb:vortex-file-compressed 443996773 / 393150955 / +12.9% 586917228 / 480677988 / +22.1% 0.76 / 0.82 / -7.5%
tpch_q04/duckdb:vortex-file-compressed 235232956 / 227442564 / +3.4% 252687560 / 411974787 / -38.7% 🟢 0.93 / 0.55 / +68.6%
tpch_q05/duckdb:vortex-file-compressed 394905946 / 371348810 / +6.3% 419752976 / 415947168 / +0.9% 0.94 / 0.89 / +5.4%
tpch_q06/duckdb:vortex-file-compressed 266155744 / 291572061 / -8.7% 297865008 / 340142259 / -12.4% 0.89 / 0.86 / +4.2%
tpch_q07/duckdb:vortex-file-compressed 403947716 / 478880570 / -15.6% 432762130 / 524188422 / -17.4% 0.93 / 0.91 / +2.2%
tpch_q08/duckdb:vortex-file-compressed 555157698 / 556685575 / -0.3% 647599694 / 547833432 / +18.2% 0.86 / 1.02 / -15.6%
tpch_q09/duckdb:vortex-file-compressed 444261669 / 448149419 / -0.9% 518917895 / 584476328 / -11.2% 0.86 / 0.77 / +11.7%
tpch_q10/duckdb:vortex-file-compressed 432027522 / 388352791 / +11.2% 415107760 / 414894411 / +0.1% 1.04 / 0.94 / +11.2%
tpch_q11/duckdb:vortex-file-compressed 138739384 / 147191491 / -5.7% 201958374 / 215314777 / -6.2% 0.69 / 0.68 / +0.5%
tpch_q12/duckdb:vortex-file-compressed 473398048 / 472623663 / +0.2% 454015066 / 399753498 / +13.6% 1.04 / 1.18 / -11.8%
tpch_q13/duckdb:vortex-file-compressed 282141694 / 305289573 / -7.6% 287750242 / 306171794 / -6.0% 0.98 / 1.00 / -1.7%
tpch_q14/duckdb:vortex-file-compressed 237622598 / 235857923 / +0.7% 271117745 / 313047844 / -13.4% 0.88 / 0.75 / +16.3%
tpch_q15/duckdb:vortex-file-compressed 146724016 / 156603451 / -6.3% 172100240 / 194953577 / -11.7% 0.85 / 0.80 / +6.1%
tpch_q16/duckdb:vortex-file-compressed 231230677 / 183906332 / +25.7% 331593026 / 216808862 / +52.9% 🔴 0.70 / 0.85 / -17.8%
tpch_q17/duckdb:vortex-file-compressed 378667196 / 380905888 / -0.6% 433128105 / 473075317 / -8.4% 0.87 / 0.81 / +8.6%
tpch_q18/duckdb:vortex-file-compressed 290544656 / 279730842 / +3.9% 336508846 / 293844437 / +14.5% 0.86 / 0.95 / -9.3%
tpch_q19/duckdb:vortex-file-compressed 329167189 / 398782390 / -17.5% 398157507 / 327140784 / +21.7% 0.83 / 1.22 / -32.2%
tpch_q20/duckdb:vortex-file-compressed 416547062 / 350696623 / +18.8% 453734344 / 426833835 / +6.3% 0.92 / 0.82 / +11.7%
tpch_q21/duckdb:vortex-file-compressed 560222972 / 561556765 / -0.2% 686436863 / 802208830 / -14.4% 0.82 / 0.70 / +16.6%
tpch_q22/duckdb:vortex-file-compressed 117170198 / 117002905 / +0.1% 123665824 / 161385866 / -23.4% 0.95 / 0.72 / +30.7%
duckdb / parquet / ns (1.069x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 310561696 / 285567355 / +8.8% 285599006 / 286005087 / -0.1% 1.09 / 1.00 / +8.9%
tpch_q02/duckdb:parquet 675561474 / 656208087 / +2.9% 752617777 / 850911853 / -11.6% 0.90 / 0.77 / +16.4%
tpch_q03/duckdb:parquet 796304383 / 717633917 / +11.0% 934012469 / 839785477 / +11.2% 0.85 / 0.85 / -0.2%
tpch_q04/duckdb:parquet 484928950 / 448216297 / +8.2% 524425267 / 530555894 / -1.2% 0.92 / 0.84 / +9.5%
tpch_q05/duckdb:parquet 927818469 / 957153839 / -3.1% 1443673232 / 863259191 / +67.2% 🔴 0.64 / 1.11 / -42.0%
tpch_q06/duckdb:parquet 321115806 / 281939043 / +13.9% 342678215 / 267008668 / +28.3% 0.94 / 1.06 / -11.3%
tpch_q07/duckdb:parquet 935158201 / 823041349 / +13.6% 869553443 / 801567549 / +8.5% 1.08 / 1.03 / +4.7%
tpch_q08/duckdb:parquet 1107601484 / 1052890577 / +5.2% 1145600058 / 1017136708 / +12.6% 0.97 / 1.04 / -6.6%
tpch_q09/duckdb:parquet 1145479421 / 982027405 / +16.6% 1076909478 / 813479062 / +32.4% 🔴 1.06 / 1.21 / -11.9%
tpch_q10/duckdb:parquet 965818418 / 956660670 / +1.0% 1051412490 / 963003737 / +9.2% 0.92 / 0.99 / -7.5%
tpch_q11/duckdb:parquet 423848661 / 419745894 / +1.0% 383051035 / 441806593 / -13.3% 1.11 / 0.95 / +16.5%
tpch_q12/duckdb:parquet 569023119 / 491770120 / +15.7% 585980810 / 530816618 / +10.4% 0.97 / 0.93 / +4.8%
tpch_q13/duckdb:parquet 797485840 / 766338924 / +4.1% 860863082 / 1265580156 / -32.0% 🟢 0.93 / 0.61 / +53.0%
tpch_q14/duckdb:parquet 506929381 / 474981262 / +6.7% 696215533 / 455176075 / +53.0% 🔴 0.73 / 1.04 / -30.2%
tpch_q15/duckdb:parquet 398658726 / 339573230 / +17.4% 402316188 / 349452281 / +15.1% 0.99 / 0.97 / +2.0%
tpch_q16/duckdb:parquet 511479943 / 486352585 / +5.2% 546038100 / 498928815 / +9.4% 0.94 / 0.97 / -3.9%
tpch_q17/duckdb:parquet 445904325 / 446329107 / -0.1% 557176459 / 416245829 / +33.9% 🔴 0.80 / 1.07 / -25.4%
tpch_q18/duckdb:parquet 628577782 / 615844018 / +2.1% 628148611 / 603213893 / +4.1% 1.00 / 1.02 / -2.0%
tpch_q19/duckdb:parquet 600871224 / 537904982 / +11.7% 663939096 / 608569079 / +9.1% 0.91 / 0.88 / +2.4%
tpch_q20/duckdb:parquet 828021594 / 807317213 / +2.6% 879902083 / 845245974 / +4.1% 0.94 / 0.96 / -1.5%
tpch_q21/duckdb:parquet 720373244 / 691353160 / +4.2% 724040063 / 662544187 / +9.3% 0.99 / 1.04 / -4.7%
tpch_q22/duckdb:parquet 428880496 / 403264754 / +6.4% 452403724 / 453833715 / -0.3% 0.95 / 0.89 / +6.7%

@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch 4 times, most recently from 5a76dc2 to 2dd2e1a Compare September 8, 2026 15:52
Comment thread vortex-arrow/src/dtype.rs
| DataType::Decimal128(precision, scale)
| DataType::Decimal256(precision, scale) => {
DType::Decimal(DecimalDType::new(*precision, *scale), nullability)
DType::Decimal(DecimalDType::try_new(*precision, *scale)?, nullability)

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fly by fix

@AdamGS AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 55e1679 to d37c4e1 Compare September 9, 2026 12:16
@AdamGS AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@AdamGS AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@AdamGS AdamGS changed the title Align DF expression conversion and pushdown Fix DataFusion expression conversion and pushdown semantics Sep 9, 2026
@AdamGS
AdamGS requested review from a10y, joseph-isaacs and robert3005 and removed request for a10y, joseph-isaacs and robert3005 September 9, 2026 14:04
@AdamGS

AdamGS commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

I'm still working on some of the tests and there are follow ups, but this should be ready for review.

@AdamGS
AdamGS marked this pull request as ready for review September 9, 2026 14:14
@a10y

a10y commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

super nit but i'm pretty sure Converter is more accepted than Convertor

@AdamGS

AdamGS commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

@a10y I'll rename, might as well.

@AdamGS AdamGS added the changelog/break A breaking API change label Sep 9, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR and removed changelog/break A breaking API change labels Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026

@joseph-isaacs joseph-isaacs left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🙈

@AdamGS

AdamGS commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

If we're near a release, I think it might be worth waiting on this PR, I have a bunch of follow ups and related changes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix ext/datafusion Relates to the DataFusion integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants