Skip to content

duckdb: don't optimize_recursive() before exporting chunks - #9795

Open
myrrc wants to merge 1 commit into
developfrom
myrrc/duckdb-no-optimize-recursive
Open

duckdb: don't optimize_recursive() before exporting chunks#9795
myrrc wants to merge 1 commit into
developfrom
myrrc/duckdb-no-optimize-recursive

Conversation

@myrrc

@myrrc myrrc commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

When we wrap an Array with another Array, we call optimize() on a child.
This means, by the time we get to the exporter, the ArrayRef of a split
is fully optimized. Remove this call.

@myrrc
myrrc requested a review from joseph-isaacs September 8, 2026 13:55
@myrrc myrrc added changelog/chore A trivial change ext/duckdb Relates to the DuckDB integration labels Sep 8, 2026
@myrrc
myrrc enabled auto-merge (squash) September 8, 2026 13:55
@myrrc myrrc added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Sep 8, 2026
@github-actions github-actions Bot removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Sep 8, 2026
@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done cbd1526 clickbench-sorted-nvme 2 Explore Profiling Data
🟢 Done cbd1526 statpopgen 1 Explore Profiling Data
🟢 Done cbd1526 tpch-nvme-10 1 Explore Profiling Data
🟢 Done cbd1526 appian-nvme 1 Explore Profiling Data
🟢 Done cbd1526 tpch-nvme 1 Explore Profiling Data
🟢 Done cbd1526 tpch-s3-10 1 Explore Profiling Data
🟢 Done cbd1526 clickbench-nvme 1 Explore Profiling Data
🟢 Done cbd1526 fineweb-s3 1 Explore Profiling Data
🟢 Done cbd1526 fineweb 1 Explore Profiling Data
🟢 Done cbd1526 tpcds-nvme 1 Explore Profiling Data
🟢 Done cbd1526 tpch-s3 1 Explore Profiling Data
🟢 Done cbd1526 polarsignals 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done cbd1526 clickbench-sorted-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@codspeed-hq

codspeed-hq Bot commented Sep 8, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 5.52%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 3 regressed benchmarks
✅ 2182 untouched benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation random_i8[0.5] 67.9 µs 91.4 µs -25.73%
Simulation decompress[u64, (4000, 1024)] 70.8 µs 86 µs -17.66%
WallTime words_gather_scalar_avx2[65536] 8.2 µs 9.4 µs -12.15%
Simulation random_i16[0.95] 95.7 µs 77.5 µs +23.5%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-no-optimize-recursive (d651f5e) with develop (5c92e4e)2

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on develop (ae8fddc) during the generation of this report, so 5c92e4e was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR cbd15261 vs base 4afdbd45
Vortex (geomean): hot 0.990x ➖ · cold 1.072x ➖


datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45318292 / 45442474 / -0.3% 93193455 / 82581402 / +12.9% 🔴 0.49 / 0.55 / -11.6%
polarsignals_q01/datafusion:vortex-file-compressed 51164180 / 51161779 / +0.0% 116683225 / 106494375 / +9.6% 0.44 / 0.48 / -8.7%
polarsignals_q02/datafusion:vortex-file-compressed 35296222 / 35488522 / -0.5% 83429343 / 72240123 / +15.5% 🔴 0.42 / 0.49 / -13.9%
polarsignals_q03/datafusion:vortex-file-compressed 53335321 / 53469794 / -0.3% 119789110 / 109576301 / +9.3% 0.45 / 0.49 / -8.8%
polarsignals_q04/datafusion:vortex-file-compressed 9330942 / 9622209 / -3.0% 51440119 / 43846567 / +17.3% 🔴 0.18 / 0.22 / -17.3%
polarsignals_q05/datafusion:vortex-file-compressed 11265410 / 11549358 / -2.5% 56131143 / 54731950 / +2.6% 0.20 / 0.21 / -4.9%
polarsignals_q06/datafusion:vortex-file-compressed 21396188 / 21613156 / -1.0% 63997821 / 63558573 / +0.7% 0.33 / 0.34 / -1.7%
polarsignals_q07/datafusion:vortex-file-compressed 10750474 / 11264542 / -4.6% 54105171 / 53644785 / +0.9% 0.20 / 0.21 / -5.4%
polarsignals_q08/datafusion:vortex-file-compressed 99803632 / 99558872 / +0.2% 163545424 / 161418484 / +1.3% 0.61 / 0.62 / -1.1%
polarsignals_q09/datafusion:vortex-file-compressed 10135246 / 9923620 / +2.1% 50597972 / 48571296 / +4.2% 0.20 / 0.20 / -2.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-2.0%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.954x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.969x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16559434 / 16599054 / -0.2% 43655336 / 44485730 / -1.9% 0.38 / 0.37 / +1.7%
tpch_q02/datafusion:vortex-file-compressed 17512856 / 17473673 / +0.2% 35048992 / 37150234 / -5.7% 0.50 / 0.47 / +6.2%
tpch_q03/datafusion:vortex-file-compressed 19565253 / 19853380 / -1.5% 42648479 / 49313522 / -13.5% 🟢 0.46 / 0.40 / +13.9%
tpch_q04/datafusion:vortex-file-compressed 10350921 / 10410579 / -0.6% 30968074 / 32637655 / -5.1% 0.33 / 0.32 / +4.8%
tpch_q05/datafusion:vortex-file-compressed 37120846 / 37211769 / -0.2% 61344500 / 63362184 / -3.2% 0.61 / 0.59 / +3.0%
tpch_q06/datafusion:vortex-file-compressed 6364564 / 6106741 / +4.2% 25164223 / 28410835 / -11.4% 🟢 0.25 / 0.21 / +17.7%
tpch_q07/datafusion:vortex-file-compressed 51215702 / 52491632 / -2.4% 78952136 / 79576488 / -0.8% 0.65 / 0.66 / -1.7%
tpch_q08/datafusion:vortex-file-compressed 51529483 / 51149393 / +0.7% 77501846 / 79845431 / -2.9% 0.66 / 0.64 / +3.8%
tpch_q09/datafusion:vortex-file-compressed 48509321 / 49767381 / -2.5% 72565006 / 76000735 / -4.5% 0.67 / 0.65 / +2.1%
tpch_q10/datafusion:vortex-file-compressed 17202248 / 17558237 / -2.0% 44703402 / 47682659 / -6.2% 0.38 / 0.37 / +4.5%
tpch_q11/datafusion:vortex-file-compressed 15048915 / 15174672 / -0.8% 31705487 / 33250682 / -4.6% 0.47 / 0.46 / +4.0%
tpch_q12/datafusion:vortex-file-compressed 23206399 / 22969456 / +1.0% 44221771 / 47517321 / -6.9% 0.52 / 0.48 / +8.6%
tpch_q13/datafusion:vortex-file-compressed 19920794 / 20192784 / -1.3% 38329735 / 39467625 / -2.9% 0.52 / 0.51 / +1.6%
tpch_q14/datafusion:vortex-file-compressed 15067022 / 15236941 / -1.1% 37839694 / 39022578 / -3.0% 0.40 / 0.39 / +2.0%
tpch_q15/datafusion:vortex-file-compressed 18846785 / 18907719 / -0.3% 44721188 / 46415501 / -3.7% 0.42 / 0.41 / +3.5%
tpch_q16/datafusion:vortex-file-compressed 18686788 / 18564378 / +0.7% 34728616 / 35760226 / -2.9% 0.54 / 0.52 / +3.6%
tpch_q17/datafusion:vortex-file-compressed 28558370 / 27961442 / +2.1% 56217910 / 57051308 / -1.5% 0.51 / 0.49 / +3.6%
tpch_q18/datafusion:vortex-file-compressed 36748537 / 37096329 / -0.9% 54352258 / 57080123 / -4.8% 0.68 / 0.65 / +4.0%
tpch_q19/datafusion:vortex-file-compressed 14032839 / 13909794 / +0.9% 37619593 / 38493321 / -2.3% 0.37 / 0.36 / +3.2%
tpch_q20/datafusion:vortex-file-compressed 21014646 / 20815557 / +1.0% 44199216 / 45178435 / -2.2% 0.48 / 0.46 / +3.2%
tpch_q21/datafusion:vortex-file-compressed 39490229 / 38296218 / +3.1% 63129605 / 62069166 / +1.7% 0.63 / 0.62 / +1.4%
tpch_q22/datafusion:vortex-file-compressed 11442037 / 11499022 / -0.5% 28453500 / 31103091 / -8.5% 0.40 / 0.37 / +8.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 66922484 / 67226428 / -0.5% 81955427 / 84565852 / -3.1% 0.82 / 0.79 / +2.7%
tpch_q02/datafusion:parquet 52425984 / 52620175 / -0.4% 68589718 / 71965249 / -4.7% 0.76 / 0.73 / +4.5%
tpch_q03/datafusion:parquet 72343082 / 72128036 / +0.3% 93389544 / 96380989 / -3.1% 0.77 / 0.75 / +3.5%
tpch_q04/datafusion:parquet 39670891 / 39485822 / +0.5% 55296883 / 59215854 / -6.6% 0.72 / 0.67 / +7.6%
tpch_q05/datafusion:parquet 87250174 / 87696483 / -0.5% 111179035 / 119145983 / -6.7% 0.78 / 0.74 / +6.6%
tpch_q06/datafusion:parquet 27869310 / 28160143 / -1.0% 45648950 / 48397233 / -5.7% 0.61 / 0.58 / +4.9%
tpch_q07/datafusion:parquet 93681198 / 94492230 / -0.9% 116587525 / 122091507 / -4.5% 0.80 / 0.77 / +3.8%
tpch_q08/datafusion:parquet 94221864 / 97647946 / -3.5% 118997577 / 122953790 / -3.2% 0.79 / 0.79 / -0.3%
tpch_q09/datafusion:parquet 113300665 / 113718272 / -0.4% 139382745 / 146045173 / -4.6% 0.81 / 0.78 / +4.4%
tpch_q10/datafusion:parquet 79134993 / 79196617 / -0.1% 108133779 / 114698822 / -5.7% 0.73 / 0.69 / +6.0%
tpch_q11/datafusion:parquet 38418976 / 38724978 / -0.8% 60005583 / 62021055 / -3.2% 0.64 / 0.62 / +2.5%
tpch_q12/datafusion:parquet 62267529 / 62176838 / +0.1% 84440799 / 87510115 / -3.5% 0.74 / 0.71 / +3.8%
tpch_q13/datafusion:parquet 159446108 / 159467751 / -0.0% 175212586 / 180134478 / -2.7% 0.91 / 0.89 / +2.8%
tpch_q14/datafusion:parquet 39696995 / 39416233 / +0.7% 64023944 / 65329484 / -2.0% 0.62 / 0.60 / +2.8%
tpch_q15/datafusion:parquet 47635262 / 46967825 / +1.4% 66582142 / 69704603 / -4.5% 0.72 / 0.67 / +6.2%
tpch_q16/datafusion:parquet 38184521 / 38924104 / -1.9% 52886727 / 59453402 / -11.0% 🟢 0.72 / 0.65 / +10.3%
tpch_q17/datafusion:parquet 116605287 / 116959557 / -0.3% 138613242 / 139274019 / -0.5% 0.84 / 0.84 / +0.2%
tpch_q18/datafusion:parquet 114666267 / 114392936 / +0.2% 134770801 / 141160946 / -4.5% 0.85 / 0.81 / +5.0%
tpch_q19/datafusion:parquet 49916316 / 50807723 / -1.8% 75761594 / 77844033 / -2.7% 0.66 / 0.65 / +0.9%
tpch_q20/datafusion:parquet 58863862 / 57736401 / +2.0% 79021608 / 83381972 / -5.2% 0.74 / 0.69 / +7.6%
tpch_q21/datafusion:parquet 98487175 / 99398961 / -0.9% 120682395 / 122745825 / -1.7% 0.82 / 0.81 / +0.8%
tpch_q22/datafusion:parquet 42306283 / 41357675 / +2.3% 55813056 / 62506085 / -10.7% 🟢 0.76 / 0.66 / +14.6%
duckdb / vortex-file-compressed / ns (0.977x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11661316 / 11477906 / +1.6% 20157535 / 23308747 / -13.5% 🟢 0.58 / 0.49 / +17.5%
tpch_q02/duckdb:vortex-file-compressed 17588252 / 17615447 / -0.2% 26893952 / 30249256 / -11.1% 🟢 0.65 / 0.58 / +12.3%
tpch_q03/duckdb:vortex-file-compressed 18434399 / 18423822 / +0.1% 34580818 / 35034841 / -1.3% 0.53 / 0.53 / +1.4%
tpch_q04/duckdb:vortex-file-compressed 16531189 / 17035149 / -3.0% 29675421 / 29472436 / +0.7% 0.56 / 0.58 / -3.6%
tpch_q05/duckdb:vortex-file-compressed 22222972 / 22407049 / -0.8% 33404414 / 38296782 / -12.8% 🟢 0.67 / 0.59 / +13.7%
tpch_q06/duckdb:vortex-file-compressed 5490690 / 5559898 / -1.2% 14347235 / 14194507 / +1.1% 0.38 / 0.39 / -2.3%
tpch_q07/duckdb:vortex-file-compressed 21365367 / 20978575 / +1.8% 36690485 / 39779435 / -7.8% 0.58 / 0.53 / +10.4%
tpch_q08/duckdb:vortex-file-compressed 23831956 / 24045381 / -0.9% 38847567 / 38911698 / -0.2% 0.61 / 0.62 / -0.7%
tpch_q09/duckdb:vortex-file-compressed 29203050 / 29460538 / -0.9% 53003556 / 52919641 / +0.2% 0.55 / 0.56 / -1.0%
tpch_q10/duckdb:vortex-file-compressed 29238038 / 28825992 / +1.4% 44866913 / 44609875 / +0.6% 0.65 / 0.65 / +0.8%
tpch_q11/duckdb:vortex-file-compressed 8117386 / 10585928 / -23.3% 🟢 15751202 / 17574539 / -10.4% 🟢 0.52 / 0.60 / -14.4%
tpch_q12/duckdb:vortex-file-compressed 16092810 / 17329598 / -7.1% 26117536 / 25685792 / +1.7% 0.62 / 0.67 / -8.7%
tpch_q13/duckdb:vortex-file-compressed 22760611 / 22399368 / +1.6% 36845661 / 41142345 / -10.4% 🟢 0.62 / 0.54 / +13.5%
tpch_q14/duckdb:vortex-file-compressed 13279994 / 13264904 / +0.1% 23250678 / 26535340 / -12.4% 🟢 0.57 / 0.50 / +14.3%
tpch_q15/duckdb:vortex-file-compressed 9291077 / 10071692 / -7.8% 19554117 / 23641015 / -17.3% 🟢 0.48 / 0.43 / +11.5%
tpch_q16/duckdb:vortex-file-compressed 18523776 / 19460724 / -4.8% 24928338 / 25861702 / -3.6% 0.74 / 0.75 / -1.3%
tpch_q17/duckdb:vortex-file-compressed 15681940 / 15824574 / -0.9% 34576749 / 32044961 / +7.9% 0.45 / 0.49 / -8.2%
tpch_q18/duckdb:vortex-file-compressed 24844664 / 26606523 / -6.6% 40402038 / 42334754 / -4.6% 0.61 / 0.63 / -2.2%
tpch_q19/duckdb:vortex-file-compressed 24698769 / 23572907 / +4.8% 36912108 / 35761293 / +3.2% 0.67 / 0.66 / +1.5%
tpch_q20/duckdb:vortex-file-compressed 17918839 / 17572422 / +2.0% 37018627 / 34049247 / +8.7% 0.48 / 0.52 / -6.2%
tpch_q21/duckdb:vortex-file-compressed 65851607 / 65840112 / +0.0% 79125820 / 87195989 / -9.3% 0.83 / 0.76 / +10.2%
tpch_q22/duckdb:vortex-file-compressed 11996040 / 12274777 / -2.3% 21343102 / 22999705 / -7.2% 0.56 / 0.53 / +5.3%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60243110 / 60150119 / +0.2% 66040178 / 66416910 / -0.6% 0.91 / 0.91 / +0.7%
tpch_q02/duckdb:parquet 34727748 / 34666623 / +0.2% 42715115 / 42655188 / +0.1% 0.81 / 0.81 / +0.0%
tpch_q03/duckdb:parquet 61949684 / 62360486 / -0.7% 72900818 / 74347489 / -1.9% 0.85 / 0.84 / +1.3%
tpch_q04/duckdb:parquet 43105135 / 43614582 / -1.2% 53046223 / 56329264 / -5.8% 0.81 / 0.77 / +4.9%
tpch_q05/duckdb:parquet 60522876 / 60909402 / -0.6% 71724057 / 73640507 / -2.6% 0.84 / 0.83 / +2.0%
tpch_q06/duckdb:parquet 20191367 / 20094038 / +0.5% 24745885 / 26254872 / -5.7% 0.82 / 0.77 / +6.6%
tpch_q07/duckdb:parquet 60876136 / 61230411 / -0.6% 71205973 / 71638774 / -0.6% 0.85 / 0.85 / +0.0%
tpch_q08/duckdb:parquet 72929374 / 73564716 / -0.9% 85169522 / 87006065 / -2.1% 0.86 / 0.85 / +1.3%
tpch_q09/duckdb:parquet 113474986 / 114445628 / -0.8% 126789362 / 127722707 / -0.7% 0.89 / 0.90 / -0.1%
tpch_q10/duckdb:parquet 108254701 / 108663378 / -0.4% 120959295 / 122673165 / -1.4% 0.89 / 0.89 / +1.0%
tpch_q11/duckdb:parquet 19773745 / 20157493 / -1.9% 23956195 / 24005545 / -0.2% 0.83 / 0.84 / -1.7%
tpch_q12/duckdb:parquet 41194628 / 41610370 / -1.0% 49098914 / 49279480 / -0.4% 0.84 / 0.84 / -0.6%
tpch_q13/duckdb:parquet 238487702 / 238366918 / +0.1% 246208302 / 248813850 / -1.0% 0.97 / 0.96 / +1.1%
tpch_q14/duckdb:parquet 43408553 / 43598319 / -0.4% 51958519 / 52454856 / -0.9% 0.84 / 0.83 / +0.5%
tpch_q15/duckdb:parquet 24745831 / 25071061 / -1.3% 30672520 / 31299176 / -2.0% 0.81 / 0.80 / +0.7%
tpch_q16/duckdb:parquet 50605180 / 50834497 / -0.5% 57013186 / 58686597 / -2.9% 0.89 / 0.87 / +2.5%
tpch_q17/duckdb:parquet 44538921 / 44722847 / -0.4% 56668447 / 57011387 / -0.6% 0.79 / 0.78 / +0.2%
tpch_q18/duckdb:parquet 93039971 / 90066887 / +3.3% 99808687 / 101669048 / -1.8% 0.93 / 0.89 / +5.2%
tpch_q19/duckdb:parquet 61223312 / 61354949 / -0.2% 70889972 / 70661838 / +0.3% 0.86 / 0.87 / -0.5%
tpch_q20/duckdb:parquet 58753779 / 58723561 / +0.1% 70258255 / 70930749 / -0.9% 0.84 / 0.83 / +1.0%
tpch_q21/duckdb:parquet 138327355 / 136892515 / +1.0% 148561014 / 148637874 / -0.1% 0.93 / 0.92 / +1.1%
tpch_q22/duckdb:parquet 50457186 / 50394955 / +0.1% 57373209 / 58000164 / -1.1% 0.88 / 0.87 / +1.2%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+2.6%, low confidence)
Vortex (geomean): hot 1.010x ➖ · cold 1.022x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.039x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.992x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7046420 / 7145036 / -1.4% 19457817 / 19194210 / +1.4% 0.36 / 0.37 / -2.7%
fineweb_q01/datafusion:vortex-compact 61708986 / 43844364 / +40.7% 🔴 79625485 / 78403964 / +1.6% 0.77 / 0.56 / +38.6%
fineweb_q02/datafusion:vortex-compact 45706210 / 61425854 / -25.6% 🟢 118181874 / 114544837 / +3.2% 0.39 / 0.54 / -27.9%
fineweb_q03/datafusion:vortex-compact 157010967 / 157520129 / -0.3% 231788451 / 226078004 / +2.5% 0.68 / 0.70 / -2.8%
fineweb_q04/datafusion:vortex-compact 168790696 / 194355626 / -13.2% 🟢 238033155 / 240435905 / -1.0% 0.71 / 0.81 / -12.3%
fineweb_q05/datafusion:vortex-compact 168992185 / 168748813 / +0.1% 234815691 / 231765655 / +1.3% 0.72 / 0.73 / -1.2%
fineweb_q06/datafusion:vortex-compact 87784442 / 86689512 / +1.3% 162231499 / 158453551 / +2.4% 0.54 / 0.55 / -1.1%
fineweb_q07/datafusion:vortex-compact 87716349 / 89399398 / -1.9% 153636982 / 156495650 / -1.8% 0.57 / 0.57 / -0.1%
fineweb_q08/datafusion:vortex-compact 9030101 / 8626496 / +4.7% 42606653 / 37259874 / +14.3% 🔴 0.21 / 0.23 / -8.5%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9345456 / 9613058 / -2.8% 34467377 / 34902314 / -1.2% 0.27 / 0.28 / -1.6%
fineweb_q01/datafusion:parquet 71061243 / 70376976 / +1.0% 153337384 / 145686601 / +5.3% 0.46 / 0.48 / -4.1%
fineweb_q02/datafusion:parquet 68832900 / 69452146 / -0.9% 160000895 / 146770218 / +9.0% 0.43 / 0.47 / -9.1%
fineweb_q03/datafusion:parquet 70498190 / 69050726 / +2.1% 151684376 / 146239293 / +3.7% 0.46 / 0.47 / -1.6%
fineweb_q04/datafusion:parquet 75478220 / 76730728 / -1.6% 154419225 / 148864152 / +3.7% 0.49 / 0.52 / -5.2%
fineweb_q05/datafusion:parquet 74437986 / 75351666 / -1.2% 152110904 / 148410672 / +2.5% 0.49 / 0.51 / -3.6%
fineweb_q06/datafusion:parquet 71061208 / 72374462 / -1.8% 158779422 / 147652852 / +7.5% 0.45 / 0.49 / -8.7%
fineweb_q07/datafusion:parquet 70879499 / 71485684 / -0.8% 153705012 / 142357450 / +8.0% 0.46 / 0.50 / -8.2%
fineweb_q08/datafusion:parquet 69611358 / 69793936 / -0.3% 152814606 / 143586926 / +6.4% 0.46 / 0.49 / -6.3%
duckdb / vortex-compact / ns (1.027x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2268259 / 2439498 / -7.0% 5407925 / 5861153 / -7.7% 0.42 / 0.42 / +0.8%
fineweb_q01/duckdb:vortex-compact 46624563 / 53960856 / -13.6% 🟢 75863840 / 76567843 / -0.9% 0.61 / 0.70 / -12.8%
fineweb_q02/duckdb:vortex-compact 61520792 / 52747919 / +16.6% 🔴 97543532 / 88269110 / +10.5% 🔴 0.63 / 0.60 / +5.5%
fineweb_q03/duckdb:vortex-compact 204617570 / 183560456 / +11.5% 🔴 238548684 / 234630799 / +1.7% 0.86 / 0.78 / +9.6%
fineweb_q04/duckdb:vortex-compact 205832002 / 189359807 / +8.7% 246110881 / 257201455 / -4.3% 0.84 / 0.74 / +13.6%
fineweb_q05/duckdb:vortex-compact 186076637 / 189543477 / -1.8% 222906333 / 242597669 / -8.1% 0.83 / 0.78 / +6.8%
fineweb_q06/duckdb:vortex-compact 96110597 / 92151034 / +4.3% 167178875 / 162279389 / +3.0% 0.57 / 0.57 / +1.2%
fineweb_q07/duckdb:vortex-compact 104395030 / 95555912 / +9.3% 174932271 / 151633341 / +15.4% 🔴 0.60 / 0.63 / -5.3%
fineweb_q08/duckdb:vortex-compact 9939573 / 9911108 / +0.3% 45132192 / 41372199 / +9.1% 0.22 / 0.24 / -8.1%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22193978 / 21970000 / +1.0% 25595392 / 23962471 / +6.8% 0.87 / 0.92 / -5.4%
fineweb_q01/duckdb:parquet 44168225 / 44316336 / -0.3% 57962917 / 56407157 / +2.8% 0.76 / 0.79 / -3.0%
fineweb_q02/duckdb:parquet 43713090 / 43718842 / -0.0% 54493075 / 57672956 / -5.5% 0.80 / 0.76 / +5.8%
fineweb_q03/duckdb:parquet 95441202 / 95057620 / +0.4% 182447840 / 181570514 / +0.5% 0.52 / 0.52 / -0.1%
fineweb_q04/duckdb:parquet 151653752 / 152331151 / -0.4% 206844071 / 204571463 / +1.1% 0.73 / 0.74 / -1.5%
fineweb_q05/duckdb:parquet 143498370 / 142896076 / +0.4% 203037045 / 201180202 / +0.9% 0.71 / 0.71 / -0.5%
fineweb_q06/duckdb:parquet 71523696 / 70672150 / +1.2% 131515495 / 116219258 / +13.2% 🔴 0.54 / 0.61 / -10.6%
fineweb_q07/duckdb:parquet 71774372 / 72916028 / -1.6% 163450799 / 155225285 / +5.3% 0.44 / 0.47 / -6.5%
fineweb_q08/duckdb:parquet 22405724 / 22232808 / +0.8% 24726315 / 24445447 / +1.1% 0.91 / 0.91 / -0.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (+1.8%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.075x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.034x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6962630 / 6742320 / +3.3% 20535518 / 20597811 / -0.3% 0.34 / 0.33 / +3.6%
fineweb_q01/datafusion:vortex-file-compressed 12768905 / 13502008 / -5.4% 52326856 / 48551026 / +7.8% 0.24 / 0.28 / -12.3%
fineweb_q02/datafusion:vortex-file-compressed 12678132 / 13346310 / -5.0% 58839002 / 51596189 / +14.0% 🔴 0.22 / 0.26 / -16.7%
fineweb_q03/datafusion:vortex-file-compressed 19478005 / 20359124 / -4.3% 104201978 / 97857474 / +6.5% 0.19 / 0.21 / -10.2%
fineweb_q04/datafusion:vortex-file-compressed 73654644 / 73701090 / -0.1% 160024119 / 152000343 / +5.3% 0.46 / 0.48 / -5.1%
fineweb_q05/datafusion:vortex-file-compressed 57329926 / 57821204 / -0.8% 130433854 / 132106886 / -1.3% 0.44 / 0.44 / +0.4%
fineweb_q06/datafusion:vortex-file-compressed 19812099 / 19977139 / -0.8% 109531554 / 100791810 / +8.7% 0.18 / 0.20 / -8.7%
fineweb_q07/datafusion:vortex-file-compressed 16997417 / 17694510 / -3.9% 100961819 / 93972409 / +7.4% 0.17 / 0.19 / -10.6%
fineweb_q08/datafusion:vortex-file-compressed 10710770 / 9912940 / +8.0% 46551262 / 38542855 / +20.8% 🔴 0.23 / 0.26 / -10.5%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9649663 / 9613058 / +0.4% 34374675 / 34902314 / -1.5% 0.28 / 0.28 / +1.9%
fineweb_q01/datafusion:parquet 70530222 / 70376976 / +0.2% 154467881 / 145686601 / +6.0% 0.46 / 0.48 / -5.5%
fineweb_q02/datafusion:parquet 71421660 / 69452146 / +2.8% 153007451 / 146770218 / +4.2% 0.47 / 0.47 / -1.4%
fineweb_q03/datafusion:parquet 69365787 / 69050726 / +0.5% 150478365 / 146239293 / +2.9% 0.46 / 0.47 / -2.4%
fineweb_q04/datafusion:parquet 75410318 / 76730728 / -1.7% 155566126 / 148864152 / +4.5% 0.48 / 0.52 / -6.0%
fineweb_q05/datafusion:parquet 75388106 / 75351666 / +0.0% 151406166 / 148410672 / +2.0% 0.50 / 0.51 / -1.9%
fineweb_q06/datafusion:parquet 72082787 / 72374462 / -0.4% 158840775 / 147652852 / +7.6% 0.45 / 0.49 / -7.4%
fineweb_q07/datafusion:parquet 69315964 / 71485684 / -3.0% 150535750 / 142357450 / +5.7% 0.46 / 0.50 / -8.3%
fineweb_q08/datafusion:parquet 71660338 / 69793936 / +2.7% 147369287 / 143586926 / +2.6% 0.49 / 0.49 / +0.0%
duckdb / vortex-file-compressed / ns (1.017x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2112270 / 2303714 / -8.3% 5699321 / 5616489 / +1.5% 0.37 / 0.41 / -9.6%
fineweb_q01/duckdb:vortex-file-compressed 19531038 / 18097875 / +7.9% 57111395 / 43557794 / +31.1% 🔴 0.34 / 0.42 / -17.7%
fineweb_q02/duckdb:vortex-file-compressed 18770642 / 18347711 / +2.3% 49317051 / 50341765 / -2.0% 0.38 / 0.36 / +4.4%
fineweb_q03/duckdb:vortex-file-compressed 22381172 / 23330286 / -4.1% 98690344 / 93809174 / +5.2% 0.23 / 0.25 / -8.8%
fineweb_q04/duckdb:vortex-file-compressed 79161974 / 78238304 / +1.2% 133527927 / 133322485 / +0.2% 0.59 / 0.59 / +1.0%
fineweb_q05/duckdb:vortex-file-compressed 63619716 / 60926045 / +4.4% 118144024 / 111825807 / +5.7% 0.54 / 0.54 / -1.2%
fineweb_q06/duckdb:vortex-file-compressed 22991656 / 22641324 / +1.5% 103141138 / 97913789 / +5.3% 0.22 / 0.23 / -3.6%
fineweb_q07/duckdb:vortex-file-compressed 22910683 / 22311689 / +2.7% 98765973 / 88468055 / +11.6% 🔴 0.23 / 0.25 / -8.0%
fineweb_q08/duckdb:vortex-file-compressed 11071510 / 10137848 / +9.2% 51173246 / 45376148 / +12.8% 🔴 0.22 / 0.22 / -3.2%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21835849 / 21970000 / -0.6% 23260397 / 23962471 / -2.9% 0.94 / 0.92 / +2.4%
fineweb_q01/duckdb:parquet 44177377 / 44316336 / -0.3% 57023995 / 56407157 / +1.1% 0.77 / 0.79 / -1.4%
fineweb_q02/duckdb:parquet 44100560 / 43718842 / +0.9% 55514336 / 57672956 / -3.7% 0.79 / 0.76 / +4.8%
fineweb_q03/duckdb:parquet 95380342 / 95057620 / +0.3% 183136863 / 181570514 / +0.9% 0.52 / 0.52 / -0.5%
fineweb_q04/duckdb:parquet 151535547 / 152331151 / -0.5% 210975117 / 204571463 / +3.1% 0.72 / 0.74 / -3.5%
fineweb_q05/duckdb:parquet 142527918 / 142896076 / -0.3% 204860369 / 201180202 / +1.8% 0.70 / 0.71 / -2.0%
fineweb_q06/duckdb:parquet 71475292 / 70672150 / +1.1% 127685825 / 116219258 / +9.9% 0.56 / 0.61 / -7.9%
fineweb_q07/duckdb:parquet 72147374 / 72916028 / -1.1% 164542988 / 155225285 / +6.0% 0.44 / 0.47 / -6.7%
fineweb_q08/duckdb:parquet 22257686 / 22232808 / +0.1% 27349288 / 24445447 / +11.9% 🔴 0.81 / 0.91 / -10.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.016x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24000604 / 24717998 / -2.9% 41874410 / 42228730 / -0.8% 0.57 / 0.59 / -2.1%
tpcds_q02/datafusion:vortex-file-compressed 45922951 / 46016020 / -0.2% 62841889 / 64647022 / -2.8% 0.73 / 0.71 / +2.7%
tpcds_q03/datafusion:vortex-file-compressed 11365264 / 11839658 / -4.0% 28453814 / 27746333 / +2.5% 0.40 / 0.43 / -6.4%
tpcds_q04/datafusion:vortex-file-compressed 112487460 / 111201766 / +1.2% 142691370 / 143504644 / -0.6% 0.79 / 0.77 / +1.7%
tpcds_q05/datafusion:vortex-file-compressed 60078312 / 59605405 / +0.8% 80468127 / 83548931 / -3.7% 0.75 / 0.71 / +4.7%
tpcds_q06/datafusion:vortex-file-compressed 23494792 / 23438748 / +0.2% 42511775 / 46288794 / -8.2% 0.55 / 0.51 / +9.1%
tpcds_q07/datafusion:vortex-file-compressed 31426646 / 31769352 / -1.1% 58362825 / 56021034 / +4.2% 0.54 / 0.57 / -5.0%
tpcds_q08/datafusion:vortex-file-compressed 26053020 / 26273362 / -0.8% 43516622 / 44733615 / -2.7% 0.60 / 0.59 / +1.9%
tpcds_q09/datafusion:vortex-file-compressed 17215662 / 16329950 / +5.4% 34313827 / 35153261 / -2.4% 0.50 / 0.46 / +8.0%
tpcds_q10/datafusion:vortex-file-compressed 29479932 / 28844175 / +2.2% 50811808 / 51656367 / -1.6% 0.58 / 0.56 / +3.9%
tpcds_q11/datafusion:vortex-file-compressed 60241091 / 59916458 / +0.5% 82941333 / 87465392 / -5.2% 0.73 / 0.69 / +6.0%
tpcds_q12/datafusion:vortex-file-compressed 16342095 / 16525218 / -1.1% 31395598 / 31890389 / -1.6% 0.52 / 0.52 / +0.5%
tpcds_q13/datafusion:vortex-file-compressed 37152028 / 37413672 / -0.7% 59396145 / 59811743 / -0.7% 0.63 / 0.63 / -0.0%
tpcds_q14/datafusion:vortex-file-compressed 91983960 / 92504030 / -0.6% 118961982 / 121756373 / -2.3% 0.77 / 0.76 / +1.8%
tpcds_q15/datafusion:vortex-file-compressed 24765606 / 25206960 / -1.8% 43797109 / 43801253 / -0.0% 0.57 / 0.58 / -1.7%
tpcds_q16/datafusion:vortex-file-compressed 20969705 / 20711054 / +1.2% 42681485 / 42278247 / +1.0% 0.49 / 0.49 / +0.3%
tpcds_q17/datafusion:vortex-file-compressed 60808618 / 57522653 / +5.7% 86588236 / 83783841 / +3.3% 0.70 / 0.69 / +2.3%
tpcds_q18/datafusion:vortex-file-compressed 68056792 / 69058442 / -1.5% 92137901 / 92591610 / -0.5% 0.74 / 0.75 / -1.0%
tpcds_q19/datafusion:vortex-file-compressed 18105611 / 18183805 / -0.4% 41176628 / 39259310 / +4.9% 0.44 / 0.46 / -5.1%
tpcds_q20/datafusion:vortex-file-compressed 17482704 / 17637234 / -0.9% 33662130 / 33367665 / +0.9% 0.52 / 0.53 / -1.7%
tpcds_q21/datafusion:vortex-file-compressed 17080126 / 16824972 / +1.5% 39178981 / 37888730 / +3.4% 0.44 / 0.44 / -1.8%
tpcds_q22/datafusion:vortex-file-compressed 49257165 / 49264680 / -0.0% 70565081 / 69080581 / +2.1% 0.70 / 0.71 / -2.1%
tpcds_q23/datafusion:vortex-file-compressed 73052579 / 71859086 / +1.7% 101002623 / 96608907 / +4.5% 0.72 / 0.74 / -2.8%
tpcds_q24/datafusion:vortex-file-compressed 69939768 / 69762787 / +0.3% 92975494 / 94240326 / -1.3% 0.75 / 0.74 / +1.6%
tpcds_q25/datafusion:vortex-file-compressed 47415418 / 54245193 / -12.6% 🟢 83361755 / 81532926 / +2.2% 0.57 / 0.67 / -14.5%
tpcds_q26/datafusion:vortex-file-compressed 30373438 / 30679074 / -1.0% 51214494 / 53322133 / -4.0% 0.59 / 0.58 / +3.1%
tpcds_q27/datafusion:vortex-file-compressed 62863249 / 60401932 / +4.1% 84677745 / 84637654 / +0.0% 0.74 / 0.71 / +4.0%
tpcds_q28/datafusion:vortex-file-compressed 17911155 / 18906056 / -5.3% 37486927 / 35706205 / +5.0% 0.48 / 0.53 / -9.8%
tpcds_q29/datafusion:vortex-file-compressed 53130434 / 60790432 / -12.6% 🟢 84606555 / 72457453 / +16.8% 🔴 0.63 / 0.84 / -25.2%
tpcds_q30/datafusion:vortex-file-compressed 27708010 / 27900558 / -0.7% 46407927 / 43636133 / +6.4% 0.60 / 0.64 / -6.6%
tpcds_q31/datafusion:vortex-file-compressed 63552590 / 64044218 / -0.8% 90933212 / 90978301 / -0.0% 0.70 / 0.70 / -0.7%
tpcds_q32/datafusion:vortex-file-compressed 13820442 / 13884574 / -0.5% 30574915 / 31081480 / -1.6% 0.45 / 0.45 / +1.2%
tpcds_q33/datafusion:vortex-file-compressed 26592932 / 26654150 / -0.2% 47387076 / 47004651 / +0.8% 0.56 / 0.57 / -1.0%
tpcds_q34/datafusion:vortex-file-compressed 18004956 / 18076876 / -0.4% 36549396 / 37990652 / -3.8% 0.49 / 0.48 / +3.5%
tpcds_q35/datafusion:vortex-file-compressed 34677816 / 35298561 / -1.8% 56772018 / 57998222 / -2.1% 0.61 / 0.61 / +0.4%
tpcds_q36/datafusion:vortex-file-compressed 47834928 / 48064583 / -0.5% 68367786 / 68096889 / +0.4% 0.70 / 0.71 / -0.9%
tpcds_q37/datafusion:vortex-file-compressed 13269536 / 13714343 / -3.2% 35521041 / 37231747 / -4.6% 0.37 / 0.37 / +1.4%
tpcds_q38/datafusion:vortex-file-compressed 29953318 / 29858800 / +0.3% 50659097 / 51018596 / -0.7% 0.59 / 0.59 / +1.0%
tpcds_q39/datafusion:vortex-file-compressed 66084982 / 66020028 / +0.1% 93064911 / 89076562 / +4.5% 0.71 / 0.74 / -4.2%
tpcds_q40/datafusion:vortex-file-compressed 25919454 / 25399930 / +2.0% 46684096 / 44515220 / +4.9% 0.56 / 0.57 / -2.7%
tpcds_q41/datafusion:vortex-file-compressed 16806391 / 16742113 / +0.4% 30569320 / 30737563 / -0.5% 0.55 / 0.54 / +0.9%
tpcds_q42/datafusion:vortex-file-compressed 11052711 / 11001441 / +0.5% 27676098 / 27560485 / +0.4% 0.40 / 0.40 / +0.0%
tpcds_q43/datafusion:vortex-file-compressed 12763962 / 12607780 / +1.2% 31571086 / 30959740 / +2.0% 0.40 / 0.41 / -0.7%
tpcds_q44/datafusion:vortex-file-compressed 26629160 / 25759838 / +3.4% 49506436 / 47556000 / +4.1% 0.54 / 0.54 / -0.7%
tpcds_q45/datafusion:vortex-file-compressed 28441219 / 28451193 / -0.0% 48829005 / 47820340 / +2.1% 0.58 / 0.59 / -2.1%
tpcds_q46/datafusion:vortex-file-compressed 24033298 / 23803783 / +1.0% 47146442 / 47060877 / +0.2% 0.51 / 0.51 / +0.8%
tpcds_q47/datafusion:vortex-file-compressed 77886144 / 77500362 / +0.5% 102556316 / 102514305 / +0.0% 0.76 / 0.76 / +0.5%
tpcds_q48/datafusion:vortex-file-compressed 32325508 / 32517388 / -0.6% 52571405 / 52731868 / -0.3% 0.61 / 0.62 / -0.3%
tpcds_q49/datafusion:vortex-file-compressed 60431052 / 60151472 / +0.5% 81277315 / 82687288 / -1.7% 0.74 / 0.73 / +2.2%
tpcds_q50/datafusion:vortex-file-compressed 33675858 / 33401162 / +0.8% 57144545 / 56868565 / +0.5% 0.59 / 0.59 / +0.3%
tpcds_q51/datafusion:vortex-file-compressed 60901994 / 60701662 / +0.3% 83427771 / 83614547 / -0.2% 0.73 / 0.73 / +0.6%
tpcds_q52/datafusion:vortex-file-compressed 11619186 / 11837736 / -1.8% 27449731 / 27503912 / -0.2% 0.42 / 0.43 / -1.7%
tpcds_q53/datafusion:vortex-file-compressed 18246259 / 18325524 / -0.4% 37549357 / 38017597 / -1.2% 0.49 / 0.48 / +0.8%
tpcds_q54/datafusion:vortex-file-compressed 33340886 / 33888402 / -1.6% 56193090 / 56266610 / -0.1% 0.59 / 0.60 / -1.5%
tpcds_q55/datafusion:vortex-file-compressed 11315836 / 11150140 / +1.5% 25904349 / 26427046 / -2.0% 0.44 / 0.42 / +3.5%
tpcds_q56/datafusion:vortex-file-compressed 25968996 / 26250641 / -1.1% 45673551 / 46544840 / -1.9% 0.57 / 0.56 / +0.8%
tpcds_q57/datafusion:vortex-file-compressed 73662574 / 73788146 / -0.2% 96018967 / 98134146 / -2.2% 0.77 / 0.75 / +2.0%
tpcds_q58/datafusion:vortex-file-compressed 41018516 / 40863499 / +0.4% 65314625 / 66683089 / -2.1% 0.63 / 0.61 / +2.5%
tpcds_q59/datafusion:vortex-file-compressed 31230827 / 31028892 / +0.7% 51249162 / 51946756 / -1.3% 0.61 / 0.60 / +2.0%
tpcds_q60/datafusion:vortex-file-compressed 26436664 / 26367540 / +0.3% 47864837 / 46117547 / +3.8% 0.55 / 0.57 / -3.4%
tpcds_q61/datafusion:vortex-file-compressed 24471176 / 23319509 / +4.9% 45885539 / 47157971 / -2.7% 0.53 / 0.49 / +7.8%
tpcds_q62/datafusion:vortex-file-compressed 17545940 / 17512918 / +0.2% 34238768 / 35238606 / -2.8% 0.51 / 0.50 / +3.1%
tpcds_q63/datafusion:vortex-file-compressed 18137473 / 18477204 / -1.8% 37643620 / 37392725 / +0.7% 0.48 / 0.49 / -2.5%
tpcds_q64/datafusion:vortex-file-compressed 330829126 / 326497658 / +1.3% 353701835 / 361644612 / -2.2% 0.94 / 0.90 / +3.6%
tpcds_q65/datafusion:vortex-file-compressed 74676536 / 74300084 / +0.5% 92871850 / 93902095 / -1.1% 0.80 / 0.79 / +1.6%
tpcds_q66/datafusion:vortex-file-compressed 52887302 / 52912795 / -0.0% 75605027 / 74813854 / +1.1% 0.70 / 0.71 / -1.1%
tpcds_q67/datafusion:vortex-file-compressed 55528802 / 55362254 / +0.3% 82413467 / 81437765 / +1.2% 0.67 / 0.68 / -0.9%
tpcds_q68/datafusion:vortex-file-compressed 23728073 / 23859067 / -0.5% 46222592 / 45791983 / +0.9% 0.51 / 0.52 / -1.5%
tpcds_q69/datafusion:vortex-file-compressed 28841719 / 30091796 / -4.2% 47674594 / 47741582 / -0.1% 0.60 / 0.63 / -4.0%
tpcds_q70/datafusion:vortex-file-compressed 69600029 / 69554224 / +0.1% 89780592 / 89582436 / +0.2% 0.78 / 0.78 / -0.2%
tpcds_q71/datafusion:vortex-file-compressed 18588738 / 19588154 / -5.1% 39883474 / 39681710 / +0.5% 0.47 / 0.49 / -5.6%
tpcds_q72/datafusion:vortex-file-compressed 477097658 / 482060540 / -1.0% 497676464 / 472791427 / +5.3% 0.96 / 1.02 / -6.0%
tpcds_q73/datafusion:vortex-file-compressed 16884013 / 17329832 / -2.6% 37702911 / 36877090 / +2.2% 0.45 / 0.47 / -4.7%
tpcds_q74/datafusion:vortex-file-compressed 44621992 / 45345254 / -1.6% 66682043 / 66769003 / -0.1% 0.67 / 0.68 / -1.5%
tpcds_q75/datafusion:vortex-file-compressed 131718514 / 133672314 / -1.5% 161070640 / 156935418 / +2.6% 0.82 / 0.85 / -4.0%
tpcds_q76/datafusion:vortex-file-compressed 42965968 / 41923284 / +2.5% 62284420 / 63252334 / -1.5% 0.69 / 0.66 / +4.1%
tpcds_q77/datafusion:vortex-file-compressed 34341479 / 37096906 / -7.4% 54718952 / 55825394 / -2.0% 0.63 / 0.66 / -5.6%
tpcds_q78/datafusion:vortex-file-compressed 79967378 / 80959362 / -1.2% 105771695 / 106875058 / -1.0% 0.76 / 0.76 / -0.2%
tpcds_q79/datafusion:vortex-file-compressed 20332892 / 21086794 / -3.6% 41993398 / 40166718 / +4.5% 0.48 / 0.52 / -7.8%
tpcds_q80/datafusion:vortex-file-compressed 77204542 / 77329282 / -0.2% 106517053 / 105789369 / +0.7% 0.72 / 0.73 / -0.8%
tpcds_q81/datafusion:vortex-file-compressed 28362840 / 28018823 / +1.2% 43803223 / 45295147 / -3.3% 0.65 / 0.62 / +4.7%
tpcds_q82/datafusion:vortex-file-compressed 13577646 / 13438236 / +1.0% 36556383 / 37213111 / -1.8% 0.37 / 0.36 / +2.9%
tpcds_q83/datafusion:vortex-file-compressed 35982293 / 36958307 / -2.6% 57141221 / 56164681 / +1.7% 0.63 / 0.66 / -4.3%
tpcds_q84/datafusion:vortex-file-compressed 12048228 / 12763688 / -5.6% 28782019 / 28086692 / +2.5% 0.42 / 0.45 / -7.9%
tpcds_q85/datafusion:vortex-file-compressed 63802278 / 62665826 / +1.8% 84547399 / 85050280 / -0.6% 0.75 / 0.74 / +2.4%
tpcds_q86/datafusion:vortex-file-compressed 16876220 / 16694406 / +1.1% 32616850 / 32198153 / +1.3% 0.52 / 0.52 / -0.2%
tpcds_q87/datafusion:vortex-file-compressed 30084629 / 30278846 / -0.6% 49957468 / 51294860 / -2.6% 0.60 / 0.59 / +2.0%
tpcds_q88/datafusion:vortex-file-compressed 32512399 / 32416862 / +0.3% 60890406 / 61672824 / -1.3% 0.53 / 0.53 / +1.6%
tpcds_q89/datafusion:vortex-file-compressed 20723910 / 20858378 / -0.6% 39791433 / 40704399 / -2.2% 0.52 / 0.51 / +1.6%
tpcds_q90/datafusion:vortex-file-compressed 10764006 / 10616460 / +1.4% 27284592 / 27356977 / -0.3% 0.39 / 0.39 / +1.7%
tpcds_q91/datafusion:vortex-file-compressed 17812782 / 18041597 / -1.3% 36641884 / 37616469 / -2.6% 0.49 / 0.48 / +1.4%
tpcds_q92/datafusion:vortex-file-compressed 14509104 / 13804706 / +5.1% 31782486 / 30669726 / +3.6% 0.46 / 0.45 / +1.4%
tpcds_q93/datafusion:vortex-file-compressed 23418804 / 22847916 / +2.5% 43115760 / 44464112 / -3.0% 0.54 / 0.51 / +5.7%
tpcds_q94/datafusion:vortex-file-compressed 19959857 / 19692504 / +1.4% 39867921 / 39873787 / -0.0% 0.50 / 0.49 / +1.4%
tpcds_q95/datafusion:vortex-file-compressed 46231740 / 46366880 / -0.3% 68423984 / 67815092 / +0.9% 0.68 / 0.68 / -1.2%
tpcds_q96/datafusion:vortex-file-compressed 8055687 / 8195564 / -1.7% 24313117 / 23322752 / +4.2% 0.33 / 0.35 / -5.7%
tpcds_q97/datafusion:vortex-file-compressed 20806141 / 20981590 / -0.8% 42424686 / 40705997 / +4.2% 0.49 / 0.52 / -4.9%
tpcds_q98/datafusion:vortex-file-compressed 16944676 / 16989923 / -0.3% 36040680 / 35113392 / +2.6% 0.47 / 0.48 / -2.8%
tpcds_q99/datafusion:vortex-file-compressed 20144880 / 19825506 / +1.6% 40371923 / 39279883 / +2.8% 0.50 / 0.50 / -1.1%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29184157 / 29793231 / -2.0% 46709048 / 45925088 / +1.7% 0.62 / 0.65 / -3.7%
tpcds_q02/datafusion:parquet 44027519 / 45563659 / -3.4% 61644107 / 60007831 / +2.7% 0.71 / 0.76 / -5.9%
tpcds_q03/datafusion:parquet 18732756 / 19339062 / -3.1% 33163912 / 29750588 / +11.5% 🔴 0.56 / 0.65 / -13.1%
tpcds_q04/datafusion:parquet 195996377 / 193170795 / +1.5% 224564366 / 218813766 / +2.6% 0.87 / 0.88 / -1.1%
tpcds_q05/datafusion:parquet 71322221 / 72599112 / -1.8% 92122889 / 95804432 / -3.8% 0.77 / 0.76 / +2.2%
tpcds_q06/datafusion:parquet 35068959 / 34555076 / +1.5% 51224334 / 50625042 / +1.2% 0.68 / 0.68 / +0.3%
tpcds_q07/datafusion:parquet 46101169 / 46244142 / -0.3% 65021079 / 66194624 / -1.8% 0.71 / 0.70 / +1.5%
tpcds_q08/datafusion:parquet 39740197 / 39670021 / +0.2% 57476049 / 57306579 / +0.3% 0.69 / 0.69 / -0.1%
tpcds_q09/datafusion:parquet 32543620 / 31411167 / +3.6% 44174969 / 43921420 / +0.6% 0.74 / 0.72 / +3.0%
tpcds_q10/datafusion:parquet 50507912 / 49060427 / +3.0% 64230377 / 66128886 / -2.9% 0.79 / 0.74 / +6.0%
tpcds_q11/datafusion:parquet 93513986 / 93690820 / -0.2% 116804202 / 115101028 / +1.5% 0.80 / 0.81 / -1.6%
tpcds_q12/datafusion:parquet 24097988 / 23920084 / +0.7% 37035457 / 34571868 / +7.1% 0.65 / 0.69 / -6.0%
tpcds_q13/datafusion:parquet 45068758 / 44741646 / +0.7% 64270386 / 69355026 / -7.3% 0.70 / 0.65 / +8.7%
tpcds_q14/datafusion:parquet 138147524 / 140308716 / -1.5% 150796942 / 154206773 / -2.2% 0.92 / 0.91 / +0.7%
tpcds_q15/datafusion:parquet 30997974 / 30924168 / +0.2% 47617117 / 47400115 / +0.5% 0.65 / 0.65 / -0.2%
tpcds_q16/datafusion:parquet 37275526 / 38452064 / -3.1% 55786805 / 55454891 / +0.6% 0.67 / 0.69 / -3.6%
tpcds_q17/datafusion:parquet 74029528 / 74345001 / -0.4% 100254795 / 99077692 / +1.2% 0.74 / 0.75 / -1.6%
tpcds_q18/datafusion:parquet 57236288 / 60710054 / -5.7% 81591719 / 74611214 / +9.4% 0.70 / 0.81 / -13.8%
tpcds_q19/datafusion:parquet 32126879 / 32293978 / -0.5% 50215085 / 49372910 / +1.7% 0.64 / 0.65 / -2.2%
tpcds_q20/datafusion:parquet 25064511 / 25070706 / -0.0% 36469073 / 37930200 / -3.9% 0.69 / 0.66 / +4.0%
tpcds_q21/datafusion:parquet 20318946 / 20230914 / +0.4% 32917588 / 32251295 / +2.1% 0.62 / 0.63 / -1.6%
tpcds_q22/datafusion:parquet 76430409 / 76863411 / -0.6% 90098566 / 90433983 / -0.4% 0.85 / 0.85 / -0.2%
tpcds_q23/datafusion:parquet 115149698 / 119327592 / -3.5% 137651897 / 131162615 / +4.9% 0.84 / 0.91 / -8.1%
tpcds_q24/datafusion:parquet 89782362 / 91286287 / -1.6% 116868484 / 116778063 / +0.1% 0.77 / 0.78 / -1.7%
tpcds_q25/datafusion:parquet 75015950 / 74839832 / +0.2% 98665146 / 97275212 / +1.4% 0.76 / 0.77 / -1.2%
tpcds_q26/datafusion:parquet 42754710 / 42099937 / +1.6% 57690965 / 57566524 / +0.2% 0.74 / 0.73 / +1.3%
tpcds_q27/datafusion:parquet 77165207 / 77773287 / -0.8% 100938702 / 104252404 / -3.2% 0.76 / 0.75 / +2.5%
tpcds_q28/datafusion:parquet 27113744 / 27210394 / -0.4% 44592194 / 44037541 / +1.3% 0.61 / 0.62 / -1.6%
tpcds_q29/datafusion:parquet 74959567 / 74901866 / +0.1% 101945378 / 99278441 / +2.7% 0.74 / 0.75 / -2.5%
tpcds_q30/datafusion:parquet 46064630 / 46503572 / -0.9% 59152372 / 62825494 / -5.8% 0.78 / 0.74 / +5.2%
tpcds_q31/datafusion:parquet 88867257 / 89537532 / -0.7% 109708612 / 105444506 / +4.0% 0.81 / 0.85 / -4.6%
tpcds_q32/datafusion:parquet 25901370 / 25788480 / +0.4% 38750916 / 40795811 / -5.0% 0.67 / 0.63 / +5.7%
tpcds_q33/datafusion:parquet 40806334 / 40601352 / +0.5% 54341744 / 53803603 / +1.0% 0.75 / 0.75 / -0.5%
tpcds_q34/datafusion:parquet 24030774 / 23678690 / +1.5% 37461045 / 36421103 / +2.9% 0.64 / 0.65 / -1.3%
tpcds_q35/datafusion:parquet 54693538 / 54028558 / +1.2% 70927543 / 70616747 / +0.4% 0.77 / 0.77 / +0.8%
tpcds_q36/datafusion:parquet 51464086 / 51184006 / +0.5% 77685500 / 70394059 / +10.4% 🔴 0.66 / 0.73 / -8.9%
tpcds_q37/datafusion:parquet 25430089 / 25624572 / -0.8% 38582119 / 39188193 / -1.5% 0.66 / 0.65 / +0.8%
tpcds_q38/datafusion:parquet 43439868 / 44328504 / -2.0% 61721488 / 61583635 / +0.2% 0.70 / 0.72 / -2.2%
tpcds_q39/datafusion:parquet 71205242 / 71059234 / +0.2% 89426681 / 88792741 / +0.7% 0.80 / 0.80 / -0.5%
tpcds_q40/datafusion:parquet 28976724 / 28010452 / +3.4% 49070517 / 48809185 / +0.5% 0.59 / 0.57 / +2.9%
tpcds_q41/datafusion:parquet 19879884 / 19728138 / +0.8% 33303488 / 32934525 / +1.1% 0.60 / 0.60 / -0.3%
tpcds_q42/datafusion:parquet 17893632 / 17871588 / +0.1% 31236097 / 32514518 / -3.9% 0.57 / 0.55 / +4.2%
tpcds_q43/datafusion:parquet 19581130 / 19208910 / +1.9% 31769606 / 31522380 / +0.8% 0.62 / 0.61 / +1.1%
tpcds_q44/datafusion:parquet 34840030 / 33686866 / +3.4% 50616147 / 50541598 / +0.1% 0.69 / 0.67 / +3.3%
tpcds_q45/datafusion:parquet 38065615 / 38158586 / -0.2% 55740496 / 52652408 / +5.9% 0.68 / 0.72 / -5.8%
tpcds_q46/datafusion:parquet 29597408 / 29533514 / +0.2% 48566290 / 48873505 / -0.6% 0.61 / 0.60 / +0.9%
tpcds_q47/datafusion:parquet 97619730 / 98607906 / -1.0% 123187817 / 122000287 / +1.0% 0.79 / 0.81 / -2.0%
tpcds_q48/datafusion:parquet 40326198 / 41158564 / -2.0% 60051897 / 61097537 / -1.7% 0.67 / 0.67 / -0.3%
tpcds_q49/datafusion:parquet 72105170 / 73346998 / -1.7% 97441347 / 93109944 / +4.7% 0.74 / 0.79 / -6.1%
tpcds_q50/datafusion:parquet 47218434 / 47488470 / -0.6% 72223034 / 69287109 / +4.2% 0.65 / 0.69 / -4.6%
tpcds_q51/datafusion:parquet 70580614 / 71591582 / -1.4% 91843425 / 85652619 / +7.2% 0.77 / 0.84 / -8.1%
tpcds_q52/datafusion:parquet 18490705 / 18504141 / -0.1% 32047680 / 30432227 / +5.3% 0.58 / 0.61 / -5.1%
tpcds_q53/datafusion:parquet 22371099 / 23223830 / -3.7% 39496471 / 40210873 / -1.8% 0.57 / 0.58 / -1.9%
tpcds_q54/datafusion:parquet 54568544 / 55355610 / -1.4% 72440775 / 75891147 / -4.5% 0.75 / 0.73 / +3.3%
tpcds_q55/datafusion:parquet 17871848 / 18169742 / -1.6% 31795070 / 32082686 / -0.9% 0.56 / 0.57 / -0.7%
tpcds_q56/datafusion:parquet 46066208 / 45621450 / +1.0% 61284643 / 60724021 / +0.9% 0.75 / 0.75 / +0.1%
tpcds_q57/datafusion:parquet 100603393 / 100948980 / -0.3% 116133678 / 115629269 / +0.4% 0.87 / 0.87 / -0.8%
tpcds_q58/datafusion:parquet 63984604 / 64150340 / -0.3% 83074522 / 83433504 / -0.4% 0.77 / 0.77 / +0.2%
tpcds_q59/datafusion:parquet 47215090 / 46713017 / +1.1% 63246386 / 62851774 / +0.6% 0.75 / 0.74 / +0.4%
tpcds_q60/datafusion:parquet 46474124 / 46324767 / +0.3% 59391349 / 62676026 / -5.2% 0.78 / 0.74 / +5.9%
tpcds_q61/datafusion:parquet 37238584 / 38371757 / -3.0% 58845272 / 59588627 / -1.2% 0.63 / 0.64 / -1.7%
tpcds_q62/datafusion:parquet 24927032 / 24847457 / +0.3% 39017967 / 37598896 / +3.8% 0.64 / 0.66 / -3.3%
tpcds_q63/datafusion:parquet 22036522 / 22205980 / -0.8% 39279975 / 38855581 / +1.1% 0.56 / 0.57 / -1.8%
tpcds_q64/datafusion:parquet 200504040 / 204869355 / -2.1% 232520945 / 237438625 / -2.1% 0.86 / 0.86 / -0.1%
tpcds_q65/datafusion:parquet 37721200 / 37557106 / +0.4% 57644014 / 55160449 / +4.5% 0.65 / 0.68 / -3.9%
tpcds_q66/datafusion:parquet 60932718 / 61683570 / -1.2% 78623032 / 78285291 / +0.4% 0.77 / 0.79 / -1.6%
tpcds_q67/datafusion:parquet 69491334 / 68811445 / +1.0% 94346015 / 93904042 / +0.5% 0.74 / 0.73 / +0.5%
tpcds_q68/datafusion:parquet 29754510 / 29247897 / +1.7% 49917600 / 49059249 / +1.7% 0.60 / 0.60 / -0.0%
tpcds_q69/datafusion:parquet 49769100 / 49394867 / +0.8% 65859800 / 64408645 / +2.3% 0.76 / 0.77 / -1.5%
tpcds_q70/datafusion:parquet 36785552 / 36868762 / -0.2% 57217782 / 57610523 / -0.7% 0.64 / 0.64 / +0.5%
tpcds_q71/datafusion:parquet 28343305 / 28065558 / +1.0% 43371157 / 43322912 / +0.1% 0.65 / 0.65 / +0.9%
tpcds_q72/datafusion:parquet 550516574 / 556971343 / -1.2% 576151498 / 580705096 / -0.8% 0.96 / 0.96 / -0.4%
tpcds_q73/datafusion:parquet 23139648 / 22926410 / +0.9% 37400175 / 38026147 / -1.6% 0.62 / 0.60 / +2.6%
tpcds_q74/datafusion:parquet 67922328 / 68792387 / -1.3% 88656302 / 84903915 / +4.4% 0.77 / 0.81 / -5.4%
tpcds_q75/datafusion:parquet 144660903 / 146853616 / -1.5% 169119444 / 174190405 / -2.9% 0.86 / 0.84 / +1.5%
tpcds_q76/datafusion:parquet 55463768 / 54282357 / +2.2% 70334925 / 71127996 / -1.1% 0.79 / 0.76 / +3.3%
tpcds_q77/datafusion:parquet 56389404 / 55966173 / +0.8% 75213432 / 77229193 / -2.6% 0.75 / 0.72 / +3.5%
tpcds_q78/datafusion:parquet 89114956 / 89075096 / +0.0% 123835013 / 121779858 / +1.7% 0.72 / 0.73 / -1.6%
tpcds_q79/datafusion:parquet 26129826 / 25909841 / +0.8% 44522674 / 44201804 / +0.7% 0.59 / 0.59 / +0.1%
tpcds_q80/datafusion:parquet 81258518 / 81628190 / -0.5% 111373136 / 110687398 / +0.6% 0.73 / 0.74 / -1.1%
tpcds_q81/datafusion:parquet 42532595 / 39580309 / +7.5% 58821712 / 60703457 / -3.1% 0.72 / 0.65 / +10.9%
tpcds_q82/datafusion:parquet 26788250 / 26229296 / +2.1% 39546671 / 39160394 / +1.0% 0.68 / 0.67 / +1.1%
tpcds_q83/datafusion:parquet 57156986 / 57344265 / -0.3% 70736674 / 73139895 / -3.3% 0.81 / 0.78 / +3.1%
tpcds_q84/datafusion:parquet 30175300 / 29910892 / +0.9% 45104645 / 45598911 / -1.1% 0.67 / 0.66 / +2.0%
tpcds_q85/datafusion:parquet 83406748 / 83870250 / -0.6% 104591978 / 106470570 / -1.8% 0.80 / 0.79 / +1.2%
tpcds_q86/datafusion:parquet 20048062 / 20238689 / -0.9% 34352935 / 34491157 / -0.4% 0.58 / 0.59 / -0.5%
tpcds_q87/datafusion:parquet 46677429 / 47113964 / -0.9% 60243036 / 61472945 / -2.0% 0.77 / 0.77 / +1.1%
tpcds_q88/datafusion:parquet 47894082 / 48873314 / -2.0% 69977797 / 66522342 / +5.2% 0.68 / 0.73 / -6.8%
tpcds_q89/datafusion:parquet 25509960 / 25857750 / -1.3% 43029851 / 41852069 / +2.8% 0.59 / 0.62 / -4.0%
tpcds_q90/datafusion:parquet 19242067 / 19104982 / +0.7% 32173758 / 31954527 / +0.7% 0.60 / 0.60 / +0.0%
tpcds_q91/datafusion:parquet 36827842 / 36573844 / +0.7% 53000224 / 50727361 / +4.5% 0.69 / 0.72 / -3.6%
tpcds_q92/datafusion:parquet 26111809 / 26612185 / -1.9% 38910197 / 40992853 / -5.1% 0.67 / 0.65 / +3.4%
tpcds_q93/datafusion:parquet 26732908 / 25765184 / +3.8% 47883822 / 47470285 / +0.9% 0.56 / 0.54 / +2.9%
tpcds_q94/datafusion:parquet 34270652 / 34918142 / -1.9% 50194716 / 49202693 / +2.0% 0.68 / 0.71 / -3.8%
tpcds_q95/datafusion:parquet 64067484 / 64990956 / -1.4% 76174581 / 80711704 / -5.6% 0.84 / 0.81 / +4.5%
tpcds_q96/datafusion:parquet 16724042 / 16370760 / +2.2% 29049863 / 28640958 / +1.4% 0.58 / 0.57 / +0.7%
tpcds_q97/datafusion:parquet 35146772 / 35294324 / -0.4% 50191009 / 50256975 / -0.1% 0.70 / 0.70 / -0.3%
tpcds_q98/datafusion:parquet 25037074 / 25013554 / +0.1% 39939179 / 38962702 / +2.5% 0.63 / 0.64 / -2.4%
tpcds_q99/datafusion:parquet 29573366 / 29778978 / -0.7% 41943229 / 43079759 / -2.6% 0.71 / 0.69 / +2.0%
duckdb / vortex-file-compressed / ns (0.998x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15239959 / 15450298 / -1.4% 24032843 / 24061543 / -0.1% 0.63 / 0.64 / -1.2%
tpcds_q02/duckdb:vortex-file-compressed 15295537 / 15405579 / -0.7% 21275309 / 20921104 / +1.7% 0.72 / 0.74 / -2.4%
tpcds_q03/duckdb:vortex-file-compressed 11813666 / 14519518 / -18.6% 🟢 21306370 / 20375477 / +4.6% 0.55 / 0.71 / -22.2%
tpcds_q04/duckdb:vortex-file-compressed 51716868 / 51995186 / -0.5% 62591109 / 62731895 / -0.2% 0.83 / 0.83 / -0.3%
tpcds_q05/duckdb:vortex-file-compressed 19341012 / 19091742 / +1.3% 26958165 / 28922972 / -6.8% 0.72 / 0.66 / +8.7%
tpcds_q06/duckdb:vortex-file-compressed 27209106 / 27330978 / -0.4% 41556218 / 40006937 / +3.9% 0.65 / 0.68 / -4.2%
tpcds_q07/duckdb:vortex-file-compressed 16546450 / 16511436 / +0.2% 27968752 / 29253229 / -4.4% 0.59 / 0.56 / +4.8%
tpcds_q08/duckdb:vortex-file-compressed 22840348 / 23221282 / -1.6% 35798142 / 33473949 / +6.9% 0.64 / 0.69 / -8.0%
tpcds_q09/duckdb:vortex-file-compressed 10513489 / 10611848 / -0.9% 18590590 / 18302065 / +1.6% 0.57 / 0.58 / -2.5%
tpcds_q10/duckdb:vortex-file-compressed 30876496 / 30758671 / +0.4% 43411287 / 45715373 / -5.0% 0.71 / 0.67 / +5.7%
tpcds_q11/duckdb:vortex-file-compressed 41974092 / 40789589 / +2.9% 52639429 / 52513959 / +0.2% 0.80 / 0.78 / +2.7%
tpcds_q12/duckdb:vortex-file-compressed 10822318 / 10723732 / +0.9% 17516760 / 17487475 / +0.2% 0.62 / 0.61 / +0.8%
tpcds_q13/duckdb:vortex-file-compressed 21438761 / 21283434 / +0.7% 35584618 / 35606384 / -0.1% 0.60 / 0.60 / +0.8%
tpcds_q14/duckdb:vortex-file-compressed 58645178 / 58553612 / +0.2% 75230778 / 70243777 / +7.1% 0.78 / 0.83 / -6.5%
tpcds_q15/duckdb:vortex-file-compressed 22163192 / 22257826 / -0.4% 28127899 / 28237242 / -0.4% 0.79 / 0.79 / -0.0%
tpcds_q16/duckdb:vortex-file-compressed 18792020 / 18890958 / -0.5% 30945853 / 27371814 / +13.1% 🔴 0.61 / 0.69 / -12.0%
tpcds_q17/duckdb:vortex-file-compressed 31738966 / 31823671 / -0.3% 46486568 / 48239298 / -3.6% 0.68 / 0.66 / +3.5%
tpcds_q18/duckdb:vortex-file-compressed 29764818 / 30059654 / -1.0% 41040084 / 40680960 / +0.9% 0.73 / 0.74 / -1.8%
tpcds_q19/duckdb:vortex-file-compressed 24980049 / 25407829 / -1.7% 35490484 / 35543160 / -0.1% 0.70 / 0.71 / -1.5%
tpcds_q20/duckdb:vortex-file-compressed 10956135 / 12243844 / -10.5% 🟢 17760500 / 15879912 / +11.8% 🔴 0.62 / 0.77 / -20.0%
tpcds_q21/duckdb:vortex-file-compressed 10855417 / 10480754 / +3.6% 24898227 / 21482491 / +15.9% 🔴 0.44 / 0.49 / -10.6%
tpcds_q22/duckdb:vortex-file-compressed 29290007 / 30653833 / -4.4% 42936703 / 43572017 / -1.5% 0.68 / 0.70 / -3.0%
tpcds_q23/duckdb:vortex-file-compressed 36153288 / 35475468 / +1.9% 52140895 / 45772057 / +13.9% 🔴 0.69 / 0.78 / -10.5%
tpcds_q24/duckdb:vortex-file-compressed 28672203 / 28578068 / +0.3% 40919434 / 39587730 / +3.4% 0.70 / 0.72 / -2.9%
tpcds_q25/duckdb:vortex-file-compressed 26387582 / 26949396 / -2.1% 41801846 / 40022049 / +4.4% 0.63 / 0.67 / -6.3%
tpcds_q26/duckdb:vortex-file-compressed 14889030 / 14865714 / +0.2% 22230149 / 21051430 / +5.6% 0.67 / 0.71 / -5.2%
tpcds_q27/duckdb:vortex-file-compressed 17444898 / 18007404 / -3.1% 29296292 / 28789026 / +1.8% 0.60 / 0.63 / -4.8%
tpcds_q28/duckdb:vortex-file-compressed 8027100 / 7946600 / +1.0% 12467798 / 11794015 / +5.7% 0.64 / 0.67 / -4.4%
tpcds_q29/duckdb:vortex-file-compressed 31509964 / 30760416 / +2.4% 46633832 / 45851025 / +1.7% 0.68 / 0.67 / +0.7%
tpcds_q30/duckdb:vortex-file-compressed 19875722 / 20034188 / -0.8% 32175388 / 31395116 / +2.5% 0.62 / 0.64 / -3.2%
tpcds_q31/duckdb:vortex-file-compressed 19620950 / 19906786 / -1.4% 30403052 / 27317408 / +11.3% 🔴 0.65 / 0.73 / -11.4%
tpcds_q32/duckdb:vortex-file-compressed 10992507 / 10877771 / +1.1% 18245289 / 17454180 / +4.5% 0.60 / 0.62 / -3.3%
tpcds_q33/duckdb:vortex-file-compressed 17392296 / 17846598 / -2.5% 31509047 / 29385817 / +7.2% 0.55 / 0.61 / -9.1%
tpcds_q34/duckdb:vortex-file-compressed 13662288 / 13684258 / -0.2% 23957747 / 21950974 / +9.1% 0.57 / 0.62 / -8.5%
tpcds_q35/duckdb:vortex-file-compressed 49125507 / 48409357 / +1.5% 63759789 / 62058371 / +2.7% 0.77 / 0.78 / -1.2%
tpcds_q36/duckdb:vortex-file-compressed 16015496 / 16158601 / -0.9% 28002156 / 34855399 / -19.7% 🟢 0.57 / 0.46 / +23.4%
tpcds_q37/duckdb:vortex-file-compressed 13841494 / 14008873 / -1.2% 25119336 / 23681310 / +6.1% 0.55 / 0.59 / -6.9%
tpcds_q38/duckdb:vortex-file-compressed 21929264 / 22106647 / -0.8% 29832444 / 28861488 / +3.4% 0.74 / 0.77 / -4.0%
tpcds_q39/duckdb:vortex-file-compressed 18765058 / 18671508 / +0.5% 29626043 / 28355283 / +4.5% 0.63 / 0.66 / -3.8%
tpcds_q40/duckdb:vortex-file-compressed 13264750 / 13616148 / -2.6% 22599483 / 19418239 / +16.4% 🔴 0.59 / 0.70 / -16.3%
tpcds_q41/duckdb:vortex-file-compressed 6558528 / 6645274 / -1.3% 10948904 / 10677746 / +2.5% 0.60 / 0.62 / -3.7%
tpcds_q42/duckdb:vortex-file-compressed 8757870 / 8505162 / +3.0% 18266754 / 17705301 / +3.2% 0.48 / 0.48 / -0.2%
tpcds_q43/duckdb:vortex-file-compressed 12299330 / 10223151 / +20.3% 🔴 22345845 / 18803647 / +18.8% 🔴 0.55 / 0.54 / +1.2%
tpcds_q44/duckdb:vortex-file-compressed 13916890 / 13927832 / -0.1% 28531988 / 23630822 / +20.7% 🔴 0.49 / 0.59 / -17.2%
tpcds_q45/duckdb:vortex-file-compressed 23872928 / 23758854 / +0.5% 30269077 / 29606328 / +2.2% 0.79 / 0.80 / -1.7%
tpcds_q46/duckdb:vortex-file-compressed 17121870 / 17236780 / -0.7% 29629239 / 28242267 / +4.9% 0.58 / 0.61 / -5.3%
tpcds_q47/duckdb:vortex-file-compressed 30713323 / 30819762 / -0.3% 43537718 / 43522546 / +0.0% 0.71 / 0.71 / -0.4%
tpcds_q48/duckdb:vortex-file-compressed 20130552 / 20157343 / -0.1% 34625398 / 32100433 / +7.9% 0.58 / 0.63 / -7.4%
tpcds_q49/duckdb:vortex-file-compressed 18126784 / 18334834 / -1.1% 32712179 / 32756286 / -0.1% 0.55 / 0.56 / -1.0%
tpcds_q50/duckdb:vortex-file-compressed 17221709 / 17092688 / +0.8% 28601384 / 28338465 / +0.9% 0.60 / 0.60 / -0.2%
tpcds_q51/duckdb:vortex-file-compressed 52448032 / 53384759 / -1.8% 90254942 / 87214628 / +3.5% 0.58 / 0.61 / -5.1%
tpcds_q52/duckdb:vortex-file-compressed 8747880 / 8824856 / -0.9% 21247076 / 18637418 / +14.0% 🔴 0.41 / 0.47 / -13.0%
tpcds_q53/duckdb:vortex-file-compressed 14180708 / 14189012 / -0.1% 25566724 / 24452902 / +4.6% 0.55 / 0.58 / -4.4%
tpcds_q54/duckdb:vortex-file-compressed 20916110 / 21179086 / -1.2% 31022850 / 30704816 / +1.0% 0.67 / 0.69 / -2.3%
tpcds_q55/duckdb:vortex-file-compressed 10319990 / 9324990 / +10.7% 🔴 18046796 / 19293302 / -6.5% 0.57 / 0.48 / +18.3%
tpcds_q56/duckdb:vortex-file-compressed 17586523 / 18111586 / -2.9% 33068058 / 35757838 / -7.5% 0.53 / 0.51 / +5.0%
tpcds_q57/duckdb:vortex-file-compressed 24646618 / 24625942 / +0.1% 31674785 / 31728963 / -0.2% 0.78 / 0.78 / +0.3%
tpcds_q58/duckdb:vortex-file-compressed 18609312 / 18790540 / -1.0% 29258147 / 28749136 / +1.8% 0.64 / 0.65 / -2.7%
tpcds_q59/duckdb:vortex-file-compressed 18463360 / 18600744 / -0.7% 27910393 / 25569782 / +9.2% 0.66 / 0.73 / -9.1%
tpcds_q60/duckdb:vortex-file-compressed 17803360 / 20977930 / -15.1% 🟢 29774574 / 30792010 / -3.3% 0.60 / 0.68 / -12.2%
tpcds_q61/duckdb:vortex-file-compressed 21284586 / 20757810 / +2.5% 34333414 / 32278897 / +6.4% 0.62 / 0.64 / -3.6%
tpcds_q62/duckdb:vortex-file-compressed 10685201 / 10679432 / +0.1% 17619386 / 17728400 / -0.6% 0.61 / 0.60 / +0.7%
tpcds_q63/duckdb:vortex-file-compressed 13516567 / 13274613 / +1.8% 23164018 / 23070589 / +0.4% 0.58 / 0.58 / +1.4%
tpcds_q64/duckdb:vortex-file-compressed 64242190 / 65340892 / -1.7% 79633311 / 79664202 / -0.0% 0.81 / 0.82 / -1.6%
tpcds_q65/duckdb:vortex-file-compressed 12960705 / 13162404 / -1.5% 22561487 / 22513458 / +0.2% 0.57 / 0.58 / -1.7%
tpcds_q66/duckdb:vortex-file-compressed 23269211 / 23029082 / +1.0% 29007405 / 33057162 / -12.3% 🟢 0.80 / 0.70 / +15.1%
tpcds_q67/duckdb:vortex-file-compressed 65388937 / 65780869 / -0.6% 80709565 / 80784297 / -0.1% 0.81 / 0.81 / -0.5%
tpcds_q68/duckdb:vortex-file-compressed 16459496 / 16754320 / -1.8% 29655857 / 32644692 / -9.2% 0.56 / 0.51 / +8.1%
tpcds_q69/duckdb:vortex-file-compressed 31474428 / 31832869 / -1.1% 45017917 / 43097566 / +4.5% 0.70 / 0.74 / -5.3%
tpcds_q70/duckdb:vortex-file-compressed 18547993 / 18775132 / -1.2% 34385723 / 29194894 / +17.8% 🔴 0.54 / 0.64 / -16.1%
tpcds_q71/duckdb:vortex-file-compressed 13343553 / 13775392 / -3.1% 25647837 / 26473518 / -3.1% 0.52 / 0.52 / -0.0%
tpcds_q72/duckdb:vortex-file-compressed 64019174 / 64223798 / -0.3% 81448513 / 80691249 / +0.9% 0.79 / 0.80 / -1.2%
tpcds_q73/duckdb:vortex-file-compressed 13300092 / 13261068 / +0.3% 20816393 / 21610842 / -3.7% 0.64 / 0.61 / +4.1%
tpcds_q74/duckdb:vortex-file-compressed 30654093 / 29014738 / +5.7% 42908172 / 42417270 / +1.2% 0.71 / 0.68 / +4.4%
tpcds_q75/duckdb:vortex-file-compressed 28397876 / 28701048 / -1.1% 39591779 / 40672777 / -2.7% 0.72 / 0.71 / +1.6%
tpcds_q76/duckdb:vortex-file-compressed 13985330 / 13531199 / +3.4% 24207262 / 25624167 / -5.5% 0.58 / 0.53 / +9.4%
tpcds_q77/duckdb:vortex-file-compressed 16200588 / 16014906 / +1.2% 25085260 / 24923563 / +0.6% 0.65 / 0.64 / +0.5%
tpcds_q78/duckdb:vortex-file-compressed 38326294 / 37579176 / +2.0% 46069549 / 47468899 / -2.9% 0.83 / 0.79 / +5.1%
tpcds_q79/duckdb:vortex-file-compressed 15761034 / 14818329 / +6.4% 28080897 / 24295609 / +15.6% 🔴 0.56 / 0.61 / -8.0%
tpcds_q80/duckdb:vortex-file-compressed 28902893 / 29054146 / -0.5% 44183048 / 43222078 / +2.2% 0.65 / 0.67 / -2.7%
tpcds_q81/duckdb:vortex-file-compressed 23462794 / 23587684 / -0.5% 31733484 / 31952707 / -0.7% 0.74 / 0.74 / +0.2%
tpcds_q82/duckdb:vortex-file-compressed 31983941 / 34391918 / -7.0% 41976744 / 40758895 / +3.0% 0.76 / 0.84 / -9.7%
tpcds_q83/duckdb:vortex-file-compressed 21300382 / 21127210 / +0.8% 25128819 / 24530583 / +2.4% 0.85 / 0.86 / -1.6%
tpcds_q84/duckdb:vortex-file-compressed 13557208 / 14649704 / -7.5% 20613687 / 20416739 / +1.0% 0.66 / 0.72 / -8.3%
tpcds_q85/duckdb:vortex-file-compressed 33412839 / 32964414 / +1.4% 43951202 / 42342606 / +3.8% 0.76 / 0.78 / -2.3%
tpcds_q86/duckdb:vortex-file-compressed 12300002 / 11062728 / +11.2% 🔴 22983960 / 18201433 / +26.3% 🔴 0.54 / 0.61 / -12.0%
tpcds_q87/duckdb:vortex-file-compressed 23929478 / 23956720 / -0.1% 31798310 / 3050447 / +4.2% 0.75 / 0.79 / -4.2%
tpcds_q88/duckdb:vortex-file-compressed 36029120 / 35940360 / +0.2% 48881924 / 48583025 / +0.6% 0.74 / 0.74 / -0.4%
tpcds_q89/duckdb:vortex-file-compressed 13840376 / 14109404 / -1.9% 23423214 / 23773568 / -1.5% 0.59 / 0.59 / -0.4%
tpcds_q90/duckdb:vortex-file-compressed 8185947 / 8322602 / -1.6% 17418972 / 17832666 / -2.3% 0.47 / 0.47 / +0.7%
tpcds_q91/duckdb:vortex-file-compressed 17272501 / 17343352 / -0.4% 27277913 / 24046336 / +13.4% 🔴 0.63 / 0.72 / -12.2%
tpcds_q92/duckdb:vortex-file-compressed 14462110 / 14376150 / +0.6% 22643860 / 23176936 / -2.3% 0.64 / 0.62 / +3.0%
tpcds_q93/duckdb:vortex-file-compressed 16422688 / 16560958 / -0.8% 26560785 / 24215197 / +9.7% 0.62 / 0.68 / -9.6%
tpcds_q94/duckdb:vortex-file-compressed 17617686 / 17485351 / +0.8% 28100618 / 27072989 / +3.8% 0.63 / 0.65 / -2.9%
tpcds_q95/duckdb:vortex-file-compressed 71746663 / 72874687 / -1.5% 80959395 / 79993895 / +1.2% 0.89 / 0.91 / -2.7%
tpcds_q96/duckdb:vortex-file-compressed 9823709 / 8631672 / +13.8% 🔴 15486242 / 15206887 / +1.8% 0.63 / 0.57 / +11.8%
tpcds_q97/duckdb:vortex-file-compressed 23067979 / 23369421 / -1.3% 32426822 / 30603755 / +6.0% 0.71 / 0.76 / -6.8%
tpcds_q98/duckdb:vortex-file-compressed 13745841 / 13748382 / -0.0% 24931209 / 24067134 / +3.6% 0.55 / 0.57 / -3.5%
tpcds_q99/duckdb:vortex-file-compressed 14475316 / 14338708 / +1.0% 24182492 / 20667227 / +17.0% 🔴 0.60 / 0.69 / -13.7%
duckdb / parquet / ns (1.004x ➖, 2↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23735613 / 23525474 / +0.9% 31716445 / 31388303 / +1.0% 0.75 / 0.75 / -0.2%
tpcds_q02/duckdb:parquet 15469454 / 15402391 / +0.4% 19684795 / 20001009 / -1.6% 0.79 / 0.77 / +2.0%
tpcds_q03/duckdb:parquet 8836130 / 8783538 / +0.6% 14928021 / 15172648 / -1.6% 0.59 / 0.58 / +2.2%
tpcds_q04/duckdb:parquet 127335204 / 127691004 / -0.3% 133413027 / 135573534 / -1.6% 0.95 / 0.94 / +1.3%
tpcds_q05/duckdb:parquet 21692170 / 21426244 / +1.2% 26193306 / 26356848 / -0.6% 0.83 / 0.81 / +1.9%
tpcds_q06/duckdb:parquet 26431052 / 26585375 / -0.6% 36791631 / 35431319 / +3.8% 0.72 / 0.75 / -4.3%
tpcds_q07/duckdb:parquet 15176507 / 15290886 / -0.7% 23270477 / 23642812 / -1.6% 0.65 / 0.65 / +0.8%
tpcds_q08/duckdb:parquet 28618640 / 26901522 / +6.4% 33401693 / 33989521 / -1.7% 0.86 / 0.79 / +8.3%
tpcds_q09/duckdb:parquet 18645909 / 19229914 / -3.0% 23332587 / 23035394 / +1.3% 0.80 / 0.83 / -4.3%
tpcds_q10/duckdb:parquet 27560464 / 28530064 / -3.4% 37389665 / 38509294 / -2.9% 0.74 / 0.74 / -0.5%
tpcds_q11/duckdb:parquet 72642990 / 71151496 / +2.1% 76273418 / 79252736 / -3.8% 0.95 / 0.90 / +6.1%
tpcds_q12/duckdb:parquet 12420582 / 12345638 / +0.6% 16915284 / 17469617 / -3.2% 0.73 / 0.71 / +3.9%
tpcds_q13/duckdb:parquet 23598795 / 23500135 / +0.4% 31843139 / 32092148 / -0.8% 0.74 / 0.73 / +1.2%
tpcds_q14/duckdb:parquet 60426143 / 60847184 / -0.7% 67719620 / 68927678 / -1.8% 0.89 / 0.88 / +1.1%
tpcds_q15/duckdb:parquet 24880053 / 24459426 / +1.7% 30626972 / 30203798 / +1.4% 0.81 / 0.81 / +0.3%
tpcds_q16/duckdb:parquet 20137590 / 21432202 / -6.0% 31618576 / 28419876 / +11.3% 🔴 0.64 / 0.75 / -15.5%
tpcds_q17/duckdb:parquet 32043390 / 32145089 / -0.3% 40522133 / 40589013 / -0.2% 0.79 / 0.79 / -0.2%
tpcds_q18/duckdb:parquet 38950259 / 41659970 / -6.5% 51492961 / 49733738 / +3.5% 0.76 / 0.84 / -9.7%
tpcds_q19/duckdb:parquet 24064656 / 24427990 / -1.5% 37136887 / 32363093 / +14.8% 🔴 0.65 / 0.75 / -14.2%
tpcds_q20/duckdb:parquet 13506766 / 15169884 / -11.0% 🟢 17984029 / 17965122 / +0.1% 0.75 / 0.84 / -11.1%
tpcds_q21/duckdb:parquet 9417442 / 9409878 / +0.1% 13347743 / 16750347 / -20.3% 🟢 0.71 / 0.56 / +25.6%
tpcds_q22/duckdb:parquet 36446286 / 35024148 / +4.1% 38867558 / 39444855 / -1.5% 0.94 / 0.89 / +5.6%
tpcds_q23/duckdb:parquet 39739176 / 40564254 / -2.0% 48563424 / 47754150 / +1.7% 0.82 / 0.85 / -3.7%
tpcds_q24/duckdb:parquet 33239915 / 33139510 / +0.3% 44003037 / 47608499 / -7.6% 0.76 / 0.70 / +8.5%
tpcds_q25/duckdb:parquet 30148607 / 29960286 / +0.6% 40435020 / 39998640 / +1.1% 0.75 / 0.75 / -0.5%
tpcds_q26/duckdb:parquet 31128799 / 30867402 / +0.8% 38357180 / 38145232 / +0.6% 0.81 / 0.81 / +0.3%
tpcds_q27/duckdb:parquet 31574817 / 31690220 / -0.4% 41280074 / 41238039 / +0.1% 0.76 / 0.77 / -0.5%
tpcds_q28/duckdb:parquet 17215513 / 17710616 / -2.8% 19564450 / 20221275 / -3.2% 0.88 / 0.88 / +0.5%
tpcds_q29/duckdb:parquet 33583396 / 32404873 / +3.6% 39293166 / 38878677 / +1.1% 0.85 / 0.83 / +2.5%
tpcds_q30/duckdb:parquet 31982227 / 34560900 / -7.5% 41621961 / 41720247 / -0.2% 0.77 / 0.83 / -7.2%
tpcds_q31/duckdb:parquet 20206283 / 20296492 / -0.4% 24917917 / 24442015 / +1.9% 0.81 / 0.83 / -2.3%
tpcds_q32/duckdb:parquet 13263084 / 11162540 / +18.8% 🔴 19317690 / 17355265 / +11.3% 🔴 0.69 / 0.64 / +6.7%
tpcds_q33/duckdb:parquet 15822892 / 15956468 / -0.8% 23297311 / 23299262 / -0.0% 0.68 / 0.68 / -0.8%
tpcds_q34/duckdb:parquet 16069749 / 16113654 / -0.3% 22342707 / 22132181 / +1.0% 0.72 / 0.73 / -1.2%
tpcds_q35/duckdb:parquet 46676008 / 48575372 / -3.9% 56340268 / 58680527 / -4.0% 0.83 / 0.83 / +0.1%
tpcds_q36/duckdb:parquet 15159808 / 15972088 / -5.1% 23324638 / 22867787 / +2.0% 0.65 / 0.70 / -6.9%
tpcds_q37/duckdb:parquet 13679502 / 12828614 / +6.6% 18765063 / 16658965 / +12.6% 🔴 0.73 / 0.77 / -5.3%
tpcds_q38/duckdb:parquet 26210984 / 26096450 / +0.4% 29793620 / 30448988 / -2.2% 0.88 / 0.86 / +2.6%
tpcds_q39/duckdb:parquet 24286870 / 24423026 / -0.6% 30693490 / 29262794 / +4.9% 0.79 / 0.83 / -5.2%
tpcds_q40/duckdb:parquet 15950488 / 15666760 / +1.8% 21381262 / 20879323 / +2.4% 0.75 / 0.75 / -0.6%
tpcds_q41/duckdb:parquet 9026692 / 7760308 / +16.3% 🔴 12987373 / 13065039 / -0.6% 0.70 / 0.59 / +17.0%
tpcds_q42/duckdb:parquet 8344389 / 8180336 / +2.0% 14950534 / 15288520 / -2.2% 0.56 / 0.54 / +4.3%
tpcds_q43/duckdb:parquet 10494340 / 10550603 / -0.5% 15606787 / 15336158 / +1.8% 0.67 / 0.69 / -2.3%
tpcds_q44/duckdb:parquet 16130898 / 16178041 / -0.3% 22814758 / 22206782 / +2.7% 0.71 / 0.73 / -2.9%
tpcds_q45/duckdb:parquet 23135982 / 22884252 / +1.1% 29445368 / 29398797 / +0.2% 0.79 / 0.78 / +0.9%
tpcds_q46/duckdb:parquet 35997834 / 35789050 / +0.6% 46337670 / 44970259 / +3.0% 0.78 / 0.80 / -2.4%
tpcds_q47/duckdb:parquet 31051122 / 31197872 / -0.5% 37919108 / 37607757 / +0.8% 0.82 / 0.83 / -1.3%
tpcds_q48/duckdb:parquet 21081953 / 20990518 / +0.4% 28361002 / 28733074 / -1.3% 0.74 / 0.73 / +1.8%
tpcds_q49/duckdb:parquet 18791396 / 18783801 / +0.0% 29286717 / 28809503 / +1.7% 0.64 / 0.65 / -1.6%
tpcds_q50/duckdb:parquet 17537332 / 17389186 / +0.9% 25578050 / 25309453 / +1.1% 0.69 / 0.69 / -0.2%
tpcds_q51/duckdb:parquet 53001208 / 52872770 / +0.2% 59007574 / 58975161 / +0.1% 0.90 / 0.90 / +0.2%
tpcds_q52/duckdb:parquet 8609428 / 8489494 / +1.4% 15165085 / 14711232 / +3.1% 0.57 / 0.58 / -1.6%
tpcds_q53/duckdb:parquet 11232974 / 11451060 / -1.9% 16772923 / 17222102 / -2.6% 0.67 / 0.66 / +0.7%
tpcds_q54/duckdb:parquet 20149838 / 20106919 / +0.2% 29152785 / 29916872 / -2.6% 0.69 / 0.67 / +2.8%
tpcds_q55/duckdb:parquet 8543428 / 8529221 / +0.2% 15348104 / 18060995 / -15.0% 🟢 0.56 / 0.47 / +17.9%
tpcds_q56/duckdb:parquet 16346096 / 16193726 / +0.9% 24357570 / 23462830 / +3.8% 0.67 / 0.69 / -2.8%
tpcds_q57/duckdb:parquet 29414510 / 28930839 / +1.7% 34035154 / 34617811 / -1.7% 0.86 / 0.84 / +3.4%
tpcds_q58/duckdb:parquet 18120509 / 18098128 / +0.1% 25765469 / 25792449 / -0.1% 0.70 / 0.70 / +0.2%
tpcds_q59/duckdb:parquet 20068963 / 19973314 / +0.5% 25512939 / 24803689 / +2.9% 0.79 / 0.81 / -2.3%
tpcds_q60/duckdb:parquet 16729784 / 16813508 / -0.5% 30267592 / 26259533 / +15.3% 🔴 0.55 / 0.64 / -13.7%
tpcds_q61/duckdb:parquet 21481050 / 21685212 / -0.9% 29507140 / 28019778 / +5.3% 0.73 / 0.77 / -5.9%
tpcds_q62/duckdb:parquet 10757306 / 10851146 / -0.9% 14723932 / 14593202 / +0.9% 0.73 / 0.74 / -1.7%
tpcds_q63/duckdb:parquet 10670281 / 10860700 / -1.8% 17099726 / 16437522 / +4.0% 0.62 / 0.66 / -5.6%
tpcds_q64/duckdb:parquet 52359864 / 52489656 / -0.2% 70666477 / 67676358 / +4.4% 0.74 / 0.78 / -4.5%
tpcds_q65/duckdb:parquet 14607912 / 14394640 / +1.5% 23683968 / 21049614 / +12.5% 🔴 0.62 / 0.68 / -9.8%
tpcds_q66/duckdb:parquet 24747327 / 24613197 / +0.5% 31021564 / 31636064 / -1.9% 0.80 / 0.78 / +2.5%
tpcds_q67/duckdb:parquet 76821478 / 76555211 / +0.3% 84300072 / 86423662 / -2.5% 0.91 / 0.89 / +2.9%
tpcds_q68/duckdb:parquet 29235107 / 29502854 / -0.9% 41944096 / 40875578 / +2.6% 0.70 / 0.72 / -3.4%
tpcds_q69/duckdb:parquet 28292172 / 28714062 / -1.5% 38680799 / 38366505 / +0.8% 0.73 / 0.75 / -2.3%
tpcds_q70/duckdb:parquet 16061222 / 18705316 / -14.1% 🟢 23309687 / 25648151 / -9.1% 0.69 / 0.73 / -5.5%
tpcds_q71/duckdb:parquet 14649030 / 14856038 / -1.4% 20969690 / 22012926 / -4.7% 0.70 / 0.67 / +3.5%
tpcds_q72/duckdb:parquet 81935036 / 81609789 / +0.4% 87003586 / 86305518 / +0.8% 0.94 / 0.95 / -0.4%
tpcds_q73/duckdb:parquet 15243746 / 13442325 / +13.4% 🔴 19489960 / 19801645 / -1.6% 0.78 / 0.68 / +15.2%
tpcds_q74/duckdb:parquet 99308074 / 98469760 / +0.9% 109110902 / 106780324 / +2.2% 0.91 / 0.92 / -1.3%
tpcds_q75/duckdb:parquet 40019264 / 39878194 / +0.4% 50988342 / 51590713 / -1.2% 0.78 / 0.77 / +1.5%
tpcds_q76/duckdb:parquet 13358319 / 13527956 / -1.3% 23930306 / 21076841 / +13.5% 🔴 0.56 / 0.64 / -13.0%
tpcds_q77/duckdb:parquet 16865702 / 16875824 / -0.1% 25598848 / 25664368 / -0.3% 0.66 / 0.66 / +0.2%
tpcds_q78/duckdb:parquet 48128832 / 48345145 / -0.4% 54354065 / 54687862 / -0.6% 0.89 / 0.88 / +0.2%
tpcds_q79/duckdb:parquet 20518900 / 20470768 / +0.2% 29213817 / 29300527 / -0.3% 0.70 / 0.70 / +0.5%
tpcds_q80/duckdb:parquet 31199142 / 31156500 / +0.1% 40687533 / 40158379 / +1.3% 0.77 / 0.78 / -1.2%
tpcds_q81/duckdb:parquet 32377518 / 29788370 / +8.7% 39136311 / 38345378 / +2.1% 0.83 / 0.78 / +6.5%
tpcds_q82/duckdb:parquet 13658278 / 12979862 / +5.2% 20436387 / 19493979 / +4.8% 0.67 / 0.67 / +0.4%
tpcds_q83/duckdb:parquet 15608592 / 15692518 / -0.5% 21980421 / 21475078 / +2.4% 0.71 / 0.73 / -2.8%
tpcds_q84/duckdb:parquet 17424126 / 17147358 / +1.6% 23177208 / 23923029 / -3.1% 0.75 / 0.72 / +4.9%
tpcds_q85/duckdb:parquet 34790361 / 34435036 / +1.0% 46210515 / 45644923 / +1.2% 0.75 / 0.75 / -0.2%
tpcds_q86/duckdb:parquet 12256058 / 10704392 / +14.5% 🔴 15598532 / 15560360 / +0.2% 0.79 / 0.69 / +14.2%
tpcds_q87/duckdb:parquet 28180857 / 28244882 / -0.2% 32494837 / 31501955 / +3.2% 0.87 / 0.90 / -3.3%
tpcds_q88/duckdb:parquet 26836555 / 27807436 / -3.5% 36709551 / 31808993 / +15.4% 🔴 0.73 / 0.87 / -16.4%
tpcds_q89/duckdb:parquet 12652354 / 12701684 / -0.4% 22194651 / 27041856 / -17.9% 🟢 0.57 / 0.47 / +21.4%
tpcds_q90/duckdb:parquet 6862603 / 7250502 / -5.3% 10974666 / 13785160 / -20.4% 🟢 0.63 / 0.53 / +18.9%
tpcds_q91/duckdb:parquet 20722004 / 20652352 / +0.3% 29075594 / 29358405 / -1.0% 0.71 / 0.70 / +1.3%
tpcds_q92/duckdb:parquet 11431730 / 11567391 / -1.2% 18127425 / 18733693 / -3.2% 0.63 / 0.62 / +2.1%
tpcds_q93/duckdb:parquet 21237542 / 21403884 / -0.8% 29243226 / 29722200 / -1.6% 0.73 / 0.72 / +0.8%
tpcds_q94/duckdb:parquet 15639452 / 16046258 / -2.5% 25202468 / 24761839 / +1.8% 0.62 / 0.65 / -4.2%
tpcds_q95/duckdb:parquet 90100845 / 89652158 / +0.5% 96484312 / 97525299 / -1.1% 0.93 / 0.92 / +1.6%
tpcds_q96/duckdb:parquet 7421364 / 6859230 / +8.2% 10421279 / 13615904 / -23.5% 🟢 0.71 / 0.50 / +41.4%
tpcds_q97/duckdb:parquet 25946784 / 25919598 / +0.1% 32180955 / 31751324 / +1.4% 0.81 / 0.82 / -1.2%
tpcds_q98/duckdb:parquet 17413246 / 14880374 / +17.0% 🔴 21997712 / 22572893 / -2.5% 0.79 / 0.66 / +20.1%
tpcds_q99/duckdb:parquet 17411873 / 17395711 / +0.1% 21070088 / 20988346 / +0.4% 0.83 / 0.83 / -0.3%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.6%, environment too noisy confidence)
Vortex (geomean): hot 0.991x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.992x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1239362 / 1249694 / -0.8% 20602827 / 19744726 / +4.3% 0.06 / 0.06 / -5.0%
clickbench_q01/datafusion:vortex-file-compressed 7084288 / 7047180 / +0.5% 34266426 / 34887042 / -1.8% 0.21 / 0.20 / +2.3%
clickbench_q02/datafusion:vortex-file-compressed 12788490 / 12453798 / +2.7% 39340233 / 39438897 / -0.3% 0.33 / 0.32 / +2.9%
clickbench_q03/datafusion:vortex-file-compressed 13152393 / 12554599 / +4.8% 48014053 / 49902479 / -3.8% 0.27 / 0.25 / +8.9%
clickbench_q04/datafusion:vortex-file-compressed 58540326 / 57111654 / +2.5% 91868314 / 91653535 / +0.2% 0.64 / 0.62 / +2.3%
clickbench_q05/datafusion:vortex-file-compressed 77644981 / 77462460 / +0.2% 117074112 / 113541139 / +3.1% 0.66 / 0.68 / -2.8%
clickbench_q06/datafusion:vortex-file-compressed 1217047 / 1260186 / -3.4% 20587471 / 20507188 / +0.4% 0.06 / 0.06 / -3.8%
clickbench_q07/datafusion:vortex-file-compressed 13425040 / 13762697 / -2.5% 36143205 / 36666397 / -1.4% 0.37 / 0.38 / -1.0%
clickbench_q08/datafusion:vortex-file-compressed 81708962 / 78784801 / +3.7% 118829482 / 111368018 / +6.7% 0.69 / 0.71 / -2.8%
clickbench_q09/datafusion:vortex-file-compressed 178056966 / 174195084 / +2.2% 209895396 / 211337107 / -0.7% 0.85 / 0.82 / +2.9%
clickbench_q10/datafusion:vortex-file-compressed 40057396 / 39469819 / +1.5% 69762647 / 66459226 / +5.0% 0.57 / 0.59 / -3.3%
clickbench_q11/datafusion:vortex-file-compressed 56115046 / 55372355 / +1.3% 82872563 / 82413435 / +0.6% 0.68 / 0.67 / +0.8%
clickbench_q12/datafusion:vortex-file-compressed 75400992 / 73512894 / +2.6% 123268915 / 118964815 / +3.6% 0.61 / 0.62 / -1.0%
clickbench_q13/datafusion:vortex-file-compressed 125848715 / 124899643 / +0.8% 183410678 / 174944588 / +4.8% 0.69 / 0.71 / -3.9%
clickbench_q14/datafusion:vortex-file-compressed 87328900 / 81030164 / +7.8% 120365674 / 122200937 / -1.5% 0.73 / 0.66 / +9.4%
clickbench_q15/datafusion:vortex-file-compressed 64583130 / 63375218 / +1.9% 93892593 / 93560523 / +0.4% 0.69 / 0.68 / +1.5%
clickbench_q16/datafusion:vortex-file-compressed 155909230 / 156695330 / -0.5% 210997011 / 198947414 / +6.1% 0.74 / 0.79 / -6.2%
clickbench_q17/datafusion:vortex-file-compressed 154695291 / 152878993 / +1.2% 205183376 / 205074898 / +0.1% 0.75 / 0.75 / +1.1%
clickbench_q18/datafusion:vortex-file-compressed 309896151 / 300475546 / +3.1% 356338106 / 356089325 / +0.1% 0.87 / 0.84 / +3.1%
clickbench_q19/datafusion:vortex-file-compressed 8266218 / 8642591 / -4.4% 45864878 / 44309356 / +3.5% 0.18 / 0.20 / -7.6%
clickbench_q20/datafusion:vortex-file-compressed 67528882 / 67529014 / -0.0% 231982760 / 225278508 / +3.0% 0.29 / 0.30 / -2.9%
clickbench_q21/datafusion:vortex-file-compressed 99840636 / 101100482 / -1.2% 270552510 / 268537110 / +0.8% 0.37 / 0.38 / -2.0%
clickbench_q22/datafusion:vortex-file-compressed 123403972 / 120336958 / +2.5% 348633844 / 338943640 / +2.9% 0.35 / 0.36 / -0.3%
clickbench_q23/datafusion:vortex-file-compressed 358697938 / 377509921 / -5.0% 655792338 / 655846453 / -0.0% 0.55 / 0.58 / -5.0%
clickbench_q24/datafusion:vortex-file-compressed 21023136 / 21525904 / -2.3% 63866768 / 63303734 / +0.9% 0.33 / 0.34 / -3.2%
clickbench_q25/datafusion:vortex-file-compressed 25828520 / 26148312 / -1.2% 60448549 / 56834642 / +6.4% 0.43 / 0.46 / -7.1%
clickbench_q26/datafusion:vortex-file-compressed 21801186 / 21806958 / -0.0% 62995881 / 61444727 / +2.5% 0.35 / 0.35 / -2.5%
clickbench_q27/datafusion:vortex-file-compressed 103596276 / 101783875 / +1.8% 247965566 / 239422904 / +3.6% 0.42 / 0.43 / -1.7%
clickbench_q28/datafusion:vortex-file-compressed 568498476 / 569953847 / -0.3% 612137917 / 609293015 / +0.5% 0.93 / 0.94 / -0.7%
clickbench_q29/datafusion:vortex-file-compressed 25040332 / 24634124 / +1.6% 49312182 / 49267955 / +0.1% 0.51 / 0.50 / +1.6%
clickbench_q30/datafusion:vortex-file-compressed 84393856 / 85825112 / -1.7% 125732504 / 118675222 / +5.9% 0.67 / 0.72 / -7.2%
clickbench_q31/datafusion:vortex-file-compressed 83473779 / 84273690 / -0.9% 149442612 / 150300190 / -0.6% 0.56 / 0.56 / -0.4%
clickbench_q32/datafusion:vortex-file-compressed 298136602 / 302683631 / -1.5% 371682647 / 363761088 / +2.2% 0.80 / 0.83 / -3.6%
clickbench_q33/datafusion:vortex-file-compressed 336125745 / 336497456 / -0.1% 409946075 / 415792842 / -1.4% 0.82 / 0.81 / +1.3%
clickbench_q34/datafusion:vortex-file-compressed 334998967 / 329277404 / +1.7% 406175427 / 424412005 / -4.3% 0.82 / 0.78 / +6.3%
clickbench_q35/datafusion:vortex-file-compressed 58208490 / 58222609 / -0.0% 86175914 / 85718539 / +0.5% 0.68 / 0.68 / -0.6%
clickbench_q36/datafusion:vortex-file-compressed 37705554 / 37779712 / -0.2% 65786011 / 65186528 / +0.9% 0.57 / 0.58 / -1.1%
clickbench_q37/datafusion:vortex-file-compressed 22195644 / 22030212 / +0.8% 47704260 / 46765866 / +2.0% 0.47 / 0.47 / -1.2%
clickbench_q38/datafusion:vortex-file-compressed 12303031 / 12439212 / -1.1% 40008737 / 38094254 / +5.0% 0.31 / 0.33 / -5.8%
clickbench_q39/datafusion:vortex-file-compressed 79381066 / 79453662 / -0.1% 109139794 / 110706289 / -1.4% 0.73 / 0.72 / +1.3%
clickbench_q40/datafusion:vortex-file-compressed 11304446 / 11105932 / +1.8% 36284947 / 36205730 / +0.2% 0.31 / 0.31 / +1.6%
clickbench_q41/datafusion:vortex-file-compressed 11051384 / 10988932 / +0.6% 35017838 / 35322473 / -0.9% 0.32 / 0.31 / +1.4%
clickbench_q42/datafusion:vortex-file-compressed 11049222 / 11388306 / -3.0% 35068682 / 34788064 / +0.8% 0.32 / 0.33 / -3.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1252056 / 1273958 / -1.7% 48263486 / 47165375 / +2.3% 0.03 / 0.03 / -4.0%
clickbench_q01/datafusion:parquet 16605518 / 15639554 / +6.2% 73092170 / 65855878 / +11.0% 🔴 0.23 / 0.24 / -4.3%
clickbench_q02/datafusion:parquet 19496384 / 18554672 / +5.1% 81507640 / 80880468 / +0.8% 0.24 / 0.23 / +4.3%
clickbench_q03/datafusion:parquet 16966040 / 16864356 / +0.6% 79475538 / 77901674 / +2.0% 0.21 / 0.22 / -1.4%
clickbench_q04/datafusion:parquet 61340030 / 61544132 / -0.3% 121974950 / 126808520 / -3.8% 0.50 / 0.49 / +3.6%
clickbench_q05/datafusion:parquet 86650362 / 88048841 / -1.6% 155318607 / 153721729 / +1.0% 0.56 / 0.57 / -2.6%
clickbench_q06/datafusion:parquet 1305114 / 1285698 / +1.5% 48402680 / 47721211 / +1.4% 0.03 / 0.03 / +0.1%
clickbench_q07/datafusion:parquet 16827692 / 16909257 / -0.5% 69027193 / 67517987 / +2.2% 0.24 / 0.25 / -2.7%
clickbench_q08/datafusion:parquet 87344452 / 90631988 / -3.6% 163771147 / 160648026 / +1.9% 0.53 / 0.56 / -5.5%
clickbench_q09/datafusion:parquet 185581842 / 185491287 / +0.0% 253712233 / 258050870 / -1.7% 0.73 / 0.72 / +1.8%
clickbench_q10/datafusion:parquet 35852578 / 35379630 / +1.3% 98635427 / 99622939 / -1.0% 0.36 / 0.36 / +2.4%
clickbench_q11/datafusion:parquet 42374260 / 41834196 / +1.3% 109068469 / 107024286 / +1.9% 0.39 / 0.39 / -0.6%
clickbench_q12/datafusion:parquet 93729442 / 95428642 / -1.8% 159118463 / 157431224 / +1.1% 0.59 / 0.61 / -2.8%
clickbench_q13/datafusion:parquet 144175266 / 144492213 / -0.2% 220376685 / 219474122 / +0.4% 0.65 / 0.66 / -0.6%
clickbench_q14/datafusion:parquet 100840396 / 100146322 / +0.7% 167079894 / 164179846 / +1.8% 0.60 / 0.61 / -1.1%
clickbench_q15/datafusion:parquet 70042249 / 71380024 / -1.9% 129161838 / 129380233 / -0.2% 0.54 / 0.55 / -1.7%
clickbench_q16/datafusion:parquet 154785646 / 152565604 / +1.5% 228722062 / 228469676 / +0.1% 0.68 / 0.67 / +1.3%
clickbench_q17/datafusion:parquet 154074472 / 153819354 / +0.2% 231800099 / 227225249 / +2.0% 0.66 / 0.68 / -1.8%
clickbench_q18/datafusion:parquet 311688070 / 311039915 / +0.2% 409906159 / 409941319 / -0.0% 0.76 / 0.76 / +0.2%
clickbench_q19/datafusion:parquet 19377594 / 19638078 / -1.3% 73460921 / 74267683 / -1.1% 0.26 / 0.26 / -0.2%
clickbench_q20/datafusion:parquet 168784650 / 169176695 / -0.2% 275799831 / 277366673 / -0.6% 0.61 / 0.61 / +0.3%
clickbench_q21/datafusion:parquet 164221228 / 164540913 / -0.2% 284418041 / 287002130 / -0.9% 0.58 / 0.57 / +0.7%
clickbench_q22/datafusion:parquet 246605526 / 248047432 / -0.6% 408753688 / 411374162 / -0.6% 0.60 / 0.60 / +0.1%
clickbench_q23/datafusion:parquet 954498186 / 959219334 / -0.5% 1166438767 / 1167619239 / -0.1% 0.82 / 0.82 / -0.4%
clickbench_q24/datafusion:parquet 29182532 / 30637752 / -4.7% 86942428 / 86110195 / +1.0% 0.34 / 0.36 / -5.7%
clickbench_q25/datafusion:parquet 35695104 / 35394838 / +0.8% 96917150 / 98215711 / -1.3% 0.37 / 0.36 / +2.2%
clickbench_q26/datafusion:parquet 30279611 / 31124166 / -2.7% 86741573 / 87881661 / -1.3% 0.35 / 0.35 / -1.4%
clickbench_q27/datafusion:parquet 181403724 / 181872358 / -0.3% 271330184 / 272961390 / -0.6% 0.67 / 0.67 / +0.3%
clickbench_q28/datafusion:parquet 619226500 / 618083750 / +0.2% 697339525 / 692969835 / +0.6% 0.89 / 0.89 / -0.4%
clickbench_q29/datafusion:parquet 29276156 / 29110432 / +0.6% 92898854 / 91550929 / +1.5% 0.32 / 0.32 / -0.9%
clickbench_q30/datafusion:parquet 89838590 / 88982652 / +1.0% 163072092 / 169453982 / -3.8% 0.55 / 0.53 / +4.9%
clickbench_q31/datafusion:parquet 98385670 / 98906645 / -0.5% 196235025 / 184436982 / +6.4% 0.50 / 0.54 / -6.5%
clickbench_q32/datafusion:parquet 317907254 / 315109982 / +0.9% 408922635 / 410627081 / -0.4% 0.78 / 0.77 / +1.3%
clickbench_q33/datafusion:parquet 371349247 / 367050894 / +1.2% 452737270 / 455346342 / -0.6% 0.82 / 0.81 / +1.8%
clickbench_q34/datafusion:parquet 369301556 / 366694463 / +0.7% 462592301 / 459929859 / +0.6% 0.80 / 0.80 / +0.1%
clickbench_q35/datafusion:parquet 64992344 / 63975738 / +1.6% 121452087 / 120233910 / +1.0% 0.54 / 0.53 / +0.6%
clickbench_q36/datafusion:parquet 72762566 / 72952512 / -0.3% 134881779 / 132250167 / +2.0% 0.54 / 0.55 / -2.2%
clickbench_q37/datafusion:parquet 35062420 / 35441996 / -1.1% 90090994 / 90103004 / -0.0% 0.39 / 0.39 / -1.1%
clickbench_q38/datafusion:parquet 47081901 / 47001620 / +0.2% 104238175 / 104003952 / +0.2% 0.45 / 0.45 / -0.1%
clickbench_q39/datafusion:parquet 142649375 / 142855742 / -0.1% 204323356 / 206786332 / -1.2% 0.70 / 0.69 / +1.1%
clickbench_q40/datafusion:parquet 19822362 / 19742648 / +0.4% 75537089 / 74720731 / +1.1% 0.26 / 0.26 / -0.7%
clickbench_q41/datafusion:parquet 18699610 / 18668877 / +0.2% 76555490 / 74795085 / +2.4% 0.24 / 0.25 / -2.1%
clickbench_q42/datafusion:parquet 19223898 / 19276181 / -0.3% 73514847 / 73148576 / +0.5% 0.26 / 0.26 / -0.8%
duckdb / vortex-file-compressed / ns (0.979x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1560876 / 1514294 / +3.1% 25398241 / 22810432 / +11.3% 🔴 0.06 / 0.07 / -7.4%
clickbench_q01/duckdb:vortex-file-compressed 12133812 / 12117184 / +0.1% 27385429 / 29493245 / -7.1% 0.44 / 0.41 / +7.8%
clickbench_q02/duckdb:vortex-file-compressed 13455929 / 16797838 / -19.9% 🟢 33526248 / 32084003 / +4.5% 0.40 / 0.52 / -23.3%
clickbench_q03/duckdb:vortex-file-compressed 17897862 / 17866984 / +0.2% 40246980 / 43500165 / -7.5% 0.44 / 0.41 / +8.3%
clickbench_q04/duckdb:vortex-file-compressed 70901116 / 69205936 / +2.4% 99814930 / 98908410 / +0.9% 0.71 / 0.70 / +1.5%
clickbench_q05/duckdb:vortex-file-compressed 68914112 / 68414568 / +0.7% 95395477 / 94191115 / +1.3% 0.72 / 0.73 / -0.5%
clickbench_q06/duckdb:vortex-file-compressed 1824556 / 1818634 / +0.3% 27705257 / 29633381 / -6.5% 0.07 / 0.06 / +7.3%
clickbench_q07/duckdb:vortex-file-compressed 14105158 / 13839650 / +1.9% 33896424 / 30544191 / +11.0% 🔴 0.42 / 0.45 / -8.2%
clickbench_q08/duckdb:vortex-file-compressed 84855192 / 88445964 / -4.1% 119658908 / 126604160 / -5.5% 0.71 / 0.70 / +1.5%
clickbench_q09/duckdb:vortex-file-compressed 110395470 / 111454383 / -1.0% 149129145 / 153281613 / -2.7% 0.74 / 0.73 / +1.8%
clickbench_q10/duckdb:vortex-file-compressed 43856308 / 45469057 / -3.5% 73626365 / 75673491 / -2.7% 0.60 / 0.60 / -0.9%
clickbench_q11/duckdb:vortex-file-compressed 56441834 / 60359157 / -6.5% 83737999 / 88637397 / -5.5% 0.67 / 0.68 / -1.0%
clickbench_q12/duckdb:vortex-file-compressed 75544110 / 76726046 / -1.5% 109282875 / 109581570 / -0.3% 0.69 / 0.70 / -1.3%
clickbench_q13/duckdb:vortex-file-compressed 145874764 / 138323920 / +5.5% 199507425 / 177894522 / +12.1% 🔴 0.73 / 0.78 / -6.0%
clickbench_q14/duckdb:vortex-file-compressed 82367091 / 85192643 / -3.3% 115541419 / 116244076 / -0.6% 0.71 / 0.73 / -2.7%
clickbench_q15/duckdb:vortex-file-compressed 90853402 / 91594058 / -0.8% 124603378 / 129386388 / -3.7% 0.73 / 0.71 / +3.0%
clickbench_q16/duckdb:vortex-file-compressed 163805133 / 166544621 / -1.6% 219275026 / 212688352 / +3.1% 0.75 / 0.78 / -4.6%
clickbench_q17/duckdb:vortex-file-compressed 163644382 / 165713194 / -1.2% 217967877 / 225858117 / -3.5% 0.75 / 0.73 / +2.3%
clickbench_q18/duckdb:vortex-file-compressed 308532838 / 317121576 / -2.7% 368009932 / 371420870 / -0.9% 0.84 / 0.85 / -1.8%
clickbench_q19/duckdb:vortex-file-compressed 18961026 / 19015381 / -0.3% 40094247 / 42404311 / -5.4% 0.47 / 0.45 / +5.5%
clickbench_q20/duckdb:vortex-file-compressed 125201366 / 129314000 / -3.2% 199122950 / 198976780 / +0.1% 0.63 / 0.65 / -3.3%
clickbench_q21/duckdb:vortex-file-compressed 183228778 / 183454348 / -0.1% 299128662 / 299308156 / -0.1% 0.61 / 0.61 / -0.1%
clickbench_q22/duckdb:vortex-file-compressed 285868727 / 281603094 / +1.5% 476845851 / 457877525 / +4.1% 0.60 / 0.62 / -2.5%
clickbench_q23/duckdb:vortex-file-compressed 71126072 / 71477522 / -0.5% 117132532 / 109089845 / +7.4% 0.61 / 0.66 / -7.3%
clickbench_q24/duckdb:vortex-file-compressed 25687970 / 27361580 / -6.1% 41466557 / 41452807 / +0.0% 0.62 / 0.66 / -6.1%
clickbench_q25/duckdb:vortex-file-compressed 35552442 / 36257110 / -1.9% 55682309 / 52370143 / +6.3% 0.64 / 0.69 / -7.8%
clickbench_q26/duckdb:vortex-file-compressed 20976080 / 20906806 / +0.3% 33775166 / 39155107 / -13.7% 🟢 0.62 / 0.53 / +16.3%
clickbench_q27/duckdb:vortex-file-compressed 171192504 / 174144433 / -1.7% 260023753 / 266926720 / -2.6% 0.66 / 0.65 / +0.9%
clickbench_q28/duckdb:vortex-file-compressed 605384534 / 637111940 / -5.0% 668727242 / 680500875 / -1.7% 0.91 / 0.94 / -3.3%
clickbench_q29/duckdb:vortex-file-compressed 19372867 / 17838387 / +8.6% 35808582 / 36574291 / -2.1% 0.54 / 0.49 / +10.9%
clickbench_q30/duckdb:vortex-file-compressed 93498103 / 93691796 / -0.2% 127321877 / 132157523 / -3.7% 0.73 / 0.71 / +3.6%
clickbench_q31/duckdb:vortex-file-compressed 141414462 / 142751402 / -0.9% 208570155 / 209340859 / -0.4% 0.68 / 0.68 / -0.6%
clickbench_q32/duckdb:vortex-file-compressed 447816586 / 454968482 / -1.6% 540094845 / 483770675 / +11.6% 🔴 0.83 / 0.94 / -11.8%
clickbench_q33/duckdb:vortex-file-compressed 400095308 / 399801642 / +0.1% 503212495 / 506290539 / -0.6% 0.80 / 0.79 / +0.7%
clickbench_q34/duckdb:vortex-file-compressed 429754824 / 421677368 / +1.9% 532766454 / 528509773 / +0.8% 0.81 / 0.80 / +1.1%
clickbench_q35/duckdb:vortex-file-compressed 102216989 / 103996121 / -1.7% 133985435 / 134611966 / -0.5% 0.76 / 0.77 / -1.3%
clickbench_q36/duckdb:vortex-file-compressed 17145297 / 17833642 / -3.9% 34197957 / 33674174 / +1.6% 0.50 / 0.53 / -5.3%
clickbench_q37/duckdb:vortex-file-compressed 12827072 / 13621716 / -5.8% 27486847 / 30812834 / -10.8% 🟢 0.47 / 0.44 / +5.6%
clickbench_q38/duckdb:vortex-file-compressed 14167884 / 14924530 / -5.1% 30835605 / 31824158 / -3.1% 0.46 / 0.47 / -2.0%
clickbench_q39/duckdb:vortex-file-compressed 25881701 / 28123503 / -8.0% 40477998 / 45229408 / -10.5% 🟢 0.64 / 0.62 / +2.8%
clickbench_q40/duckdb:vortex-file-compressed 11722853 / 11752106 / -0.2% 27869496 / 28495298 / -2.2% 0.42 / 0.41 / +2.0%
clickbench_q41/duckdb:vortex-file-compressed 12511672 / 12927704 / -3.2% 29370490 / 31343948 / -6.3% 0.43 / 0.41 / +3.3%
clickbench_q42/duckdb:vortex-file-compressed 12272494 / 14618368 / -16.0% 🟢 30075111 / 29724822 / +1.2% 0.41 / 0.49 / -17.0%
duckdb / parquet / ns (0.985x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9331510 / 8843795 / +5.5% 18088306 / 18663687 / -3.1% 0.52 / 0.47 / +8.9%
clickbench_q01/duckdb:parquet 8753042 / 10429928 / -16.1% 🟢 18422065 / 21584965 / -14.7% 🟢 0.48 / 0.48 / -1.7%
clickbench_q02/duckdb:parquet 15283658 / 18308825 / -16.5% 🟢 33027383 / 31296293 / +5.5% 0.46 / 0.59 / -20.9%
clickbench_q03/duckdb:parquet 15713140 / 15647662 / +0.4% 50798743 / 50803425 / -0.0% 0.31 / 0.31 / +0.4%
clickbench_q04/duckdb:parquet 67097108 / 69638642 / -3.6% 90831778 / 88120209 / +3.1% 0.74 / 0.79 / -6.5%
clickbench_q05/duckdb:parquet 81303036 / 92285166 / -11.9% 🟢 128922841 / 119305055 / +8.1% 0.63 / 0.77 / -18.5%
clickbench_q06/duckdb:parquet 14765736 / 15307928 / -3.5% 26634707 / 22622893 / +17.7% 🔴 0.55 / 0.68 / -18.1%
clickbench_q07/duckdb:parquet 11218742 / 10148460 / +10.5% 🔴 20748598 / 26126737 / -20.6% 🟢 0.54 / 0.39 / +39.2%
clickbench_q08/duckdb:parquet 85080654 / 85797215 / -0.8% 137382721 / 126177576 / +8.9% 0.62 / 0.68 / -8.9%
clickbench_q09/duckdb:parquet 114762466 / 117428328 / -2.3% 156099634 / 167254886 / -6.7% 0.74 / 0.70 / +4.7%
clickbench_q10/duckdb:parquet 32284675 / 32811760 / -1.6% 68689576 / 67774214 / +1.4% 0.47 / 0.48 / -2.9%
clickbench_q11/duckdb:parquet 36521538 / 36997368 / -1.3% 76864188 / 75040599 / +2.4% 0.48 / 0.49 / -3.6%
clickbench_q12/duckdb:parquet 92553434 / 90301820 / +2.5% 132051269 / 137858165 / -4.2% 0.70 / 0.66 / +7.0%
clickbench_q13/duckdb:parquet 149503680 / 147888332 / +1.1% 204105960 / 214643373 / -4.9% 0.73 / 0.69 / +6.3%
clickbench_q14/duckdb:parquet 95775836 / 95724041 / +0.1% 136729652 / 144311501 / -5.3% 0.70 / 0.66 / +5.6%
clickbench_q15/duckdb:parquet 93114682 / 92687706 / +0.5% 120649475 / 117805859 / +2.4% 0.77 / 0.79 / -1.9%
clickbench_q16/duckdb:parquet 168151063 / 172737910 / -2.7% 236535609 / 225432779 / +4.9% 0.71 / 0.77 / -7.2%
clickbench_q17/duckdb:parquet 171368286 / 179658830 / -4.6% 230818651 / 232046018 / -0.5% 0.74 / 0.77 / -4.1%
clickbench_q18/duckdb:parquet 314668010 / 324712342 / -3.1% 396840890 / 401212718 / -1.1% 0.79 / 0.81 / -2.0%
clickbench_q19/duckdb:parquet 13184299 / 13893066 / -5.1% 40748669 / 40737776 / +0.0% 0.32 / 0.34 / -5.1%
clickbench_q20/duckdb:parquet 133264526 / 138239740 / -3.6% 248023027 / 242234660 / +2.4% 0.54 / 0.57 / -5.8%
clickbench_q21/duckdb:parquet 175859156 / 177044165 / -0.7% 329362868 / 324783647 / +1.4% 0.53 / 0.55 / -2.1%
clickbench_q22/duckdb:parquet 237113865 / 237288884 / -0.1% 415558881 / 419494544 / -0.9% 0.57 / 0.57 / +0.9%
clickbench_q23/duckdb:parquet 146243356 / 147409858 / -0.8% 167485939 / 168964980 / -0.9% 0.87 / 0.87 / +0.1%
clickbench_q24/duckdb:parquet 42903154 / 43939671 / -2.4% 60826185 / 62243172 / -2.3% 0.71 / 0.71 / -0.1%
clickbench_q25/duckdb:parquet 39642459 / 39621939 / +0.1% 91564855 / 91922502 / -0.4% 0.43 / 0.43 / +0.4%
clickbench_q26/duckdb:parquet 30198052 / 31994067 / -5.6% 45839255 / 48077122 / -4.7% 0.66 / 0.67 / -1.0%
clickbench_q27/duckdb:parquet 143931588 / 145200465 / -0.9% 254019001 / 258036618 / -1.6% 0.57 / 0.56 / +0.7%
clickbench_q28/duckdb:parquet 902124813 / 903844380 / -0.2% 975537729 / 978490638 / -0.3% 0.92 / 0.92 / +0.1%
clickbench_q29/duckdb:parquet 16890310 / 16686202 / +1.2% 29780938 / 32155268 / -7.4% 0.57 / 0.52 / +9.3%
clickbench_q30/duckdb:parquet 90102130 / 92153532 / -2.2% 175761517 / 170541690 / +3.1% 0.51 / 0.54 / -5.1%
clickbench_q31/duckdb:parquet 143155545 / 145102732 / -1.3% 292094883 / 291966719 / +0.0% 0.49 / 0.50 / -1.4%
clickbench_q32/duckdb:parquet 455860632 / 450587114 / +1.2% 527909695 / 496836853 / +6.3% 0.86 / 0.91 / -4.8%
clickbench_q33/duckdb:parquet 458064988 / 431087906 / +6.3% 471332039 / 465853391 / +1.2% 0.97 / 0.93 / +5.0%
clickbench_q34/duckdb:parquet 450815254 / 451922634 / -0.2% 486047847 / 471361918 / +3.1% 0.93 / 0.96 / -3.3%
clickbench_q35/duckdb:parquet 99610342 / 98966656 / +0.7% 133635741 / 120335501 / +11.1% 🔴 0.75 / 0.82 / -9.4%
clickbench_q36/duckdb:parquet 30586772 / 31327620 / -2.4% 41893165 / 41642834 / +0.6% 0.73 / 0.75 / -2.9%
clickbench_q37/duckdb:parquet 23069756 / 22809704 / +1.1% 30999026 / 31963489 / -3.0% 0.74 / 0.71 / +4.3%
clickbench_q38/duckdb:parquet 23928644 / 24825154 / -3.6% 34278213 / 35972486 / -4.7% 0.70 / 0.69 / +1.2%
clickbench_q39/duckdb:parquet 56879800 / 56891349 / -0.0% 66212939 / 67107985 / -1.3% 0.86 / 0.85 / +1.3%
clickbench_q40/duckdb:parquet 12788280 / 12992570 / -1.6% 31681811 / 23516343 / +34.7% 🔴 0.40 / 0.55 / -26.9%
clickbench_q41/duckdb:parquet 13191708 / 12606942 / +4.6% 22412225 / 22461829 / -0.2% 0.59 / 0.56 / +4.9%
clickbench_q42/duckdb:parquet 14993374 / 14626797 / +2.5% 24706045 / 29401073 / -16.0% 🟢 0.61 / 0.50 / +22.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.9%, environment too noisy confidence)
Vortex (geomean): hot 0.994x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.991x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92458620 / 90820898 / +1.8% 165840098 / 165886182 / -0.0% 0.56 / 0.55 / +1.8%
tpch_q02/datafusion:vortex-file-compressed 65456866 / 64977430 / +0.7% 91695217 / 93601005 / -2.0% 0.71 / 0.69 / +2.8%
tpch_q03/datafusion:vortex-file-compressed 66931252 / 66247635 / +1.0% 114239217 / 115026920 / -0.7% 0.59 / 0.58 / +1.7%
tpch_q04/datafusion:vortex-file-compressed 35415957 / 35992215 / -1.6% 74175429 / 74436884 / -0.4% 0.48 / 0.48 / -1.3%
tpch_q05/datafusion:vortex-file-compressed 116473554 / 121271407 / -4.0% 169900067 / 177313927 / -4.2% 0.69 / 0.68 / +0.2%
tpch_q06/datafusion:vortex-file-compressed 14566905 / 14815250 / -1.7% 72498746 / 68509589 / +5.8% 0.20 / 0.22 / -7.1%
tpch_q07/datafusion:vortex-file-compressed 140841028 / 143189355 / -1.6% 192833174 / 189926327 / +1.5% 0.73 / 0.75 / -3.1%
tpch_q08/datafusion:vortex-file-compressed 145429448 / 150267771 / -3.2% 209908256 / 202725357 / +3.5% 0.69 / 0.74 / -6.5%
tpch_q09/datafusion:vortex-file-compressed 187311880 / 186568590 / +0.4% 249842428 / 252058546 / -0.9% 0.75 / 0.74 / +1.3%
tpch_q10/datafusion:vortex-file-compressed 76018594 / 75483044 / +0.7% 133881515 / 127104867 / +5.3% 0.57 / 0.59 / -4.4%
tpch_q11/datafusion:vortex-file-compressed 43422314 / 43621570 / -0.5% 67172812 / 67037556 / +0.2% 0.65 / 0.65 / -0.7%
tpch_q12/datafusion:vortex-file-compressed 46536769 / 47690234 / -2.4% 94884660 / 88861273 / +6.8% 0.49 / 0.54 / -8.6%
tpch_q13/datafusion:vortex-file-compressed 46622446 / 47913130 / -2.7% 77435721 / 77134982 / +0.4% 0.60 / 0.62 / -3.1%
tpch_q14/datafusion:vortex-file-compressed 24916543 / 24635208 / +1.1% 97958108 / 97459722 / +0.5% 0.25 / 0.25 / +0.6%
tpch_q15/datafusion:vortex-file-compressed 36952384 / 36948023 / +0.0% 97893571 / 103067839 / -5.0% 0.38 / 0.36 / +5.3%
tpch_q16/datafusion:vortex-file-compressed 37837169 / 37821751 / +0.0% 64369232 / 64879722 / -0.8% 0.59 / 0.58 / +0.8%
tpch_q17/datafusion:vortex-file-compressed 177470019 / 179856187 / -1.3% 225058245 / 227238383 / -1.0% 0.79 / 0.79 / -0.4%
tpch_q18/datafusion:vortex-file-compressed 202402711 / 201565470 / +0.4% 258350719 / 253734601 / +1.8% 0.78 / 0.79 / -1.4%
tpch_q19/datafusion:vortex-file-compressed 39409296 / 39605585 / -0.5% 97815594 / 93256445 / +4.9% 0.40 / 0.42 / -5.1%
tpch_q20/datafusion:vortex-file-compressed 62779915 / 62805341 / -0.0% 124875920 / 127113522 / -1.8% 0.50 / 0.49 / +1.8%
tpch_q21/datafusion:vortex-file-compressed 181010905 / 181663102 / -0.4% 228887147 / 237413157 / -3.6% 0.79 / 0.77 / +3.4%
tpch_q22/datafusion:vortex-file-compressed 25435932 / 25418392 / +0.1% 52586337 / 54807368 / -4.1% 0.48 / 0.46 / +4.3%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83316953 / 83274967 / +0.1% 138500541 / 135243665 / +2.4% 0.60 / 0.62 / -2.3%
tpch_q02/datafusion:parquet 135956238 / 134625250 / +1.0% 166070391 / 167210263 / -0.7% 0.82 / 0.81 / +1.7%
tpch_q03/datafusion:parquet 125378087 / 125056387 / +0.3% 198635878 / 196136661 / +1.3% 0.63 / 0.64 / -1.0%
tpch_q04/datafusion:parquet 52835294 / 53501234 / -1.2% 109848081 / 108187926 / +1.5% 0.48 / 0.49 / -2.7%
tpch_q05/datafusion:parquet 163557708 / 164356938 / -0.5% 243182803 / 244381529 / -0.5% 0.67 / 0.67 / +0.0%
tpch_q06/datafusion:parquet 32035727 / 32036743 / -0.0% 84892306 / 85301565 / -0.5% 0.38 / 0.38 / +0.5%
tpch_q07/datafusion:parquet 213430988 / 213426079 / +0.0% 293943146 / 293993798 / -0.0% 0.73 / 0.73 / +0.0%
tpch_q08/datafusion:parquet 209447742 / 210001017 / -0.3% 290722340 / 302722068 / -4.0% 0.72 / 0.69 / +3.9%
tpch_q09/datafusion:parquet 283229901 / 282604986 / +0.2% 354421507 / 356359490 / -0.5% 0.80 / 0.79 / +0.8%
tpch_q10/datafusion:parquet 302163388 / 304858219 / -0.9% 362252848 / 366678882 / -1.2% 0.83 / 0.83 / +0.3%
tpch_q11/datafusion:parquet 96246627 / 96306895 / -0.1% 119555864 / 121780508 / -1.8% 0.81 / 0.79 / +1.8%
tpch_q12/datafusion:parquet 78645658 / 78813598 / -0.2% 131373561 / 131029794 / +0.3% 0.60 / 0.60 / -0.5%
tpch_q13/datafusion:parquet 194902102 / 194814722 / +0.0% 228353829 / 227549321 / +0.4% 0.85 / 0.86 / -0.3%
tpch_q14/datafusion:parquet 74322191 / 74392648 / -0.1% 183159829 / 176861974 / +3.6% 0.41 / 0.42 / -3.5%
tpch_q15/datafusion:parquet 77254827 / 78308531 / -1.3% 137770102 / 140017933 / -1.6% 0.56 / 0.56 / +0.3%
tpch_q16/datafusion:parquet 84384682 / 84498068 / -0.1% 108885495 / 109993687 / -1.0% 0.77 / 0.77 / +0.9%
tpch_q17/datafusion:parquet 204976301 / 210184181 / -2.5% 265951639 / 262964185 / +1.1% 0.77 / 0.80 / -3.6%
tpch_q18/datafusion:parquet 260706668 / 264168516 / -1.3% 319492520 / 315555359 / +1.2% 0.82 / 0.84 / -2.5%
tpch_q19/datafusion:parquet 98323390 / 97883600 / +0.4% 176729031 / 174095028 / +1.5% 0.56 / 0.56 / -1.0%
tpch_q20/datafusion:parquet 152400816 / 151993756 / +0.3% 207326581 / 218258543 / -5.0% 0.74 / 0.70 / +5.6%
tpch_q21/datafusion:parquet 228885411 / 229311783 / -0.2% 304773253 / 308476509 / -1.2% 0.75 / 0.74 / +1.0%
tpch_q22/datafusion:parquet 160732995 / 161195907 / -0.3% 184699244 / 185434088 / -0.4% 0.87 / 0.87 / +0.1%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 56308823 / 54584132 / +3.2% 96637745 / 90663331 / +6.6% 0.58 / 0.60 / -3.2%
tpch_q02/duckdb:vortex-file-compressed 32191454 / 32995621 / -2.4% 47490965 / 48184806 / -1.4% 0.68 / 0.68 / -1.0%
tpch_q03/duckdb:vortex-file-compressed 60848146 / 58755170 / +3.6% 97810237 / 99671865 / -1.9% 0.62 / 0.59 / +5.5%
tpch_q04/duckdb:vortex-file-compressed 80321245 / 81026854 / -0.9% 112872691 / 111607427 / +1.1% 0.71 / 0.73 / -2.0%
tpch_q05/duckdb:vortex-file-compressed 64585731 / 65297324 / -1.1% 104573119 / 108545468 / -3.7% 0.62 / 0.60 / +2.7%
tpch_q06/duckdb:vortex-file-compressed 21912603 / 22287554 / -1.7% 58985792 / 58008778 / +1.7% 0.37 / 0.38 / -3.3%
tpch_q07/duckdb:vortex-file-compressed 61092937 / 61885510 / -1.3% 120293415 / 118121418 / +1.8% 0.51 / 0.52 / -3.1%
tpch_q08/duckdb:vortex-file-compressed 86110961 / 86201355 / -0.1% 137975771 / 148574215 / -7.1% 0.62 / 0.58 / +7.6%
tpch_q09/duckdb:vortex-file-compressed 165076520 / 168837489 / -2.2% 222766493 / 227286590 / -2.0% 0.74 / 0.74 / -0.2%
tpch_q10/duckdb:vortex-file-compressed 114886022 / 116151395 / -1.1% 189571780 / 187941249 / +0.9% 0.61 / 0.62 / -1.9%
tpch_q11/duckdb:vortex-file-compressed 17111062 / 17307399 / -1.1% 30154995 / 31715655 / -4.9% 0.57 / 0.55 / +4.0%
tpch_q12/duckdb:vortex-file-compressed 54117502 / 56706062 / -4.6% 84355052 / 84736859 / -0.5% 0.64 / 0.67 / -4.1%
tpch_q13/duckdb:vortex-file-compressed 91428859 / 92327670 / -1.0% 130153207 / 123806139 / +5.1% 0.70 / 0.75 / -5.8%
tpch_q14/duckdb:vortex-file-compressed 32063184 / 30688233 / +4.5% 78768125 / 76019022 / +3.6% 0.41 / 0.40 / +0.8%
tpch_q15/duckdb:vortex-file-compressed 37408506 / 38873483 / -3.8% 83219084 / 85560524 / -2.7% 0.45 / 0.45 / -1.1%
tpch_q16/duckdb:vortex-file-compressed 42200069 / 42873068 / -1.6% 55638923 / 54732637 / +1.7% 0.76 / 0.78 / -3.2%
tpch_q17/duckdb:vortex-file-compressed 68128434 / 63283127 / +7.7% 128989660 / 137298396 / -6.1% 0.53 / 0.46 / +14.6%
tpch_q18/duckdb:vortex-file-compressed 131451036 / 134743892 / -2.4% 149533753 / 149733226 / -0.1% 0.88 / 0.90 / -2.3%
tpch_q19/duckdb:vortex-file-compressed 44452232 / 47878646 / -7.2% 111296833 / 111027758 / +0.2% 0.40 / 0.43 / -7.4%
tpch_q20/duckdb:vortex-file-compressed 59360586 / 60188782 / -1.4% 115465678 / 109906615 / +5.1% 0.51 / 0.55 / -6.1%
tpch_q21/duckdb:vortex-file-compressed 242471027 / 245888520 / -1.4% 272865811 / 278578996 / -2.1% 0.89 / 0.88 / +0.7%
tpch_q22/duckdb:vortex-file-compressed 41998666 / 40377920 / +4.0% 56519164 / 54552045 / +3.6% 0.74 / 0.74 / +0.4%
duckdb / parquet / ns (0.985x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70281494 / 71115292 / -1.2% 87308038 / 92532014 / -5.6% 0.80 / 0.77 / +4.7%
tpch_q02/duckdb:parquet 70591814 / 71101050 / -0.7% 80960140 / 81074196 / -0.1% 0.87 / 0.88 / -0.6%
tpch_q03/duckdb:parquet 111823555 / 114979737 / -2.7% 161950481 / 150029659 / +7.9% 0.69 / 0.77 / -9.9%
tpch_q04/duckdb:parquet 74505295 / 75013021 / -0.7% 100092900 / 104485463 / -4.2% 0.74 / 0.72 / +3.7%
tpch_q05/duckdb:parquet 124454584 / 125918215 / -1.2% 161926124 / 170438826 / -5.0% 0.77 / 0.74 / +4.0%
tpch_q06/duckdb:parquet 34091118 / 42692368 / -20.1% 🟢 49520739 / 50883808 / -2.7% 0.69 / 0.84 / -17.9%
tpch_q07/duckdb:parquet 90074129 / 90561276 / -0.5% 129388054 / 136366977 / -5.1% 0.70 / 0.66 / +4.8%
tpch_q08/duckdb:parquet 142084846 / 143336896 / -0.9% 186517717 / 188283092 / -0.9% 0.76 / 0.76 / +0.1%
tpch_q09/duckdb:parquet 220755673 / 224168538 / -1.5% 261900280 / 264927649 / -1.1% 0.84 / 0.85 / -0.4%
tpch_q10/duckdb:parquet 471341797 / 474462090 / -0.7% 507986651 / 522005040 / -2.7% 0.93 / 0.91 / +2.1%
tpch_q11/duckdb:parquet 30838799 / 30983652 / -0.5% 38145605 / 36886598 / +3.4% 0.81 / 0.84 / -3.8%
tpch_q12/duckdb:parquet 75378700 / 75373985 / +0.0% 91219877 / 100345912 / -9.1% 0.83 / 0.75 / +10.0%
tpch_q13/duckdb:parquet 316016563 / 320886024 / -1.5% 331614626 / 331194174 / +0.1% 0.95 / 0.97 / -1.6%
tpch_q14/duckdb:parquet 105810559 / 106760161 / -0.9% 138792133 / 135945597 / +2.1% 0.76 / 0.79 / -2.9%
tpch_q15/duckdb:parquet 43385596 / 44173056 / -1.8% 67437360 / 66689900 / +1.1% 0.64 / 0.66 / -2.9%
tpch_q16/duckdb:parquet 114492338 / 114604726 / -0.1% 124044919 / 124678325 / -0.5% 0.92 / 0.92 / +0.4%
tpch_q17/duckdb:parquet 76687503 / 75961370 / +1.0% 100384513 / 102118493 / -1.7% 0.76 / 0.74 / +2.7%
tpch_q18/duckdb:parquet 209022162 / 198901728 / +5.1% 192905260 / 166413623 / +15.9% 🔴 1.08 / 1.20 / -9.3%
tpch_q19/duckdb:parquet 162547201 / 163736625 / -0.7% 197680603 / 212278581 / -6.9% 0.82 / 0.77 / +6.6%
tpch_q20/duckdb:parquet 128743126 / 128865063 / -0.1% 163448302 / 162057373 / +0.9% 0.79 / 0.80 / -0.9%
tpch_q21/duckdb:parquet 271101955 / 274141418 / -1.1% 291300553 / 303955991 / -4.2% 0.93 / 0.90 / +3.2%
tpch_q22/duckdb:parquet 260441752 / 261588099 / -0.4% 271295831 / 270830319 / +0.2% 0.96 / 0.97 / -0.6%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+5.1%, environment too noisy confidence) · DuckDB No clear signal (-3.5%, environment too noisy confidence)
Vortex (geomean): hot 1.066x ➖ · cold 1.078x ➖
Parquet (geomean): hot 1.059x ➖ · cold 1.186x ➖
Shifts: Parquet (control) +5.9% · Median polish +4.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.145x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 39048328 / 39917712 / -2.2% 147850976 / 161557890 / -8.5% 0.26 / 0.25 / +6.9%
fineweb_q01/datafusion:vortex-file-compressed 409273595 / 372581638 / +9.8% 710369833 / 622215577 / +14.2% 0.58 / 0.60 / -3.8%
fineweb_q02/datafusion:vortex-file-compressed 371294298 / 376366049 / -1.3% 617327428 / 510966246 / +20.8% 0.60 / 0.74 / -18.3%
fineweb_q03/datafusion:vortex-file-compressed 492987607 / 470138663 / +4.9% 895192586 / 619327536 / +44.5% 🔴 0.55 / 0.76 / -27.5%
fineweb_q04/datafusion:vortex-file-compressed 442876210 / 392816606 / +12.7% 467498643 / 433424413 / +7.9% 0.95 / 0.91 / +4.5%
fineweb_q05/datafusion:vortex-file-compressed 526159102 / 506622453 / +3.9% 715160131 / 655422314 / +9.1% 0.74 / 0.77 / -4.8%
fineweb_q06/datafusion:vortex-file-compressed 950282382 / 666066418 / +42.7% 🔴 819865429 / 652553045 / +25.6% 1.16 / 1.02 / +13.6%
fineweb_q07/datafusion:vortex-file-compressed 897950732 / 496785093 / +80.8% 🔴 815666042 / 494706700 / +64.9% 🔴 1.10 / 1.00 / +9.6%
fineweb_q08/datafusion:vortex-file-compressed 178056574 / 176496584 / +0.9% 223514017 / 176175825 / +26.9% 0.80 / 1.00 / -20.5%
datafusion / parquet / ns (1.090x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 455362354 / 461682347 / -1.4% 718994442 / 803396860 / -10.5% 0.63 / 0.57 / +10.2%
fineweb_q01/datafusion:parquet 1028773858 / 732417650 / +40.5% 🔴 1353536537 / 675677647 / +100.3% 🔴 0.76 / 1.08 / -29.9%
fineweb_q02/datafusion:parquet 678623925 / 743034332 / -8.7% 636046115 / 758352608 / -16.1% 1.07 / 0.98 / +8.9%
fineweb_q03/datafusion:parquet 708457466 / 876350986 / -19.2% 632188873 / 1024376222 / -38.3% 🟢 1.12 / 0.86 / +31.0%
fineweb_q04/datafusion:parquet 837096100 / 619458173 / +35.1% 🔴 741711905 / 653834532 / +13.4% 1.13 / 0.95 / +19.1%
fineweb_q05/datafusion:parquet 1068438588 / 841585164 / +27.0% 974370984 / 633925078 / +53.7% 🔴 1.10 / 1.33 / -17.4%
fineweb_q06/datafusion:parquet 755215906 / 736548016 / +2.5% 823565964 / 737318380 / +11.7% 0.92 / 1.00 / -8.2%
fineweb_q07/datafusion:parquet 823699914 / 744775388 / +10.6% 775755988 / 611778082 / +26.8% 1.06 / 1.22 / -12.8%
fineweb_q08/datafusion:parquet 727554880 / 666876196 / +9.1% 649086683 / 598261338 / +8.5% 1.12 / 1.11 / +0.6%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 58745215 / 59628790 / -1.5% 49156233 / 61389578 / -19.9% 1.20 / 0.97 / +23.0%
fineweb_q01/duckdb:vortex-file-compressed 426437904 / 409618806 / +4.1% 446080420 / 432751630 / +3.1% 0.96 / 0.95 / +1.0%
fineweb_q02/duckdb:vortex-file-compressed 597553244 / 573809825 / +4.1% 634590913 / 622345672 / +2.0% 0.94 / 0.92 / +2.1%
fineweb_q03/duckdb:vortex-file-compressed 973053831 / 1015161986 / -4.1% 1005133330 / 1293772039 / -22.3% 0.97 / 0.78 / +23.4%
fineweb_q04/duckdb:vortex-file-compressed 988233267 / 1000973235 / -1.3% 953861837 / 1006719379 / -5.3% 1.04 / 0.99 / +4.2%
fineweb_q05/duckdb:vortex-file-compressed 910307252 / 922512386 / -1.3% 1009072058 / 950566066 / +6.2% 0.90 / 0.97 / -7.0%
fineweb_q06/duckdb:vortex-file-compressed 1161998062 / 1174516252 / -1.1% 1275662024 / 1220261347 / +4.5% 0.91 / 0.96 / -5.4%
fineweb_q07/duckdb:vortex-file-compressed 946425046 / 1001182092 / -5.5% 998473607 / 1060618022 / -5.9% 0.95 / 0.94 / +0.4%
fineweb_q08/duckdb:vortex-file-compressed 436185032 / 432607551 / +0.8% 516115331 / 484453879 / +6.5% 0.85 / 0.89 / -5.4%
duckdb / parquet / ns (1.030x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 540482410 / 519297182 / +4.1% 604166586 / 527230794 / +14.6% 0.89 / 0.98 / -9.2%
fineweb_q01/duckdb:parquet 577505691 / 669215350 / -13.7% 1642126375 / 585903712 / +180.3% 🔴 0.35 / 1.14 / -69.2%
fineweb_q02/duckdb:parquet 576912106 / 538262144 / +7.2% 581733525 / 767185253 / -24.2% 0.99 / 0.70 / +41.3%
fineweb_q03/duckdb:parquet 1335547622 / 1297326239 / +2.9% 1291327250 / 1212103192 / +6.5% 1.03 / 1.07 / -3.4%
fineweb_q04/duckdb:parquet 816954032 / 795626421 / +2.7% 1044171076 / 704113486 / +48.3% 🔴 0.78 / 1.13 / -30.8%
fineweb_q05/duckdb:parquet 916201400 / 840480708 / +9.0% 1051030262 / 870053184 / +20.8% 0.87 / 0.97 / -9.8%
fineweb_q06/duckdb:parquet 1618727893 / 1603242239 / +1.0% 1977139273 / 1632922955 / +21.1% 0.82 / 0.98 / -16.6%
fineweb_q07/duckdb:parquet 1074857830 / 1059735560 / +1.4% 1336207932 / 989318083 / +35.1% 🔴 0.80 / 1.07 / -24.9%
fineweb_q08/duckdb:parquet 510733436 / 446215071 / +14.5% 543401678 / 476311099 / +14.1% 0.94 / 0.94 / +0.3%

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.005x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9107440 / 9072564 / +0.4% 9529680 / 9527202 / +0.0% 0.96 / 0.95 / +0.4%
statpopgen_q01/duckdb:vortex-file-compressed 10458690 / 10525758 / -0.6% 16026941 / 15979348 / +0.3% 0.65 / 0.66 / -0.9%
statpopgen_q02/duckdb:vortex-file-compressed 382902240 / 377120486 / +1.5% 397157045 / 392405226 / +1.2% 0.96 / 0.96 / +0.3%
statpopgen_q03/duckdb:vortex-file-compressed 888803446 / 893823973 / -0.6% 901370673 / 897631069 / +0.4% 0.99 / 1.00 / -1.0%
statpopgen_q04/duckdb:vortex-file-compressed 890710494 / 890306560 / +0.0% 919391677 / 899942007 / +2.2% 0.97 / 0.99 / -2.1%
statpopgen_q05/duckdb:vortex-file-compressed 425019124 / 424274456 / +0.2% 438621059 / 436771600 / +0.4% 0.97 / 0.97 / -0.2%
statpopgen_q06/duckdb:vortex-file-compressed 1169011266 / 1168878904 / +0.0% 1178222288 / 1167502218 / +0.9% 0.99 / 1.00 / -0.9%
statpopgen_q07/duckdb:vortex-file-compressed 185214738 / 185668528 / -0.2% 211733626 / 220871668 / -4.1% 0.87 / 0.84 / +4.1%
statpopgen_q08/duckdb:vortex-file-compressed 198720843 / 197900960 / +0.4% 230062081 / 217391756 / +5.8% 0.86 / 0.91 / -5.1%
statpopgen_q09/duckdb:vortex-file-compressed 725882540 / 718844867 / +1.0% 740619638 / 754079591 / -1.8% 0.98 / 0.95 / +2.8%
statpopgen_q10/duckdb:vortex-file-compressed 2001482783 / 2011810453 / -0.5% 1979667505 / 1967191953 / +0.6% 1.01 / 1.02 / -1.1%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 244658937 / 249018460 / -1.8% 243734814 / 247088781 / -1.4% 1.00 / 1.01 / -0.4%
statpopgen_q01/duckdb:parquet 306132193 / 305350408 / +0.3% 310079802 / 309164049 / +0.3% 0.99 / 0.99 / -0.0%
statpopgen_q02/duckdb:parquet 547749589 / 537209138 / +2.0% 542880380 / 560586733 / -3.2% 1.01 / 0.96 / +5.3%
statpopgen_q03/duckdb:parquet 917082382 / 851554926 / +7.7% 906833387 / 843651249 / +7.5% 1.01 / 1.01 / +0.2%
statpopgen_q04/duckdb:parquet 797733747 / 858387062 / -7.1% 809178744 / 882966865 / -8.4% 0.99 / 0.97 / +1.4%
statpopgen_q05/duckdb:parquet 580417093 / 567488334 / +2.3% 569322760 / 583080985 / -2.4% 1.02 / 0.97 / +4.7%
statpopgen_q06/duckdb:parquet 689686293 / 749844737 / -8.0% 693349018 / 740801914 / -6.4% 0.99 / 1.01 / -1.7%
statpopgen_q07/duckdb:parquet 620882032 / 614712082 / +1.0% 705018356 / 676817800 / +4.2% 0.88 / 0.91 / -3.0%
statpopgen_q08/duckdb:parquet 622125348 / 626206458 / -0.7% 710737890 / 678214720 / +4.8% 0.88 / 0.92 / -5.2%
statpopgen_q09/duckdb:parquet 801530318 / 815065448 / -1.7% 819552048 / 821769900 / -0.3% 0.98 / 0.99 / -1.4%
statpopgen_q10/duckdb:parquet 1463710782 / 1520327274 / -3.7% 1268062809 / 1350427775 / -6.1% 1.15 / 1.13 / +2.5%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (-0.8%, environment too noisy confidence) · DuckDB No clear signal (+3.8%, environment too noisy confidence)
Vortex (geomean): hot 1.087x ➖ · cold 1.068x ➖
Parquet (geomean): hot 1.071x ➖ · cold 1.123x ➖
Shifts: Parquet (control) +7.1% · Median polish +4.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.092x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 43416622 / 54345820 / -20.1% 180855498 / 130622038 / +38.5% 🔴 0.24 / 0.42 / -42.3%
fineweb_q01/datafusion:vortex-compact 511479640 / 355507852 / +43.9% 🔴 683741500 / 624668013 / +9.5% 0.75 / 0.57 / +31.4%
fineweb_q02/datafusion:vortex-compact 567711390 / 367183554 / +54.6% 🔴 586883618 / 480442272 / +22.2% 0.97 / 0.76 / +26.6%
fineweb_q03/datafusion:vortex-compact 531586835 / 552423151 / -3.8% 651302754 / 633761180 / +2.8% 0.82 / 0.87 / -6.4%
fineweb_q04/datafusion:vortex-compact 460594034 / 444219130 / +3.7% 513077296 / 478450290 / +7.2% 0.90 / 0.93 / -3.3%
fineweb_q05/datafusion:vortex-compact 417165319 / 566903633 / -26.4% 414371207 / 684744120 / -39.5% 🟢 1.01 / 0.83 / +21.6%
fineweb_q06/datafusion:vortex-compact 696883956 / 630774900 / +10.5% 807204121 / 707689643 / +14.1% 0.86 / 0.89 / -3.1%
fineweb_q07/datafusion:vortex-compact 566685812 / 487429350 / +16.3% 465417510 / 424742134 / +9.6% 1.22 / 1.15 / +6.1%
fineweb_q08/datafusion:vortex-compact 215266014 / 163245544 / +31.9% 🔴 331602153 / 168845221 / +96.4% 🔴 0.65 / 0.97 / -32.9%
datafusion / parquet / ns (1.101x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 394063664 / 461682347 / -14.6% 810021671 / 803396860 / +0.8% 0.49 / 0.57 / -15.3%
fineweb_q01/datafusion:parquet 791455648 / 732417650 / +8.1% 899632458 / 675677647 / +33.1% 🔴 0.88 / 1.08 / -18.8%
fineweb_q02/datafusion:parquet 790897562 / 743034332 / +6.4% 902507821 / 758352608 / +19.0% 0.88 / 0.98 / -10.6%
fineweb_q03/datafusion:parquet 708777526 / 876350986 / -19.1% 623652479 / 1024376222 / -39.1% 🟢 1.14 / 0.86 / +32.8%
fineweb_q04/datafusion:parquet 781643000 / 619458173 / +26.2% 748814496 / 653834532 / +14.5% 1.04 / 0.95 / +10.2%
fineweb_q05/datafusion:parquet 748944525 / 841585164 / -11.0% 776051157 / 633925078 / +22.4% 0.97 / 1.33 / -27.3%
fineweb_q06/datafusion:parquet 1016142748 / 736548016 / +38.0% 🔴 891033726 / 737318380 / +20.8% 1.14 / 1.00 / +14.2%
fineweb_q07/datafusion:parquet 895140019 / 744775388 / +20.2% 1219659857 / 611778082 / +99.4% 🔴 0.73 / 1.22 / -39.7%
fineweb_q08/datafusion:parquet 1069735740 / 666876196 / +60.4% 🔴 861984257 / 598261338 / +44.1% 🔴 1.24 / 1.11 / +11.3%
duckdb / vortex-compact / ns (1.082x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 73266141 / 64930229 / +12.8% 55340296 / 66642727 / -17.0% 1.32 / 0.97 / +35.9%
fineweb_q01/duckdb:vortex-compact 385816066 / 424815043 / -9.2% 418019371 / 452730962 / -7.7% 0.92 / 0.94 / -1.6%
fineweb_q02/duckdb:vortex-compact 525679956 / 538800405 / -2.4% 584583898 / 550350435 / +6.2% 0.90 / 0.98 / -8.1%
fineweb_q03/duckdb:vortex-compact 1189738694 / 1046290550 / +13.7% 1376924803 / 1226240860 / +12.3% 0.86 / 0.85 / +1.3%
fineweb_q04/duckdb:vortex-compact 1118987054 / 1089598569 / +2.7% 1024773053 / 1083226259 / -5.4% 1.09 / 1.01 / +8.6%
fineweb_q05/duckdb:vortex-compact 1236268184 / 864113455 / +43.1% 🔴 1129486302 / 1090205228 / +3.6% 1.09 / 0.79 / +38.1%
fineweb_q06/duckdb:vortex-compact 1116695749 / 1101230288 / +1.4% 1344558600 / 1160688805 / +15.8% 0.83 / 0.95 / -12.5%
fineweb_q07/duckdb:vortex-compact 1001092470 / 927688311 / +7.9% 1014418925 / 1013095245 / +0.1% 0.99 / 0.92 / +7.8%
fineweb_q08/duckdb:vortex-compact 392938350 / 354323468 / +10.9% 425613035 / 413183510 / +3.0% 0.92 / 0.86 / +7.7%
duckdb / parquet / ns (1.042x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 509249728 / 519297182 / -1.9% 506650356 / 527230794 / -3.9% 1.01 / 0.98 / +2.0%
fineweb_q01/duckdb:parquet 624109666 / 669215350 / -6.7% 575678180 / 585903712 / -1.7% 1.08 / 1.14 / -5.1%
fineweb_q02/duckdb:parquet 579704450 / 538262144 / +7.7% 596229906 / 767185253 / -22.3% 0.97 / 0.70 / +38.6%
fineweb_q03/duckdb:parquet 1440519130 / 1297326239 / +11.0% 1413532792 / 1212103192 / +16.6% 1.02 / 1.07 / -4.8%
fineweb_q04/duckdb:parquet 764698424 / 795626421 / -3.9% 798080080 / 704113486 / +13.3% 0.96 / 1.13 / -15.2%
fineweb_q05/duckdb:parquet 850217342 / 840480708 / +1.2% 878946214 / 870053184 / +1.0% 0.97 / 0.97 / +0.1%
fineweb_q06/duckdb:parquet 1656653284 / 1603242239 / +3.3% 1758091671 / 1632922955 / +7.7% 0.94 / 0.98 / -4.0%
fineweb_q07/duckdb:parquet 1084691028 / 1059735560 / +2.4% 1117822744 / 989318083 / +13.0% 0.97 / 1.07 / -9.4%
fineweb_q08/duckdb:parquet 576318486 / 446215071 / +29.2% 678778834 / 476311099 / +42.5% 🔴 0.85 / 0.94 / -9.4%

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.988x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.995x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25536960 / 25959268 / -1.6% 42908717 / 44327747 / -3.2% 0.60 / 0.59 / +1.6%
tpcds_q02/datafusion:vortex-compact 48968414 / 48400502 / +1.2% 62651796 / 65494711 / -4.3% 0.78 / 0.74 / +5.8%
tpcds_q03/datafusion:vortex-compact 13285144 / 12860004 / +3.3% 30586225 / 32814269 / -6.8% 0.43 / 0.39 / +10.8%
tpcds_q04/datafusion:vortex-compact 123918422 / 121194836 / +2.2% 147837234 / 147335514 / +0.3% 0.84 / 0.82 / +1.9%
tpcds_q05/datafusion:vortex-compact 61677545 / 61518899 / +0.3% 82470578 / 82019287 / +0.6% 0.75 / 0.75 / -0.3%
tpcds_q06/datafusion:vortex-compact 26350922 / 26030892 / +1.2% 44391763 / 44506576 / -0.3% 0.59 / 0.58 / +1.5%
tpcds_q07/datafusion:vortex-compact 34724909 / 34406162 / +0.9% 54555293 / 56081935 / -2.7% 0.64 / 0.61 / +3.8%
tpcds_q08/datafusion:vortex-compact 30928008 / 30122962 / +2.7% 49792719 / 46713119 / +6.6% 0.62 / 0.64 / -3.7%
tpcds_q09/datafusion:vortex-compact 22161220 / 22355242 / -0.9% 38640956 / 36367447 / +6.3% 0.57 / 0.61 / -6.7%
tpcds_q10/datafusion:vortex-compact 37410276 / 36572601 / +2.3% 58472317 / 56341053 / +3.8% 0.64 / 0.65 / -1.4%
tpcds_q11/datafusion:vortex-compact 69496179 / 68749770 / +1.1% 90898537 / 88447365 / +2.8% 0.76 / 0.78 / -1.6%
tpcds_q12/datafusion:vortex-compact 20573558 / 21067833 / -2.3% 37079279 / 38639926 / -4.0% 0.55 / 0.55 / +1.8%
tpcds_q13/datafusion:vortex-compact 63562743 / 66781756 / -4.8% 92668595 / 80921993 / +14.5% 🔴 0.69 / 0.83 / -16.9%
tpcds_q14/datafusion:vortex-compact 96202438 / 96446652 / -0.3% 121729846 / 127032118 / -4.2% 0.79 / 0.76 / +4.1%
tpcds_q15/datafusion:vortex-compact 27751347 / 27171112 / +2.1% 43874244 / 45238317 / -3.0% 0.63 / 0.60 / +5.3%
tpcds_q16/datafusion:vortex-compact 24641661 / 23843490 / +3.3% 41989164 / 43163990 / -2.7% 0.59 / 0.55 / +6.2%
tpcds_q17/datafusion:vortex-compact 63785176 / 65053214 / -1.9% 81419848 / 92669285 / -12.1% 🟢 0.78 / 0.70 / +11.6%
tpcds_q18/datafusion:vortex-compact 68718228 / 68968856 / -0.4% 89102978 / 94444139 / -5.7% 0.77 / 0.73 / +5.6%
tpcds_q19/datafusion:vortex-compact 22715938 / 24147446 / -5.9% 40293932 / 41915792 / -3.9% 0.56 / 0.58 / -2.1%
tpcds_q20/datafusion:vortex-compact 22104938 / 21810125 / +1.4% 39568563 / 40619550 / -2.6% 0.56 / 0.54 / +4.0%
tpcds_q21/datafusion:vortex-compact 17824308 / 17852093 / -0.2% 40812210 / 40824745 / -0.0% 0.44 / 0.44 / -0.1%
tpcds_q22/datafusion:vortex-compact 49693554 / 49837759 / -0.3% 70963375 / 69741500 / +1.8% 0.70 / 0.71 / -2.0%
tpcds_q23/datafusion:vortex-compact 75318582 / 74123714 / +1.6% 98158568 / 102012216 / -3.8% 0.77 / 0.73 / +5.6%
tpcds_q24/datafusion:vortex-compact 79499238 / 78278892 / +1.6% 99121195 / 104242378 / -4.9% 0.80 / 0.75 / +6.8%
tpcds_q25/datafusion:vortex-compact 57337864 / 58946018 / -2.7% 86287189 / 86335065 / -0.1% 0.66 / 0.68 / -2.7%
tpcds_q26/datafusion:vortex-compact 32350375 / 33908220 / -4.6% 49999799 / 52319687 / -4.4% 0.65 / 0.65 / -0.2%
tpcds_q27/datafusion:vortex-compact 64685398 / 63365740 / +2.1% 85766437 / 82474546 / +4.0% 0.75 / 0.77 / -1.8%
tpcds_q28/datafusion:vortex-compact 28308903 / 28474348 / -0.6% 47194360 / 47805045 / -1.3% 0.60 / 0.60 / +0.7%
tpcds_q29/datafusion:vortex-compact 64023480 / 67078942 / -4.6% 84601222 / 82415887 / +2.7% 0.76 / 0.81 / -7.0%
tpcds_q30/datafusion:vortex-compact 30409474 / 29933239 / +1.6% 45864456 / 46409885 / -1.2% 0.66 / 0.64 / +2.8%
tpcds_q31/datafusion:vortex-compact 77404428 / 78407610 / -1.3% 100422394 / 100774634 / -0.3% 0.77 / 0.78 / -0.9%
tpcds_q32/datafusion:vortex-compact 16005833 / 16295005 / -1.8% 32877579 / 34376646 / -4.4% 0.49 / 0.47 / +2.7%
tpcds_q33/datafusion:vortex-compact 27493920 / 28684252 / -4.1% 51686377 / 51459884 / +0.4% 0.53 / 0.56 / -4.6%
tpcds_q34/datafusion:vortex-compact 21055586 / 21190898 / -0.6% 40743190 / 39958006 / +2.0% 0.52 / 0.53 / -2.6%
tpcds_q35/datafusion:vortex-compact 42538335 / 42434094 / +0.2% 63752562 / 64725639 / -1.5% 0.67 / 0.66 / +1.8%
tpcds_q36/datafusion:vortex-compact 50740746 / 52758208 / -3.8% 74179944 / 73562656 / +0.8% 0.68 / 0.72 / -4.6%
tpcds_q37/datafusion:vortex-compact 15240218 / 15510436 / -1.7% 37052094 / 38058850 / -2.6% 0.41 / 0.41 / +0.9%
tpcds_q38/datafusion:vortex-compact 34286019 / 33415440 / +2.6% 53394001 / 54619420 / -2.2% 0.64 / 0.61 / +5.0%
tpcds_q39/datafusion:vortex-compact 66756080 / 64783467 / +3.0% 85822382 / 86144271 / -0.4% 0.78 / 0.75 / +3.4%
tpcds_q40/datafusion:vortex-compact 27756190 / 28687104 / -3.2% 47939028 / 48440433 / -1.0% 0.58 / 0.59 / -2.2%
tpcds_q41/datafusion:vortex-compact 18570004 / 18632720 / -0.3% 31950141 / 32900500 / -2.9% 0.58 / 0.57 / +2.6%
tpcds_q42/datafusion:vortex-compact 12958079 / 12757259 / +1.6% 31313024 / 32065469 / -2.3% 0.41 / 0.40 / +4.0%
tpcds_q43/datafusion:vortex-compact 14256696 / 14412629 / -1.1% 32341389 / 33203222 / -2.6% 0.44 / 0.43 / +1.6%
tpcds_q44/datafusion:vortex-compact 30509132 / 30149617 / +1.2% 50052794 / 55261349 / -9.4% 0.61 / 0.55 / +11.7%
tpcds_q45/datafusion:vortex-compact 30456006 / 30789452 / -1.1% 48378835 / 49195881 / -1.7% 0.63 / 0.63 / +0.6%
tpcds_q46/datafusion:vortex-compact 27725844 / 27877920 / -0.5% 48366739 / 50825908 / -4.8% 0.57 / 0.55 / +4.5%
tpcds_q47/datafusion:vortex-compact 89192442 / 85986692 / +3.7% 112470018 / 111692912 / +0.7% 0.79 / 0.77 / +3.0%
tpcds_q48/datafusion:vortex-compact 50773659 / 50984658 / -0.4% 67600382 / 67113574 / +0.7% 0.75 / 0.76 / -1.1%
tpcds_q49/datafusion:vortex-compact 65765719 / 69726720 / -5.7% 92684609 / 92712493 / -0.0% 0.71 / 0.75 / -5.7%
tpcds_q50/datafusion:vortex-compact 36465350 / 36367277 / +0.3% 57183307 / 59870178 / -4.5% 0.64 / 0.61 / +5.0%
tpcds_q51/datafusion:vortex-compact 62556508 / 62356856 / +0.3% 81904945 / 83737175 / -2.2% 0.76 / 0.74 / +2.6%
tpcds_q52/datafusion:vortex-compact 13238056 / 13019872 / +1.7% 31003162 / 33281515 / -6.8% 0.43 / 0.39 / +9.1%
tpcds_q53/datafusion:vortex-compact 21028363 / 22365334 / -6.0% 41661920 / 43515154 / -4.3% 0.50 / 0.51 / -1.8%
tpcds_q54/datafusion:vortex-compact 38486890 / 39233764 / -1.9% 60567421 / 64147909 / -5.6% 0.64 / 0.61 / +3.9%
tpcds_q55/datafusion:vortex-compact 12785726 / 12578984 / +1.6% 30565708 / 32677130 / -6.5% 0.42 / 0.38 / +8.7%
tpcds_q56/datafusion:vortex-compact 30048160 / 30056592 / -0.0% 50375397 / 51492936 / -2.2% 0.60 / 0.58 / +2.2%
tpcds_q57/datafusion:vortex-compact 78644900 / 79211138 / -0.7% 102358869 / 103086990 / -0.7% 0.77 / 0.77 / -0.0%
tpcds_q58/datafusion:vortex-compact 46672040 / 46424370 / +0.5% 70051559 / 70405676 / -0.5% 0.67 / 0.66 / +1.0%
tpcds_q59/datafusion:vortex-compact 39073039 / 39962860 / -2.2% 56118642 / 55324387 / +1.4% 0.70 / 0.72 / -3.6%
tpcds_q60/datafusion:vortex-compact 27482519 / 28710650 / -4.3% 48348094 / 51506983 / -6.1% 0.57 / 0.56 / +2.0%
tpcds_q61/datafusion:vortex-compact 28590908 / 28201191 / +1.4% 45942815 / 47791217 / -3.9% 0.62 / 0.59 / +5.5%
tpcds_q62/datafusion:vortex-compact 17663068 / 17798900 / -0.8% 33798966 / 35091092 / -3.7% 0.52 / 0.51 / +3.0%
tpcds_q63/datafusion:vortex-compact 23370588 / 23079376 / +1.3% 40503762 / 46079918 / -12.1% 🟢 0.58 / 0.50 / +15.2%
tpcds_q64/datafusion:vortex-compact 453643834 / 454932535 / -0.3% 454866088 / 457690164 / -0.6% 1.00 / 0.99 / +0.3%
tpcds_q65/datafusion:vortex-compact 81270113 / 81641677 / -0.5% 96411525 / 100563764 / -4.1% 0.84 / 0.81 / +3.8%
tpcds_q66/datafusion:vortex-compact 54666553 / 54851176 / -0.3% 74845074 / 75920671 / -1.4% 0.73 / 0.72 / +1.1%
tpcds_q67/datafusion:vortex-compact 58902545 / 59688793 / -1.3% 86806379 / 87079116 / -0.3% 0.68 / 0.69 / -1.0%
tpcds_q68/datafusion:vortex-compact 30444003 / 27503012 / +10.7% 🔴 49630202 / 51012130 / -2.7% 0.61 / 0.54 / +13.8%
tpcds_q69/datafusion:vortex-compact 36562682 / 36689416 / -0.3% 56340184 / 55455315 / +1.6% 0.65 / 0.66 / -1.9%
tpcds_q70/datafusion:vortex-compact 75521162 / 74717466 / +1.1% 96825185 / 93642501 / +3.4% 0.78 / 0.80 / -2.2%
tpcds_q71/datafusion:vortex-compact 20440910 / 19912668 / +2.7% 41540449 / 40269776 / +3.2% 0.49 / 0.49 / -0.5%
tpcds_q72/datafusion:vortex-compact 451556996 / 470239451 / -4.0% 463210930 / 494587861 / -6.3% 0.97 / 0.95 / +2.5%
tpcds_q73/datafusion:vortex-compact 21499830 / 20225730 / +6.3% 40355051 / 41084294 / -1.8% 0.53 / 0.49 / +8.2%
tpcds_q74/datafusion:vortex-compact 50465040 / 51465739 / -1.9% 69772791 / 72923823 / -4.3% 0.72 / 0.71 / +2.5%
tpcds_q75/datafusion:vortex-compact 135935245 / 134113684 / +1.4% 160320840 / 177788463 / -9.8% 0.85 / 0.75 / +12.4%
tpcds_q76/datafusion:vortex-compact 40256148 / 42182706 / -4.6% 59360679 / 58295197 / +1.8% 0.68 / 0.72 / -6.3%
tpcds_q77/datafusion:vortex-compact 38521817 / 39239196 / -1.8% 57405909 / 60606434 / -5.3% 0.67 / 0.65 / +3.6%
tpcds_q78/datafusion:vortex-compact 85535900 / 86273337 / -0.9% 112071127 / 110892152 / +1.1% 0.76 / 0.78 / -1.9%
tpcds_q79/datafusion:vortex-compact 24501004 / 24552132 / -0.2% 42401192 / 45128817 / -6.0% 0.58 / 0.54 / +6.2%
tpcds_q80/datafusion:vortex-compact 79925741 / 79856597 / +0.1% 107817140 / 107708934 / +0.1% 0.74 / 0.74 / -0.0%
tpcds_q81/datafusion:vortex-compact 29202170 / 29690662 / -1.6% 43779512 / 45145815 / -3.0% 0.67 / 0.66 / +1.4%
tpcds_q82/datafusion:vortex-compact 15519413 / 15912573 / -2.5% 36698378 / 39105615 / -6.2% 0.42 / 0.41 / +3.9%
tpcds_q83/datafusion:vortex-compact 36785436 / 36977882 / -0.5% 55733824 / 57149735 / -2.5% 0.66 / 0.65 / +2.0%
tpcds_q84/datafusion:vortex-compact 13097480 / 13066885 / +0.2% 26009971 / 27394628 / -5.1% 0.50 / 0.48 / +5.6%
tpcds_q85/datafusion:vortex-compact 107931774 / 109180420 / -1.1% 127621769 / 134046330 / -4.8% 0.85 / 0.81 / +3.8%
tpcds_q86/datafusion:vortex-compact 16609797 / 16977232 / -2.2% 32709630 / 35484811 / -7.8% 0.51 / 0.48 / +6.1%
tpcds_q87/datafusion:vortex-compact 33847208 / 33071089 / +2.3% 55263622 / 54702809 / +1.0% 0.61 / 0.60 / +1.3%
tpcds_q88/datafusion:vortex-compact 41753352 / 40827846 / +2.3% 67151386 / 68954535 / -2.6% 0.62 / 0.59 / +5.0%
tpcds_q89/datafusion:vortex-compact 25471246 / 25820249 / -1.4% 43810419 / 44931632 / -2.5% 0.58 / 0.57 / +1.2%
tpcds_q90/datafusion:vortex-compact 11332702 / 11383852 / -0.4% 26230337 / 26962929 / -2.7% 0.43 / 0.42 / +2.3%
tpcds_q91/datafusion:vortex-compact 27456348 / 26873514 / +2.2% 44713484 / 45973613 / -2.7% 0.61 / 0.58 / +5.0%
tpcds_q92/datafusion:vortex-compact 15358050 / 15950554 / -3.7% 31667660 / 32297757 / -2.0% 0.48 / 0.49 / -1.8%
tpcds_q93/datafusion:vortex-compact 25495544 / 25018196 / +1.9% 44147313 / 44656794 / -1.1% 0.58 / 0.56 / +3.1%
tpcds_q94/datafusion:vortex-compact 21925604 / 21740806 / +0.9% 42686070 / 41208097 / +3.6% 0.51 / 0.53 / -2.6%
tpcds_q95/datafusion:vortex-compact 50369056 / 49922700 / +0.9% 67976873 / 70133569 / -3.1% 0.74 / 0.71 / +4.1%
tpcds_q96/datafusion:vortex-compact 11659103 / 11639992 / +0.2% 25666840 / 28417726 / -9.7% 0.45 / 0.41 / +10.9%
tpcds_q97/datafusion:vortex-compact 23386837 / 23503658 / -0.5% 40776296 / 43185815 / -5.6% 0.57 / 0.54 / +5.4%
tpcds_q98/datafusion:vortex-compact 22482661 / 21781850 / +3.2% 42739602 / 41419897 / +3.2% 0.53 / 0.53 / +0.0%
tpcds_q99/datafusion:vortex-compact 20874212 / 20979034 / -0.5% 37784037 / 38368933 / -1.5% 0.55 / 0.55 / +1.0%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31280039 / 29793231 / +5.0% 44243555 / 45925088 / -3.7% 0.71 / 0.65 / +9.0%
tpcds_q02/datafusion:parquet 45034256 / 45563659 / -1.2% 56722659 / 60007831 / -5.5% 0.79 / 0.76 / +4.6%
tpcds_q03/datafusion:parquet 18727224 / 19339062 / -3.2% 30571019 / 29750588 / +2.8% 0.61 / 0.65 / -5.8%
tpcds_q04/datafusion:parquet 196278078 / 193170795 / +1.6% 220202965 / 218813766 / +0.6% 0.89 / 0.88 / +1.0%
tpcds_q05/datafusion:parquet 70042269 / 72599112 / -3.5% 91782118 / 95804432 / -4.2% 0.76 / 0.76 / +0.7%
tpcds_q06/datafusion:parquet 35016767 / 34555076 / +1.3% 50206205 / 50625042 / -0.8% 0.70 / 0.68 / +2.2%
tpcds_q07/datafusion:parquet 46285573 / 46244142 / +0.1% 63955424 / 66194624 / -3.4% 0.72 / 0.70 / +3.6%
tpcds_q08/datafusion:parquet 39064337 / 39670021 / -1.5% 50859556 / 57306579 / -11.3% 🟢 0.77 / 0.69 / +11.0%
tpcds_q09/datafusion:parquet 31922090 / 31411167 / +1.6% 43470050 / 43921420 / -1.0% 0.73 / 0.72 / +2.7%
tpcds_q10/datafusion:parquet 48025042 / 49060427 / -2.1% 61348980 / 66128886 / -7.2% 0.78 / 0.74 / +5.5%
tpcds_q11/datafusion:parquet 93128723 / 93690820 / -0.6% 114731299 / 115101028 / -0.3% 0.81 / 0.81 / -0.3%
tpcds_q12/datafusion:parquet 24276294 / 23920084 / +1.5% 35632957 / 34571868 / +3.1% 0.68 / 0.69 / -1.5%
tpcds_q13/datafusion:parquet 44928344 / 44741646 / +0.4% 66745436 / 69355026 / -3.8% 0.67 / 0.65 / +4.3%
tpcds_q14/datafusion:parquet 141059282 / 140308716 / +0.5% 150004682 / 154206773 / -2.7% 0.94 / 0.91 / +3.4%
tpcds_q15/datafusion:parquet 30749122 / 30924168 / -0.6% 47177562 / 47400115 / -0.5% 0.65 / 0.65 / -0.1%
tpcds_q16/datafusion:parquet 37960774 / 38452064 / -1.3% 55689039 / 55454891 / +0.4% 0.68 / 0.69 / -1.7%
tpcds_q17/datafusion:parquet 73717248 / 74345001 / -0.8% 98725309 / 99077692 / -0.4% 0.75 / 0.75 / -0.5%
tpcds_q18/datafusion:parquet 58176880 / 60710054 / -4.2% 76481469 / 74611214 / +2.5% 0.76 / 0.81 / -6.5%
tpcds_q19/datafusion:parquet 32026470 / 32293978 / -0.8% 49329388 / 49372910 / -0.1% 0.65 / 0.65 / -0.7%
tpcds_q20/datafusion:parquet 25499850 / 25070706 / +1.7% 35519610 / 37930200 / -6.4% 0.72 / 0.66 / +8.6%
tpcds_q21/datafusion:parquet 20008958 / 20230914 / -1.1% 33095694 / 32251295 / +2.6% 0.60 / 0.63 / -3.6%
tpcds_q22/datafusion:parquet 76722122 / 76863411 / -0.2% 89215255 / 90433983 / -1.3% 0.86 / 0.85 / +1.2%
tpcds_q23/datafusion:parquet 116586578 / 119327592 / -2.3% 137102559 / 131162615 / +4.5% 0.85 / 0.91 / -6.5%
tpcds_q24/datafusion:parquet 89779271 / 91286287 / -1.7% 115303514 / 116778063 / -1.3% 0.78 / 0.78 / -0.4%
tpcds_q25/datafusion:parquet 75025026 / 74839832 / +0.2% 98547743 / 97275212 / +1.3% 0.76 / 0.77 / -1.0%
tpcds_q26/datafusion:parquet 41978642 / 42099937 / -0.3% 58519711 / 57566524 / +1.7% 0.72 / 0.73 / -1.9%
tpcds_q27/datafusion:parquet 74899265 / 77773287 / -3.7% 103505829 / 104252404 / -0.7% 0.72 / 0.75 / -3.0%
tpcds_q28/datafusion:parquet 26678050 / 27210394 / -2.0% 41930637 / 44037541 / -4.8% 0.64 / 0.62 / +3.0%
tpcds_q29/datafusion:parquet 76029824 / 74901866 / +1.5% 100807657 / 99278441 / +1.5% 0.75 / 0.75 / -0.0%
tpcds_q30/datafusion:parquet 44188552 / 46503572 / -5.0% 64618649 / 62825494 / +2.9% 0.68 / 0.74 / -7.6%
tpcds_q31/datafusion:parquet 90832206 / 89537532 / +1.4% 105701508 / 105444506 / +0.2% 0.86 / 0.85 / +1.2%
tpcds_q32/datafusion:parquet 24931924 / 25788480 / -3.3% 39644667 / 40795811 / -2.8% 0.63 / 0.63 / -0.5%
tpcds_q33/datafusion:parquet 39937966 / 40601352 / -1.6% 53807263 / 53803603 / +0.0% 0.74 / 0.75 / -1.6%
tpcds_q34/datafusion:parquet 23940466 / 23678690 / +1.1% 35859827 / 36421103 / -1.5% 0.67 / 0.65 / +2.7%
tpcds_q35/datafusion:parquet 54175974 / 54028558 / +0.3% 72225021 / 70616747 / +2.3% 0.75 / 0.77 / -2.0%
tpcds_q36/datafusion:parquet 51354804 / 51184006 / +0.3% 70086098 / 70394059 / -0.4% 0.73 / 0.73 / +0.8%
tpcds_q37/datafusion:parquet 25818209 / 25624572 / +0.8% 39174706 / 39188193 / -0.0% 0.66 / 0.65 / +0.8%
tpcds_q38/datafusion:parquet 43844324 / 44328504 / -1.1% 61803285 / 61583635 / +0.4% 0.71 / 0.72 / -1.4%
tpcds_q39/datafusion:parquet 72130750 / 71059234 / +1.5% 89030700 / 88792741 / +0.3% 0.81 / 0.80 / +1.2%
tpcds_q40/datafusion:parquet 29584450 / 28010452 / +5.6% 47685035 / 48809185 / -2.3% 0.62 / 0.57 / +8.1%
tpcds_q41/datafusion:parquet 20023354 / 19728138 / +1.5% 31527328 / 32934525 / -4.3% 0.64 / 0.60 / +6.0%
tpcds_q42/datafusion:parquet 18334965 / 17871588 / +2.6% 29649856 / 32514518 / -8.8% 0.62 / 0.55 / +12.5%
tpcds_q43/datafusion:parquet 19252458 / 19208910 / +0.2% 31747656 / 31522380 / +0.7% 0.61 / 0.61 / -0.5%
tpcds_q44/datafusion:parquet 33706245 / 33686866 / +0.1% 49962056 / 50541598 / -1.1% 0.67 / 0.67 / +1.2%
tpcds_q45/datafusion:parquet 38268842 / 38158586 / +0.3% 51655217 / 52652408 / -1.9% 0.74 / 0.72 / +2.2%
tpcds_q46/datafusion:parquet 29289660 / 29533514 / -0.8% 47835060 / 48873505 / -2.1% 0.61 / 0.60 / +1.3%
tpcds_q47/datafusion:parquet 97852598 / 98607906 / -0.8% 119176355 / 122000287 / -2.3% 0.82 / 0.81 / +1.6%
tpcds_q48/datafusion:parquet 42306206 / 41158564 / +2.8% 59627970 / 61097537 / -2.4% 0.71 / 0.67 / +5.3%
tpcds_q49/datafusion:parquet 74911800 / 73346998 / +2.1% 92348445 / 93109944 / -0.8% 0.81 / 0.79 / +3.0%
tpcds_q50/datafusion:parquet 47568660 / 47488470 / +0.2% 65672826 / 69287109 / -5.2% 0.72 / 0.69 / +5.7%
tpcds_q51/datafusion:parquet 71433686 / 71591582 / -0.2% 90316319 / 85652619 / +5.4% 0.79 / 0.84 / -5.4%
tpcds_q52/datafusion:parquet 18627533 / 18504141 / +0.7% 30512367 / 30432227 / +0.3% 0.61 / 0.61 / +0.4%
tpcds_q53/datafusion:parquet 22689543 / 23223830 / -2.3% 37532269 / 40210873 / -6.7% 0.60 / 0.58 / +4.7%
tpcds_q54/datafusion:parquet 55043223 / 55355610 / -0.6% 73166229 / 75891147 / -3.6% 0.75 / 0.73 / +3.1%
tpcds_q55/datafusion:parquet 18156050 / 18169742 / -0.1% 31084565 / 32082686 / -3.1% 0.58 / 0.57 / +3.1%
tpcds_q56/datafusion:parquet 44859106 / 45621450 / -1.7% 60149822 / 60724021 / -0.9% 0.75 / 0.75 / -0.7%
tpcds_q57/datafusion:parquet 100159555 / 100948980 / -0.8% 115736056 / 115629269 / +0.1% 0.87 / 0.87 / -0.9%
tpcds_q58/datafusion:parquet 63901500 / 64150340 / -0.4% 80416878 / 83433504 / -3.6% 0.79 / 0.77 / +3.3%
tpcds_q59/datafusion:parquet 45922533 / 46713017 / -1.7% 61479264 / 62851774 / -2.2% 0.75 / 0.74 / +0.5%
tpcds_q60/datafusion:parquet 45624902 / 46324767 / -1.5% 60682085 / 62676026 / -3.2% 0.75 / 0.74 / +1.7%
tpcds_q61/datafusion:parquet 37132208 / 38371757 / -3.2% 60515096 / 59588627 / +1.6% 0.61 / 0.64 / -4.7%
tpcds_q62/datafusion:parquet 24759199 / 24847457 / -0.4% 38034575 / 37598896 / +1.2% 0.65 / 0.66 / -1.5%
tpcds_q63/datafusion:parquet 22035473 / 22205980 / -0.8% 37359465 / 38855581 / -3.9% 0.59 / 0.57 / +3.2%
tpcds_q64/datafusion:parquet 209575375 / 204869355 / +2.3% 232019712 / 237438625 / -2.3% 0.90 / 0.86 / +4.7%
tpcds_q65/datafusion:parquet 37986350 / 37557106 / +1.1% 55140227 / 55160449 / -0.0% 0.69 / 0.68 / +1.2%
tpcds_q66/datafusion:parquet 61936020 / 61683570 / +0.4% 76781296 / 78285291 / -1.9% 0.81 / 0.79 / +2.4%
tpcds_q67/datafusion:parquet 69497737 / 68811445 / +1.0% 91572111 / 93904042 / -2.5% 0.76 / 0.73 / +3.6%
tpcds_q68/datafusion:parquet 29452536 / 29247897 / +0.7% 49432155 / 49059249 / +0.8% 0.60 / 0.60 / -0.1%
tpcds_q69/datafusion:parquet 50338630 / 49394867 / +1.9% 61504879 / 64408645 / -4.5% 0.82 / 0.77 / +6.7%
tpcds_q70/datafusion:parquet 36697740 / 36868762 / -0.5% 55831934 / 57610523 / -3.1% 0.66 / 0.64 / +2.7%
tpcds_q71/datafusion:parquet 27840694 / 28065558 / -0.8% 42926398 / 43322912 / -0.9% 0.65 / 0.65 / +0.1%
tpcds_q72/datafusion:parquet 555822656 / 556971343 / -0.2% 572143974 / 580705096 / -1.5% 0.97 / 0.96 / +1.3%
tpcds_q73/datafusion:parquet 22820062 / 22926410 / -0.5% 36575242 / 38026147 / -3.8% 0.62 / 0.60 / +3.5%
tpcds_q74/datafusion:parquet 67446798 / 68792387 / -2.0% 85777404 / 84903915 / +1.0% 0.79 / 0.81 / -3.0%
tpcds_q75/datafusion:parquet 145425400 / 146853616 / -1.0% 168349133 / 174190405 / -3.4% 0.86 / 0.84 / +2.5%
tpcds_q76/datafusion:parquet 55465650 / 54282357 / +2.2% 71264007 / 71127996 / +0.2% 0.78 / 0.76 / +2.0%
tpcds_q77/datafusion:parquet 54201409 / 55966173 / -3.2% 71933705 / 77229193 / -6.9% 0.75 / 0.72 / +4.0%
tpcds_q78/datafusion:parquet 90445628 / 89075096 / +1.5% 117364574 / 121779858 / -3.6% 0.77 / 0.73 / +5.4%
tpcds_q79/datafusion:parquet 25889400 / 25909841 / -0.1% 43320148 / 44201804 / -2.0% 0.60 / 0.59 / +2.0%
tpcds_q80/datafusion:parquet 80074208 / 81628190 / -1.9% 109180306 / 110687398 / -1.4% 0.73 / 0.74 / -0.5%
tpcds_q81/datafusion:parquet 42520208 / 39580309 / +7.4% 62096609 / 60703457 / +2.3% 0.68 / 0.65 / +5.0%
tpcds_q82/datafusion:parquet 26106678 / 26229296 / -0.5% 39297886 / 39160394 / +0.4% 0.66 / 0.67 / -0.8%
tpcds_q83/datafusion:parquet 58246375 / 57344265 / +1.6% 74394587 / 73139895 / +1.7% 0.78 / 0.78 / -0.1%
tpcds_q84/datafusion:parquet 30256799 / 29910892 / +1.2% 44278285 / 45598911 / -2.9% 0.68 / 0.66 / +4.2%
tpcds_q85/datafusion:parquet 83544653 / 83870250 / -0.4% 105542848 / 106470570 / -0.9% 0.79 / 0.79 / +0.5%
tpcds_q86/datafusion:parquet 20249056 / 20238689 / +0.1% 33472933 / 34491157 / -3.0% 0.60 / 0.59 / +3.1%
tpcds_q87/datafusion:parquet 47567989 / 47113964 / +1.0% 62729375 / 61472945 / +2.0% 0.76 / 0.77 / -1.1%
tpcds_q88/datafusion:parquet 46825642 / 48873314 / -4.2% 68012830 / 66522342 / +2.2% 0.69 / 0.73 / -6.3%
tpcds_q89/datafusion:parquet 25542082 / 25857750 / -1.2% 41745570 / 41852069 / -0.3% 0.61 / 0.62 / -1.0%
tpcds_q90/datafusion:parquet 19320258 / 19104982 / +1.1% 31981258 / 31954527 / +0.1% 0.60 / 0.60 / +1.0%
tpcds_q91/datafusion:parquet 37313206 / 36573844 / +2.0% 52182506 / 50727361 / +2.9% 0.72 / 0.72 / -0.8%
tpcds_q92/datafusion:parquet 26223351 / 26612185 / -1.5% 39974117 / 40992853 / -2.5% 0.66 / 0.65 / +1.1%
tpcds_q93/datafusion:parquet 27210560 / 25765184 / +5.6% 46239620 / 47470285 / -2.6% 0.59 / 0.54 / +8.4%
tpcds_q94/datafusion:parquet 34521982 / 34918142 / -1.1% 49074895 / 49202693 / -0.3% 0.70 / 0.71 / -0.9%
tpcds_q95/datafusion:parquet 63775254 / 64990956 / -1.9% 78436618 / 80711704 / -2.8% 0.81 / 0.81 / +1.0%
tpcds_q96/datafusion:parquet 16585084 / 16370760 / +1.3% 28811968 / 28640958 / +0.6% 0.58 / 0.57 / +0.7%
tpcds_q97/datafusion:parquet 35426550 / 35294324 / +0.4% 52557586 / 50256975 / +4.6% 0.67 / 0.70 / -4.0%
tpcds_q98/datafusion:parquet 25165490 / 25013554 / +0.6% 39822793 / 38962702 / +2.2% 0.63 / 0.64 / -1.6%
tpcds_q99/datafusion:parquet 29157880 / 29778978 / -2.1% 42785649 / 43079759 / -0.7% 0.68 / 0.69 / -1.4%
duckdb / vortex-compact / ns (0.996x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16447246 / 16575386 / -0.8% 25148535 / 23822593 / +5.6% 0.65 / 0.70 / -6.0%
tpcds_q02/duckdb:vortex-compact 16239834 / 16113515 / +0.8% 24649930 / 21364286 / +15.4% 🔴 0.66 / 0.75 / -12.6%
tpcds_q03/duckdb:vortex-compact 24574201 / 23882570 / +2.9% 29750678 / 34473358 / -13.7% 🟢 0.83 / 0.69 / +19.2%
tpcds_q04/duckdb:vortex-compact 53936742 / 55642658 / -3.1% 67577526 / 72728068 / -7.1% 0.80 / 0.77 / +4.3%
tpcds_q05/duckdb:vortex-compact 23317217 / 22665336 / +2.9% 32404473 / 32853020 / -1.4% 0.72 / 0.69 / +4.3%
tpcds_q06/duckdb:vortex-compact 32543456 / 32426682 / +0.4% 45909940 / 44558248 / +3.0% 0.71 / 0.73 / -2.6%
tpcds_q07/duckdb:vortex-compact 28933682 / 28417769 / +1.8% 39241251 / 42635476 / -8.0% 0.74 / 0.67 / +10.6%
tpcds_q08/duckdb:vortex-compact 49466257 / 49392082 / +0.2% 57751191 / 56920298 / +1.5% 0.86 / 0.87 / -1.3%
tpcds_q09/duckdb:vortex-compact 11933550 / 13387282 / -10.9% 🟢 22645508 / 19876119 / +13.9% 🔴 0.53 / 0.67 / -21.8%
tpcds_q10/duckdb:vortex-compact 45768152 / 46114542 / -0.8% 58612665 / 56835652 / +3.1% 0.78 / 0.81 / -3.8%
tpcds_q11/duckdb:vortex-compact 45683658 / 45542470 / +0.3% 56254806 / 56186780 / +0.1% 0.81 / 0.81 / +0.2%
tpcds_q12/duckdb:vortex-compact 13610962 / 13520018 / +0.7% 20060420 / 20333621 / -1.3% 0.68 / 0.66 / +2.0%
tpcds_q13/duckdb:vortex-compact 36513689 / 36952826 / -1.2% 49158401 / 49726838 / -1.1% 0.74 / 0.74 / -0.0%
tpcds_q14/duckdb:vortex-compact 67008682 / 65583891 / +2.2% 83904615 / 80479722 / +4.3% 0.80 / 0.81 / -2.0%
tpcds_q15/duckdb:vortex-compact 26445698 / 26289345 / +0.6% 32302592 / 31067476 / +4.0% 0.82 / 0.85 / -3.3%
tpcds_q16/duckdb:vortex-compact 25032060 / 28356560 / -11.7% 🟢 33583988 / 35545429 / -5.5% 0.75 / 0.80 / -6.6%
tpcds_q17/duckdb:vortex-compact 45497673 / 45756542 / -0.6% 57686450 / 58945356 / -2.1% 0.79 / 0.78 / +1.6%
tpcds_q18/duckdb:vortex-compact 36188594 / 35734238 / +1.3% 44698484 / 45132272 / -1.0% 0.81 / 0.79 / +2.3%
tpcds_q19/duckdb:vortex-compact 36052690 / 36486822 / -1.2% 43438265 / 44525054 / -2.4% 0.83 / 0.82 / +1.3%
tpcds_q20/duckdb:vortex-compact 14213918 / 14259365 / -0.3% 19915193 / 18866299 / +5.6% 0.71 / 0.76 / -5.6%
tpcds_q21/duckdb:vortex-compact 11361935 / 12868124 / -11.7% 🟢 19662876 / 20206774 / -2.7% 0.58 / 0.64 / -9.3%
tpcds_q22/duckdb:vortex-compact 34541988 / 34115816 / +1.2% 40934744 / 42629038 / -4.0% 0.84 / 0.80 / +5.4%
tpcds_q23/duckdb:vortex-compact 42679973 / 42698208 / -0.0% 55374609 / 55058307 / +0.6% 0.77 / 0.78 / -0.6%
tpcds_q24/duckdb:vortex-compact 39522934 / 39837274 / -0.8% 47678097 / 48281286 / -1.2% 0.83 / 0.83 / +0.5%
tpcds_q25/duckdb:vortex-compact 43770567 / 43489968 / +0.6% 54439696 / 54671358 / -0.4% 0.80 / 0.80 / +1.1%
tpcds_q26/duckdb:vortex-compact 25330932 / 25351192 / -0.1% 31631403 / 31064332 / +1.8% 0.80 / 0.82 / -1.9%
tpcds_q27/duckdb:vortex-compact 32897230 / 33403214 / -1.5% 41010083 / 47613566 / -13.9% 🟢 0.80 / 0.70 / +14.3%
tpcds_q28/duckdb:vortex-compact 11172978 / 12610946 / -11.4% 🟢 18241465 / 17538420 / +4.0% 0.61 / 0.72 / -14.8%
tpcds_q29/duckdb:vortex-compact 45116366 / 44834294 / +0.6% 57426932 / 58617675 / -2.0% 0.79 / 0.76 / +2.7%
tpcds_q30/duckdb:vortex-compact 22613012 / 22602759 / +0.0% 30745286 / 33625625 / -8.6% 0.74 / 0.67 / +9.4%
tpcds_q31/duckdb:vortex-compact 23619484 / 23580650 / +0.2% 31172466 / 32871778 / -5.2% 0.76 / 0.72 / +5.6%
tpcds_q32/duckdb:vortex-compact 14824117 / 14363982 / +3.2% 25353168 / 23294871 / +8.8% 0.58 / 0.62 / -5.2%
tpcds_q33/duckdb:vortex-compact 25026374 / 23672524 / +5.7% 34487396 / 35428722 / -2.7% 0.73 / 0.67 / +8.6%
tpcds_q34/duckdb:vortex-compact 23653035 / 22312240 / +6.0% 30038155 / 29957039 / +0.3% 0.79 / 0.74 / +5.7%
tpcds_q35/duckdb:vortex-compact 62565354 / 62693810 / -0.2% 76037904 / 73957102 / +2.8% 0.82 / 0.85 / -2.9%
tpcds_q36/duckdb:vortex-compact 21986798 / 22832219 / -3.7% 31144541 / 34536220 / -9.8% 0.71 / 0.66 / +6.8%
tpcds_q37/duckdb:vortex-compact 15412336 / 15419366 / -0.0% 24393320 / 27691383 / -11.9% 🟢 0.63 / 0.56 / +13.5%
tpcds_q38/duckdb:vortex-compact 26518188 / 26595724 / -0.3% 32870916 / 32600344 / +0.8% 0.81 / 0.82 / -1.1%
tpcds_q39/duckdb:vortex-compact 20271178 / 20266444 / +0.0% 29147789 / 29033349 / +0.4% 0.70 / 0.70 / -0.4%
tpcds_q40/duckdb:vortex-compact 15842109 / 16127426 / -1.8% 24631158 / 24944229 / -1.3% 0.64 / 0.65 / -0.5%
tpcds_q41/duckdb:vortex-compact 7733098 / 7737609 / -0.1% 13022233 / 12159215 / +7.1% 0.59 / 0.64 / -6.7%
tpcds_q42/duckdb:vortex-compact 11658092 / 12392450 / -5.9% 26014203 / 23373664 / +11.3% 🔴 0.45 / 0.53 / -15.5%
tpcds_q43/duckdb:vortex-compact 16430162 / 16401540 / +0.2% 26351184 / 25743538 / +2.4% 0.62 / 0.64 / -2.1%
tpcds_q44/duckdb:vortex-compact 21151962 / 19903118 / +6.3% 33509909 / 31612455 / +6.0% 0.63 / 0.63 / +0.3%
tpcds_q45/duckdb:vortex-compact 27683817 / 27466438 / +0.8% 36859574 / 32886291 / +12.1% 🔴 0.75 / 0.84 / -10.1%
tpcds_q46/duckdb:vortex-compact 29243808 / 29557714 / -1.1% 39106965 / 39244997 / -0.4% 0.75 / 0.75 / -0.7%
tpcds_q47/duckdb:vortex-compact 36673092 / 36213831 / +1.3% 44589808 / 45767105 / -2.6% 0.82 / 0.79 / +3.9%
tpcds_q48/duckdb:vortex-compact 35586058 / 34497506 / +3.2% 53044942 / 45179900 / +17.4% 🔴 0.67 / 0.76 / -12.1%
tpcds_q49/duckdb:vortex-compact 24192210 / 22867698 / +5.8% 38459528 / 39232876 / -2.0% 0.63 / 0.58 / +7.9%
tpcds_q50/duckdb:vortex-compact 27423490 / 28266762 / -3.0% 36379078 / 38279778 / -5.0% 0.75 / 0.74 / +2.1%
tpcds_q51/duckdb:vortex-compact 52808020 / 52936748 / -0.2% 64697721 / 62930521 / +2.8% 0.82 / 0.84 / -3.0%
tpcds_q52/duckdb:vortex-compact 11919292 / 12299098 / -3.1% 20626840 / 21280119 / -3.1% 0.58 / 0.58 / -0.0%
tpcds_q53/duckdb:vortex-compact 22034094 / 21653157 / +1.8% 30234728 / 29264155 / +3.3% 0.73 / 0.74 / -1.5%
tpcds_q54/duckdb:vortex-compact 26264472 / 26027375 / +0.9% 35574876 / 34399325 / +3.4% 0.74 / 0.76 / -2.4%
tpcds_q55/duckdb:vortex-compact 11738434 / 12026102 / -2.4% 20513367 / 20846216 / -1.6% 0.57 / 0.58 / -0.8%
tpcds_q56/duckdb:vortex-compact 23757040 / 23784943 / -0.1% 37550724 / 36301193 / +3.4% 0.63 / 0.66 / -3.4%
tpcds_q57/duckdb:vortex-compact 27830649 / 27889244 / -0.2% 36143790 / 36181107 / -0.1% 0.77 / 0.77 / -0.1%
tpcds_q58/duckdb:vortex-compact 21315176 / 21814830 / -2.3% 31723822 / 34698525 / -8.6% 0.67 / 0.63 / +6.9%
tpcds_q59/duckdb:vortex-compact 23349932 / 23277196 / +0.3% 29446006 / 31460941 / -6.4% 0.79 / 0.74 / +7.2%
tpcds_q60/duckdb:vortex-compact 25142568 / 24786810 / +1.4% 35143244 / 34312775 / +2.4% 0.72 / 0.72 / -1.0%
tpcds_q61/duckdb:vortex-compact 33117196 / 31657642 / +4.6% 43581919 / 44802916 / -2.7% 0.76 / 0.71 / +7.5%
tpcds_q62/duckdb:vortex-compact 11826358 / 12807162 / -7.7% 17543775 / 17516720 / +0.2% 0.67 / 0.73 / -7.8%
tpcds_q63/duckdb:vortex-compact 21315137 / 20371788 / +4.6% 29077004 / 28644488 / +1.5% 0.73 / 0.71 / +3.1%
tpcds_q64/duckdb:vortex-compact 86318124 / 86475486 / -0.2% 96164430 / 113985209 / -15.6% 🟢 0.90 / 0.76 / +18.3%
tpcds_q65/duckdb:vortex-compact 18156403 / 18152742 / +0.0% 32509936 / 28492695 / +14.1% 🔴 0.56 / 0.64 / -12.3%
tpcds_q66/duckdb:vortex-compact 25786318 / 26140216 / -1.4% 33697470 / 37034037 / -9.0% 0.77 / 0.71 / +8.4%
tpcds_q67/duckdb:vortex-compact 71016739 / 71161378 / -0.2% 97264064 / 86035684 / +13.1% 🔴 0.73 / 0.83 / -11.7%
tpcds_q68/duckdb:vortex-compact 29653039 / 29330404 / +1.1% 40234557 / 39163817 / +2.7% 0.74 / 0.75 / -1.6%
tpcds_q69/duckdb:vortex-compact 46877726 / 47227064 / -0.7% 62545958 / 59778593 / +4.6% 0.75 / 0.79 / -5.1%
tpcds_q70/duckdb:vortex-compact 33254053 / 31348069 / +6.1% 46104066 / 40145174 / +14.8% 🔴 0.72 / 0.78 / -7.6%
tpcds_q71/duckdb:vortex-compact 19256336 / 20593122 / -6.5% 28539762 / 32903641 / -13.3% 🟢 0.67 / 0.63 / +7.8%
tpcds_q72/duckdb:vortex-compact 70122484 / 70592214 / -0.7% 81724340 / 82477381 / -0.9% 0.86 / 0.86 / +0.2%
tpcds_q73/duckdb:vortex-compact 21929121 / 21769118 / +0.7% 28764863 / 37431857 / -23.2% 🟢 0.76 / 0.58 / +31.1%
tpcds_q74/duckdb:vortex-compact 32405535 / 33137446 / -2.2% 39735513 / 40673900 / -2.3% 0.82 / 0.81 / +0.1%
tpcds_q75/duckdb:vortex-compact 32534940 / 35231351 / -7.7% 43522480 / 43519177 / +0.0% 0.75 / 0.81 / -7.7%
tpcds_q76/duckdb:vortex-compact 16324992 / 16283379 / +0.3% 28555674 / 28166472 / +1.4% 0.57 / 0.58 / -1.1%
tpcds_q77/duckdb:vortex-compact 22594511 / 22975668 / -1.7% 30217164 / 34659491 / -12.8% 🟢 0.75 / 0.66 / +12.8%
tpcds_q78/duckdb:vortex-compact 41818106 / 41474784 / +0.8% 50633232 / 55648230 / -9.0% 0.83 / 0.75 / +10.8%
tpcds_q79/duckdb:vortex-compact 38107732 / 38034791 / +0.2% 46137540 / 46175055 / -0.1% 0.83 / 0.82 / +0.3%
tpcds_q80/duckdb:vortex-compact 36619158 / 39275820 / -6.8% 51556886 / 49756065 / +3.6% 0.71 / 0.79 / -10.0%
tpcds_q81/duckdb:vortex-compact 24729256 / 24507881 / +0.9% 33439845 / 32334092 / +3.4% 0.74 / 0.76 / -2.4%
tpcds_q82/duckdb:vortex-compact 36037070 / 36119715 / -0.2% 43637558 / 42475907 / +2.7% 0.83 / 0.85 / -2.9%
tpcds_q83/duckdb:vortex-compact 27913954 / 28063493 / -0.5% 32427468 / 31709476 / +2.3% 0.86 / 0.89 / -2.7%
tpcds_q84/duckdb:vortex-compact 14915459 / 15018132 / -0.7% 24335851 / 22919649 / +6.2% 0.61 / 0.66 / -6.5%
tpcds_q85/duckdb:vortex-compact 41839036 / 42039881 / -0.5% 50903312 / 50511723 / +0.8% 0.82 / 0.83 / -1.2%
tpcds_q86/duckdb:vortex-compact 12236120 / 11988022 / +2.1% 19150719 / 18290049 / +4.7% 0.64 / 0.66 / -2.5%
tpcds_q87/duckdb:vortex-compact 27811142 / 28520542 / -2.5% 34856976 / 34228094 / +1.8% 0.80 / 0.83 / -4.2%
tpcds_q88/duckdb:vortex-compact 73333823 / 67992864 / +7.9% 81380788 / 81751116 / -0.5% 0.90 / 0.83 / +8.3%
tpcds_q89/duckdb:vortex-compact 21353770 / 21295516 / +0.3% 35578515 / 28647278 / +24.2% 🔴 0.60 / 0.74 / -19.3%
tpcds_q90/duckdb:vortex-compact 11746356 / 11783232 / -0.3% 19996843 / 17198524 / +16.3% 🔴 0.59 / 0.69 / -14.3%
tpcds_q91/duckdb:vortex-compact 33110974 / 33073390 / +0.1% 40862389 / 39786759 / +2.7% 0.81 / 0.83 / -2.5%
tpcds_q92/duckdb:vortex-compact 20707710 / 20649258 / +0.3% 27883693 / 31710054 / -12.1% 🟢 0.74 / 0.65 / +14.0%
tpcds_q93/duckdb:vortex-compact 18354464 / 18642396 / -1.5% 25272453 / 27062286 / -6.6% 0.73 / 0.69 / +5.4%
tpcds_q94/duckdb:vortex-compact 22458274 / 22123216 / +1.5% 30737072 / 30471391 / +0.9% 0.73 / 0.73 / +0.6%
tpcds_q95/duckdb:vortex-compact 78371454 / 77857413 / +0.7% 83710307 / 96658951 / -13.4% 🟢 0.94 / 0.81 / +16.2%
tpcds_q96/duckdb:vortex-compact 17283025 / 17365682 / -0.5% 24572723 / 27433566 / -10.4% 🟢 0.70 / 0.63 / +11.1%
tpcds_q97/duckdb:vortex-compact 25571798 / 25252675 / +1.3% 36167524 / 32615687 / +10.9% 🔴 0.71 / 0.77 / -8.7%
tpcds_q98/duckdb:vortex-compact 18617400 / 18256402 / +2.0% 28320965 / 28027099 / +1.0% 0.66 / 0.65 / +0.9%
tpcds_q99/duckdb:vortex-compact 16929432 / 16773348 / +0.9% 24835779 / 25968730 / -4.4% 0.68 / 0.65 / +5.5%
duckdb / parquet / ns (1.004x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24751549 / 23525474 / +5.2% 32037348 / 31388303 / +2.1% 0.77 / 0.75 / +3.1%
tpcds_q02/duckdb:parquet 15351196 / 15402391 / -0.3% 20524528 / 20001009 / +2.6% 0.75 / 0.77 / -2.9%
tpcds_q03/duckdb:parquet 8824026 / 8783538 / +0.5% 15320720 / 15172648 / +1.0% 0.58 / 0.58 / -0.5%
tpcds_q04/duckdb:parquet 127732724 / 127691004 / +0.0% 132472083 / 135573534 / -2.3% 0.96 / 0.94 / +2.4%
tpcds_q05/duckdb:parquet 21281054 / 21426244 / -0.7% 25256047 / 26356848 / -4.2% 0.84 / 0.81 / +3.7%
tpcds_q06/duckdb:parquet 26607420 / 26585375 / +0.1% 38378140 / 35431319 / +8.3% 0.69 / 0.75 / -7.6%
tpcds_q07/duckdb:parquet 15146334 / 15290886 / -0.9% 22762383 / 23642812 / -3.7% 0.67 / 0.65 / +2.9%
tpcds_q08/duckdb:parquet 25593001 / 26901522 / -4.9% 33683331 / 33989521 / -0.9% 0.76 / 0.79 / -4.0%
tpcds_q09/duckdb:parquet 18631638 / 19229914 / -3.1% 21475683 / 23035394 / -6.8% 0.87 / 0.83 / +3.9%
tpcds_q10/duckdb:parquet 28339102 / 28530064 / -0.7% 41357358 / 38509294 / +7.4% 0.69 / 0.74 / -7.5%
tpcds_q11/duckdb:parquet 71535686 / 71151496 / +0.5% 77136347 / 79252736 / -2.7% 0.93 / 0.90 / +3.3%
tpcds_q12/duckdb:parquet 12564025 / 12345638 / +1.8% 17999747 / 17469617 / +3.0% 0.70 / 0.71 / -1.2%
tpcds_q13/duckdb:parquet 23965278 / 23500135 / +2.0% 31507703 / 32092148 / -1.8% 0.76 / 0.73 / +3.9%
tpcds_q14/duckdb:parquet 60980172 / 60847184 / +0.2% 67752118 / 68927678 / -1.7% 0.90 / 0.88 / +2.0%
tpcds_q15/duckdb:parquet 24858830 / 24459426 / +1.6% 30864164 / 30203798 / +2.2% 0.81 / 0.81 / -0.5%
tpcds_q16/duckdb:parquet 19756595 / 21432202 / -7.8% 29218462 / 28419876 / +2.8% 0.68 / 0.75 / -10.3%
tpcds_q17/duckdb:parquet 32199470 / 32145089 / +0.2% 41067769 / 40589013 / +1.2% 0.78 / 0.79 / -1.0%
tpcds_q18/duckdb:parquet 40083933 / 41659970 / -3.8% 56553164 / 49733738 / +13.7% 🔴 0.71 / 0.84 / -15.4%
tpcds_q19/duckdb:parquet 25962482 / 24427990 / +6.3% 34449486 / 32363093 / +6.4% 0.75 / 0.75 / -0.2%
tpcds_q20/duckdb:parquet 13519934 / 15169884 / -10.9% 🟢 18648777 / 17965122 / +3.8% 0.72 / 0.84 / -14.1%
tpcds_q21/duckdb:parquet 9448575 / 9409878 / +0.4% 15242950 / 16750347 / -9.0% 0.62 / 0.56 / +10.3%
tpcds_q22/duckdb:parquet 36256934 / 35024148 / +3.5% 39020536 / 39444855 / -1.1% 0.93 / 0.89 / +4.6%
tpcds_q23/duckdb:parquet 40508832 / 40564254 / -0.1% 46322990 / 47754150 / -3.0% 0.87 / 0.85 / +2.9%
tpcds_q24/duckdb:parquet 33204200 / 33139510 / +0.2% 43564811 / 47608499 / -8.5% 0.76 / 0.70 / +9.5%
tpcds_q25/duckdb:parquet 30268947 / 29960286 / +1.0% 39676976 / 39998640 / -0.8% 0.76 / 0.75 / +1.8%
tpcds_q26/duckdb:parquet 34057850 / 30867402 / +10.3% 🔴 38876927 / 38145232 / +1.9% 0.88 / 0.81 / +8.3%
tpcds_q27/duckdb:parquet 32150381 / 31690220 / +1.5% 43958819 / 41238039 / +6.6% 0.73 / 0.77 / -4.8%
tpcds_q28/duckdb:parquet 17076324 / 17710616 / -3.6% 23117669 / 20221275 / +14.3% 🔴 0.74 / 0.88 / -15.7%
tpcds_q29/duckdb:parquet 30668258 / 32404873 / -5.4% 39309777 / 38878677 / +1.1% 0.78 / 0.83 / -6.4%
tpcds_q30/duckdb:parquet 32371885 / 34560900 / -6.3% 41554159 / 41720247 / -0.4% 0.78 / 0.83 / -6.0%
tpcds_q31/duckdb:parquet 20534546 / 20296492 / +1.2% 24984680 / 24442015 / +2.2% 0.82 / 0.83 / -1.0%
tpcds_q32/duckdb:parquet 11057976 / 11162540 / -0.9% 17513393 / 17355265 / +0.9% 0.63 / 0.64 / -1.8%
tpcds_q33/duckdb:parquet 15972749 / 15956468 / +0.1% 23395836 / 23299262 / +0.4% 0.68 / 0.68 / -0.3%
tpcds_q34/duckdb:parquet 16009059 / 16113654 / -0.6% 23800732 / 22132181 / +7.5% 0.67 / 0.73 / -7.6%
tpcds_q35/duckdb:parquet 46050036 / 48575372 / -5.2% 57664272 / 58680527 / -1.7% 0.80 / 0.83 / -3.5%
tpcds_q36/duckdb:parquet 16774644 / 15972088 / +5.0% 25518846 / 22867787 / +11.6% 🔴 0.66 / 0.70 / -5.9%
tpcds_q37/duckdb:parquet 11676561 / 12828614 / -9.0% 19162286 / 16658965 / +15.0% 🔴 0.61 / 0.77 / -20.9%
tpcds_q38/duckdb:parquet 26290260 / 26096450 / +0.7% 30701648 / 30448988 / +0.8% 0.86 / 0.86 / -0.1%
tpcds_q39/duckdb:parquet 24574031 / 24423026 / +0.6% 31430113 / 29262794 / +7.4% 0.78 / 0.83 / -6.3%
tpcds_q40/duckdb:parquet 15723154 / 15666760 / +0.4% 21169052 / 20879323 / +1.4% 0.74 / 0.75 / -1.0%
tpcds_q41/duckdb:parquet 8285786 / 7760308 / +6.8% 15148926 / 13065039 / +16.0% 🔴 0.55 / 0.59 / -7.9%
tpcds_q42/duckdb:parquet 8333340 / 8180336 / +1.9% 15287056 / 15288520 / -0.0% 0.55 / 0.54 / +1.9%
tpcds_q43/duckdb:parquet 10605514 / 10550603 / +0.5% 15779273 / 15336158 / +2.9% 0.67 / 0.69 / -2.3%
tpcds_q44/duckdb:parquet 16613154 / 16178041 / +2.7% 24035011 / 22206782 / +8.2% 0.69 / 0.73 / -5.1%
tpcds_q45/duckdb:parquet 23182816 / 22884252 / +1.3% 28716442 / 29398797 / -2.3% 0.81 / 0.78 / +3.7%
tpcds_q46/duckdb:parquet 35984062 / 35789050 / +0.5% 56421662 / 44970259 / +25.5% 🔴 0.64 / 0.80 / -19.9%
tpcds_q47/duckdb:parquet 31539918 / 31197872 / +1.1% 39954313 / 37607757 / +6.2% 0.79 / 0.83 / -4.8%
tpcds_q48/duckdb:parquet 21072160 / 20990518 / +0.4% 28804899 / 28733074 / +0.2% 0.73 / 0.73 / +0.1%
tpcds_q49/duckdb:parquet 18872524 / 18783801 / +0.5% 28098352 / 28809503 / -2.5% 0.67 / 0.65 / +3.0%
tpcds_q50/duckdb:parquet 17536746 / 17389186 / +0.8% 24934162 / 25309453 / -1.5% 0.70 / 0.69 / +2.4%
tpcds_q51/duckdb:parquet 52999248 / 52872770 / +0.2% 60251216 / 58975161 / +2.2% 0.88 / 0.90 / -1.9%
tpcds_q52/duckdb:parquet 8542506 / 8489494 / +0.6% 14885802 / 14711232 / +1.2% 0.57 / 0.58 / -0.6%
tpcds_q53/duckdb:parquet 11641988 / 11451060 / +1.7% 16772077 / 17222102 / -2.6% 0.69 / 0.66 / +4.4%
tpcds_q54/duckdb:parquet 20379444 / 20106919 / +1.4% 29516347 / 29916872 / -1.3% 0.69 / 0.67 / +2.7%
tpcds_q55/duckdb:parquet 8586992 / 8529221 / +0.7% 14919900 / 18060995 / -17.4% 🟢 0.58 / 0.47 / +21.9%
tpcds_q56/duckdb:parquet 16204474 / 16193726 / +0.1% 23627127 / 23462830 / +0.7% 0.69 / 0.69 / -0.6%
tpcds_q57/duckdb:parquet 28927461 / 28930839 / -0.0% 34234895 / 34617811 / -1.1% 0.84 / 0.84 / +1.1%
tpcds_q58/duckdb:parquet 18174865 / 18098128 / +0.4% 25985956 / 25792449 / +0.8% 0.70 / 0.70 / -0.3%
tpcds_q59/duckdb:parquet 19963158 / 19973314 / -0.1% 25152054 / 24803689 / +1.4% 0.79 / 0.81 / -1.4%
tpcds_q60/duckdb:parquet 17098348 / 16813508 / +1.7% 23887940 / 26259533 / -9.0% 0.72 / 0.64 / +11.8%
tpcds_q61/duckdb:parquet 21542892 / 21685212 / -0.7% 28457345 / 28019778 / +1.6% 0.76 / 0.77 / -2.2%
tpcds_q62/duckdb:parquet 10613280 / 10851146 / -2.2% 15278677 / 14593202 / +4.7% 0.69 / 0.74 / -6.6%
tpcds_q63/duckdb:parquet 10815272 / 10860700 / -0.4% 18560722 / 16437522 / +12.9% 🔴 0.58 / 0.66 / -11.8%
tpcds_q64/duckdb:parquet 52177868 / 52489656 / -0.6% 65393895 / 67676358 / -3.4% 0.80 / 0.78 / +2.9%
tpcds_q65/duckdb:parquet 14607959 / 14394640 / +1.5% 20577270 / 21049614 / -2.2% 0.71 / 0.68 / +3.8%
tpcds_q66/duckdb:parquet 24694368 / 24613197 / +0.3% 34446736 / 31636064 / +8.9% 0.72 / 0.78 / -7.9%
tpcds_q67/duckdb:parquet 76556067 / 76555211 / +0.0% 88754977 / 86423662 / +2.7% 0.86 / 0.89 / -2.6%
tpcds_q68/duckdb:parquet 32197360 / 29502854 / +9.1% 40208406 / 40875578 / -1.6% 0.80 / 0.72 / +10.9%
tpcds_q69/duckdb:parquet 28836530 / 28714062 / +0.4% 38937347 / 38366505 / +1.5% 0.74 / 0.75 / -1.0%
tpcds_q70/duckdb:parquet 16068066 / 18705316 / -14.1% 🟢 23232224 / 25648151 / -9.4% 0.69 / 0.73 / -5.2%
tpcds_q71/duckdb:parquet 14692610 / 14856038 / -1.1% 20457598 / 22012926 / -7.1% 0.72 / 0.67 / +6.4%
tpcds_q72/duckdb:parquet 81571390 / 81609789 / -0.0% 85388290 / 86305518 / -1.1% 0.96 / 0.95 / +1.0%
tpcds_q73/duckdb:parquet 13413262 / 13442325 / -0.2% 19422334 / 19801645 / -1.9% 0.69 / 0.68 / +1.7%
tpcds_q74/duckdb:parquet 98316898 / 98469760 / -0.2% 109092467 / 106780324 / +2.2% 0.90 / 0.92 / -2.3%
tpcds_q75/duckdb:parquet 40525040 / 39878194 / +1.6% 50080759 / 51590713 / -2.9% 0.81 / 0.77 / +4.7%
tpcds_q76/duckdb:parquet 13366470 / 13527956 / -1.2% 20454980 / 21076841 / -3.0% 0.65 / 0.64 / +1.8%
tpcds_q77/duckdb:parquet 17016214 / 16875824 / +0.8% 25871006 / 25664368 / +0.8% 0.66 / 0.66 / +0.0%
tpcds_q78/duckdb:parquet 48224352 / 48345145 / -0.2% 53927629 / 54687862 / -1.4% 0.89 / 0.88 / +1.2%
tpcds_q79/duckdb:parquet 20339504 / 20470768 / -0.6% 28991858 / 29300527 / -1.1% 0.70 / 0.70 / +0.4%
tpcds_q80/duckdb:parquet 31098370 / 31156500 / -0.2% 39054700 / 40158379 / -2.7% 0.80 / 0.78 / +2.6%
tpcds_q81/duckdb:parquet 29877216 / 29788370 / +0.3% 41432414 / 38345378 / +8.1% 0.72 / 0.78 / -7.2%
tpcds_q82/duckdb:parquet 14766860 / 12979862 / +13.8% 🔴 20101870 / 19493979 / +3.1% 0.73 / 0.67 / +10.3%
tpcds_q83/duckdb:parquet 17275365 / 15692518 / +10.1% 🔴 20902598 / 21475078 / -2.7% 0.83 / 0.73 / +13.1%
tpcds_q84/duckdb:parquet 17484399 / 17147358 / +2.0% 23991061 / 23923029 / +0.3% 0.73 / 0.72 / +1.7%
tpcds_q85/duckdb:parquet 34934432 / 34435036 / +1.5% 46011607 / 45644923 / +0.8% 0.76 / 0.75 / +0.6%
tpcds_q86/duckdb:parquet 11047408 / 10704392 / +3.2% 15981709 / 15560360 / +2.7% 0.69 / 0.69 / +0.5%
tpcds_q87/duckdb:parquet 28151474 / 28244882 / -0.3% 32681508 / 31501955 / +3.7% 0.86 / 0.90 / -3.9%
tpcds_q88/duckdb:parquet 27029070 / 27807436 / -2.8% 30955554 / 31808993 / -2.7% 0.87 / 0.87 / -0.1%
tpcds_q89/duckdb:parquet 12702146 / 12701684 / +0.0% 18551852 / 27041856 / -31.4% 🟢 0.68 / 0.47 / +45.8%
tpcds_q90/duckdb:parquet 9469583 / 7250502 / +30.6% 🔴 12829965 / 13785160 / -6.9% 0.74 / 0.53 / +40.3%
tpcds_q91/duckdb:parquet 20749075 / 20652352 / +0.5% 29967409 / 29358405 / +2.1% 0.69 / 0.70 / -1.6%
tpcds_q92/duckdb:parquet 11402749 / 11567391 / -1.4% 18164086 / 18733693 / -3.0% 0.63 / 0.62 / +1.7%
tpcds_q93/duckdb:parquet 21376889 / 21403884 / -0.1% 28909258 / 29722200 / -2.7% 0.74 / 0.72 / +2.7%
tpcds_q94/duckdb:parquet 16139366 / 16046258 / +0.6% 25066289 / 24761839 / +1.2% 0.64 / 0.65 / -0.6%
tpcds_q95/duckdb:parquet 89939202 / 89652158 / +0.3% 96491174 / 97525299 / -1.1% 0.93 / 0.92 / +1.4%
tpcds_q96/duckdb:parquet 6885782 / 6859230 / +0.4% 10742460 / 13615904 / -21.1% 🟢 0.64 / 0.50 / +27.2%
tpcds_q97/duckdb:parquet 25961383 / 25919598 / +0.2% 31940842 / 31751324 / +0.6% 0.81 / 0.82 / -0.4%
tpcds_q98/duckdb:parquet 15242149 / 14880374 / +2.4% 21559680 / 22572893 / -4.5% 0.71 / 0.66 / +7.2%
tpcds_q99/duckdb:parquet 17296632 / 17395711 / -0.6% 22171878 / 20988346 / +5.6% 0.78 / 0.83 / -5.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 1.025x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.024x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1255082 / 1234049 / +1.7% 20344260 / 20207671 / +0.7% 0.06 / 0.06 / +1.0%
clickbench_q01/datafusion:vortex-compact 7532965 / 7049096 / +6.9% 34249069 / 28850837 / +18.7% 🔴 0.22 / 0.24 / -10.0%
clickbench_q02/datafusion:vortex-compact 20292052 / 20285916 / +0.0% 47180829 / 42622605 / +10.7% 🔴 0.43 / 0.48 / -9.6%
clickbench_q03/datafusion:vortex-compact 13787592 / 14808566 / -6.9% 40013767 / 37510795 / +6.7% 0.34 / 0.39 / -12.7%
clickbench_q04/datafusion:vortex-compact 58164333 / 57578940 / +1.0% 84963526 / 88372644 / -3.9% 0.68 / 0.65 / +5.1%
clickbench_q05/datafusion:vortex-compact 85323633 / 84217868 / +1.3% 123537957 / 119965140 / +3.0% 0.69 / 0.70 / -1.6%
clickbench_q06/datafusion:vortex-compact 1235050 / 1281910 / -3.7% 20191335 / 19487748 / +3.6% 0.06 / 0.07 / -7.0%
clickbench_q07/datafusion:vortex-compact 12668848 / 12507927 / +1.3% 35313481 / 37058176 / -4.7% 0.36 / 0.34 / +6.3%
clickbench_q08/datafusion:vortex-compact 88084586 / 85977824 / +2.5% 117986642 / 111963222 / +5.4% 0.75 / 0.77 / -2.8%
clickbench_q09/datafusion:vortex-compact 190674606 / 187637978 / +1.6% 220930409 / 213095433 / +3.7% 0.86 / 0.88 / -2.0%
clickbench_q10/datafusion:vortex-compact 43135298 / 43546444 / -0.9% 69218362 / 71877773 / -3.7% 0.62 / 0.61 / +2.9%
clickbench_q11/datafusion:vortex-compact 55893332 / 55372877 / +0.9% 82878374 / 81299336 / +1.9% 0.67 / 0.68 / -1.0%
clickbench_q12/datafusion:vortex-compact 84109275 / 84299668 / -0.2% 122936406 / 119705676 / +2.7% 0.68 / 0.70 / -2.8%
clickbench_q13/datafusion:vortex-compact 135830849 / 138279304 / -1.8% 178883693 / 181735860 / -1.6% 0.76 / 0.76 / -0.2%
clickbench_q14/datafusion:vortex-compact 89837962 / 93116296 / -3.5% 130236471 / 121726648 / +7.0% 0.69 / 0.76 / -9.8%
clickbench_q15/datafusion:vortex-compact 63613733 / 64755939 / -1.8% 94218272 / 91647239 / +2.8% 0.68 / 0.71 / -4.4%
clickbench_q16/datafusion:vortex-compact 169289822 / 163613714 / +3.5% 211863009 / 207674228 / +2.0% 0.80 / 0.79 / +1.4%
clickbench_q17/datafusion:vortex-compact 164625532 / 160277920 / +2.7% 210769265 / 211916587 / -0.5% 0.78 / 0.76 / +3.3%
clickbench_q18/datafusion:vortex-compact 305828054 / 307577564 / -0.6% 351074534 / 356434600 / -1.5% 0.87 / 0.86 / +0.9%
clickbench_q19/datafusion:vortex-compact 10597588 / 10436554 / +1.5% 37832382 / 37837989 / -0.0% 0.28 / 0.28 / +1.6%
clickbench_q20/datafusion:vortex-compact 71684244 / 71561638 / +0.2% 187786420 / 190064629 / -1.2% 0.38 / 0.38 / +1.4%
clickbench_q21/datafusion:vortex-compact 118407841 / 117529072 / +0.7% 223852668 / 225733097 / -0.8% 0.53 / 0.52 / +1.6%
clickbench_q22/datafusion:vortex-compact 185837176 / 185635914 / +0.1% 269412501 / 271440438 / -0.7% 0.69 / 0.68 / +0.9%
clickbench_q23/datafusion:vortex-compact 526861006 / 538913129 / -2.2% 640700331 / 634593422 / +1.0% 0.82 / 0.85 / -3.2%
clickbench_q24/datafusion:vortex-compact 27933744 / 28377058 / -1.6% 60875086 / 57389413 / +6.1% 0.46 / 0.49 / -7.2%
clickbench_q25/datafusion:vortex-compact 35028914 / 37182586 / -5.8% 69788824 / 65726330 / +6.2% 0.50 / 0.57 / -11.3%
clickbench_q26/datafusion:vortex-compact 26648694 / 29388147 / -9.3% 63239649 / 61164636 / +3.4% 0.42 / 0.48 / -12.3%
clickbench_q27/datafusion:vortex-compact 105565344 / 104422342 / +1.1% 207530109 / 202986494 / +2.2% 0.51 / 0.51 / -1.1%
clickbench_q28/datafusion:vortex-compact 575544524 / 582572390 / -1.2% 634951487 / 611323603 / +3.9% 0.91 / 0.95 / -4.9%
clickbench_q29/datafusion:vortex-compact 30776209 / 30615804 / +0.5% 53900853 / 53642755 / +0.5% 0.57 / 0.57 / +0.0%
clickbench_q30/datafusion:vortex-compact 94148474 / 92981863 / +1.3% 128985988 / 124056079 / +4.0% 0.73 / 0.75 / -2.6%
clickbench_q31/datafusion:vortex-compact 100476948 / 101209674 / -0.7% 153172685 / 154254737 / -0.7% 0.66 / 0.66 / -0.0%
clickbench_q32/datafusion:vortex-compact 300243392 / 302248104 / -0.7% 367960827 / 363489678 / +1.2% 0.82 / 0.83 / -1.9%
clickbench_q33/datafusion:vortex-compact 341281818 / 345880892 / -1.3% 412424422 / 417520626 / -1.2% 0.83 / 0.83 / -0.1%
clickbench_q34/datafusion:vortex-compact 341022331 / 342926031 / -0.6% 407732152 / 422306393 / -3.5% 0.84 / 0.81 / +3.0%
clickbench_q35/datafusion:vortex-compact 62574294 / 61721326 / +1.4% 92862963 / 90237330 / +2.9% 0.67 / 0.68 / -1.5%
clickbench_q36/datafusion:vortex-compact 38254735 / 38567253 / -0.8% 64841955 / 64560525 / +0.4% 0.59 / 0.60 / -1.2%
clickbench_q37/datafusion:vortex-compact 22484962 / 22484605 / +0.0% 46423439 / 46117147 / +0.7% 0.48 / 0.49 / -0.7%
clickbench_q38/datafusion:vortex-compact 13120188 / 12953152 / +1.3% 39678706 / 38055657 / +4.3% 0.33 / 0.34 / -2.9%
clickbench_q39/datafusion:vortex-compact 79054750 / 79119350 / -0.1% 110662324 / 108305811 / +2.2% 0.71 / 0.73 / -2.2%
clickbench_q40/datafusion:vortex-compact 12455482 / 12490180 / -0.3% 36065933 / 35193481 / +2.5% 0.35 / 0.35 / -2.7%
clickbench_q41/datafusion:vortex-compact 12659418 / 13204074 / -4.1% 35325690 / 35817403 / -1.4% 0.36 / 0.37 / -2.8%
clickbench_q42/datafusion:vortex-compact 11015214 / 11395796 / -3.3% 33898615 / 33578852 / +1.0% 0.32 / 0.34 / -4.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1267660 / 1273958 / -0.5% 49127456 / 47165375 / +4.2% 0.03 / 0.03 / -4.5%
clickbench_q01/datafusion:parquet 16458526 / 15639554 / +5.2% 72366598 / 65855878 / +9.9% 0.23 / 0.24 / -4.2%
clickbench_q02/datafusion:parquet 19350233 / 18554672 / +4.3% 85402252 / 80880468 / +5.6% 0.23 / 0.23 / -1.2%
clickbench_q03/datafusion:parquet 17875408 / 16864356 / +6.0% 84628211 / 77901674 / +8.6% 0.21 / 0.22 / -2.4%
clickbench_q04/datafusion:parquet 62181288 / 61544132 / +1.0% 123242506 / 126808520 / -2.8% 0.50 / 0.49 / +4.0%
clickbench_q05/datafusion:parquet 87086056 / 88048841 / -1.1% 161348084 / 153721729 / +5.0% 0.54 / 0.57 / -5.8%
clickbench_q06/datafusion:parquet 1288280 / 1285698 / +0.2% 48913134 / 47721211 / +2.5% 0.03 / 0.03 / -2.2%
clickbench_q07/datafusion:parquet 16714592 / 16909257 / -1.2% 68363217 / 67517987 / +1.3% 0.24 / 0.25 / -2.4%
clickbench_q08/datafusion:parquet 83324568 / 90631988 / -8.1% 169463859 / 160648026 / +5.5% 0.49 / 0.56 / -12.8%
clickbench_q09/datafusion:parquet 187568330 / 185491287 / +1.1% 263868108 / 258050870 / +2.3% 0.71 / 0.72 / -1.1%
clickbench_q10/datafusion:parquet 35902830 / 35379630 / +1.5% 102182881 / 99622939 / +2.6% 0.35 / 0.36 / -1.1%
clickbench_q11/datafusion:parquet 42494230 / 41834196 / +1.6% 111871465 / 107024286 / +4.5% 0.38 / 0.39 / -2.8%
clickbench_q12/datafusion:parquet 94628477 / 95428642 / -0.8% 158761954 / 157431224 / +0.8% 0.60 / 0.61 / -1.7%
clickbench_q13/datafusion:parquet 145864406 / 144492213 / +0.9% 221967945 / 219474122 / +1.1% 0.66 / 0.66 / -0.2%
clickbench_q14/datafusion:parquet 99361407 / 100146322 / -0.8% 171562396 / 164179846 / +4.5% 0.58 / 0.61 / -5.1%
clickbench_q15/datafusion:parquet 66927164 / 71380024 / -6.2% 130117827 / 129380233 / +0.6% 0.51 / 0.55 / -6.8%
clickbench_q16/datafusion:parquet 153908940 / 152565604 / +0.9% 230057700 / 228469676 / +0.7% 0.67 / 0.67 / +0.2%
clickbench_q17/datafusion:parquet 154934833 / 153819354 / +0.7% 233676298 / 227225249 / +2.8% 0.66 / 0.68 / -2.1%
clickbench_q18/datafusion:parquet 309866595 / 311039915 / -0.4% 410735611 / 409941319 / +0.2% 0.75 / 0.76 / -0.6%
clickbench_q19/datafusion:parquet 19575126 / 19638078 / -0.3% 75423729 / 74267683 / +1.6% 0.26 / 0.26 / -1.8%
clickbench_q20/datafusion:parquet 169585688 / 169176695 / +0.2% 279882688 / 277366673 / +0.9% 0.61 / 0.61 / -0.7%
clickbench_q21/datafusion:parquet 164840877 / 164540913 / +0.2% 294918539 / 287002130 / +2.8% 0.56 / 0.57 / -2.5%
clickbench_q22/datafusion:parquet 245729806 / 248047432 / -0.9% 424410901 / 411374162 / +3.2% 0.58 / 0.60 / -4.0%
clickbench_q23/datafusion:parquet 955568020 / 959219334 / -0.4% 1204623672 / 1167619239 / +3.2% 0.79 / 0.82 / -3.4%
clickbench_q24/datafusion:parquet 29571886 / 30637752 / -3.5% 87584461 / 86110195 / +1.7% 0.34 / 0.36 / -5.1%
clickbench_q25/datafusion:parquet 35501860 / 35394838 / +0.3% 102654963 / 98215711 / +4.5% 0.35 / 0.36 / -4.0%
clickbench_q26/datafusion:parquet 30297635 / 31124166 / -2.7% 89568442 / 87881661 / +1.9% 0.34 / 0.35 / -4.5%
clickbench_q27/datafusion:parquet 181668006 / 181872358 / -0.1% 281586576 / 272961390 / +3.2% 0.65 / 0.67 / -3.2%
clickbench_q28/datafusion:parquet 618967290 / 618083750 / +0.1% 701098818 / 692969835 / +1.2% 0.88 / 0.89 / -1.0%
clickbench_q29/datafusion:parquet 29622858 / 29110432 / +1.8% 90999231 / 91550929 / -0.6% 0.33 / 0.32 / +2.4%
clickbench_q30/datafusion:parquet 89612825 / 88982652 / +0.7% 173304298 / 169453982 / +2.3% 0.52 / 0.53 / -1.5%
clickbench_q31/datafusion:parquet 99171594 / 98906645 / +0.3% 192837941 / 184436982 / +4.6% 0.51 / 0.54 / -4.1%
clickbench_q32/datafusion:parquet 313672286 / 315109982 / -0.5% 422085369 / 410627081 / +2.8% 0.74 / 0.77 / -3.2%
clickbench_q33/datafusion:parquet 369604414 / 367050894 / +0.7% 455946193 / 455346342 / +0.1% 0.81 / 0.81 / +0.6%
clickbench_q34/datafusion:parquet 370448792 / 366694463 / +1.0% 462919747 / 459929859 / +0.7% 0.80 / 0.80 / +0.4%
clickbench_q35/datafusion:parquet 63390604 / 63975738 / -0.9% 127849857 / 120233910 / +6.3% 0.50 / 0.53 / -6.8%
clickbench_q36/datafusion:parquet 72920826 / 72952512 / -0.0% 135973619 / 132250167 / +2.8% 0.54 / 0.55 / -2.8%
clickbench_q37/datafusion:parquet 35555618 / 35441996 / +0.3% 91224853 / 90103004 / +1.2% 0.39 / 0.39 / -0.9%
clickbench_q38/datafusion:parquet 46883504 / 47001620 / -0.3% 107131364 / 104003952 / +3.0% 0.44 / 0.45 / -3.2%
clickbench_q39/datafusion:parquet 142787038 / 142855742 / -0.0% 211229909 / 206786332 / +2.1% 0.68 / 0.69 / -2.2%
clickbench_q40/datafusion:parquet 19948695 / 19742648 / +1.0% 79005750 / 74720731 / +5.7% 0.25 / 0.26 / -4.4%
clickbench_q41/datafusion:parquet 18465294 / 18668877 / -1.1% 75383159 / 74795085 / +0.8% 0.24 / 0.25 / -1.9%
clickbench_q42/datafusion:parquet 19185046 / 19276181 / -0.5% 74193447 / 73148576 / +1.4% 0.26 / 0.26 / -1.9%
duckdb / vortex-compact / ns (0.991x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1555592 / 1586538 / -2.0% 23465409 / 25633899 / -8.5% 0.07 / 0.06 / +7.1%
clickbench_q01/duckdb:vortex-compact 12334354 / 13771110 / -10.4% 🟢 28306496 / 29381123 / -3.7% 0.44 / 0.47 / -7.0%
clickbench_q02/duckdb:vortex-compact 20679412 / 22192312 / -6.8% 42456758 / 43265923 / -1.9% 0.49 / 0.51 / -5.0%
clickbench_q03/duckdb:vortex-compact 20576607 / 19703332 / +4.4% 45628809 / 42950218 / +6.2% 0.45 / 0.46 / -1.7%
clickbench_q04/duckdb:vortex-compact 70992867 / 73467416 / -3.4% 104361520 / 104507587 / -0.1% 0.68 / 0.70 / -3.2%
clickbench_q05/duckdb:vortex-compact 80024746 / 76327936 / +4.8% 101109374 / 100054563 / +1.1% 0.79 / 0.76 / +3.7%
clickbench_q06/duckdb:vortex-compact 1782137 / 1835338 / -2.9% 30694694 / 31109303 / -1.3% 0.06 / 0.06 / -1.6%
clickbench_q07/duckdb:vortex-compact 14994552 / 14576449 / +2.9% 29839652 / 31271095 / -4.6% 0.50 / 0.47 / +7.8%
clickbench_q08/duckdb:vortex-compact 105763162 / 95078910 / +11.2% 🔴 133722611 / 129259047 / +3.5% 0.79 / 0.74 / +7.5%
clickbench_q09/duckdb:vortex-compact 144527278 / 144528120 / -0.0% 173372683 / 177241521 / -2.2% 0.83 / 0.82 / +2.2%
clickbench_q10/duckdb:vortex-compact 52435797 / 54770506 / -4.3% 88066599 / 90428978 / -2.6% 0.60 / 0.61 / -1.7%
clickbench_q11/duckdb:vortex-compact 66446380 / 67746233 / -1.9% 108249861 / 103756704 / +4.3% 0.61 / 0.65 / -6.0%
clickbench_q12/duckdb:vortex-compact 85867794 / 86116614 / -0.3% 123871883 / 124659149 / -0.6% 0.69 / 0.69 / +0.3%
clickbench_q13/duckdb:vortex-compact 166522264 / 166752492 / -0.1% 214519061 / 203635552 / +5.3% 0.78 / 0.82 / -5.2%
clickbench_q14/duckdb:vortex-compact 96160884 / 98057420 / -1.9% 135580211 / 126827542 / +6.9% 0.71 / 0.77 / -8.3%
clickbench_q15/duckdb:vortex-compact 98366640 / 97818052 / +0.6% 134322007 / 136662019 / -1.7% 0.73 / 0.72 / +2.3%
clickbench_q16/duckdb:vortex-compact 175413522 / 179559144 / -2.3% 226764611 / 223428971 / +1.5% 0.77 / 0.80 / -3.7%
clickbench_q17/duckdb:vortex-compact 181259267 / 181854745 / -0.3% 229719811 / 224696111 / +2.2% 0.79 / 0.81 / -2.5%
clickbench_q18/duckdb:vortex-compact 329518402 / 335419138 / -1.8% 384757831 / 377803203 / +1.8% 0.86 / 0.89 / -3.5%
clickbench_q19/duckdb:vortex-compact 16253122 / 17242161 / -5.7% 40654377 / 37521515 / +8.3% 0.40 / 0.46 / -13.0%
clickbench_q20/duckdb:vortex-compact 109893904 / 109335116 / +0.5% 178977929 / 168422542 / +6.3% 0.61 / 0.65 / -5.4%
clickbench_q21/duckdb:vortex-compact 183755467 / 187615306 / -2.1% 371462578 / 320740904 / +15.8% 🔴 0.49 / 0.58 / -15.4%
clickbench_q22/duckdb:vortex-compact 387968426 / 386450254 / +0.4% 661026994 / 569504149 / +16.1% 🔴 0.59 / 0.68 / -13.5%
clickbench_q23/duckdb:vortex-compact 97122333 / 97919636 / -0.8% 138675897 / 122517295 / +13.2% 🔴 0.70 / 0.80 / -12.4%
clickbench_q24/duckdb:vortex-compact 31888963 / 30868266 / +3.3% 48558789 / 45918524 / +5.7% 0.66 / 0.67 / -2.3%
clickbench_q25/duckdb:vortex-compact 47579953 / 48514003 / -1.9% 69004491 / 66851749 / +3.2% 0.69 / 0.73 / -5.0%
clickbench_q26/duckdb:vortex-compact 23547226 / 23018647 / +2.3% 41385775 / 37656464 / +9.9% 0.57 / 0.61 / -6.9%
clickbench_q27/duckdb:vortex-compact 206621758 / 208680134 / -1.0% 359294106 / 319811856 / +12.3% 🔴 0.58 / 0.65 / -11.9%
clickbench_q28/duckdb:vortex-compact 590887992 / 603562444 / -2.1% 712781243 / 696752303 / +2.3% 0.83 / 0.87 / -4.3%
clickbench_q29/duckdb:vortex-compact 25255531 / 26247486 / -3.8% 44149765 / 45568664 / -3.1% 0.57 / 0.58 / -0.7%
clickbench_q30/duckdb:vortex-compact 109406010 / 112234673 / -2.5% 153618101 / 145093908 / +5.9% 0.71 / 0.77 / -7.9%
clickbench_q31/duckdb:vortex-compact 176131986 / 171973024 / +2.4% 256653886 / 244174263 / +5.1% 0.69 / 0.70 / -2.6%
clickbench_q32/duckdb:vortex-compact 447055054 / 462776132 / -3.4% 497526391 / 503714866 / -1.2% 0.90 / 0.92 / -2.2%
clickbench_q33/duckdb:vortex-compact 401222320 / 400093415 / +0.3% 530775914 / 504507555 / +5.2% 0.76 / 0.79 / -4.7%
clickbench_q34/duckdb:vortex-compact 417616060 / 429886002 / -2.9% 562587210 / 544013129 / +3.4% 0.74 / 0.79 / -6.1%
clickbench_q35/duckdb:vortex-compact 106986459 / 107302794 / -0.3% 146672670 / 134658946 / +8.9% 0.73 / 0.80 / -8.5%
clickbench_q36/duckdb:vortex-compact 16934902 / 17172770 / -1.4% 34197441 / 32247926 / +6.0% 0.50 / 0.53 / -7.0%
clickbench_q37/duckdb:vortex-compact 15125776 / 14632772 / +3.4% 29575351 / 31781744 / -6.9% 0.51 / 0.46 / +11.1%
clickbench_q38/duckdb:vortex-compact 14066591 / 14994390 / -6.2% 29513594 / 28511481 / +3.5% 0.48 / 0.53 / -9.4%
clickbench_q39/duckdb:vortex-compact 26472288 / 27159598 / -2.5% 47965205 / 43520056 / +10.2% 🔴 0.55 / 0.62 / -11.6%
clickbench_q40/duckdb:vortex-compact 13330806 / 13200640 / +1.0% 29858986 / 27338853 / +9.2% 0.45 / 0.48 / -7.5%
clickbench_q41/duckdb:vortex-compact 14239450 / 14251214 / -0.1% 27769502 / 29609248 / -6.2% 0.51 / 0.48 / +6.5%
clickbench_q42/duckdb:vortex-compact 12408360 / 12343516 / +0.5% 28422227 / 28447631 / -0.1% 0.44 / 0.43 / +0.6%
duckdb / parquet / ns (1.002x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9954918 / 8843795 / +12.6% 🔴 24179034 / 18663687 / +29.6% 🔴 0.41 / 0.47 / -13.1%
clickbench_q01/duckdb:parquet 10856454 / 10429928 / +4.1% 24582137 / 21584965 / +13.9% 🔴 0.44 / 0.48 / -8.6%
clickbench_q02/duckdb:parquet 15807754 / 18308825 / -13.7% 🟢 34553408 / 31296293 / +10.4% 🔴 0.46 / 0.59 / -21.8%
clickbench_q03/duckdb:parquet 16761884 / 15647662 / +7.1% 54119662 / 50803425 / +6.5% 0.31 / 0.31 / +0.6%
clickbench_q04/duckdb:parquet 70136557 / 69638642 / +0.7% 97378076 / 88120209 / +10.5% 🔴 0.72 / 0.79 / -8.9%
clickbench_q05/duckdb:parquet 80979610 / 92285166 / -12.3% 🟢 124328679 / 119305055 / +4.2% 0.65 / 0.77 / -15.8%
clickbench_q06/duckdb:parquet 14764925 / 15307928 / -3.5% 28093327 / 22622893 / +24.2% 🔴 0.53 / 0.68 / -22.3%
clickbench_q07/duckdb:parquet 10986878 / 10148460 / +8.3% 23620759 / 26126737 / -9.6% 0.47 / 0.39 / +19.7%
clickbench_q08/duckdb:parquet 88596646 / 85797215 / +3.3% 124205661 / 126177576 / -1.6% 0.71 / 0.68 / +4.9%
clickbench_q09/duckdb:parquet 114217490 / 117428328 / -2.7% 164119217 / 167254886 / -1.9% 0.70 / 0.70 / -0.9%
clickbench_q10/duckdb:parquet 33140442 / 32811760 / +1.0% 71106717 / 67774214 / +4.9% 0.47 / 0.48 / -3.7%
clickbench_q11/duckdb:parquet 35995980 / 36997368 / -2.7% 80702285 / 75040599 / +7.5% 0.45 / 0.49 / -9.5%
clickbench_q12/duckdb:parquet 94165082 / 90301820 / +4.3% 136471492 / 137858165 / -1.0% 0.69 / 0.66 / +5.3%
clickbench_q13/duckdb:parquet 148522918 / 147888332 / +0.4% 209002873 / 214643373 / -2.6% 0.71 / 0.69 / +3.1%
clickbench_q14/duckdb:parquet 100899546 / 95724041 / +5.4% 143553289 / 144311501 / -0.5% 0.70 / 0.66 / +6.0%
clickbench_q15/duckdb:parquet 92664112 / 92687706 / -0.0% 120163784 / 117805859 / +2.0% 0.77 / 0.79 / -2.0%
clickbench_q16/duckdb:parquet 171501042 / 172737910 / -0.7% 236362982 / 225432779 / +4.8% 0.73 / 0.77 / -5.3%
clickbench_q17/duckdb:parquet 176191195 / 179658830 / -1.9% 243378034 / 232046018 / +4.9% 0.72 / 0.77 / -6.5%
clickbench_q18/duckdb:parquet 325724135 / 324712342 / +0.3% 402042492 / 401212718 / +0.2% 0.81 / 0.81 / +0.1%
clickbench_q19/duckdb:parquet 13382936 / 13893066 / -3.7% 42649730 / 40737776 / +4.7% 0.31 / 0.34 / -8.0%
clickbench_q20/duckdb:parquet 135651172 / 138239740 / -1.9% 241788752 / 242234660 / -0.2% 0.56 / 0.57 / -1.7%
clickbench_q21/duckdb:parquet 177278088 / 177044165 / +0.1% 324618237 / 324783647 / -0.1% 0.55 / 0.55 / +0.2%
clickbench_q22/duckdb:parquet 250246206 / 237288884 / +5.5% 427876859 / 419494544 / +2.0% 0.58 / 0.57 / +3.4%
clickbench_q23/duckdb:parquet 147791592 / 147409858 / +0.3% 164802820 / 168964980 / -2.5% 0.90 / 0.87 / +2.8%
clickbench_q24/duckdb:parquet 43536581 / 43939671 / -0.9% 62053838 / 62243172 / -0.3% 0.70 / 0.71 / -0.6%
clickbench_q25/duckdb:parquet 41127352 / 39621939 / +3.8% 91666266 / 91922502 / -0.3% 0.45 / 0.43 / +4.1%
clickbench_q26/duckdb:parquet 30090582 / 31994067 / -5.9% 45739945 / 48077122 / -4.9% 0.66 / 0.67 / -1.1%
clickbench_q27/duckdb:parquet 150405446 / 145200465 / +3.6% 258117631 / 258036618 / +0.0% 0.58 / 0.56 / +3.6%
clickbench_q28/duckdb:parquet 897656034 / 903844380 / -0.7% 1029514836 / 978490638 / +5.2% 0.87 / 0.92 / -5.6%
clickbench_q29/duckdb:parquet 16610244 / 16686202 / -0.5% 31272401 / 32155268 / -2.7% 0.53 / 0.52 / +2.4%
clickbench_q30/duckdb:parquet 91210508 / 92153532 / -1.0% 175326146 / 170541690 / +2.8% 0.52 / 0.54 / -3.7%
clickbench_q31/duckdb:parquet 144314377 / 145102732 / -0.5% 296528360 / 291966719 / +1.6% 0.49 / 0.50 / -2.1%
clickbench_q32/duckdb:parquet 446334764 / 450587114 / -0.9% 519496136 / 496836853 / +4.6% 0.86 / 0.91 / -5.3%
clickbench_q33/duckdb:parquet 442359048 / 431087906 / +2.6% 478882896 / 465853391 / +2.8% 0.92 / 0.93 / -0.2%
clickbench_q34/duckdb:parquet 451501825 / 451922634 / -0.1% 479531288 / 471361918 / +1.7% 0.94 / 0.96 / -1.8%
clickbench_q35/duckdb:parquet 101203850 / 98966656 / +2.3% 122058851 / 120335501 / +1.4% 0.83 / 0.82 / +0.8%
clickbench_q36/duckdb:parquet 30846821 / 31327620 / -1.5% 41347650 / 41642834 / -0.7% 0.75 / 0.75 / -0.8%
clickbench_q37/duckdb:parquet 22938136 / 22809704 / +0.6% 31684060 / 31963489 / -0.9% 0.72 / 0.71 / +1.4%
clickbench_q38/duckdb:parquet 24516288 / 24825154 / -1.2% 34861154 / 35972486 / -3.1% 0.70 / 0.69 / +1.9%
clickbench_q39/duckdb:parquet 56389982 / 56891349 / -0.9% 66184095 / 67107985 / -1.4% 0.85 / 0.85 / +0.5%
clickbench_q40/duckdb:parquet 12584214 / 12992570 / -3.1% 21987979 / 23516343 / -6.5% 0.57 / 0.55 / +3.6%
clickbench_q41/duckdb:parquet 13278799 / 12606942 / +5.3% 23332875 / 22461829 / +3.9% 0.57 / 0.56 / +1.4%
clickbench_q42/duckdb:parquet 14911775 / 14626797 / +1.9% 24968886 / 29401073 / -15.1% 🟢 0.60 / 0.50 / +20.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.3%
Engines: DataFusion No clear signal (+14.3%, environment too noisy confidence) · DuckDB No clear signal (+6.5%, low confidence)
Vortex (geomean): hot 1.119x ➖ · cold 1.073x ➖
Parquet (geomean): hot 1.014x ➖ · cold 1.015x ➖
Shifts: Parquet (control) +1.4% · Median polish +3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.120x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 210276071 / 219478840 / -4.2% 715029278 / 755390339 / -5.3% 0.29 / 0.29 / +1.2%
tpch_q02/datafusion:vortex-file-compressed 312429676 / 391663824 / -20.2% 572894956 / 683643244 / -16.2% 0.55 / 0.57 / -4.8%
tpch_q03/datafusion:vortex-file-compressed 306412725 / 296678449 / +3.3% 1025051055 / 905985186 / +13.1% 0.30 / 0.33 / -8.7%
tpch_q04/datafusion:vortex-file-compressed 157566993 / 151582445 / +3.9% 335091330 / 360081832 / -6.9% 0.47 / 0.42 / +11.7%
tpch_q05/datafusion:vortex-file-compressed 338467746 / 392989645 / -13.9% 505211275 / 627608623 / -19.5% 0.67 / 0.63 / +7.0%
tpch_q06/datafusion:vortex-file-compressed 261070275 / 242438566 / +7.7% 386969383 / 448069475 / -13.6% 0.67 / 0.54 / +24.7%
tpch_q07/datafusion:vortex-file-compressed 335835351 / 404079563 / -16.9% 472271982 / 513725279 / -8.1% 0.71 / 0.79 / -9.6%
tpch_q08/datafusion:vortex-file-compressed 551625493 / 429051377 / +28.6% 734397812 / 573374736 / +28.1% 0.75 / 0.75 / +0.4%
tpch_q09/datafusion:vortex-file-compressed 447235783 / 495674768 / -9.8% 662432820 / 626863492 / +5.7% 0.68 / 0.79 / -14.6%
tpch_q10/datafusion:vortex-file-compressed 791945906 / 327820254 / +141.6% 🔴 442768267 / 554845064 / -20.2% 1.79 / 0.59 / +202.7%
tpch_q11/datafusion:vortex-file-compressed 281831133 / 260523555 / +8.2% 448295648 / 408242185 / +9.8% 0.63 / 0.64 / -1.5%
tpch_q12/datafusion:vortex-file-compressed 573421007 / 302338765 / +89.7% 🔴 737270147 / 533297511 / +38.2% 🔴 0.78 / 0.57 / +37.2%
tpch_q13/datafusion:vortex-file-compressed 193815041 / 121344072 / +59.7% 🔴 504593252 / 301583315 / +67.3% 🔴 0.38 / 0.40 / -4.5%
tpch_q14/datafusion:vortex-file-compressed 165645023 / 186036370 / -11.0% 314559214 / 284178673 / +10.7% 0.53 / 0.65 / -19.6%
tpch_q15/datafusion:vortex-file-compressed 291688691 / 288712243 / +1.0% 452569173 / 449630949 / +0.7% 0.64 / 0.64 / +0.4%
tpch_q16/datafusion:vortex-file-compressed 176978407 / 156578898 / +13.0% 295111476 / 267462615 / +10.3% 0.60 / 0.59 / +2.4%
tpch_q17/datafusion:vortex-file-compressed 280805210 / 236696586 / +18.6% 445917611 / 460641526 / -3.2% 0.63 / 0.51 / +22.6%
tpch_q18/datafusion:vortex-file-compressed 226146789 / 214312468 / +5.5% 483357623 / 392433503 / +23.2% 0.47 / 0.55 / -14.3%
tpch_q19/datafusion:vortex-file-compressed 337971735 / 325738710 / +3.8% 566090873 / 469528264 / +20.6% 0.60 / 0.69 / -13.9%
tpch_q20/datafusion:vortex-file-compressed 451687341 / 294948759 / +53.1% 🔴 564376853 / 622783892 / -9.4% 0.80 / 0.47 / +69.0%
tpch_q21/datafusion:vortex-file-compressed 452909473 / 379892821 / +19.2% 562087983 / 545185245 / +3.1% 0.81 / 0.70 / +15.6%
tpch_q22/datafusion:vortex-file-compressed 172394841 / 197949216 / -12.9% 354097896 / 338227395 / +4.7% 0.49 / 0.59 / -16.8%
datafusion / parquet / ns (0.980x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164673060 / 162885220 / +1.1% 454470986 / 397871647 / +14.2% 0.36 / 0.41 / -11.5%
tpch_q02/datafusion:parquet 261141385 / 319787928 / -18.3% 555533055 / 562840909 / -1.3% 0.47 / 0.57 / -17.3%
tpch_q03/datafusion:parquet 276524450 / 264218028 / +4.7% 729904522 / 661685108 / +10.3% 0.38 / 0.40 / -5.1%
tpch_q04/datafusion:parquet 138120567 / 158564077 / -12.9% 345258515 / 336623374 / +2.6% 0.40 / 0.47 / -15.1%
tpch_q05/datafusion:parquet 321591820 / 341297257 / -5.8% 437816856 / 442207154 / -1.0% 0.73 / 0.77 / -4.8%
tpch_q06/datafusion:parquet 125197812 / 126000716 / -0.6% 230742837 / 223477887 / +3.3% 0.54 / 0.56 / -3.8%
tpch_q07/datafusion:parquet 336212356 / 369234525 / -8.9% 426824238 / 514214328 / -17.0% 0.79 / 0.72 / +9.7%
tpch_q08/datafusion:parquet 420062617 / 407358097 / +3.1% 552250312 / 492547957 / +12.1% 0.76 / 0.83 / -8.0%
tpch_q09/datafusion:parquet 418965621 / 415430967 / +0.9% 581064375 / 558341256 / +4.1% 0.72 / 0.74 / -3.1%
tpch_q10/datafusion:parquet 366137877 / 368525065 / -0.6% 519017342 / 525335256 / -1.2% 0.71 / 0.70 / +0.6%
tpch_q11/datafusion:parquet 253804090 / 258594860 / -1.9% 390668637 / 381896749 / +2.3% 0.65 / 0.68 / -4.1%
tpch_q12/datafusion:parquet 184217951 / 171036402 / +7.7% 481808652 / 375379904 / +28.4% 0.38 / 0.46 / -16.1%
tpch_q13/datafusion:parquet 399219864 / 397454081 / +0.4% 513737431 / 536916439 / -4.3% 0.78 / 0.74 / +5.0%
tpch_q14/datafusion:parquet 157568225 / 158534025 / -0.6% 292207467 / 250872684 / +16.5% 0.54 / 0.63 / -14.7%
tpch_q15/datafusion:parquet 256291937 / 251694768 / +1.8% 370694340 / 396178799 / -6.4% 0.69 / 0.64 / +8.8%
tpch_q16/datafusion:parquet 125569795 / 103989115 / +20.8% 302854601 / 271510109 / +11.5% 0.41 / 0.38 / +8.3%
tpch_q17/datafusion:parquet 327018105 / 388135901 / -15.7% 385675556 / 496995220 / -22.4% 0.85 / 0.78 / +8.6%
tpch_q18/datafusion:parquet 479764380 / 382399799 / +25.5% 531804767 / 488743815 / +8.8% 0.90 / 0.78 / +15.3%
tpch_q19/datafusion:parquet 152508805 / 174903898 / -12.8% 259747212 / 262543073 / -1.1% 0.59 / 0.67 / -11.9%
tpch_q20/datafusion:parquet 282716546 / 237609241 / +19.0% 502171427 / 430306151 / +16.7% 0.56 / 0.55 / +2.0%
tpch_q21/datafusion:parquet 328040972 / 525511284 / -37.6% 🟢 391012179 / 691223344 / -43.4% 🟢 0.84 / 0.76 / +10.4%
tpch_q22/datafusion:parquet 167147242 / 153070656 / +9.2% 327970516 / 316209298 / +3.7% 0.51 / 0.48 / +5.3%
duckdb / vortex-file-compressed / ns (1.117x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 192098248 / 194499685 / -1.2% 246146191 / 320971721 / -23.3% 0.78 / 0.61 / +28.8%
tpch_q02/duckdb:vortex-file-compressed 377519357 / 387815572 / -2.7% 391526889 / 355627318 / +10.1% 0.96 / 1.09 / -11.6%
tpch_q03/duckdb:vortex-file-compressed 407061909 / 369391032 / +10.2% 398732460 / 410001202 / -2.7% 1.02 / 0.90 / +13.3%
tpch_q04/duckdb:vortex-file-compressed 263617310 / 228150289 / +15.5% 441976357 / 260091809 / +69.9% 🔴 0.60 / 0.88 / -32.0%
tpch_q05/duckdb:vortex-file-compressed 390501042 / 371674913 / +5.1% 385957998 / 429736437 / -10.2% 1.01 / 0.86 / +17.0%
tpch_q06/duckdb:vortex-file-compressed 298662021 / 252516828 / +18.3% 327703370 / 265846909 / +23.3% 0.91 / 0.95 / -4.1%
tpch_q07/duckdb:vortex-file-compressed 425244779 / 409055951 / +4.0% 490500661 / 425521167 / +15.3% 0.87 / 0.96 / -9.8%
tpch_q08/duckdb:vortex-file-compressed 555656331 / 513431962 / +8.2% 591509720 / 554011914 / +6.8% 0.94 / 0.93 / +1.4%
tpch_q09/duckdb:vortex-file-compressed 468510283 / 442384212 / +5.9% 530897659 / 405315751 / +31.0% 🔴 0.88 / 1.09 / -19.1%
tpch_q10/duckdb:vortex-file-compressed 419781827 / 412995204 / +1.6% 432566314 / 445932201 / -3.0% 0.97 / 0.93 / +4.8%
tpch_q11/duckdb:vortex-file-compressed 159710017 / 132159591 / +20.8% 150931048 / 167746291 / -10.0% 1.06 / 0.79 / +34.3%
tpch_q12/duckdb:vortex-file-compressed 381101443 / 432449058 / -11.9% 498806756 / 463927877 / +7.5% 0.76 / 0.93 / -18.0%
tpch_q13/duckdb:vortex-file-compressed 289006493 / 284293970 / +1.7% 525751786 / 287397576 / +82.9% 🔴 0.55 / 0.99 / -44.4%
tpch_q14/duckdb:vortex-file-compressed 279479287 / 203427779 / +37.4% 🔴 300681593 / 257087082 / +17.0% 0.93 / 0.79 / +17.5%
tpch_q15/duckdb:vortex-file-compressed 281294012 / 137940693 / +103.9% 🔴 184253500 / 147921061 / +24.6% 1.53 / 0.93 / +63.7%
tpch_q16/duckdb:vortex-file-compressed 209221207 / 174659423 / +19.8% 230855779 / 213874076 / +7.9% 0.91 / 0.82 / +11.0%
tpch_q17/duckdb:vortex-file-compressed 524105685 / 364992239 / +43.6% 🔴 525012286 / 385361642 / +36.2% 🔴 1.00 / 0.95 / +5.4%
tpch_q18/duckdb:vortex-file-compressed 275920110 / 296701399 / -7.0% 297769003 / 305546215 / -2.5% 0.93 / 0.97 / -4.6%
tpch_q19/duckdb:vortex-file-compressed 321535916 / 333992212 / -3.7% 390658996 / 361696180 / +8.0% 0.82 / 0.92 / -10.9%
tpch_q20/duckdb:vortex-file-compressed 352810353 / 348221830 / +1.3% 420303045 / 434724750 / -3.3% 0.84 / 0.80 / +4.8%
tpch_q21/duckdb:vortex-file-compressed 599018811 / 539269046 / +11.1% 647319492 / 576362479 / +12.3% 0.93 / 0.94 / -1.1%
tpch_q22/duckdb:vortex-file-compressed 119740057 / 101979046 / +17.4% 118638790 / 141349376 / -16.1% 1.01 / 0.72 / +39.9%
duckdb / parquet / ns (1.049x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 287514351 / 275288123 / +4.4% 358524631 / 289310366 / +23.9% 0.80 / 0.95 / -15.7%
tpch_q02/duckdb:parquet 669817269 / 611501343 / +9.5% 685658428 / 621897679 / +10.3% 0.98 / 0.98 / -0.6%
tpch_q03/duckdb:parquet 757865559 / 690474429 / +9.8% 796644151 / 760494050 / +4.8% 0.95 / 0.91 / +4.8%
tpch_q04/duckdb:parquet 457766863 / 427965615 / +7.0% 445866414 / 523138202 / -14.8% 1.03 / 0.82 / +25.5%
tpch_q05/duckdb:parquet 872728469 / 861803668 / +1.3% 810892058 / 1027094920 / -21.0% 1.08 / 0.84 / +28.3%
tpch_q06/duckdb:parquet 287868593 / 263806237 / +9.1% 307978082 / 269355411 / +14.3% 0.93 / 0.98 / -4.6%
tpch_q07/duckdb:parquet 770069444 / 802484324 / -4.0% 853343785 / 826812954 / +3.2% 0.90 / 0.97 / -7.0%
tpch_q08/duckdb:parquet 1017362721 / 989490030 / +2.8% 1003801701 / 1543436214 / -35.0% 🟢 1.01 / 0.64 / +58.1%
tpch_q09/duckdb:parquet 1077568068 / 911371159 / +18.2% 1017594168 / 895313977 / +13.7% 1.06 / 1.02 / +4.0%
tpch_q10/duckdb:parquet 958050904 / 907535630 / +5.6% 1136974806 / 891235187 / +27.6% 0.84 / 1.02 / -17.3%
tpch_q11/duckdb:parquet 413871963 / 389544044 / +6.2% 421066814 / 384278575 / +9.6% 0.98 / 1.01 / -3.0%
tpch_q12/duckdb:parquet 516621975 / 504713777 / +2.4% 556260847 / 523759984 / +6.2% 0.93 / 0.96 / -3.6%
tpch_q13/duckdb:parquet 774753036 / 765946642 / +1.1% 874543285 / 991045828 / -11.8% 0.89 / 0.77 / +14.6%
tpch_q14/duckdb:parquet 468781462 / 453939127 / +3.3% 504335450 / 430144382 / +17.2% 0.93 / 1.06 / -11.9%
tpch_q15/duckdb:parquet 370634052 / 358334242 / +3.4% 555436948 / 400151764 / +38.8% 🔴 0.67 / 0.90 / -25.5%
tpch_q16/duckdb:parquet 456716387 / 468560630 / -2.5% 489655943 / 481571676 / +1.7% 0.93 / 0.97 / -4.1%
tpch_q17/duckdb:parquet 466365532 / 448192576 / +4.1% 477359192 / 454933246 / +4.9% 0.98 / 0.99 / -0.8%
tpch_q18/duckdb:parquet 595613880 / 594318516 / +0.2% 590359285 / 553045305 / +6.7% 1.01 / 1.07 / -6.1%
tpch_q19/duckdb:parquet 551296287 / 522547161 / +5.5% 668351191 / 570742667 / +17.1% 0.82 / 0.92 / -9.9%
tpch_q20/duckdb:parquet 857972057 / 753440161 / +13.9% 753472169 / 799553117 / -5.8% 1.14 / 0.94 / +20.8%
tpch_q21/duckdb:parquet 695768098 / 650694663 / +6.9% 897250813 / 670768122 / +33.8% 🔴 0.78 / 0.97 / -20.1%
tpch_q22/duckdb:parquet 392868314 / 387498850 / +1.4% 386204333 / 648641922 / -40.5% 🟢 1.02 / 0.60 / +70.3%

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.8%
Engines: DataFusion No clear signal (+13.1%, environment too noisy confidence) · DuckDB No clear signal (-4.8%, low confidence)
Vortex (geomean): hot 1.063x ➖ · cold 1.040x ➖
Parquet (geomean): hot 1.024x ➖ · cold 1.037x ➖
Shifts: Parquet (control) +2.4% · Median polish +3.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.130x ➖, 0↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 217040753 / 211940518 / +2.4% 583572049 / 658914169 / -11.4% 0.37 / 0.32 / +15.6%
tpch_q02/datafusion:vortex-compact 312585028 / 345640668 / -9.6% 624338839 / 643244195 / -2.9% 0.50 / 0.54 / -6.8%
tpch_q03/datafusion:vortex-compact 304923883 / 298156917 / +2.3% 735075867 / 695220717 / +5.7% 0.41 / 0.43 / -3.3%
tpch_q04/datafusion:vortex-compact 344414782 / 142893171 / +141.0% 🔴 487682032 / 371905949 / +31.1% 🔴 0.71 / 0.38 / +83.8%
tpch_q05/datafusion:vortex-compact 441443696 / 336796112 / +31.1% 🔴 514031139 / 604705915 / -15.0% 0.86 / 0.56 / +54.2%
tpch_q06/datafusion:vortex-compact 366940483 / 238712526 / +53.7% 🔴 369457483 / 372306706 / -0.8% 0.99 / 0.64 / +54.9%
tpch_q07/datafusion:vortex-compact 578222048 / 371728932 / +55.5% 🔴 776148072 / 447165337 / +73.6% 🔴 0.74 / 0.83 / -10.4%
tpch_q08/datafusion:vortex-compact 735919543 / 408183872 / +80.3% 🔴 995650188 / 577822207 / +72.3% 🔴 0.74 / 0.71 / +4.6%
tpch_q09/datafusion:vortex-compact 311274469 / 420231576 / -25.9% 520822534 / 453802291 / +14.8% 0.60 / 0.93 / -35.5%
tpch_q10/datafusion:vortex-compact 304424468 / 341606294 / -10.9% 494199512 / 443645144 / +11.4% 0.62 / 0.77 / -20.0%
tpch_q11/datafusion:vortex-compact 306934970 / 294236760 / +4.3% 441126919 / 446345006 / -1.2% 0.70 / 0.66 / +5.5%
tpch_q12/datafusion:vortex-compact 293739672 / 262851024 / +11.8% 523249595 / 397764852 / +31.5% 🔴 0.56 / 0.66 / -15.0%
tpch_q13/datafusion:vortex-compact 106077172 / 108087904 / -1.9% 309720421 / 289945378 / +6.8% 0.34 / 0.37 / -8.1%
tpch_q14/datafusion:vortex-compact 170626837 / 166256075 / +2.6% 281602033 / 291790286 / -3.5% 0.61 / 0.57 / +6.3%
tpch_q15/datafusion:vortex-compact 399021896 / 277661377 / +43.7% 🔴 534162772 / 542630167 / -1.6% 0.75 / 0.51 / +46.0%
tpch_q16/datafusion:vortex-compact 171028276 / 189646376 / -9.8% 296178013 / 392330950 / -24.5% 0.58 / 0.48 / +19.5%
tpch_q17/datafusion:vortex-compact 268053454 / 325282688 / -17.6% 463102338 / 500898235 / -7.5% 0.58 / 0.65 / -10.9%
tpch_q18/datafusion:vortex-compact 337344819 / 252495263 / +33.6% 🔴 376109241 / 457098971 / -17.7% 0.90 / 0.55 / +62.4%
tpch_q19/datafusion:vortex-compact 444569048 / 473545753 / -6.1% 532280586 / 506376261 / +5.1% 0.84 / 0.94 / -10.7%
tpch_q20/datafusion:vortex-compact 264338394 / 280964040 / -5.9% 429950246 / 688850900 / -37.6% 🟢 0.61 / 0.41 / +50.7%
tpch_q21/datafusion:vortex-compact 413232420 / 389183912 / +6.2% 536156971 / 704529680 / -23.9% 0.77 / 0.55 / +39.5%
tpch_q22/datafusion:vortex-compact 188281983 / 171565716 / +9.7% 308309403 / 328112891 / -6.0% 0.61 / 0.52 / +16.8%
datafusion / parquet / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 192619699 / 162885220 / +18.3% 483125797 / 397871647 / +21.4% 0.40 / 0.41 / -2.6%
tpch_q02/datafusion:parquet 253250851 / 319787928 / -20.8% 566202219 / 562840909 / +0.6% 0.45 / 0.57 / -21.3%
tpch_q03/datafusion:parquet 271420638 / 264218028 / +2.7% 1063770640 / 661685108 / +60.8% 🔴 0.26 / 0.40 / -36.1%
tpch_q04/datafusion:parquet 139795057 / 158564077 / -11.8% 347887453 / 336623374 / +3.3% 0.40 / 0.47 / -14.7%
tpch_q05/datafusion:parquet 348099674 / 341297257 / +2.0% 473928699 / 442207154 / +7.2% 0.73 / 0.77 / -4.8%
tpch_q06/datafusion:parquet 127162516 / 126000716 / +0.9% 304145933 / 223477887 / +36.1% 🔴 0.42 / 0.56 / -25.8%
tpch_q07/datafusion:parquet 331450718 / 369234525 / -10.2% 527040368 / 514214328 / +2.5% 0.63 / 0.72 / -12.4%
tpch_q08/datafusion:parquet 457155116 / 407358097 / +12.2% 549215393 / 492547957 / +11.5% 0.83 / 0.83 / +0.6%
tpch_q09/datafusion:parquet 417928712 / 415430967 / +0.6% 614592383 / 558341256 / +10.1% 0.68 / 0.74 / -8.6%
tpch_q10/datafusion:parquet 365374279 / 368525065 / -0.9% 532035179 / 525335256 / +1.3% 0.69 / 0.70 / -2.1%
tpch_q11/datafusion:parquet 260281360 / 258594860 / +0.7% 445368684 / 381896749 / +16.6% 0.58 / 0.68 / -13.7%
tpch_q12/datafusion:parquet 235845403 / 171036402 / +37.9% 🔴 357418355 / 375379904 / -4.8% 0.66 / 0.46 / +44.8%
tpch_q13/datafusion:parquet 395447055 / 397454081 / -0.5% 495321368 / 536916439 / -7.7% 0.80 / 0.74 / +7.9%
tpch_q14/datafusion:parquet 170452059 / 158534025 / +7.5% 356594159 / 250872684 / +42.1% 🔴 0.48 / 0.63 / -24.4%
tpch_q15/datafusion:parquet 277420514 / 251694768 / +10.2% 450175128 / 396178799 / +13.6% 0.62 / 0.64 / -3.0%
tpch_q16/datafusion:parquet 112133956 / 103989115 / +7.8% 238591841 / 271510109 / -12.1% 0.47 / 0.38 / +22.7%
tpch_q17/datafusion:parquet 286062432 / 388135901 / -26.3% 425473713 / 496995220 / -14.4% 0.67 / 0.78 / -13.9%
tpch_q18/datafusion:parquet 412293203 / 382399799 / +7.8% 561519485 / 488743815 / +14.9% 0.73 / 0.78 / -6.2%
tpch_q19/datafusion:parquet 156526765 / 174903898 / -10.5% 302184939 / 262543073 / +15.1% 0.52 / 0.67 / -22.2%
tpch_q20/datafusion:parquet 256964978 / 237609241 / +8.1% 434790704 / 430306151 / +1.0% 0.59 / 0.55 / +7.0%
tpch_q21/datafusion:parquet 415849984 / 525511284 / -20.9% 517824253 / 691223344 / -25.1% 0.80 / 0.76 / +5.6%
tpch_q22/datafusion:parquet 159090936 / 153070656 / +3.9% 316409854 / 316209298 / +0.1% 0.50 / 0.48 / +3.9%
duckdb / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 207933088 / 206709965 / +0.6% 223151252 / 228349841 / -2.3% 0.93 / 0.91 / +2.9%
tpch_q02/duckdb:vortex-compact 343529270 / 349421156 / -1.7% 359827801 / 375333286 / -4.1% 0.95 / 0.93 / +2.6%
tpch_q03/duckdb:vortex-compact 420898640 / 384244826 / +9.5% 482889475 / 413241912 / +16.9% 0.87 / 0.93 / -6.3%
tpch_q04/duckdb:vortex-compact 236427558 / 253898850 / -6.9% 281969632 / 247134109 / +14.1% 0.84 / 1.03 / -18.4%
tpch_q05/duckdb:vortex-compact 364366726 / 335529786 / +8.6% 411916474 / 395513920 / +4.1% 0.88 / 0.85 / +4.3%
tpch_q06/duckdb:vortex-compact 277696509 / 248304883 / +11.8% 248130343 / 250354341 / -0.9% 1.12 / 0.99 / +12.8%
tpch_q07/duckdb:vortex-compact 410699493 / 383993204 / +7.0% 425845148 / 488156659 / -12.8% 0.96 / 0.79 / +22.6%
tpch_q08/duckdb:vortex-compact 495962526 / 505647097 / -1.9% 566455305 / 547725816 / +3.4% 0.88 / 0.92 / -5.2%
tpch_q09/duckdb:vortex-compact 445883716 / 426474980 / +4.6% 424124949 / 423851680 / +0.1% 1.05 / 1.01 / +4.5%
tpch_q10/duckdb:vortex-compact 402097565 / 376282935 / +6.9% 488903369 / 390179124 / +25.3% 0.82 / 0.96 / -14.7%
tpch_q11/duckdb:vortex-compact 152325691 / 167172935 / -8.9% 179727485 / 150156277 / +19.7% 0.85 / 1.11 / -23.9%
tpch_q12/duckdb:vortex-compact 387460131 / 445977608 / -13.1% 392880580 / 457347552 / -14.1% 0.99 / 0.98 / +1.1%
tpch_q13/duckdb:vortex-compact 190697177 / 224009010 / -14.9% 237691402 / 268751355 / -11.6% 0.80 / 0.83 / -3.7%
tpch_q14/duckdb:vortex-compact 218795094 / 246283965 / -11.2% 326007783 / 253537230 / +28.6% 0.67 / 0.97 / -30.9%
tpch_q15/duckdb:vortex-compact 146707236 / 140352688 / +4.5% 230971021 / 172207333 / +34.1% 🔴 0.64 / 0.82 / -22.1%
tpch_q16/duckdb:vortex-compact 176651148 / 165250342 / +6.9% 219767379 / 188470209 / +16.6% 0.80 / 0.88 / -8.3%
tpch_q17/duckdb:vortex-compact 377592423 / 360373289 / +4.8% 385821855 / 411018391 / -6.1% 0.98 / 0.88 / +11.6%
tpch_q18/duckdb:vortex-compact 291524664 / 260489579 / +11.9% 296100830 / 320521308 / -7.6% 0.98 / 0.81 / +21.1%
tpch_q19/duckdb:vortex-compact 337087014 / 368890151 / -8.6% 525975184 / 358056602 / +46.9% 🔴 0.64 / 1.03 / -37.8%
tpch_q20/duckdb:vortex-compact 355000546 / 356053736 / -0.3% 407621775 / 356803468 / +14.2% 0.87 / 1.00 / -12.7%
tpch_q21/duckdb:vortex-compact 549034752 / 551972775 / -0.5% 641082252 / 552522672 / +16.0% 0.86 / 1.00 / -14.3%
tpch_q22/duckdb:vortex-compact 99466620 / 101423070 / -1.9% 128522250 / 138168152 / -7.0% 0.77 / 0.73 / +5.4%
duckdb / parquet / ns (1.050x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 295196584 / 275288123 / +7.2% 300763180 / 289310366 / +4.0% 0.98 / 0.95 / +3.1%
tpch_q02/duckdb:parquet 619843494 / 611501343 / +1.4% 595131318 / 621897679 / -4.3% 1.04 / 0.98 / +5.9%
tpch_q03/duckdb:parquet 759331413 / 690474429 / +10.0% 774351703 / 760494050 / +1.8% 0.98 / 0.91 / +8.0%
tpch_q04/duckdb:parquet 471296916 / 427965615 / +10.1% 518010480 / 523138202 / -1.0% 0.91 / 0.82 / +11.2%
tpch_q05/duckdb:parquet 890910779 / 861803668 / +3.4% 910242100 / 1027094920 / -11.4% 0.98 / 0.84 / +16.6%
tpch_q06/duckdb:parquet 294428434 / 263806237 / +11.6% 314176909 / 269355411 / +16.6% 0.94 / 0.98 / -4.3%
tpch_q07/duckdb:parquet 829404456 / 802484324 / +3.4% 852398467 / 826812954 / +3.1% 0.97 / 0.97 / +0.3%
tpch_q08/duckdb:parquet 1016311932 / 989490030 / +2.7% 1045972905 / 1543436214 / -32.2% 🟢 0.97 / 0.64 / +51.6%
tpch_q09/duckdb:parquet 999650324 / 911371159 / +9.7% 995932153 / 895313977 / +11.2% 1.00 / 1.02 / -1.4%
tpch_q10/duckdb:parquet 920682937 / 907535630 / +1.4% 985134535 / 891235187 / +10.5% 0.93 / 1.02 / -8.2%
tpch_q11/duckdb:parquet 447064115 / 389544044 / +14.8% 440940850 / 384278575 / +14.7% 1.01 / 1.01 / +0.0%
tpch_q12/duckdb:parquet 550768817 / 504713777 / +9.1% 618201536 / 523759984 / +18.0% 0.89 / 0.96 / -7.5%
tpch_q13/duckdb:parquet 762489923 / 765946642 / -0.5% 862829678 / 991045828 / -12.9% 0.88 / 0.77 / +14.3%
tpch_q14/duckdb:parquet 464564690 / 453939127 / +2.3% 470819011 / 430144382 / +9.5% 0.99 / 1.06 / -6.5%
tpch_q15/duckdb:parquet 376471688 / 358334242 / +5.1% 361448285 / 400151764 / -9.7% 1.04 / 0.90 / +16.3%
tpch_q16/duckdb:parquet 494433455 / 468560630 / +5.5% 584616262 / 481571676 / +21.4% 0.85 / 0.97 / -13.1%
tpch_q17/duckdb:parquet 440456209 / 448192576 / -1.7% 427358295 / 454933246 / -6.1% 1.03 / 0.99 / +4.6%
tpch_q18/duckdb:parquet 602733320 / 594318516 / +1.4% 540484449 / 553045305 / -2.3% 1.12 / 1.07 / +3.8%
tpch_q19/duckdb:parquet 571914778 / 522547161 / +9.4% 725335738 / 570742667 / +27.1% 0.79 / 0.92 / -13.9%
tpch_q20/duckdb:parquet 778284193 / 753440161 / +3.3% 821549836 / 799553117 / +2.8% 0.95 / 0.94 / +0.5%
tpch_q21/duckdb:parquet 656485098 / 650694663 / +0.9% 658588214 / 670768122 / -1.8% 1.00 / 0.97 / +2.8%
tpch_q22/duckdb:parquet 393192523 / 387498850 / +1.5% 455813410 / 648641922 / -29.7% 0.86 / 0.60 / +44.4%

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.967x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.981x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 17820173 / 18520210 / -3.8% 40841712 / 43003784 / -5.0% 0.44 / 0.43 / +1.3%
tpch_q02/datafusion:vortex-compact 19891966 / 19947421 / -0.3% 35532576 / 38576359 / -7.9% 0.56 / 0.52 / +8.3%
tpch_q03/datafusion:vortex-compact 20116612 / 20175433 / -0.3% 42897549 / 46654048 / -8.1% 0.47 / 0.43 / +8.4%
tpch_q04/datafusion:vortex-compact 11750783 / 11749620 / +0.0% 28547730 / 30815730 / -7.4% 0.41 / 0.38 / +8.0%
tpch_q05/datafusion:vortex-compact 38218636 / 38211364 / +0.0% 63090393 / 63235764 / -0.2% 0.61 / 0.60 / +0.2%
tpch_q06/datafusion:vortex-compact 6800900 / 6919792 / -1.7% 27911453 / 28682003 / -2.7% 0.24 / 0.24 / +1.0%
tpch_q07/datafusion:vortex-compact 51983310 / 52218968 / -0.5% 72717292 / 78100184 / -6.9% 0.71 / 0.67 / +6.9%
tpch_q08/datafusion:vortex-compact 52639629 / 53300800 / -1.2% 83372327 / 83243832 / +0.2% 0.63 / 0.64 / -1.4%
tpch_q09/datafusion:vortex-compact 51040255 / 51591908 / -1.1% 75811107 / 79194945 / -4.3% 0.67 / 0.65 / +3.3%
tpch_q10/datafusion:vortex-compact 19200723 / 18947277 / +1.3% 52843540 / 46474674 / +13.7% 🔴 0.36 / 0.41 / -10.9%
tpch_q11/datafusion:vortex-compact 16069823 / 16025080 / +0.3% 33803703 / 33929343 / -0.4% 0.48 / 0.47 / +0.7%
tpch_q12/datafusion:vortex-compact 24235190 / 24452057 / -0.9% 45764260 / 45220359 / +1.2% 0.53 / 0.54 / -2.1%
tpch_q13/datafusion:vortex-compact 21125478 / 21328764 / -1.0% 36905160 / 39362129 / -6.2% 0.57 / 0.54 / +5.6%
tpch_q14/datafusion:vortex-compact 16381211 / 16311740 / +0.4% 40215166 / 41441434 / -3.0% 0.41 / 0.39 / +3.5%
tpch_q15/datafusion:vortex-compact 20203562 / 19938712 / +1.3% 44283833 / 44665997 / -0.9% 0.46 / 0.45 / +2.2%
tpch_q16/datafusion:vortex-compact 18645502 / 18800759 / -0.8% 36426985 / 36286865 / +0.4% 0.51 / 0.52 / -1.2%
tpch_q17/datafusion:vortex-compact 28815902 / 28808748 / +0.0% 55417571 / 56530659 / -2.0% 0.52 / 0.51 / +2.0%
tpch_q18/datafusion:vortex-compact 38107238 / 38549819 / -1.1% 56511910 / 59451435 / -4.9% 0.67 / 0.65 / +4.0%
tpch_q19/datafusion:vortex-compact 18692368 / 18686907 / +0.0% 42243010 / 43976699 / -3.9% 0.44 / 0.42 / +4.1%
tpch_q20/datafusion:vortex-compact 22168774 / 21877217 / +1.3% 44882792 / 44258954 / +1.4% 0.49 / 0.49 / -0.1%
tpch_q21/datafusion:vortex-compact 42402443 / 41643302 / +1.8% 65986477 / 67351417 / -2.0% 0.64 / 0.62 / +3.9%
tpch_q22/datafusion:vortex-compact 11421102 / 11641709 / -1.9% 28748120 / 30768161 / -6.6% 0.40 / 0.38 / +5.0%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67020609 / 67226428 / -0.3% 82977833 / 84565852 / -1.9% 0.81 / 0.79 / +1.6%
tpch_q02/datafusion:parquet 51926080 / 52620175 / -1.3% 70980070 / 71965249 / -1.4% 0.73 / 0.73 / +0.1%
tpch_q03/datafusion:parquet 72840402 / 72128036 / +1.0% 93760575 / 96380989 / -2.7% 0.78 / 0.75 / +3.8%
tpch_q04/datafusion:parquet 39621445 / 39485822 / +0.3% 57868358 / 59215854 / -2.3% 0.68 / 0.67 / +2.7%
tpch_q05/datafusion:parquet 88293828 / 87696483 / +0.7% 113870700 / 119145983 / -4.4% 0.78 / 0.74 / +5.3%
tpch_q06/datafusion:parquet 28026495 / 28160143 / -0.5% 46054653 / 48397233 / -4.8% 0.61 / 0.58 / +4.6%
tpch_q07/datafusion:parquet 93975111 / 94492230 / -0.5% 117880712 / 122091507 / -3.4% 0.80 / 0.77 / +3.0%
tpch_q08/datafusion:parquet 96110820 / 97647946 / -1.6% 117441281 / 122953790 / -4.5% 0.82 / 0.79 / +3.0%
tpch_q09/datafusion:parquet 113024852 / 113718272 / -0.6% 140536797 / 146045173 / -3.8% 0.80 / 0.78 / +3.3%
tpch_q10/datafusion:parquet 79468106 / 79196617 / +0.3% 107102280 / 114698822 / -6.6% 0.74 / 0.69 / +7.5%
tpch_q11/datafusion:parquet 38103706 / 38724978 / -1.6% 58891901 / 62021055 / -5.0% 0.65 / 0.62 / +3.6%
tpch_q12/datafusion:parquet 62307817 / 62176838 / +0.2% 88419585 / 87510115 / +1.0% 0.70 / 0.71 / -0.8%
tpch_q13/datafusion:parquet 159500009 / 159467751 / +0.0% 178784432 / 180134478 / -0.7% 0.89 / 0.89 / +0.8%
tpch_q14/datafusion:parquet 39747873 / 39416233 / +0.8% 63540410 / 65329484 / -2.7% 0.63 / 0.60 / +3.7%
tpch_q15/datafusion:parquet 46324844 / 46967825 / -1.4% 64477659 / 69704603 / -7.5% 0.72 / 0.67 / +6.6%
tpch_q16/datafusion:parquet 38456917 / 38924104 / -1.2% 57630867 / 59453402 / -3.1% 0.67 / 0.65 / +1.9%
tpch_q17/datafusion:parquet 117144932 / 116959557 / +0.2% 139663758 / 139274019 / +0.3% 0.84 / 0.84 / -0.1%
tpch_q18/datafusion:parquet 115561490 / 114392936 / +1.0% 136803260 / 141160946 / -3.1% 0.84 / 0.81 / +4.2%
tpch_q19/datafusion:parquet 50123187 / 50807723 / -1.3% 75164883 / 77844033 / -3.4% 0.67 / 0.65 / +2.2%
tpch_q20/datafusion:parquet 58045135 / 57736401 / +0.5% 80235450 / 83381972 / -3.8% 0.72 / 0.69 / +4.5%
tpch_q21/datafusion:parquet 99573359 / 99398961 / +0.2% 119592606 / 122745825 / -2.6% 0.83 / 0.81 / +2.8%
tpch_q22/datafusion:parquet 41234412 / 41357675 / -0.3% 57131715 / 62506085 / -8.6% 0.72 / 0.66 / +9.1%
duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 13398558 / 13580258 / -1.3% 24001974 / 24244181 / -1.0% 0.56 / 0.56 / -0.3%
tpch_q02/duckdb:vortex-compact 20213514 / 20066937 / +0.7% 27582339 / 30080173 / -8.3% 0.73 / 0.67 / +9.9%
tpch_q03/duckdb:vortex-compact 19182157 / 18925230 / +1.4% 38707948 / 35141140 / +10.1% 🔴 0.50 / 0.54 / -8.0%
tpch_q04/duckdb:vortex-compact 19342989 / 18793786 / +2.9% 28765595 / 31949381 / -10.0% 0.67 / 0.59 / +14.3%
tpch_q05/duckdb:vortex-compact 22471477 / 22711167 / -1.1% 35015844 / 35665936 / -1.8% 0.64 / 0.64 / +0.8%
tpch_q06/duckdb:vortex-compact 6340574 / 6190484 / +2.4% 14982348 / 16087486 / -6.9% 0.42 / 0.38 / +10.0%
tpch_q07/duckdb:vortex-compact 21826658 / 22167085 / -1.5% 37848588 / 38176555 / -0.9% 0.58 / 0.58 / -0.7%
tpch_q08/duckdb:vortex-compact 25966406 / 26431426 / -1.8% 38918472 / 40475282 / -3.8% 0.67 / 0.65 / +2.2%
tpch_q09/duckdb:vortex-compact 30989180 / 30363153 / +2.1% 47926301 / 52270626 / -8.3% 0.65 / 0.58 / +11.3%
tpch_q10/duckdb:vortex-compact 30496311 / 30776604 / -0.9% 44825187 / 47768736 / -6.2% 0.68 / 0.64 / +5.6%
tpch_q11/duckdb:vortex-compact 12295072 / 12249394 / +0.4% 16299439 / 16653433 / -2.1% 0.75 / 0.74 / +2.6%
tpch_q12/duckdb:vortex-compact 18251063 / 18238091 / +0.1% 29590660 / 28120073 / +5.2% 0.62 / 0.65 / -4.9%
tpch_q13/duckdb:vortex-compact 23559646 / 23636767 / -0.3% 40475030 / 39237013 / +3.2% 0.58 / 0.60 / -3.4%
tpch_q14/duckdb:vortex-compact 14092077 / 14570011 / -3.3% 27724728 / 30697576 / -9.7% 0.51 / 0.47 / +7.1%
tpch_q15/duckdb:vortex-compact 10673171 / 10191738 / +4.7% 20744239 / 27716267 / -25.2% 🟢 0.51 / 0.37 / +39.9%
tpch_q16/duckdb:vortex-compact 19809253 / 20089936 / -1.4% 25997523 / 29177389 / -10.9% 🟢 0.76 / 0.69 / +10.7%
tpch_q17/duckdb:vortex-compact 17113145 / 17066050 / +0.3% 31470044 / 36112415 / -12.9% 🟢 0.54 / 0.47 / +15.1%
tpch_q18/duckdb:vortex-compact 26036818 / 26553658 / -1.9% 37338428 / 37350821 / -0.0% 0.70 / 0.71 / -1.9%
tpch_q19/duckdb:vortex-compact 24578846 / 24610043 / -0.1% 36157956 / 36618978 / -1.3% 0.68 / 0.67 / +1.1%
tpch_q20/duckdb:vortex-compact 19013613 / 19481064 / -2.4% 36541414 / 37144681 / -1.6% 0.52 / 0.52 / -0.8%
tpch_q21/duckdb:vortex-compact 70228434 / 70372757 / -0.2% 89980553 / 85776472 / +4.9% 0.78 / 0.82 / -4.9%
tpch_q22/duckdb:vortex-compact 12292688 / 12527671 / -1.9% 22688843 / 20751908 / +9.3% 0.54 / 0.60 / -10.3%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60085400 / 60150119 / -0.1% 66400387 / 66416910 / -0.0% 0.90 / 0.91 / -0.1%
tpch_q02/duckdb:parquet 34631887 / 34666623 / -0.1% 44018623 / 42655188 / +3.2% 0.79 / 0.81 / -3.2%
tpch_q03/duckdb:parquet 61879550 / 62360486 / -0.8% 74049549 / 74347489 / -0.4% 0.84 / 0.84 / -0.4%
tpch_q04/duckdb:parquet 45502182 / 43614582 / +4.3% 56414808 / 56329264 / +0.2% 0.81 / 0.77 / +4.2%
tpch_q05/duckdb:parquet 60376231 / 60909402 / -0.9% 72615949 / 73640507 / -1.4% 0.83 / 0.83 / +0.5%
tpch_q06/duckdb:parquet 20044167 / 20094038 / -0.2% 24857545 / 26254872 / -5.3% 0.81 / 0.77 / +5.4%
tpch_q07/duckdb:parquet 60464032 / 61230411 / -1.3% 71380758 / 71638774 / -0.4% 0.85 / 0.85 / -0.9%
tpch_q08/duckdb:parquet 73041833 / 73564716 / -0.7% 86396828 / 87006065 / -0.7% 0.85 / 0.85 / -0.0%
tpch_q09/duckdb:parquet 113938153 / 114445628 / -0.4% 126912666 / 127722707 / -0.6% 0.90 / 0.90 / +0.2%
tpch_q10/duckdb:parquet 107768428 / 108663378 / -0.8% 120216383 / 122673165 / -2.0% 0.90 / 0.89 / +1.2%
tpch_q11/duckdb:parquet 19953700 / 20157493 / -1.0% 24931707 / 24005545 / +3.9% 0.80 / 0.84 / -4.7%
tpch_q12/duckdb:parquet 40982619 / 41610370 / -1.5% 49172503 / 49279480 / -0.2% 0.83 / 0.84 / -1.3%
tpch_q13/duckdb:parquet 238597880 / 238366918 / +0.1% 247217026 / 248813850 / -0.6% 0.97 / 0.96 / +0.7%
tpch_q14/duckdb:parquet 43436763 / 43598319 / -0.4% 52177580 / 52454856 / -0.5% 0.83 / 0.83 / +0.2%
tpch_q15/duckdb:parquet 24775844 / 25071061 / -1.2% 30850987 / 31299176 / -1.4% 0.80 / 0.80 / +0.3%
tpch_q16/duckdb:parquet 49727285 / 50834497 / -2.2% 59496248 / 58686597 / +1.4% 0.84 / 0.87 / -3.5%
tpch_q17/duckdb:parquet 44529519 / 44722847 / -0.4% 54639618 / 57011387 / -4.2% 0.81 / 0.78 / +3.9%
tpch_q18/duckdb:parquet 89817618 / 90066887 / -0.3% 99816203 / 101669048 / -1.8% 0.90 / 0.89 / +1.6%
tpch_q19/duckdb:parquet 61154656 / 61354949 / -0.3% 70872717 / 70661838 / +0.3% 0.86 / 0.87 / -0.6%
tpch_q20/duckdb:parquet 58514129 / 58723561 / -0.4% 70918725 / 70930749 / -0.0% 0.83 / 0.83 / -0.3%
tpch_q21/duckdb:parquet 136483295 / 136892515 / -0.3% 150648277 / 148637874 / +1.4% 0.91 / 0.92 / -1.6%
tpch_q22/duckdb:parquet 50232336 / 50394955 / -0.3% 60734247 / 58000164 / +4.7% 0.83 / 0.87 / -4.8%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.026x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.027x ➖
Shifts: Parquet (control) +0.3% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 190571646 / 193626080 / -1.6% 442181446 / 462967557 / -4.5% 0.43 / 0.42 / +3.0%
clickbench-sorted_q24/datafusion:vortex-compact 23259869 / 21916476 / +6.1% 57363849 / 53590797 / +7.0% 0.41 / 0.41 / -0.9%
clickbench-sorted_q26/datafusion:vortex-compact 23886104 / 22796009 / +4.8% 56564798 / 55915750 / +1.2% 0.42 / 0.41 / +3.6%
clickbench-sorted_q36/datafusion:vortex-compact 25630469 / 25754294 / -0.5% 71419743 / 72979836 / -2.1% 0.36 / 0.35 / +1.7%
clickbench-sorted_q37/datafusion:vortex-compact 21438844 / 22032847 / -2.7% 70382266 / 66637604 / +5.6% 0.30 / 0.33 / -7.9%
clickbench-sorted_q38/datafusion:vortex-compact 20131782 / 20966063 / -4.0% 68629612 / 70270866 / -2.3% 0.29 / 0.30 / -1.7%
clickbench-sorted_q39/datafusion:vortex-compact 43781118 / 44646693 / -1.9% 86639582 / 86874103 / -0.3% 0.51 / 0.51 / -1.7%
clickbench-sorted_q40/datafusion:vortex-compact 15305030 / 15807402 / -3.2% 45974040 / 47193671 / -2.6% 0.33 / 0.33 / -0.6%
clickbench-sorted_q41/datafusion:vortex-compact 14051714 / 14440194 / -2.7% 46992293 / 47868901 / -1.8% 0.30 / 0.30 / -0.9%
clickbench-sorted_q42/datafusion:vortex-compact 11393358 / 11123693 / +2.4% 34412184 / 34672356 / -0.8% 0.33 / 0.32 / +3.2%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 759244965 / 762230984 / -0.4% 945753114 / 957817495 / -1.3% 0.80 / 0.80 / +0.9%
clickbench-sorted_q24/datafusion:parquet 8725792 / 8351800 / +4.5% 72105769 / 73636960 / -2.1% 0.12 / 0.11 / +6.7%
clickbench-sorted_q26/datafusion:parquet 8913628 / 9326229 / -4.4% 72149401 / 71425309 / +1.0% 0.12 / 0.13 / -5.4%
clickbench-sorted_q36/datafusion:parquet 94359450 / 93260000 / +1.2% 172558522 / 171706262 / +0.5% 0.55 / 0.54 / +0.7%
clickbench-sorted_q37/datafusion:parquet 64854727 / 64236459 / +1.0% 133976934 / 132547894 / +1.1% 0.48 / 0.48 / -0.1%
clickbench-sorted_q38/datafusion:parquet 87809623 / 86879039 / +1.1% 165020593 / 165280484 / -0.2% 0.53 / 0.53 / +1.2%
clickbench-sorted_q39/datafusion:parquet 159680836 / 159484275 / +0.1% 240142861 / 239840623 / +0.1% 0.66 / 0.66 / -0.0%
clickbench-sorted_q40/datafusion:parquet 44697948 / 44291234 / +0.9% 119213854 / 115498765 / +3.2% 0.37 / 0.38 / -2.2%
clickbench-sorted_q41/datafusion:parquet 42754357 / 41633990 / +2.7% 112692554 / 116582383 / -3.3% 0.38 / 0.36 / +6.2%
clickbench-sorted_q42/datafusion:parquet 26321968 / 26400742 / -0.3% 86673475 / 88493485 / -2.1% 0.30 / 0.30 / +1.8%
duckdb / vortex-compact / ns (1.012x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 71240789 / 72188844 / -1.3% 90222333 / 92141193 / -2.1% 0.79 / 0.78 / +0.8%
clickbench-sorted_q24/duckdb:vortex-compact 20778967 / 21794295 / -4.7% 34537349 / 35521484 / -2.8% 0.60 / 0.61 / -1.9%
clickbench-sorted_q26/duckdb:vortex-compact 17891472 / 15001506 / +19.3% 🔴 39246915 / 30397983 / +29.1% 🔴 0.46 / 0.49 / -7.6%
clickbench-sorted_q36/duckdb:vortex-compact 39629274 / 40784552 / -2.8% 77663447 / 75649123 / +2.7% 0.51 / 0.54 / -5.4%
clickbench-sorted_q37/duckdb:vortex-compact 33393458 / 33325426 / +0.2% 71620201 / 67832489 / +5.6% 0.47 / 0.49 / -5.1%
clickbench-sorted_q38/duckdb:vortex-compact 33836694 / 34107801 / -0.8% 75540155 / 69095978 / +9.3% 0.45 / 0.49 / -9.3%
clickbench-sorted_q39/duckdb:vortex-compact 63858624 / 66934020 / -4.6% 110840732 / 103930483 / +6.6% 0.58 / 0.64 / -10.5%
clickbench-sorted_q40/duckdb:vortex-compact 19489604 / 18733289 / +4.0% 41652867 / 40301070 / +3.4% 0.47 / 0.46 / +0.7%
clickbench-sorted_q41/duckdb:vortex-compact 19563862 / 19887655 / -1.6% 42979727 / 42745829 / +0.5% 0.46 / 0.47 / -2.2%
clickbench-sorted_q42/duckdb:vortex-compact 16027906 / 15054520 / +6.5% 32996121 / 31507997 / +4.7% 0.49 / 0.48 / +1.7%
duckdb / parquet / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 125986828 / 129557612 / -2.8% 159394388 / 153614260 / +3.8% 0.79 / 0.84 / -6.3%
clickbench-sorted_q24/duckdb:parquet 17753088 / 17755248 / -0.0% 26742771 / 25868789 / +3.4% 0.66 / 0.69 / -3.3%
clickbench-sorted_q26/duckdb:parquet 14369081 / 13021414 / +10.3% 🔴 25839115 / 21232969 / +21.7% 🔴 0.56 / 0.61 / -9.3%
clickbench-sorted_q36/duckdb:parquet 46335268 / 47448352 / -2.3% 64790221 / 64150748 / +1.0% 0.72 / 0.74 / -3.3%
clickbench-sorted_q37/duckdb:parquet 30380668 / 31307330 / -3.0% 49632184 / 48962190 / +1.4% 0.61 / 0.64 / -4.3%
clickbench-sorted_q38/duckdb:parquet 41507226 / 39650619 / +4.7% 61255914 / 60075503 / +2.0% 0.68 / 0.66 / +2.7%
clickbench-sorted_q39/duckdb:parquet 78109612 / 76029661 / +2.7% 87310596 / 87377408 / -0.1% 0.89 / 0.87 / +2.8%
clickbench-sorted_q40/duckdb:parquet 17039222 / 17624909 / -3.3% 46284224 / 40283802 / +14.9% 🔴 0.37 / 0.44 / -15.9%
clickbench-sorted_q41/duckdb:parquet 16254724 / 16595996 / -2.1% 43627253 / 40612833 / +7.4% 0.37 / 0.41 / -8.8%
clickbench-sorted_q42/duckdb:parquet 10918482 / 11347082 / -3.8% 24921749 / 23740367 / +5.0% 0.44 / 0.48 / -8.3%

File Size Changes (100 files changed, -0.0% overall, 58↑ 42↓)
File Scale Format Base HEAD Change %
hits_076.vortex 1.0 vortex-compact 123.58 MB 125.60 MB +2.03 MB +1.6%
hits_098.vortex 1.0 vortex-compact 102.95 MB 104.23 MB +1.27 MB +1.2%
hits_002.vortex 1.0 vortex-compact 124.12 MB 125.52 MB +1.40 MB +1.1%
hits_097.vortex 1.0 vortex-compact 140.13 MB 141.41 MB +1.28 MB +0.9%
hits_052.vortex 1.0 vortex-compact 97.21 MB 98.03 MB +845.23 KB +0.8%
hits_086.vortex 1.0 vortex-compact 139.53 MB 140.67 MB +1.14 MB +0.8%
hits_039.vortex 1.0 vortex-compact 125.36 MB 126.30 MB +959.36 KB +0.7%
hits_067.vortex 1.0 vortex-compact 98.35 MB 99.03 MB +696.81 KB +0.7%
hits_089.vortex 1.0 vortex-compact 99.15 MB 99.75 MB +613.16 KB +0.6%
hits_056.vortex 1.0 vortex-compact 100.85 MB 101.32 MB +475.40 KB +0.5%
hits_031.vortex 1.0 vortex-compact 111.18 MB 111.68 MB +504.47 KB +0.4%
hits_024.vortex 1.0 vortex-compact 124.35 MB 124.89 MB +556.36 KB +0.4%
hits_040.vortex 1.0 vortex-compact 109.97 MB 110.44 MB +482.20 KB +0.4%
hits_093.vortex 1.0 vortex-compact 98.68 MB 99.06 MB +382.51 KB +0.4%
hits_020.vortex 1.0 vortex-compact 111.70 MB 112.12 MB +425.18 KB +0.4%
hits_028.vortex 1.0 vortex-compact 115.30 MB 115.72 MB +427.68 KB +0.4%
hits_085.vortex 1.0 vortex-compact 152.99 MB 153.52 MB +539.80 KB +0.3%
hits_043.vortex 1.0 vortex-compact 94.28 MB 94.60 MB +328.13 KB +0.3%
hits_016.vortex 1.0 vortex-compact 127.36 MB 127.76 MB +412.25 KB +0.3%
hits_008.vortex 1.0 vortex-compact 105.83 MB 106.13 MB +309.83 KB +0.3%
hits_004.vortex 1.0 vortex-compact 98.44 MB 98.71 MB +282.35 KB +0.3%
hits_062.vortex 1.0 vortex-compact 132.50 MB 132.82 MB +330.27 KB +0.2%
hits_061.vortex 1.0 vortex-compact 123.43 MB 123.69 MB +263.42 KB +0.2%
hits_011.vortex 1.0 vortex-compact 152.55 MB 152.85 MB +315.90 KB +0.2%
hits_075.vortex 1.0 vortex-compact 139.09 MB 139.35 MB +267.08 KB +0.2%
hits_082.vortex 1.0 vortex-compact 105.63 MB 105.81 MB +184.28 KB +0.2%
hits_051.vortex 1.0 vortex-compact 133.83 MB 134.05 MB +222.45 KB +0.2%
hits_096.vortex 1.0 vortex-compact 152.94 MB 153.17 MB +233.70 KB +0.1%
hits_068.vortex 1.0 vortex-compact 112.45 MB 112.61 MB +171.52 KB +0.1%
hits_033.vortex 1.0 vortex-compact 153.44 MB 153.63 MB +192.75 KB +0.1%
hits_079.vortex 1.0 vortex-compact 128.03 MB 128.18 MB +152.12 KB +0.1%
hits_092.vortex 1.0 vortex-compact 153.34 MB 153.50 MB +166.52 KB +0.1%
hits_022.vortex 1.0 vortex-compact 152.98 MB 153.12 MB +148.55 KB +0.1%
hits_027.vortex 1.0 vortex-compact 139.20 MB 139.32 MB +126.80 KB +0.1%
hits_077.vortex 1.0 vortex-compact 134.06 MB 134.15 MB +90.27 KB +0.1%
hits_074.vortex 1.0 vortex-compact 153.00 MB 153.09 MB +92.50 KB +0.1%
hits_036.vortex 1.0 vortex-compact 133.28 MB 133.35 MB +71.75 KB +0.1%
hits_091.vortex 1.0 vortex-compact 111.72 MB 111.78 MB +59.73 KB +0.1%
hits_017.vortex 1.0 vortex-compact 111.71 MB 111.76 MB +55.86 KB +0.0%
hits_083.vortex 1.0 vortex-compact 110.04 MB 110.09 MB +54.41 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.91 MB 75.94 MB +34.40 KB +0.0%
hits_087.vortex 1.0 vortex-compact 125.61 MB 125.67 MB +56.13 KB +0.0%
hits_029.vortex 1.0 vortex-compact 153.39 MB 153.44 MB +59.77 KB +0.0%
hits_070.vortex 1.0 vortex-compact 153.61 MB 153.66 MB +53.09 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.79 MB 111.83 MB +37.27 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.17 MB 134.21 MB +43.87 KB +0.0%
hits_038.vortex 1.0 vortex-compact 139.57 MB 139.61 MB +44.09 KB +0.0%
hits_094.vortex 1.0 vortex-compact 110.72 MB 110.75 MB +23.15 KB +0.0%
hits_064.vortex 1.0 vortex-compact 140.01 MB 140.04 MB +28.93 KB +0.0%
hits_034.vortex 1.0 vortex-compact 133.30 MB 133.32 MB +22.70 KB +0.0%
hits_054.vortex 1.0 vortex-compact 112.08 MB 112.09 MB +13.44 KB +0.0%
hits_066.vortex 1.0 vortex-compact 117.39 MB 117.40 MB +8.41 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.61 MB 75.61 MB +4.63 KB +0.0%
hits_007.vortex 1.0 vortex-compact 153.77 MB 153.77 MB +7.80 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.04 MB 111.04 MB +3.86 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.48 MB 110.48 MB +3.63 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.25 MB 136.26 MB +3.85 KB +0.0%
hits_060.vortex 1.0 vortex-compact 141.15 MB 141.15 MB +864 B +0.0%
hits_032.vortex 1.0 vortex-compact 110.59 MB 110.58 MB 6.64 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.20 MB 4.72 KB -0.0%
hits_059.vortex 1.0 vortex-compact 152.80 MB 152.79 MB 12.28 KB -0.0%
hits_014.vortex 1.0 vortex-compact 133.89 MB 133.88 MB 12.06 KB -0.0%
hits_044.vortex 1.0 vortex-compact 153.64 MB 153.62 MB 15.82 KB -0.0%
hits_084.vortex 1.0 vortex-compact 110.66 MB 110.64 MB 18.70 KB -0.0%
hits_099.vortex 1.0 vortex-compact 133.15 MB 133.13 MB 22.84 KB -0.0%
hits_023.vortex 1.0 vortex-compact 142.69 MB 142.61 MB 83.59 KB -0.1%
hits_005.vortex 1.0 vortex-compact 115.88 MB 115.81 MB 72.92 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.56 MB 104.49 MB 73.45 KB -0.1%
hits_046.vortex 1.0 vortex-compact 74.94 MB 74.85 MB 88.78 KB -0.1%
hits_069.vortex 1.0 vortex-compact 99.80 MB 99.65 MB 145.21 KB -0.1%
hits_013.vortex 1.0 vortex-compact 124.52 MB 124.34 MB 186.37 KB -0.1%
hits_010.vortex 1.0 vortex-compact 123.33 MB 123.13 MB 206.51 KB -0.2%
hits_045.vortex 1.0 vortex-compact 106.25 MB 106.05 MB 197.52 KB -0.2%
hits_053.vortex 1.0 vortex-compact 138.51 MB 138.24 MB 270.85 KB -0.2%
hits_025.vortex 1.0 vortex-compact 133.67 MB 133.36 MB 325.89 KB -0.2%
hits_088.vortex 1.0 vortex-compact 134.35 MB 134.03 MB 331.79 KB -0.2%
hits_081.vortex 1.0 vortex-compact 153.76 MB 153.37 MB 400.84 KB -0.3%
hits_095.vortex 1.0 vortex-compact 110.94 MB 110.61 MB 336.80 KB -0.3%
hits_015.vortex 1.0 vortex-compact 97.93 MB 97.64 MB 298.35 KB -0.3%
hits_041.vortex 1.0 vortex-compact 98.05 MB 97.76 MB 300.90 KB -0.3%
hits_063.vortex 1.0 vortex-compact 98.44 MB 98.14 MB 310.59 KB -0.3%
hits_026.vortex 1.0 vortex-compact 97.58 MB 97.27 MB 318.55 KB -0.3%
hits_021.vortex 1.0 vortex-compact 110.96 MB 110.60 MB 369.88 KB -0.3%
hits_037.vortex 1.0 vortex-compact 132.78 MB 132.34 MB 450.46 KB -0.3%
hits_012.vortex 1.0 vortex-compact 139.26 MB 138.71 MB 571.12 KB -0.4%
hits_019.vortex 1.0 vortex-compact 106.62 MB 106.19 MB 441.32 KB -0.4%
hits_071.vortex 1.0 vortex-compact 106.14 MB 105.71 MB 446.35 KB -0.4%
hits_055.vortex 1.0 vortex-compact 153.32 MB 152.67 MB 658.41 KB -0.4%
hits_018.vortex 1.0 vortex-compact 153.71 MB 152.98 MB 750.17 KB -0.5%
hits_048.vortex 1.0 vortex-compact 153.30 MB 152.53 MB 791.98 KB -0.5%
hits_078.vortex 1.0 vortex-compact 98.15 MB 97.65 MB 511.41 KB -0.5%
hits_000.vortex 1.0 vortex-compact 99.56 MB 98.68 MB 893.24 KB -0.9%
hits_050.vortex 1.0 vortex-compact 126.61 MB 125.49 MB 1.12 MB -0.9%
hits_090.vortex 1.0 vortex-compact 141.34 MB 140.05 MB 1.29 MB -0.9%
hits_049.vortex 1.0 vortex-compact 140.98 MB 139.38 MB 1.60 MB -1.1%
hits_065.vortex 1.0 vortex-compact 125.93 MB 124.44 MB 1.48 MB -1.2%
hits_030.vortex 1.0 vortex-compact 98.90 MB 97.73 MB 1.17 MB -1.2%
hits_080.vortex 1.0 vortex-compact 97.00 MB 94.82 MB 2.18 MB -2.2%
hits_001.vortex 1.0 vortex-compact 140.86 MB 137.67 MB 3.19 MB -2.3%
hits_006.vortex 1.0 vortex-compact 96.20 MB 93.92 MB 2.27 MB -2.4%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.2%, environment too noisy confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 96625765 / 96200219 / +0.4% 156623931 / 163784450 / -4.4% 0.62 / 0.59 / +5.0%
tpch_q02/datafusion:vortex-compact 66634041 / 65506754 / +1.7% 94415626 / 92212823 / +2.4% 0.71 / 0.71 / -0.7%
tpch_q03/datafusion:vortex-compact 66725268 / 66488079 / +0.4% 108551640 / 109129273 / -0.5% 0.61 / 0.61 / +0.9%
tpch_q04/datafusion:vortex-compact 41780475 / 42518873 / -1.7% 82447749 / 83899995 / -1.7% 0.51 / 0.51 / -0.0%
tpch_q05/datafusion:vortex-compact 118383900 / 119801920 / -1.2% 168267664 / 163127261 / +3.2% 0.70 / 0.73 / -4.2%
tpch_q06/datafusion:vortex-compact 18260701 / 18535336 / -1.5% 63862992 / 59081129 / +8.1% 0.29 / 0.31 / -8.9%
tpch_q07/datafusion:vortex-compact 145391937 / 144086957 / +0.9% 189386956 / 189601286 / -0.1% 0.77 / 0.76 / +1.0%
tpch_q08/datafusion:vortex-compact 145845950 / 146772672 / -0.6% 201622733 / 211645694 / -4.7% 0.72 / 0.69 / +4.3%
tpch_q09/datafusion:vortex-compact 199079304 / 188818529 / +5.4% 251274936 / 244744049 / +2.7% 0.79 / 0.77 / +2.7%
tpch_q10/datafusion:vortex-compact 80038130 / 78802430 / +1.6% 133658659 / 131578620 / +1.6% 0.60 / 0.60 / -0.0%
tpch_q11/datafusion:vortex-compact 43760795 / 43150670 / +1.4% 67082188 / 67994864 / -1.3% 0.65 / 0.63 / +2.8%
tpch_q12/datafusion:vortex-compact 57462774 / 57363885 / +0.2% 95640802 / 98355586 / -2.8% 0.60 / 0.58 / +3.0%
tpch_q13/datafusion:vortex-compact 53883851 / 54034067 / -0.3% 79097219 / 75456131 / +4.8% 0.68 / 0.72 / -4.9%
tpch_q14/datafusion:vortex-compact 27463202 / 27496520 / -0.1% 94760093 / 91240858 / +3.9% 0.29 / 0.30 / -3.8%
tpch_q15/datafusion:vortex-compact 44772918 / 44940397 / -0.4% 98713045 / 98065083 / +0.7% 0.45 / 0.46 / -1.0%
tpch_q16/datafusion:vortex-compact 40785604 / 41349619 / -1.4% 65279078 / 67424017 / -3.2% 0.62 / 0.61 / +1.9%
tpch_q17/datafusion:vortex-compact 175574547 / 176833268 / -0.7% 218046116 / 207645158 / +5.0% 0.81 / 0.85 / -5.4%
tpch_q18/datafusion:vortex-compact 201733187 / 203260265 / -0.8% 252145977 / 253216284 / -0.4% 0.80 / 0.80 / -0.3%
tpch_q19/datafusion:vortex-compact 62811818 / 61839097 / +1.6% 105368016 / 98067830 / +7.4% 0.60 / 0.63 / -5.5%
tpch_q20/datafusion:vortex-compact 65591448 / 65707806 / -0.2% 119144253 / 115491104 / +3.2% 0.55 / 0.57 / -3.2%
tpch_q21/datafusion:vortex-compact 192086657 / 191315372 / +0.4% 240424625 / 237914513 / +1.1% 0.80 / 0.80 / -0.6%
tpch_q22/datafusion:vortex-compact 26914090 / 27048630 / -0.5% 55936217 / 53120107 / +5.3% 0.48 / 0.51 / -5.5%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83221539 / 83274967 / -0.1% 132977574 / 135243665 / -1.7% 0.63 / 0.62 / +1.6%
tpch_q02/datafusion:parquet 135630369 / 134625250 / +0.7% 164025942 / 167210263 / -1.9% 0.83 / 0.81 / +2.7%
tpch_q03/datafusion:parquet 124394306 / 125056387 / -0.5% 189197340 / 196136661 / -3.5% 0.66 / 0.64 / +3.1%
tpch_q04/datafusion:parquet 53499661 / 53501234 / -0.0% 103700848 / 108187926 / -4.1% 0.52 / 0.49 / +4.3%
tpch_q05/datafusion:parquet 163309586 / 164356938 / -0.6% 241620216 / 244381529 / -1.1% 0.68 / 0.67 / +0.5%
tpch_q06/datafusion:parquet 32207511 / 32036743 / +0.5% 79922949 / 85301565 / -6.3% 0.40 / 0.38 / +7.3%
tpch_q07/datafusion:parquet 214141460 / 213426079 / +0.3% 283200211 / 293993798 / -3.7% 0.76 / 0.73 / +4.2%
tpch_q08/datafusion:parquet 208911892 / 210001017 / -0.5% 286157579 / 302722068 / -5.5% 0.73 / 0.69 / +5.2%
tpch_q09/datafusion:parquet 283733419 / 282604986 / +0.4% 370006590 / 356359490 / +3.8% 0.77 / 0.79 / -3.3%
tpch_q10/datafusion:parquet 302789271 / 304858219 / -0.7% 371881883 / 366678882 / +1.4% 0.81 / 0.83 / -2.1%
tpch_q11/datafusion:parquet 96616335 / 96306895 / +0.3% 123579091 / 121780508 / +1.5% 0.78 / 0.79 / -1.1%
tpch_q12/datafusion:parquet 78738707 / 78813598 / -0.1% 131737117 / 131029794 / +0.5% 0.60 / 0.60 / -0.6%
tpch_q13/datafusion:parquet 193685833 / 194814722 / -0.6% 229129797 / 227549321 / +0.7% 0.85 / 0.86 / -1.3%
tpch_q14/datafusion:parquet 73361814 / 74392648 / -1.4% 171529191 / 176861974 / -3.0% 0.43 / 0.42 / +1.7%
tpch_q15/datafusion:parquet 77537808 / 78308531 / -1.0% 137646532 / 140017933 / -1.7% 0.56 / 0.56 / +0.7%
tpch_q16/datafusion:parquet 84898832 / 84498068 / +0.5% 113056970 / 109993687 / +2.8% 0.75 / 0.77 / -2.2%
tpch_q17/datafusion:parquet 204955396 / 210184181 / -2.5% 261990303 / 262964185 / -0.4% 0.78 / 0.80 / -2.1%
tpch_q18/datafusion:parquet 267300544 / 264168516 / +1.2% 314598707 / 315555359 / -0.3% 0.85 / 0.84 / +1.5%
tpch_q19/datafusion:parquet 97485707 / 97883600 / -0.4% 169859049 / 174095028 / -2.4% 0.57 / 0.56 / +2.1%
tpch_q20/datafusion:parquet 152760531 / 151993756 / +0.5% 218379160 / 218258543 / +0.1% 0.70 / 0.70 / +0.4%
tpch_q21/datafusion:parquet 227353585 / 229311783 / -0.9% 303151451 / 308476509 / -1.7% 0.75 / 0.74 / +0.9%
tpch_q22/datafusion:parquet 161711025 / 161195907 / +0.3% 187190055 / 185434088 / +0.9% 0.86 / 0.87 / -0.6%
duckdb / vortex-compact / ns (0.987x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 69078538 / 70362495 / -1.8% 107086067 / 97798103 / +9.5% 0.65 / 0.72 / -10.3%
tpch_q02/duckdb:vortex-compact 35158307 / 35017811 / +0.4% 50046284 / 50856399 / -1.6% 0.70 / 0.69 / +2.0%
tpch_q03/duckdb:vortex-compact 61404692 / 62844016 / -2.3% 106182640 / 102640298 / +3.5% 0.58 / 0.61 / -5.5%
tpch_q04/duckdb:vortex-compact 88523462 / 88906166 / -0.4% 123337021 / 113884298 / +8.3% 0.72 / 0.78 / -8.1%
tpch_q05/duckdb:vortex-compact 69002751 / 69532433 / -0.8% 125090834 / 115631978 / +8.2% 0.55 / 0.60 / -8.3%
tpch_q06/duckdb:vortex-compact 25253834 / 24866521 / +1.6% 64322571 / 58139606 / +10.6% 🔴 0.39 / 0.43 / -8.2%
tpch_q07/duckdb:vortex-compact 70197541 / 73747233 / -4.8% 137297358 / 132835649 / +3.4% 0.51 / 0.56 / -7.9%
tpch_q08/duckdb:vortex-compact 89017971 / 91348987 / -2.6% 152527624 / 142320668 / +7.2% 0.58 / 0.64 / -9.1%
tpch_q09/duckdb:vortex-compact 173452334 / 175109604 / -0.9% 235828051 / 241044429 / -2.2% 0.74 / 0.73 / +1.2%
tpch_q10/duckdb:vortex-compact 124795960 / 126039693 / -1.0% 190063220 / 168307521 / +12.9% 🔴 0.66 / 0.75 / -12.3%
tpch_q11/duckdb:vortex-compact 18874812 / 18365136 / +2.8% 38775500 / 36906733 / +5.1% 0.49 / 0.50 / -2.2%
tpch_q12/duckdb:vortex-compact 72040479 / 71662801 / +0.5% 107714227 / 100135906 / +7.6% 0.67 / 0.72 / -6.5%
tpch_q13/duckdb:vortex-compact 97879081 / 97068672 / +0.8% 146952917 / 133862859 / +9.8% 0.67 / 0.73 / -8.1%
tpch_q14/duckdb:vortex-compact 33660111 / 35213577 / -4.4% 76300461 / 72798327 / +4.8% 0.44 / 0.48 / -8.8%
tpch_q15/duckdb:vortex-compact 41882028 / 44034896 / -4.9% 99173245 / 88285356 / +12.3% 🔴 0.42 / 0.50 / -15.3%
tpch_q16/duckdb:vortex-compact 44647413 / 44400861 / +0.6% 54508239 / 54625720 / -0.2% 0.82 / 0.81 / +0.8%
tpch_q17/duckdb:vortex-compact 60904932 / 63790869 / -4.5% 131981597 / 119182417 / +10.7% 🔴 0.46 / 0.54 / -13.8%
tpch_q18/duckdb:vortex-compact 143009061 / 146451213 / -2.4% 171019546 / 156669248 / +9.2% 0.84 / 0.93 / -10.5%
tpch_q19/duckdb:vortex-compact 46459359 / 47513685 / -2.2% 94073045 / 88606607 / +6.2% 0.49 / 0.54 / -7.9%
tpch_q20/duckdb:vortex-compact 67801556 / 69604923 / -2.6% 136132632 / 120420515 / +13.0% 🔴 0.50 / 0.58 / -13.8%
tpch_q21/duckdb:vortex-compact 259983827 / 256916289 / +1.2% 293118565 / 289916327 / +1.1% 0.89 / 0.89 / +0.1%
tpch_q22/duckdb:vortex-compact 41276781 / 41361528 / -0.2% 64128607 / 57669517 / +11.2% 🔴 0.64 / 0.72 / -10.3%
duckdb / parquet / ns (0.985x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70544500 / 71115292 / -0.8% 86258201 / 92532014 / -6.8% 0.82 / 0.77 / +6.4%
tpch_q02/duckdb:parquet 70706415 / 71101050 / -0.6% 84561528 / 81074196 / +4.3% 0.84 / 0.88 / -4.7%
tpch_q03/duckdb:parquet 113609931 / 114979737 / -1.2% 155332619 / 150029659 / +3.5% 0.73 / 0.77 / -4.6%
tpch_q04/duckdb:parquet 74534187 / 75013021 / -0.6% 98533508 / 104485463 / -5.7% 0.76 / 0.72 / +5.4%
tpch_q05/duckdb:parquet 126631741 / 125918215 / +0.6% 161529287 / 170438826 / -5.2% 0.78 / 0.74 / +6.1%
tpch_q06/duckdb:parquet 33644405 / 42692368 / -21.2% 🟢 47628202 / 50883808 / -6.4% 0.71 / 0.84 / -15.8%
tpch_q07/duckdb:parquet 89844595 / 90561276 / -0.8% 137897867 / 136366977 / +1.1% 0.65 / 0.66 / -1.9%
tpch_q08/duckdb:parquet 142027575 / 143336896 / -0.9% 187605852 / 188283092 / -0.4% 0.76 / 0.76 / -0.6%
tpch_q09/duckdb:parquet 222576343 / 224168538 / -0.7% 269007053 / 264927649 / +1.5% 0.83 / 0.85 / -2.2%
tpch_q10/duckdb:parquet 470998189 / 474462090 / -0.7% 513943270 / 522005040 / -1.5% 0.92 / 0.91 / +0.8%
tpch_q11/duckdb:parquet 30746267 / 30983652 / -0.8% 38685537 / 36886598 / +4.9% 0.79 / 0.84 / -5.4%
tpch_q12/duckdb:parquet 74273391 / 75373985 / -1.5% 93246438 / 100345912 / -7.1% 0.80 / 0.75 / +6.0%
tpch_q13/duckdb:parquet 314714879 / 320886024 / -1.9% 332343837 / 331194174 / +0.3% 0.95 / 0.97 / -2.3%
tpch_q14/duckdb:parquet 104189898 / 106760161 / -2.4% 130979546 / 135945597 / -3.7% 0.80 / 0.79 / +1.3%
tpch_q15/duckdb:parquet 45015468 / 44173056 / +1.9% 87335412 / 66689900 / +31.0% 🔴 0.52 / 0.66 / -22.2%
tpch_q16/duckdb:parquet 113991622 / 114604726 / -0.5% 125260941 / 124678325 / +0.5% 0.91 / 0.92 / -1.0%
tpch_q17/duckdb:parquet 75552870 / 75961370 / -0.5% 101059671 / 102118493 / -1.0% 0.75 / 0.74 / +0.5%
tpch_q18/duckdb:parquet 207248068 / 198901728 / +4.2% 170271271 / 166413623 / +2.3% 1.22 / 1.20 / +1.8%
tpch_q19/duckdb:parquet 160873515 / 163736625 / -1.7% 197754071 / 212278581 / -6.8% 0.81 / 0.77 / +5.5%
tpch_q20/duckdb:parquet 128923033 / 128865063 / +0.0% 167455676 / 162057373 / +3.3% 0.77 / 0.80 / -3.2%
tpch_q21/duckdb:parquet 273832652 / 274141418 / -0.1% 293675147 / 303955991 / -3.4% 0.93 / 0.90 / +3.4%
tpch_q22/duckdb:parquet 262793966 / 261588099 / +0.5% 272091592 / 270830319 / +0.5% 0.97 / 0.97 / -0.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9045110 / 9137396 / -1.0% 9470924 / 9412323 / +0.6% 0.96 / 0.97 / -1.6%
statpopgen_q01/duckdb:vortex-compact 10304849 / 10211592 / +0.9% 14415677 / 15973038 / -9.7% 0.71 / 0.64 / +11.8%
statpopgen_q02/duckdb:vortex-compact 393863674 / 390078596 / +1.0% 404114723 / 403431602 / +0.2% 0.97 / 0.97 / +0.8%
statpopgen_q03/duckdb:vortex-compact 909947415 / 912040427 / -0.2% 913310302 / 904817976 / +0.9% 1.00 / 1.01 / -1.2%
statpopgen_q04/duckdb:vortex-compact 918137338 / 910966188 / +0.8% 915198305 / 911849009 / +0.4% 1.00 / 1.00 / +0.4%
statpopgen_q05/duckdb:vortex-compact 439887088 / 435613118 / +1.0% 451741204 / 448040780 / +0.8% 0.97 / 0.97 / +0.2%
statpopgen_q06/duckdb:vortex-compact 1188280630 / 1180531426 / +0.7% 1183233555 / 1176733200 / +0.6% 1.00 / 1.00 / +0.1%
statpopgen_q07/duckdb:vortex-compact 312339524 / 312195940 / +0.0% 328739677 / 329448179 / -0.2% 0.95 / 0.95 / +0.3%
statpopgen_q08/duckdb:vortex-compact 328321079 / 330108588 / -0.5% 353258348 / 358156457 / -1.4% 0.93 / 0.92 / +0.8%
statpopgen_q09/duckdb:vortex-compact 725037267 / 719690738 / +0.7% 734507102 / 721428612 / +1.8% 0.99 / 1.00 / -1.1%
statpopgen_q10/duckdb:vortex-compact 2009139726 / 2029174110 / -1.0% 1986561628 / 1994360330 / -0.4% 1.01 / 1.02 / -0.6%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 246630159 / 249018460 / -1.0% 246798177 / 247088781 / -0.1% 1.00 / 1.01 / -0.8%
statpopgen_q01/duckdb:parquet 302610258 / 305350408 / -0.9% 305363980 / 309164049 / -1.2% 0.99 / 0.99 / +0.3%
statpopgen_q02/duckdb:parquet 538698686 / 537209138 / +0.3% 546711861 / 560586733 / -2.5% 0.99 / 0.96 / +2.8%
statpopgen_q03/duckdb:parquet 865176284 / 851554926 / +1.6% 862498736 / 843651249 / +2.2% 1.00 / 1.01 / -0.6%
statpopgen_q04/duckdb:parquet 851165492 / 858387062 / -0.8% 857138641 / 882966865 / -2.9% 0.99 / 0.97 / +2.1%
statpopgen_q05/duckdb:parquet 599324250 / 567488334 / +5.6% 597807541 / 583080985 / +2.5% 1.00 / 0.97 / +3.0%
statpopgen_q06/duckdb:parquet 733244592 / 749844737 / -2.2% 708698899 / 740801914 / -4.3% 1.03 / 1.01 / +2.2%
statpopgen_q07/duckdb:parquet 610261144 / 614712082 / -0.7% 680124883 / 676817800 / +0.5% 0.90 / 0.91 / -1.2%
statpopgen_q08/duckdb:parquet 623252454 / 626206458 / -0.5% 701382567 / 678214720 / +3.4% 0.89 / 0.92 / -3.8%
statpopgen_q09/duckdb:parquet 807048740 / 815065448 / -1.0% 829078440 / 821769900 / +0.9% 0.97 / 0.99 / -1.9%
statpopgen_q10/duckdb:parquet 1463321958 / 1520327274 / -3.7% 1307592540 / 1350427775 / -3.2% 1.12 / 1.13 / -0.6%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52290049 / 53039563 / -1.4% 71760990 / 73316767 / -2.1% 0.73 / 0.72 / +0.7%
appian_q02/datafusion:vortex-compact 232322406 / 234269315 / -0.8% 260387434 / 261042525 / -0.3% 0.89 / 0.90 / -0.6%
appian_q03/datafusion:vortex-compact 148584304 / 146771233 / +1.2% 179191954 / 181690456 / -1.4% 0.83 / 0.81 / +2.6%
appian_q04/datafusion:vortex-compact 9871380124 / 9922379893 / -0.5% 9781871385 / 9886127511 / -1.1% 1.01 / 1.00 / +0.5%
appian_q05/datafusion:vortex-compact 137980136 / 136108045 / +1.4% 161462944 / 163835336 / -1.4% 0.85 / 0.83 / +2.9%
appian_q06/datafusion:vortex-compact 144319712 / 143011577 / +0.9% 165259598 / 166302073 / -0.6% 0.87 / 0.86 / +1.6%
appian_q07/datafusion:vortex-compact 165446493 / 164583792 / +0.5% 188768882 / 189346809 / -0.3% 0.88 / 0.87 / +0.8%
appian_q08/datafusion:vortex-compact 553561645 / 569503899 / -2.8% 587866144 / 571968967 / +2.8% 0.94 / 1.00 / -5.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72433428 / 72999320 / -0.8% 91349010 / 93760904 / -2.6% 0.79 / 0.78 / +1.8%
appian_q02/datafusion:parquet 295473314 / 299571685 / -1.4% 328411133 / 326380955 / +0.6% 0.90 / 0.92 / -2.0%
appian_q03/datafusion:parquet 185367135 / 185605867 / -0.1% 227088838 / 225601301 / +0.7% 0.82 / 0.82 / -0.8%
appian_q04/datafusion:parquet 9935961624 / 9967091301 / -0.3% 9849544746 / 9874048338 / -0.2% 1.01 / 1.01 / -0.1%
appian_q05/datafusion:parquet 193608629 / 192230547 / +0.7% 213430084 / 215985427 / -1.2% 0.91 / 0.89 / +1.9%
appian_q06/datafusion:parquet 169623124 / 169585592 / +0.0% 188574640 / 192692927 / -2.1% 0.90 / 0.88 / +2.2%
appian_q07/datafusion:parquet 204946098 / 204792681 / +0.1% 231928437 / 241311358 / -3.9% 0.88 / 0.85 / +4.1%
appian_q08/datafusion:parquet 666093979 / 659752865 / +1.0% 677974754 / 684895443 / -1.0% 0.98 / 0.96 / +2.0%
duckdb / vortex-compact / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 93444347 / 90942675 / +2.8% 107881752 / 109539206 / -1.5% 0.87 / 0.83 / +4.3%
appian_q02/duckdb:vortex-compact 214573093 / 210707035 / +1.8% 232219293 / 227285843 / +2.2% 0.92 / 0.93 / -0.3%
appian_q03/duckdb:vortex-compact 120903530 / 121318880 / -0.3% 135950810 / 136795590 / -0.6% 0.89 / 0.89 / +0.3%
appian_q04/duckdb:vortex-compact 541534900 / 530962227 / +2.0% 547219179 / 553688160 / -1.2% 0.99 / 0.96 / +3.2%
appian_q05/duckdb:vortex-compact 135384538 / 128297401 / +5.5% 158715634 / 151349731 / +4.9% 0.85 / 0.85 / +0.6%
appian_q06/duckdb:vortex-compact 407519002 / 405377438 / +0.5% 383960990 / 403727482 / -4.9% 1.06 / 1.00 / +5.7%
appian_q07/duckdb:vortex-compact 137260492 / 137070182 / +0.1% 152566795 / 158373421 / -3.7% 0.90 / 0.87 / +4.0%
appian_q08/duckdb:vortex-compact 434960712 / 447088007 / -2.7% 463954702 / 482393358 / -3.8% 0.94 / 0.93 / +1.2%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99870503 / 99838495 / +0.0% 122816659 / 118601412 / +3.6% 0.81 / 0.84 / -3.4%
appian_q02/duckdb:parquet 197096838 / 197545462 / -0.2% 206390886 / 203356442 / +1.5% 0.95 / 0.97 / -1.7%
appian_q03/duckdb:parquet 126580607 / 128186968 / -1.3% 148096176 / 140193917 / +5.6% 0.85 / 0.91 / -6.5%
appian_q04/duckdb:parquet 443095213 / 431388576 / +2.7% 448720640 / 432015551 / +3.9% 0.99 / 1.00 / -1.1%
appian_q05/duckdb:parquet 142991913 / 142008009 / +0.7% 163044691 / 170794131 / -4.5% 0.88 / 0.83 / +5.5%
appian_q06/duckdb:parquet 270219417 / 279012363 / -3.2% 302433464 / 287213134 / +5.3% 0.89 / 0.97 / -8.0%
appian_q07/duckdb:parquet 154290018 / 154477427 / -0.1% 166800157 / 177077332 / -5.8% 0.92 / 0.87 / +6.0%
appian_q08/duckdb:parquet 382441747 / 374373635 / +2.2% 378300659 / 384888812 / -1.7% 1.01 / 0.97 / +3.9%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.984x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.956x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 264497387 / 225263510 / +17.4% 🔴 610297340 / 635795009 / -4.0% 0.43 / 0.35 / +22.3%
clickbench-sorted_q24/datafusion:vortex-file-compressed 13006153 / 13553188 / -4.0% 48507640 / 48374976 / +0.3% 0.27 / 0.28 / -4.3%
clickbench-sorted_q26/datafusion:vortex-file-compressed 14163518 / 13307200 / +6.4% 51003604 / 50525467 / +0.9% 0.28 / 0.26 / +5.4%
clickbench-sorted_q36/datafusion:vortex-file-compressed 28907580 / 29372913 / -1.6% 68239094 / 66668906 / +2.4% 0.42 / 0.44 / -3.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed 24534169 / 24932436 / -1.6% 61272838 / 60365807 / +1.5% 0.40 / 0.41 / -3.1%
clickbench-sorted_q38/datafusion:vortex-file-compressed 37084102 / 34148036 / +8.6% 68900617 / 69166806 / -0.4% 0.54 / 0.49 / +9.0%
clickbench-sorted_q39/datafusion:vortex-file-compressed 87760048 / 91562840 / -4.2% 117388836 / 125495942 / -6.5% 0.75 / 0.73 / +2.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 16500039 / 16476631 / +0.1% 45627955 / 50722741 / -10.0% 🟢 0.36 / 0.32 / +11.3%
clickbench-sorted_q41/datafusion:vortex-file-compressed 15404478 / 15894954 / -3.1% 44925378 / 49437635 / -9.1% 0.34 / 0.32 / +6.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed 13859638 / 14091062 / -1.6% 38583800 / 40685089 / -5.2% 0.36 / 0.35 / +3.7%
datafusion / parquet / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 757469358 / 762230984 / -0.6% 939669602 / 957817495 / -1.9% 0.81 / 0.80 / +1.3%
clickbench-sorted_q24/datafusion:parquet 9235411 / 8351800 / +10.6% 🔴 72481947 / 73636960 / -1.6% 0.13 / 0.11 / +12.3%
clickbench-sorted_q26/datafusion:parquet 9482047 / 9326229 / +1.7% 72047213 / 71425309 / +0.9% 0.13 / 0.13 / +0.8%
clickbench-sorted_q36/datafusion:parquet 94175558 / 93260000 / +1.0% 168265456 / 171706262 / -2.0% 0.56 / 0.54 / +3.0%
clickbench-sorted_q37/datafusion:parquet 64581788 / 64236459 / +0.5% 132186606 / 132547894 / -0.3% 0.49 / 0.48 / +0.8%
clickbench-sorted_q38/datafusion:parquet 87555522 / 86879039 / +0.8% 159827182 / 165280484 / -3.3% 0.55 / 0.53 / +4.2%
clickbench-sorted_q39/datafusion:parquet 160025182 / 159484275 / +0.3% 234393067 / 239840623 / -2.3% 0.68 / 0.66 / +2.7%
clickbench-sorted_q40/datafusion:parquet 44673549 / 44291234 / +0.9% 110861758 / 115498765 / -4.0% 0.40 / 0.38 / +5.1%
clickbench-sorted_q41/datafusion:parquet 42278292 / 41633990 / +1.5% 107785626 / 116582383 / -7.5% 0.39 / 0.36 / +9.8%
clickbench-sorted_q42/datafusion:parquet 26191296 / 26400742 / -0.8% 85409657 / 88493485 / -3.5% 0.31 / 0.30 / +2.8%
duckdb / vortex-file-compressed / ns (0.964x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 68505719 / 69613128 / -1.6% 89620585 / 100401952 / -10.7% 🟢 0.76 / 0.69 / +10.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed 20106831 / 20000933 / +0.5% 34495283 / 33683335 / +2.4% 0.58 / 0.59 / -1.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed 13649072 / 18820656 / -27.5% 🟢 28416344 / 30317640 / -6.3% 0.48 / 0.62 / -22.6%
clickbench-sorted_q36/duckdb:vortex-file-compressed 43443652 / 46508240 / -6.6% 74371236 / 72073743 / +3.2% 0.58 / 0.65 / -9.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed 39232822 / 38515432 / +1.9% 66401295 / 61163992 / +8.6% 0.59 / 0.63 / -6.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed 49374265 / 49626554 / -0.5% 78027563 / 74754731 / +4.4% 0.63 / 0.66 / -4.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed 118172814 / 114834656 / +2.9% 143999613 / 144561697 / -0.4% 0.82 / 0.79 / +3.3%
clickbench-sorted_q40/duckdb:vortex-file-compressed 21090650 / 21991994 / -4.1% 44598177 / 43757167 / +1.9% 0.47 / 0.50 / -5.9%
clickbench-sorted_q41/duckdb:vortex-file-compressed 21460412 / 21242014 / +1.0% 43604833 / 42159330 / +3.4% 0.49 / 0.50 / -2.3%
clickbench-sorted_q42/duckdb:vortex-file-compressed 18401294 / 17936422 / +2.6% 35475897 / 37242533 / -4.7% 0.52 / 0.48 / +7.7%
duckdb / parquet / ns (0.978x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 124447894 / 129557612 / -3.9% 145272334 / 153614260 / -5.4% 0.86 / 0.84 / +1.6%
clickbench-sorted_q24/duckdb:parquet 17963242 / 17755248 / +1.2% 26720432 / 25868789 / +3.3% 0.67 / 0.69 / -2.1%
clickbench-sorted_q26/duckdb:parquet 12341982 / 13021414 / -5.2% 21176442 / 21232969 / -0.3% 0.58 / 0.61 / -5.0%
clickbench-sorted_q36/duckdb:parquet 43586217 / 47448352 / -8.1% 61369534 / 64150748 / -4.3% 0.71 / 0.74 / -4.0%
clickbench-sorted_q37/duckdb:parquet 30617780 / 31307330 / -2.2% 43768614 / 48962190 / -10.6% 🟢 0.70 / 0.64 / +9.4%
clickbench-sorted_q38/duckdb:parquet 38929842 / 39650619 / -1.8% 54963228 / 60075503 / -8.5% 0.71 / 0.66 / +7.3%
clickbench-sorted_q39/duckdb:parquet 77654758 / 76029661 / +2.1% 85225147 / 87377408 / -2.5% 0.91 / 0.87 / +4.7%
clickbench-sorted_q40/duckdb:parquet 17650389 / 17624909 / +0.1% 34490936 / 40283802 / -14.4% 🟢 0.51 / 0.44 / +17.0%
clickbench-sorted_q41/duckdb:parquet 16700002 / 16595996 / +0.6% 34420718 / 40612833 / -15.2% 🟢 0.49 / 0.41 / +18.7%
clickbench-sorted_q42/duckdb:parquet 10848482 / 11347082 / -4.4% 23393085 / 23740367 / -1.5% 0.46 / 0.48 / -3.0%

File Size Changes (100 files changed, -0.0% overall, 39↑ 61↓)
File Scale Format Base HEAD Change %
hits_038.vortex 1.0 vortex-file-compressed 188.98 MB 191.53 MB +2.55 MB +1.3%
hits_054.vortex 1.0 vortex-file-compressed 145.94 MB 147.74 MB +1.81 MB +1.2%
hits_001.vortex 1.0 vortex-file-compressed 192.43 MB 194.70 MB +2.27 MB +1.2%
hits_086.vortex 1.0 vortex-file-compressed 191.24 MB 193.21 MB +1.97 MB +1.0%
hits_064.vortex 1.0 vortex-file-compressed 190.23 MB 191.90 MB +1.67 MB +0.9%
hits_033.vortex 1.0 vortex-file-compressed 197.97 MB 199.52 MB +1.54 MB +0.8%
hits_046.vortex 1.0 vortex-file-compressed 100.60 MB 101.10 MB +507.20 KB +0.5%
hits_072.vortex 1.0 vortex-file-compressed 101.74 MB 102.20 MB +472.09 KB +0.5%
hits_020.vortex 1.0 vortex-file-compressed 159.22 MB 159.85 MB +651.91 KB +0.4%
hits_094.vortex 1.0 vortex-file-compressed 157.19 MB 157.78 MB +599.04 KB +0.4%
hits_024.vortex 1.0 vortex-file-compressed 159.43 MB 159.95 MB +535.48 KB +0.3%
hits_095.vortex 1.0 vortex-file-compressed 153.34 MB 153.75 MB +424.40 KB +0.3%
hits_042.vortex 1.0 vortex-file-compressed 200.59 MB 201.06 MB +484.09 KB +0.2%
hits_009.vortex 1.0 vortex-file-compressed 100.64 MB 100.85 MB +217.78 KB +0.2%
hits_045.vortex 1.0 vortex-file-compressed 139.15 MB 139.39 MB +241.17 KB +0.2%
hits_018.vortex 1.0 vortex-file-compressed 198.71 MB 199.02 MB +313.25 KB +0.2%
hits_096.vortex 1.0 vortex-file-compressed 198.63 MB 198.84 MB +220.84 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.64 MB 153.78 MB +149.99 KB +0.1%
hits_055.vortex 1.0 vortex-file-compressed 199.19 MB 199.37 MB +183.11 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 189.82 MB 189.98 MB +169.71 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.58 MB 130.69 MB +112.66 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.18 MB 199.32 MB +140.53 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.14 MB 154.23 MB +98.42 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 125.80 MB 125.87 MB +73.45 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.27 MB 130.34 MB +72.30 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.07 MB 168.15 MB +88.43 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.12 MB 171.19 MB +74.95 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 171.49 MB 171.55 MB +66.83 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.79 MB 159.85 MB +60.77 KB +0.0%
hits_077.vortex 1.0 vortex-file-compressed 171.63 MB 171.69 MB +58.38 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.24 MB 160.29 MB +44.16 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.78 MB 145.82 MB +39.17 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 190.26 MB 190.31 MB +47.19 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.32 MB 194.36 MB +43.43 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.69 MB 135.72 MB +29.53 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 191.87 MB 191.90 MB +29.40 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 188.44 MB 188.46 MB +15.74 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.77 MB 130.78 MB +6.28 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 199.27 MB 199.27 MB +7.76 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 150.84 MB 150.84 MB 992 B -0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.77 MB 153.76 MB 6.06 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.35 MB 179.34 MB 8.62 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 134.49 MB 134.48 MB 7.31 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 159.94 MB 159.93 MB 9.48 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 129.84 MB 129.83 MB 12.62 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.57 MB 153.56 MB 16.66 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.15 MB 130.14 MB 14.23 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 139.66 MB 139.64 MB 19.48 KB -0.0%
hits_090.vortex 1.0 vortex-file-compressed 191.61 MB 191.58 MB 28.60 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.17 MB 126.15 MB 20.41 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 160.05 MB 160.01 MB 35.88 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.11 MB 146.08 MB 35.70 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.49 MB 130.46 MB 35.61 KB -0.0%
hits_071.vortex 1.0 vortex-file-compressed 138.80 MB 138.76 MB 38.85 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.03 MB 180.98 MB 55.05 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 198.94 MB 198.87 MB 67.45 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.72 MB 141.67 MB 55.91 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.47 MB 153.40 MB 63.35 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.24 MB 160.17 MB 71.22 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.70 MB 125.64 MB 59.56 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 199.29 MB 199.19 MB 102.25 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 169.95 MB 169.86 MB 91.93 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 171.75 MB 171.65 MB 94.65 KB -0.1%
hits_027.vortex 1.0 vortex-file-compressed 188.96 MB 188.84 MB 120.08 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 198.61 MB 198.48 MB 126.98 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 158.87 MB 158.77 MB 103.06 KB -0.1%
hits_039.vortex 1.0 vortex-file-compressed 160.16 MB 160.04 MB 123.91 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.75 MB 130.65 MB 109.44 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.27 MB 156.12 MB 157.39 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 170.65 MB 170.47 MB 185.84 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.16 MB 131.02 MB 147.88 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.04 MB 179.83 MB 224.04 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 159.87 MB 159.66 MB 209.03 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.39 MB 102.26 MB 135.78 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.14 MB 130.96 MB 185.98 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.63 MB 199.35 MB 288.80 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.03 MB 130.84 MB 194.70 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.04 MB 171.78 MB 261.55 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 166.66 MB 166.39 MB 270.61 KB -0.2%
hits_057.vortex 1.0 vortex-file-compressed 159.35 MB 159.03 MB 323.16 KB -0.2%
hits_037.vortex 1.0 vortex-file-compressed 176.78 MB 176.41 MB 377.06 KB -0.2%
hits_053.vortex 1.0 vortex-file-compressed 189.28 MB 188.84 MB 448.88 KB -0.2%
hits_088.vortex 1.0 vortex-file-compressed 171.83 MB 171.28 MB 569.15 KB -0.3%
hits_066.vortex 1.0 vortex-file-compressed 162.88 MB 162.34 MB 559.41 KB -0.3%
hits_082.vortex 1.0 vortex-file-compressed 139.14 MB 138.64 MB 514.60 KB -0.4%
hits_008.vortex 1.0 vortex-file-compressed 139.24 MB 138.72 MB 536.50 KB -0.4%
hits_098.vortex 1.0 vortex-file-compressed 137.20 MB 136.68 MB 530.76 KB -0.4%
hits_078.vortex 1.0 vortex-file-compressed 130.46 MB 129.97 MB 508.24 KB -0.4%
hits_036.vortex 1.0 vortex-file-compressed 171.34 MB 170.62 MB 729.82 KB -0.4%
hits_059.vortex 1.0 vortex-file-compressed 198.38 MB 197.34 MB 1.04 MB -0.5%
hits_085.vortex 1.0 vortex-file-compressed 198.89 MB 197.78 MB 1.11 MB -0.6%
hits_011.vortex 1.0 vortex-file-compressed 198.65 MB 197.54 MB 1.12 MB -0.6%
hits_048.vortex 1.0 vortex-file-compressed 198.90 MB 197.66 MB 1.24 MB -0.6%
hits_040.vortex 1.0 vortex-file-compressed 142.94 MB 142.03 MB 925.89 KB -0.6%
hits_004.vortex 1.0 vortex-file-compressed 130.60 MB 129.77 MB 849.81 KB -0.6%
hits_022.vortex 1.0 vortex-file-compressed 198.49 MB 197.19 MB 1.30 MB -0.7%
hits_060.vortex 1.0 vortex-file-compressed 193.65 MB 192.24 MB 1.41 MB -0.7%
hits_087.vortex 1.0 vortex-file-compressed 159.98 MB 158.63 MB 1.35 MB -0.8%
hits_007.vortex 1.0 vortex-file-compressed 199.79 MB 198.08 MB 1.71 MB -0.9%
hits_002.vortex 1.0 vortex-file-compressed 159.99 MB 158.47 MB 1.52 MB -0.9%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.88 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR cbd15261 vs base 4afdbd45
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.5%, environment too noisy confidence) · DuckDB No clear signal (-1.0%, environment too noisy confidence)
Vortex (geomean): hot 1.063x ➖ · cold 1.076x ➖
Parquet (geomean): hot 1.071x ➖ · cold 1.094x ➖
Shifts: Parquet (control) +7.1% · Median polish +5.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.039x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 345471508 / 333414959 / +3.6% 958991997 / 869462003 / +10.3% 0.36 / 0.38 / -6.1%
tpch_q02/datafusion:vortex-compact 508933324 / 454290354 / +12.0% 1139636708 / 1104293838 / +3.2% 0.45 / 0.41 / +8.6%
tpch_q03/datafusion:vortex-compact 404802933 / 564307242 / -28.3% 1489450744 / 1201125035 / +24.0% 0.27 / 0.47 / -42.2%
tpch_q04/datafusion:vortex-compact 240655186 / 343814678 / -30.0% 🟢 545486414 / 539766510 / +1.1% 0.44 / 0.64 / -30.7%
tpch_q05/datafusion:vortex-compact 1001119515 / 585980860 / +70.8% 🔴 858604718 / 681770365 / +25.9% 1.17 / 0.86 / +35.7%
tpch_q06/datafusion:vortex-compact 270644718 / 351669604 / -23.0% 483604465 / 468410966 / +3.2% 0.56 / 0.75 / -25.5%
tpch_q07/datafusion:vortex-compact 513561042 / 514211420 / -0.1% 797053547 / 778492839 / +2.4% 0.64 / 0.66 / -2.5%
tpch_q08/datafusion:vortex-compact 850133091 / 822858599 / +3.3% 1040125449 / 1006304351 / +3.4% 0.82 / 0.82 / -0.0%
tpch_q09/datafusion:vortex-compact 700931211 / 653251034 / +7.3% 961185970 / 909084786 / +5.7% 0.73 / 0.72 / +1.5%
tpch_q10/datafusion:vortex-compact 668146630 / 577944995 / +15.6% 788226844 / 1118894311 / -29.6% 0.85 / 0.52 / +64.1%
tpch_q11/datafusion:vortex-compact 492830299 / 344048325 / +43.2% 🔴 621577315 / 554535824 / +12.1% 0.79 / 0.62 / +27.8%
tpch_q12/datafusion:vortex-compact 793957634 / 500460737 / +58.6% 🔴 841543319 / 587992103 / +43.1% 🔴 0.94 / 0.85 / +10.8%
tpch_q13/datafusion:vortex-compact 253940146 / 297656116 / -14.7% 683905237 / 591979821 / +15.5% 0.37 / 0.50 / -26.2%
tpch_q14/datafusion:vortex-compact 407513535 / 379616911 / +7.3% 625846870 / 532864904 / +17.4% 0.65 / 0.71 / -8.6%
tpch_q15/datafusion:vortex-compact 640476574 / 789239238 / -18.8% 785040879 / 921822174 / -14.8% 0.82 / 0.86 / -4.7%
tpch_q16/datafusion:vortex-compact 271059224 / 301577342 / -10.1% 424647170 / 436014119 / -2.6% 0.64 / 0.69 / -7.7%
tpch_q17/datafusion:vortex-compact 823835788 / 779710233 / +5.7% 1140833059 / 946403416 / +20.5% 0.72 / 0.82 / -12.3%
tpch_q18/datafusion:vortex-compact 646290274 / 567675441 / +13.8% 683653009 / 708328413 / -3.5% 0.95 / 0.80 / +18.0%
tpch_q19/datafusion:vortex-compact 490124708 / 477166101 / +2.7% 903759298 / 645981237 / +39.9% 🔴 0.54 / 0.74 / -26.6%
tpch_q20/datafusion:vortex-compact 801614812 / 564045242 / +42.1% 🔴 1163346863 / 640381455 / +81.7% 🔴 0.69 / 0.88 / -21.8%
tpch_q21/datafusion:vortex-compact 973061298 / 751940430 / +29.4% 1083974962 / 875245306 / +23.8% 0.90 / 0.86 / +4.5%
tpch_q22/datafusion:vortex-compact 312153242 / 456578272 / -31.6% 🟢 561988056 / 598921476 / -6.2% 0.56 / 0.76 / -27.1%
datafusion / parquet / ns (1.044x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 297322105 / 233878305 / +27.1% 880340719 / 622050932 / +41.5% 🔴 0.34 / 0.38 / -10.2%
tpch_q02/datafusion:parquet 518841280 / 468308194 / +10.8% 1234416226 / 962312670 / +28.3% 0.42 / 0.49 / -13.6%
tpch_q03/datafusion:parquet 579166908 / 815533750 / -29.0% 1367628994 / 1312247410 / +4.2% 0.42 / 0.62 / -31.9%
tpch_q04/datafusion:parquet 359554209 / 418950114 / -14.2% 570466273 / 626007739 / -8.9% 0.63 / 0.67 / -5.8%
tpch_q05/datafusion:parquet 694315709 / 681143801 / +1.9% 962550326 / 857484229 / +12.3% 0.72 / 0.79 / -9.2%
tpch_q06/datafusion:parquet 208393699 / 186320436 / +11.8% 564732228 / 452676729 / +24.8% 0.37 / 0.41 / -10.3%
tpch_q07/datafusion:parquet 916265545 / 678422418 / +35.1% 🔴 1188866631 / 813338482 / +46.2% 🔴 0.77 / 0.83 / -7.6%
tpch_q08/datafusion:parquet 846392566 / 775474441 / +9.1% 1190733890 / 952063548 / +25.1% 0.71 / 0.81 / -12.7%
tpch_q09/datafusion:parquet 1123849384 / 1150970454 / -2.4% 1388235689 / 1127902623 / +23.1% 0.81 / 1.02 / -20.7%
tpch_q10/datafusion:parquet 1779041611 / 1595173654 / +11.5% 2236764256 / 1848681698 / +21.0% 0.80 / 0.86 / -7.8%
tpch_q11/datafusion:parquet 385451331 / 419907168 / -8.2% 692642178 / 524886457 / +32.0% 🔴 0.56 / 0.80 / -30.4%
tpch_q12/datafusion:parquet 422518752 / 395383659 / +6.9% 592385555 / 528866249 / +12.0% 0.71 / 0.75 / -4.6%
tpch_q13/datafusion:parquet 459815258 / 461464052 / -0.4% 1278769106 / 969568729 / +31.9% 🔴 0.36 / 0.48 / -24.5%
tpch_q14/datafusion:parquet 514557958 / 496216033 / +3.7% 726391817 / 591593879 / +22.8% 0.71 / 0.84 / -15.5%
tpch_q15/datafusion:parquet 800268302 / 706819284 / +13.2% 1059466305 / 1177229230 / -10.0% 0.76 / 0.60 / +25.8%
tpch_q16/datafusion:parquet 273532036 / 262013930 / +4.4% 540057222 / 478028080 / +13.0% 0.51 / 0.55 / -7.6%
tpch_q17/datafusion:parquet 776990480 / 775536215 / +0.2% 982862056 / 856907891 / +14.7% 0.79 / 0.91 / -12.7%
tpch_q18/datafusion:parquet 906942899 / 825189477 / +9.9% 1320872387 / 1151483987 / +14.7% 0.69 / 0.72 / -4.2%
tpch_q19/datafusion:parquet 459711155 / 442940003 / +3.8% 718693508 / 612512857 / +17.3% 0.64 / 0.72 / -11.5%
tpch_q20/datafusion:parquet 809054344 / 741993341 / +9.0% 1134259994 / 880271492 / +28.9% 0.71 / 0.84 / -15.4%
tpch_q21/datafusion:parquet 1097277868 / 1082608999 / +1.4% 1230972141 / 1192994981 / +3.2% 0.89 / 0.91 / -1.8%
tpch_q22/datafusion:parquet 643194625 / 595179096 / +8.1% 976635471 / 971704313 / +0.5% 0.66 / 0.61 / +7.5%
duckdb / vortex-compact / ns (1.088x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 918442237 / 847390226 / +8.4% 1644598901 / 2040862097 / -19.4% 0.56 / 0.42 / +34.5%
tpch_q02/duckdb:vortex-compact 510874736 / 454303299 / +12.5% 765512612 / 714814629 / +7.1% 0.67 / 0.64 / +5.0%
tpch_q03/duckdb:vortex-compact 1050519519 / 998241286 / +5.2% 1290316192 / 1767399310 / -27.0% 0.81 / 0.56 / +44.1%
tpch_q04/duckdb:vortex-compact 716870232 / 624536960 / +14.8% 891157710 / 888881647 / +0.3% 0.80 / 0.70 / +14.5%
tpch_q05/duckdb:vortex-compact 1076850815 / 1052650311 / +2.3% 1364450565 / 1330810153 / +2.5% 0.79 / 0.79 / -0.2%
tpch_q06/duckdb:vortex-compact 1096308839 / 1038447771 / +5.6% 1243296917 / 1135918149 / +9.5% 0.88 / 0.91 / -3.5%
tpch_q07/duckdb:vortex-compact 1484040588 / 1384925814 / +7.2% 1589405393 / 1356448830 / +17.2% 0.93 / 1.02 / -8.5%
tpch_q08/duckdb:vortex-compact 1412539620 / 1333360896 / +5.9% 1603729878 / 1450826059 / +10.5% 0.88 / 0.92 / -4.2%
tpch_q09/duckdb:vortex-compact 1600905045 / 1859983752 / -13.9% 1886377439 / 2184203904 / -13.6% 0.85 / 0.85 / -0.3%
tpch_q10/duckdb:vortex-compact 1467311476 / 1387570450 / +5.7% 1840700828 / 1648247357 / +11.7% 0.80 / 0.84 / -5.3%
tpch_q11/duckdb:vortex-compact 476347484 / 428200572 / +11.2% 723097515 / 712705937 / +1.5% 0.66 / 0.60 / +9.6%
tpch_q12/duckdb:vortex-compact 1979123765 / 1937926562 / +2.1% 2349992561 / 1981540480 / +18.6% 0.84 / 0.98 / -13.9%
tpch_q13/duckdb:vortex-compact 1183558649 / 1059146824 / +11.7% 1769421107 / 1520318062 / +16.4% 0.67 / 0.70 / -4.0%
tpch_q14/duckdb:vortex-compact 822342593 / 784256120 / +4.9% 976482537 / 897121893 / +8.8% 0.84 / 0.87 / -3.7%
tpch_q15/duckdb:vortex-compact 930127258 / 835410859 / +11.3% 1060717436 / 856736991 / +23.8% 0.88 / 0.98 / -10.1%
tpch_q16/duckdb:vortex-compact 243834681 / 217032569 / +12.3% 311947319 / 325867899 / -4.3% 0.78 / 0.67 / +17.4%
tpch_q17/duckdb:vortex-compact 1283245207 / 1217554114 / +5.4% 1356076477 / 1310483476 / +3.5% 0.95 / 0.93 / +1.9%
tpch_q18/duckdb:vortex-compact 1599350705 / 1245505850 / +28.4% 1315048062 / 1329057264 / -1.1% 1.22 / 0.94 / +29.8%
tpch_q19/duckdb:vortex-compact 1005900974 / 992211379 / +1.4% 1279635173 / 1065941884 / +20.0% 0.79 / 0.93 / -15.6%
tpch_q20/duckdb:vortex-compact 1774392581 / 1577144884 / +12.5% 2185161807 / 1844270713 / +18.5% 0.81 / 0.86 / -5.0%
tpch_q21/duckdb:vortex-compact 2358362549 / 2298426398 / +2.6% 2237499153 / 2201621445 / +1.6% 1.05 / 1.04 / +1.0%
tpch_q22/duckdb:vortex-compact 428329752 / 291180633 / +47.1% 🔴 465637046 / 394361811 / +18.1% 0.92 / 0.74 / +24.6%
duckdb / parquet / ns (1.099x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 385972853 / 373435464 / +3.4% 490059204 / 558148981 / -12.2% 0.79 / 0.67 / +17.7%
tpch_q02/duckdb:parquet 795093280 / 717226950 / +10.9% 1202340011 / 1185266851 / +1.4% 0.66 / 0.61 / +9.3%
tpch_q03/duckdb:parquet 1041430258 / 1211956506 / -14.1% 1719167946 / 1627243222 / +5.6% 0.61 / 0.74 / -18.7%
tpch_q04/duckdb:parquet 675253289 / 522521259 / +29.2% 725157532 / 619716146 / +17.0% 0.93 / 0.84 / +10.4%
tpch_q05/duckdb:parquet 1116509099 / 1249964292 / -10.7% 1295580512 / 1174019840 / +10.4% 0.86 / 1.06 / -19.1%
tpch_q06/duckdb:parquet 758978603 / 352378353 / +115.4% 🔴 538154609 / 296703223 / +81.4% 🔴 1.41 / 1.19 / +18.8%
tpch_q07/duckdb:parquet 978150606 / 1014945338 / -3.6% 895628384 / 1294026969 / -30.8% 🟢 1.09 / 0.78 / +39.2%
tpch_q08/duckdb:parquet 1492676836 / 1182859301 / +26.2% 1233799649 / 2387119195 / -48.3% 🟢 1.21 / 0.50 / +144.2%
tpch_q09/duckdb:parquet 1253290650 / 1266471554 / -1.0% 1308089242 / 1839440365 / -28.9% 0.96 / 0.69 / +39.2%
tpch_q10/duckdb:parquet 2179638122 / 2131783503 / +2.2% 2582608501 / 2686961213 / -3.9% 0.84 / 0.79 / +6.4%
tpch_q11/duckdb:parquet 526948390 / 473489522 / +11.3% 601733363 / 775113187 / -22.4% 0.88 / 0.61 / +43.4%
tpch_q12/duckdb:parquet 625505840 / 597139655 / +4.8% 773386334 / 770246970 / +0.4% 0.81 / 0.78 / +4.3%
tpch_q13/duckdb:parquet 898556270 / 908852401 / -1.1% 1634299045 / 1152076333 / +41.9% 🔴 0.55 / 0.79 / -30.3%
tpch_q14/duckdb:parquet 766349622 / 695770767 / +10.1% 853972012 / 706677995 / +20.8% 0.90 / 0.98 / -8.9%
tpch_q15/duckdb:parquet 544086958 / 441949922 / +23.1% 648195766 / 466853234 / +38.8% 🔴 0.84 / 0.95 / -11.3%
tpch_q16/duckdb:parquet 628588755 / 604002889 / +4.1% 626150308 / 932546385 / -32.9% 🟢 1.00 / 0.65 / +55.0%
tpch_q17/duckdb:parquet 734764998 / 614701272 / +19.5% 747891639 / 667171608 / +12.1% 0.98 / 0.92 / +6.6%
tpch_q18/duckdb:parquet 842137247 / 914287518 / -7.9% 973187656 / 1073594216 / -9.4% 0.87 / 0.85 / +1.6%
tpch_q19/duckdb:parquet 840854239 / 744987247 / +12.9% 1302430643 / 825086393 / +57.9% 🔴 0.65 / 0.90 / -28.5%
tpch_q20/duckdb:parquet 1574712395 / 1128868791 / +39.5% 🔴 1950987909 / 1912983488 / +2.0% 0.81 / 0.59 / +36.8%
tpch_q21/duckdb:parquet 823486509 / 868741657 / -5.2% 1147506065 / 842134699 / +36.3% 🔴 0.72 / 1.03 / -30.4%
tpch_q22/duckdb:parquet 802821509 / 814145186 / -1.4% 1013378348 / 958406330 / +5.7% 0.79 / 0.85 / -6.7%

Comment thread vortex-duckdb/src/table_function.rs Outdated
@myrrc
myrrc requested review from joseph-isaacs and removed request for joseph-isaacs September 8, 2026 15:46
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc force-pushed the myrrc/duckdb-no-optimize-recursive branch from 6e90205 to d651f5e Compare September 9, 2026 15:58
@myrrc
myrrc enabled auto-merge (squash) September 9, 2026 16:07
Comment on lines +382 to +384
// In very rare cases we may get a DType::Struct which is not a Struct
// array
array.execute::<Canonical>(ctx)?.into_struct()

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not rare

Suggested change
// In very rare cases we may get a DType::Struct which is not a Struct
// array
array.execute::<Canonical>(ctx)?.into_struct()
array.execute::<Canonical>(ctx)?.into_struct()

@myrrc
myrrc disabled auto-merge September 9, 2026 16:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants