Skip to content

Test main aggmetrics benchmark - #25105

Draft
kosiew wants to merge 4 commits into
apache:mainfrom
kosiew:test-main-aggmetrics-benchmark
Draft

Test main aggmetrics benchmark#25105
kosiew wants to merge 4 commits into
apache:mainfrom
kosiew:test-main-aggmetrics-benchmark

Conversation

@kosiew

@kosiew kosiew commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Test benchmark

- Added harness implementation:
- `benchmarks/sql_benchmarks/array_agg_distinct/array_agg_distinct.suite` – defines the benchmark suite, test parameters, and execution configuration for the data‑free SQL harness.
- `benchmarks/sql_benchmarks/array_agg_distinct/benchmarks/q01.benchmark` – contains the specific query benchmark (`q01`) that exercises the `array_agg(DISTINCT …)` workload without requiring any input data.

- Workload characteristics:
- Simulates **2 M range rows** → **1 M groups**.
- Each group contains **2 rows** with **2 distinct values**, providing a realistic yet data‑free test scenario for aggregation performance.
- add bench.sh wrapper for array_agg_distinct
- `benchmarks/sql_benchmarks/array_agg_distinct/benchmarks/q01.benchmark`: changed `range` from `2000000` to `20000`
- `benchmarks/bench.sh`: updated help text
@kosiew

kosiew commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

run benchmark sql

env:
  CARGO_BUILD_JOBS: 1
  BENCH_NAME: array_agg_distinct
  BENCH_QUERY: 1
baseline:
  ref: "a5bb36462890cd6f2cc3b13f6344a2d9e458f897"
changed:
  ref: "78cf4e00ac3a5b989ad62477c9a7137881f0d79a"

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c5600092255-2248-7rxpr 6.12.94+ #1 SMP Fri Jul 17 09:42:57 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing 78cf4e0 (78cf4e0) to a5bb364 diff

Run configuration
run benchmark sql
env:
  BENCH_NAME: "array_agg_distinct"
  BENCH_QUERY: "1"
  CARGO_BUILD_JOBS: "1"
baseline:
  ref: "a5bb36462890cd6f2cc3b13f6344a2d9e458f897"
changed:
  ref: "78cf4e00ac3a5b989ad62477c9a7137881f0d79a"

Results will be posted here when complete


File an issue against this benchmark runner

@kosiew

kosiew commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

show benchmark queue

@adriangbot

Copy link
Copy Markdown

Hi @kosiew, you asked to view the benchmark queue (#25105 (comment)).

Comment Repo PR User Benchmarks Status
#5599222828 apache/datafusion #25096 kosiew ["sql"] running
#5600092255 apache/datafusion #25105 kosiew ["sql"] running

File an issue against this benchmark runner

@kosiew

kosiew commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

show benchmark queue

@adriangbot

Copy link
Copy Markdown

Hi @kosiew, you asked to view the benchmark queue (#25105 (comment)).

Comment Repo PR User Benchmarks Status
#5600092255 apache/datafusion #25105 kosiew ["sql"] running
#5600614517 apache/datafusion #25096 kosiew ["sql"] running

File an issue against this benchmark runner

@kosiew

kosiew commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

show benchmark queue

@adriangbot

Copy link
Copy Markdown

Hi @kosiew, you asked to view the benchmark queue (#25105 (comment)).

Comment Repo PR User Benchmarks Status
#5600092255 apache/datafusion #25105 kosiew ["sql"] running
#5600614517 apache/datafusion #25096 kosiew ["sql"] running
#5601497362 apache/datafusion #25108 rluvaton ["clickbench_partitioned"] running
#5601497362 apache/datafusion #25108 rluvaton ["tpcds"] running
#5601497362 apache/datafusion #25108 rluvaton ["tpch"] running

File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

Benchmark for this request hit the 7200s job deadline before finishing.

Benchmarks requested: sql

Kubernetes message
Job was active longer than specified deadline

File an issue against this benchmark runner

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants