ci: publish aggregate regression report

[ldm0]

No description provided.

[github-actions]

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 189 / 240 rows; 39 / 48 sites produced rows; 9 unexpected empty sites.

✅ Deterministic fixture contract is clean.

Common ancestor 39d474864b39 → HEAD 6e3614a5607d; benchmark order: base-first; workflow: success.

Public 48-site run · informational

Metric	Base	HEAD	Δ
Run status	success	success	—
Extracted rows / contract	189 / 240	189 / 240	0 (0.00%)
Contract fill	78.75%	78.75%	0.00 pp (0.00%)
Sites with rows	39 / 48	39 / 48	0 (0.00%)
Sites meeting row contract	37 / 48	37 / 48	0 (0.00%)
Unexpected empty sites	9	9	0 (0.00%)
Partial-row sites	2	2	0 (0.00%)
Site outcomes	extracted: 38; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 2	extracted: 38; HTTP error + rows: 1; empty: 6; HTTP error + empty: 1; snapshot error + empty: 2	—
Observed duration	37.65 s	41.08 s	+3.43 s (+9.11%)
Estimated CPU	33.40 s	32.42 s	-0.98 s (-2.92%)
Peak PSS	295.31 MiB	272.59 MiB	-22.72 MiB (-7.69%)
Peak RSS	298.84 MiB	276.23 MiB	-22.61 MiB (-7.57%)
Peak threads	27	27	0 (0.00%)
Mismatched sites	0	0	0
Timeout with items	0	0	0

Category rows	Base	HEAD	Δ
news	35 / 40	35 / 40	0
stocks	20 / 40	20 / 40	0
tech	35 / 40	35 / 40	0
sports	32 / 40	32 / 40	0
games	37 / 40	37 / 40	0
life	30 / 40	30 / 40	0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.035, 2.037, 3.038, 4.039, 5.041, 5.541, 6.542, 7.543, 8.544, 9.544, 10.546, 11.547, 12.548, 13.548, 15.051, 16.051, 17.051, 18.052, 19.053, 20.055, 20.555, 21.055, 22.057, 23.058, 24.56, 25.061, 25.562, 26.563, 27.564, 28.565, 29.567, 30.569, 31.571, 32.572, 34.072, 35.074, 36.075, 37.077]
    y-axis "CPU percent" 0 --> 200
    line [25.98, 115.89, 107.99, 171.81, 131.82, 129.78, 104, 139.84, 75.99, 90.01, 113.78, 25.96, 115.85, 93.95, 39.9, 72.01, 107.93, 137.81, 121.81, 125.77, 110.02, 133.94, 63.93, 107.83, 53.89, 7.99, 15.98, 85.93, 39.94, 13.98, 91.91, 99.89, 71.84, 7.99, 127.94, 63.92, 95.92, 131.74]

Loading

xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.037, 3.038, 4.039, 5.041, 5.541, 6.542, 7.543, 8.544, 9.544, 10.546, 11.547, 12.548, 13.548, 15.051, 16.051, 17.051, 18.052, 19.053, 20.055, 20.555, 21.055, 22.057, 23.058, 24.56, 25.061, 25.562, 26.563, 27.564, 28.565, 29.567, 30.569, 31.571, 32.572, 34.072, 35.074, 36.075, 37.077, 37.651]
    y-axis "Memory MiB" 0 --> 500
    line [22.07, 118.11, 146.2, 183.36, 237.29, 264.99, 244.99, 231.48, 248.96, 236.45, 214.95, 231.82, 218.58, 201.12, 188.22, 185.72, 228.65, 212.18, 217.76, 252.33, 256.85, 298.84, 229.1, 207.96, 258.93, 195.79, 195.09, 190.46, 186.18, 194.48, 195.37, 214.94, 236.51, 243.22, 224.37, 255.27, 195.25, 206.75, 257.49, 0]
    line [18.88, 114.53, 142.62, 179.73, 233.67, 261.32, 241.32, 228.23, 245.28, 232.78, 211.41, 228.14, 215.46, 197.44, 184.55, 182.04, 225.01, 208.54, 214.08, 248.65, 253.17, 295.31, 225.44, 207.26, 255.27, 192.13, 191.42, 186.8, 182.41, 190.81, 191.69, 212.63, 232.83, 239.11, 220.69, 251.63, 191.57, 203.1, 253.84, 0]

Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.036, 2.038, 2.539, 3.541, 4.542, 5.543, 7.045, 7.546, 8.047, 9.048, 10.551, 11.552, 12.553, 13.554, 15.057, 16.057, 17.057, 18.058, 19.56, 20.561, 21.563, 22.064, 23.066, 24.068, 25.068, 26.069, 27.571, 28.572, 29.574, 31.075, 32.076, 33.077, 34.078, 35.579, 36.58, 37.581, 38.582, 40.083]
    y-axis "CPU percent" 0 --> 200
    line [0, 95.75, 119.82, 97.73, 159.81, 141.87, 111.69, 163.71, 141.77, 115.86, 121.82, 107.86, 69.93, 47.97, 49.92, 21.97, 8, 93.97, 113.77, 131.91, 107.82, 115.81, 121.79, 135.73, 126.11, 103.87, 29.98, 87.83, 7.99, 43.96, 105.89, 4, 15.99, 0, 47.96, 127.83, 41.99, 111.89]

Loading

xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.036, 2.038, 2.539, 3.541, 4.542, 5.543, 7.045, 7.546, 8.047, 9.048, 10.551, 11.552, 12.553, 13.554, 15.057, 16.057, 17.057, 18.058, 19.56, 20.561, 21.563, 22.064, 23.066, 24.068, 25.068, 26.069, 27.571, 28.572, 29.574, 31.075, 32.076, 33.077, 34.078, 35.579, 36.58, 37.581, 38.582, 40.083, 41.08]
    y-axis "Memory MiB" 0 --> 500
    line [22.28, 76.08, 144.62, 165.37, 188.58, 230.48, 239.24, 246.7, 249.18, 241.04, 235.84, 232.47, 212.13, 182.2, 185.73, 186.39, 181.25, 192.15, 215.48, 208.81, 221.63, 261.17, 276.23, 210.43, 224.81, 228.37, 206.61, 187.7, 196.06, 194.32, 203.56, 202.42, 191.07, 187.11, 197.02, 197.92, 203.6, 182.98, 217.02, 0]
    line [19.08, 72.52, 141.05, 161.82, 185, 226.88, 232.83, 243.53, 245.27, 237.39, 232.19, 228.58, 208.49, 178.56, 182.09, 182.75, 177.61, 188.51, 212.02, 205.17, 217.99, 257.63, 272.59, 206.79, 221.1, 224.87, 203.06, 184.11, 192.51, 190.75, 199.97, 198.94, 187.63, 183.67, 193.52, 194.43, 199.71, 179.54, 213.58, 0]

Loading

Deterministic fixture · required contract

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric	Base	HEAD	Δ
Run status	success	success	—
Extracted rows / contract	40 / 40	40 / 40	0 (0.00%)
Contract fill	100.00%	100.00%	0.00 pp (0.00%)
Sites with rows	8 / 15	8 / 15	0 (0.00%)
Sites meeting row contract	15 / 15	15 / 15	0 (0.00%)
Unexpected empty sites	0	0	0
Partial-row sites	0	0	0
Site outcomes	extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4	extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4	—
Observed duration	19.94 s	19.94 s	+0.00 s (+0.01%)
Estimated CPU	0.43 s	0.44 s	+0.01 s (+2.31%)
Peak PSS	84.20 MiB	84.87 MiB	+0.68 MiB (+0.81%)
Peak RSS	87.75 MiB	88.54 MiB	+0.79 MiB (+0.89%)
Peak threads	18	18	0 (0.00%)
Mismatched sites	0	0	0
Timeout with items	0	0	0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

The public-web A/B is informational. The exact HEAD fixture contract runs as a separate required CI check; timing and public-site content deltas remain non-blocking.

[github-actions]

Sequential Navigation Soak A/B

✅ HEAD completed the 200-navigation resilience and memory observation.

One browser process, one target, and one CDP session navigate CSDN → SegmentFault → Huaban → example.com repeatedly. This run issued 200 Page.navigate commands per binary.

Common ancestor 39d474864b → HEAD 6e3614a560; benchmark order: base-first; workflow: success.

Session resilience

Metric	Base	HEAD
Attempted / planned	200 / 200	200 / 200
Direct observable pass	200 / 200	200 / 200
Failures / recovered	0 / 0	0 / 0
Recovery failures	0	0
Lifecycle order violations	0	0
Network order violations	0	0
Wall time	529.6 s	478.3 s

A public-page failure is reported separately from an unrecoverable session. The soak requires all navigation attempts, zero failed recovery, zero lifecycle/network ordering violations, and complete resource evidence.

Process-tree memory

Metric	Base	HEAD	Δ
Boundary samples	200	200	0
Boundary RSS samples	200	200	0
Boundary PSS samples	200	200	0
Periodic peak RSS	305.1 MiB	305.3 MiB	+0.2 MiB
Periodic peak PSS	301.6 MiB	302.3 MiB	+0.7 MiB
RSS · first 10 avg	226.4 MiB	227.4 MiB	+1.0 MiB
RSS · last 10 avg	256.6 MiB	232.9 MiB	-23.7 MiB
RSS · last − first window	+30.1 MiB	+5.5 MiB	-24.7 MiB
RSS · warm slope / 100 nav	+18.3 MiB	+4.3 MiB	-14.0 MiB
PSS · first 10 avg	222.8 MiB	224.0 MiB	+1.2 MiB
PSS · last 10 avg	253.0 MiB	229.9 MiB	-23.2 MiB
PSS · last − first window	+30.2 MiB	+5.8 MiB	-24.4 MiB
PSS · warm slope / 100 nav	+18.3 MiB	+3.9 MiB	-14.4 MiB
Peak file descriptors	68	56	-12
Peak threads	29	29	0

HEAD memory by 50-navigation quarter

HEAD range	Avg RSS	Final RSS	Peak RSS	Avg PSS	Final PSS	Peak FD
1–50	225.0 MiB	197.8 MiB	286.5 MiB	221.7 MiB	195.7 MiB	48
51–100	230.0 MiB	218.7 MiB	280.5 MiB	227.9 MiB	216.9 MiB	48
101–150	232.9 MiB	216.9 MiB	288.2 MiB	229.8 MiB	213.8 MiB	48
151–200	231.5 MiB	222.3 MiB	301.6 MiB	228.4 MiB	219.2 MiB	49

Raw reports and per-navigation boundary samples: workflow run and full sequential-navigation-soak-results artifact.

Public-site timing and memory are observational. Use the A/B deltas and trend shape as evidence, not as a deterministic performance threshold.