Skip to content

python-math #46: feat(delphi): large-conv tick benchmark (Phase 5) — synthesized 33k x 783 shape, cold+warm tick timing - #2675

Draft
jucor wants to merge 1 commit into
spr/edge/075d2f77from
spr/edge/5747f8c9
Draft

python-math #46: feat(delphi): large-conv tick benchmark (Phase 5) — synthesized 33k x 783 shape, cold+warm tick timing#2675
jucor wants to merge 1 commit into
spr/edge/075d2f77from
spr/edge/5747f8c9

Conversation

@jucor

@jucor jucor commented Jul 27, 2026

Copy link
Copy Markdown
Collaborator

What

GOAL_CUTOVER_READY.md Phase 5 / CUTOVER_RUNBOOK.md risk item 3: the pre-flip measurement tool — a benchmark answering whether the Python engine can tick the largest production-scale conversations serially before production is flipped onto it.

How it works

Synthesizes the largest conversation shape found in prodclone (the local clone of the production database): 33,422 participants x 783 comments, ~2.0M votes — seeded RNG, no real data. It then times one COLD tick (full PCA from scratch) and one WARM tick (lineage warm starts populated — the steady per-tick cost the serial-capacity verdict rides on).

First numbers

Smoke run at 2000 x 200 x 120k votes on an arm64 laptop: cold 6.5s, warm 14.4s — the warm tick is the expensive one at scale (the legacy kmeans warm-start path). The benchmark runs on the bench EC2 instance class via a plain clone; the dataset is synthesized on-instance.

commit-id:5747f8c9


Stack:


⚠️ Part of a stack created by spr. Do not merge manually using the UI - doing so may have unexpected results.

This was referenced Jul 27, 2026
This was referenced Jul 27, 2026
@jucor
jucor force-pushed the spr/edge/5747f8c9 branch from cdd53ea to 55b1c20 Compare July 28, 2026 00:11
@jucor
jucor force-pushed the spr/edge/075d2f77 branch from ab57b72 to 4488548 Compare July 28, 2026 00:12
@jucor jucor changed the title feat(delphi): large-conv tick benchmark (Phase 5) — synthesized 33k x 783 shape, cold+warm tick timing python-math #46: feat(delphi): large-conv tick benchmark (Phase 5) — synthesized 33k x 783 shape, cold+warm tick timing Jul 28, 2026
…synthesized 33k x 783 shape, cold+warm tick timing

## What

`GOAL_CUTOVER_READY.md` Phase 5 / `CUTOVER_RUNBOOK.md` risk item 3: the pre-flip measurement tool — a benchmark answering whether the Python engine can tick the largest production-scale conversations serially before production is flipped onto it.

## How it works

Synthesizes the largest conversation shape found in prodclone (the local clone of the production database): 33,422 participants x 783 comments, ~2.0M votes — seeded RNG, no real data. It then times one COLD tick (full PCA from scratch) and one WARM tick (lineage warm starts populated — the steady per-tick cost the serial-capacity verdict rides on).

## First numbers

Smoke run at 2000 x 200 x 120k votes on an arm64 laptop: cold 6.5s, warm 14.4s — the warm tick is the expensive one at scale (the legacy kmeans warm-start path). The benchmark runs on the bench EC2 instance class via a plain clone; the dataset is synthesized on-instance.

commit-id:5747f8c9
@jucor
jucor force-pushed the spr/edge/075d2f77 branch from 4488548 to 9dc3027 Compare July 28, 2026 01:10
@jucor
jucor force-pushed the spr/edge/5747f8c9 branch from 55b1c20 to 8777ac3 Compare July 28, 2026 01:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant