Skip to content

Run the existing 60-person certification weekly and retain results #174

Description

@Maneek21

Current state

Refreshed September 24, 2026 against master at 1427f66.

The 60-person harness already emits JSON/HTML reports and enforces configured write/read latency, queue-drain, recovery, and attention-projection budgets. It is exposed as pnpm certify:60-person. No recurring workflow invoking that harness was found.

Remaining work and acceptance evidence

Wire the existing harness into weekly and manually dispatched CI, reusing its budgets and verdict.

  • Run weekly on the default branch and support manual dispatch.
  • Use disposable test data and infrastructure; preserve cleanup on failure.
  • Record the exact commit, workload, configured budgets, result, and execution environment.
  • Upload machine-readable results and a compact job summary, including failure diagnostics when available.
  • Set explicit artifact retention and workflow timeout/concurrency limits.
  • A failed verdict fails the job; missing results cannot appear as a pass.
  • Demonstrate one successful workflow run and verify the failure-reporting path.
  • Keep this expensive run off ordinary pull requests.

Scope and limitations

One API instance with synthetic users and deterministic queue jobs. This does not certify multi-instance fanout, external AI-provider capacity, browser rendering, or guarantee production capacity.

Ownership and priority

Unassigned backlog. Select a CI/performance owner before scheduling into a release milestone.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is neededperformancePerformance and scale certification

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions