Skip to content

Fuzzy Validator 2.1: containerized capture/validate runner - #494

Open
esdraelon wants to merge 5 commits into
megiddo/p3-bootstrap-model-hopfrom
megiddo/fuzzy-validator-2.1-runner
Open

Fuzzy Validator 2.1: containerized capture/validate runner#494
esdraelon wants to merge 5 commits into
megiddo/p3-bootstrap-model-hopfrom
megiddo/fuzzy-validator-2.1-runner

Conversation

@esdraelon

Copy link
Copy Markdown
Member

Summary

Stacked on #493 (megiddo/p3-bootstrap-model-hop). Merge #492#493 → this PR (or retarget after lower PRs land).

Makes the default bin/fuzzy-validator path run capture/validate inside a long-lived Ubuntu 26.04 runner with Playwright-pinned Chromium, so setpoints are not host-OS/Chrome dependent.

  • Auto-starts the runner if down; leaves it running after commands; restart: "no" (no reboot persistence).
  • Joins the php8 Docker network (http://ork3-php8-app/orkui/); mounts the repo + docker.sock so dual-profile ork-db still works.
  • Escape hatch: FUZZY_VALIDATOR_NATIVE=1 / --host for bare-metal.
  • Docs: docs/megiddo/fuzzy-validator/version-2.1/ + tools README updates.

Test plan

  • docker compose -f docker-compose.php8.yml up -d
  • bin/fuzzy-validator validate --profile test --page home-authenticated --phase visual (auto-starts runner)
  • docker stop ork3-fuzzy-validator-runner then re-run a command — runner comes back
  • FUZZY_VALIDATOR_NATIVE=1 bin/fuzzy-validator validate --help still works
  • After merge: re-record and publish gold setpoint from the runner before treating visual gates as sign-off (existing macOS baselines will drift under Linux Chromium)

Made with Cursor

Noah Smith and others added 5 commits July 20, 2026 09:19
Document Ubuntu 26.04 + pinned Chromium default path, mounts/networking/lifecycle, and FV21 milestones so capture/validate stay stable across host OS.

Co-authored-by: Cursor <cursoragent@cursor.com>
Confirm ork3-php8-app DNS works on the external compose network and that localhost:19080 is wrong inside the runner.

Co-authored-by: Cursor <cursoragent@cursor.com>
Ubuntu 26.04 image with pinned Playwright Chromium, compose fragment
(restart no), ensure+exec wrapper with native escape hatch, and socat
forwards so in-container ork-db dual-profile keeps working.

Co-authored-by: Cursor <cursoragent@cursor.com>
Mark version-2.1 implemented, update operator quick starts, and note
one-time setpoint re-record after switching off host Chromium.

Co-authored-by: Cursor <cursoragent@cursor.com>
Use --ignore-scripts so postinstall does not dirty the bind-mounted tree.

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant