Skip to content

[P0][E2E] Prove installed Loop to Runtime MCP execution through Mapper, Dev CLI, watcher and HBP #693

Description

@wesleysimplicio

Objective

Provide one release-blocking installed-package E2E proving the complete supported execution chain rather than isolated contracts or checkout-only mocks.

Target chain:

Coordinator -> Simplicio Loop -> Runtime MCP -> Mapper -> Dev CLI/effect executor -> validation -> watcher -> HBP evidence -> Runtime contract verification -> final delivery.

Scope

The test must use released/locally built install artifacts outside all source checkouts. Simplicio Loop remains usable without Runtime, but the Runtime-backed profile must prove that every effect travels through Runtime and no direct mutation bypass occurs.

Implementation steps

  1. Build/install pinned Loop, Runtime, Mapper and Dev CLI artifacts into an isolated environment.
  2. Record versions, package hashes, commits, OS, CPU, RAM and configuration.
  3. Create a small fixture repository with one mechanical task and one semantic task.
  4. Start one persistent Runtime MCP session through RuntimeBridge.
  5. Negotiate capabilities and contract versions.
  6. Run intake, Mapper scan/inspect/handoff and execution route.
  7. Execute mutation only through the Runtime effect transaction.
  8. Validate with focused tests, independent watcher challenge and acceptance anchor.
  9. Publish HBP-linked Loop, Mapper, Dev CLI, Runtime and delivery receipts with one causal run ID.
  10. Ask Runtime to consume/verify simplicio.loop-execution/v1.
  11. Assert final VERIFIED only when every receipt, hash and watcher condition passes.
  12. Repeat with injected failures and upgrade/minimum-supported versions.
  13. Store raw metrics and commands; use null with reason for unavailable values.

Mandatory negative lanes

  • Runtime missing.
  • Runtime explicitly selected but wrong binary.
  • Missing Mapper or Dev CLI capability.
  • MCP disconnect after effect/before response.
  • Corrupt HBP link.
  • Stale Mapper artifact.
  • Watcher mismatch.
  • Duplicate idempotency key.
  • Direct file mutation bypass attempt.
  • Version/schema mismatch.
  • Cancellation and restart.

Acceptance criteria

  • Installed artifacts complete the full chain without source-checkout imports.
  • Exactly one persistent Runtime process serves the workspace.
  • Process trace proves zero cold self-exec on the normal hot path.
  • Every mutation has EffectTransaction, gate, validation and HBP receipt.
  • Runtime verifies the Loop receipt as VERIFIED.
  • Any missing/corrupt/stale link prevents VERIFIED.
  • Runtime-optional standalone Loop behavior remains separately tested.
  • Linux, macOS and Windows fixtures are covered or unavailable platforms are explicitly reported.
  • Raw p50/p95 latency, tokens, CPU/RSS, process count and receipt bytes are published.
  • No paid GitHub Actions is required; the suite runs locally/containerized.
  • Release cannot claim integrated Runtime support until this lane passes.

Relations

  • Runtime Loop consumer: wesleysimplicio/simplicio-runtime#3459
  • Runtime conformance: wesleysimplicio/simplicio-runtime#3289
  • Runtime warm path: wesleysimplicio/simplicio-runtime#2983

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    Status
    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions