Skip to content

Make rechecks prove that the original check definition did not change #4

Open

Description

@onoderakosen89

Problem

The repair demo verifies that the original test text was not changed. The reusable loop trusts the caller's check result without an equivalent guard. A stable check ID alone cannot tell whether a test, control, or selected input changed between the baseline and the recheck.

Acceptance criteria

  • Offer a reusable way to pin the check definition and explicitly declare which test files, configuration, fixtures, or controls it covers.
  • An unchanged definition plus a passing recheck can verify the repair. A changed or unavailable definition cannot produce a verified pass; return an actionable stop reason.
  • Legitimate changes to the acceptance criteria start a new baseline instead of resolving the original failure.
  • Cover unchanged checks, changed checks with the same ID, and checks whose identity cannot be established. Document what remains the caller's responsibility.

Related positioning: #1.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions