Repository navigation
eval: prepare explicitly gated PR80 annotation and review flow - #81
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scope
Prepare the first stage of merged PR80, without executing it. Reuse the existing frozen durable annotator in an isolated namespace; no new dependency/client/checkpoint framework, prompt, schema or dataset change. Bind the50 full-Top14 inputs, source/protocol/prompt/request fingerprints and future execution contract. Explicit PR80 data/model/budget approval must be obtained before contract preparation or paid execution; a merge-only/continue reply is not sufficient. The CLI confirmation flag records already-obtained approval and does not grant permission by itself.
Behavior
Current execution status
The first real-call command was rejected by automatic safety review before process creation because explicit approval for the new data/model scope was not established. It was not retried or bypassed. Verified absent: annotation execution contract/checkpoint, target freeze, target rows and classifier checkpoint. Actual provider calls0, actual new cost0. Paid work waits for explicit authorization of both PR80 stages (Singapore qwen3.6-plus-2026-04-02 annotation<=50, then frozen reviewed labels before qwen3.5-plus-2026-04-20 paired classification<=100; total CNY25, stage caps10/15, no DEV/recharge/paid retries).
Verification