Repository navigation
fix(skills-ratchet): evals/** leave the priced population; the standing 「先削重复,余额按实测提高」 ruling is the gate-recognised raise path - #27984
Conversation
…ng 「先削重复,余额按实测提高」 ruling is the gate-recognised raise path Ruling record 6513306068 on the token-ratchet decision card, letter B. - `evals/**` under a published skill is population 1b: measured and printed in the bundle total, never ratcheted — the generated-file treatment. The 28 eval rows leave `CEILINGS`; a row on an eval path is red, as on a generated file. `isEvalFixture()` is the path predicate. - The header and the over-ceiling refusal name the 2026-10-27 standing ruling as the one gate-recognised raise path for teaching text: deletion of restatement shown in the same file plus the ruling quoted in the PR body moves the row by the measured remainder, pinned AT the measurement; no deletion and no ruling stays red. The script reads neither diffs nor rulings, so the conditions are text the seat's review checks, as #23606 B did for the line ratchet. - Self-test: 18 new cases pin both legs (eval fixture not priced but printed; the refusal carries the ruling id, both conditions and the pin); floor 79 -> 97. Bundle total unchanged (219351). Co-authored-by: Claude <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016WV4cwV7T5pwdsjZBGP4Uv
|
domain:skills#2 · os-elon-musk · session_016WV4d1QkPVVzNz3FJqb2iS Contract-review-claim: session_016WV4d1QkPVVzNz3FJqb2iS · head cc1daee · 2026-10-30T06:25Z |
|
domain:skills#2 · os-elon-musk · session_016WV4d1QkPVVzNz3FJqb2iS Contract reviewServed-tier: ① Derived judgmentsBase: the PR's merge base with
② Semver levelNone owed. The diff is ③ Boundary flags
④ Design judgmentRules face, judged on the
No file in Implemented-by: VERDICT: PASS Must-fix: none. Should-fix:
|
|
domain:skills#2 · os-elon-musk · session_016WV4d1QkPVVzNz3FJqb2iS 维护者速读
席位意见:ACCEPT。契约复核 PASS,没有 must-fix。−358 行逐行对上:28 条 eval 行、308 行附带注释、10 行头部、4 行空行、8 行代码。should-fix 1、2 都是说明文字:拒收提示只提一条路径,没提「裁决本身命令写入」那条;头部「skills/ 整体加载」没注明 evals 例外。按分诊「门禁不做其他改动」,留到下次改头部时一并处理,不阻塞。should-fix 3 是与 #27922 的合并顺序,见下。 席位核对
|
Requested by Elon · project thread
domain:skills#2 · os-elon-musk · session_016WV4cwV7T5pwdsjZBGP4Uv
Fixes #27847
Ruling-ref: 6513306068
What changes
One file,
scripts/check-skills-token-ratchet.mjs, implementing ruling record 6513306068 (letter B) as worded, and nothing else about the gate:evals/**leaves the PRICED population. A new population 1b, EVAL FIXTURES (skills/<name>/evals/**, decided by path alone throughisEvalFixture()), takes the generated-file treatment of [finding] The published-skills TOKEN ratchet prices only SKILL.md — 37% of the shipped bundle (68,390 tokens) carries no ceiling #12392: measured, printed per file as(eval fixture)and in a neweval fixtures (measured, not ratcheted)subtotal, counted into thebundle total (whole shipped tree), never ratcheted. The 28 eval rows leaveCEILINGSwith their row comments. ACEILINGSrow on an eval path is red, exactly as on a generator-owned file, with the ruling named in the refusal.SKILL.md,rules/**,guides/**, hand-authoredreferences/**): a PR whose diff shows deletion of restatement in the same file and whose body quotes that ruling (or record 6513306068) may move the row by the measured remainder, pinned AT the measurement, with no per-card ruling; a raise with no deletion shown and no ruling quoted stays red. As [Decision] The line ratchet (check:pm-skill-ratchet): 32 of 37 files at zero headroom, so a sentence already ruled still needs a second ruling to land — keep it, let the ordering ruling carry its lines, add slack, or narrow it #23606 B did for the.claude/**line ratchet, the script reads neither diffs nor rulings: the conditions are author-facing text that the seat's contract-review record checks against.evals/**path is one;SKILL.md, a rule, a reference,skills/README.md, arules/evals/path and a bareevals/outsideskills/are not), an eval fixture with no row is green and says measured-not-ratcheted, a row on one is red naming the ruling, no row names an eval path, the real tree has eval fixtures, the walk still measures them, the report counts them into the bundle total and not into the ratcheted subtotal and prints their subtotal; and the refusal text carries the ruling id, the same-file-deletion condition, the AT-the-measurement pin and the no-deletion-no-ruling red.Not changed: the walk, the counting convention, the stamp-line exclusion, the generator-owned boundary and its tripwire, every teaching row,
check:skill-eval-tokensand the eval self-consistency rule. No rule text restates "a raise needs a ruling id per raise" for this gate (.claude/**,skills/README.md,AGENTS.mdgrepped for the ratchet,天花板,token ceiling):triage-duties.mdL102 says a ceiling raise 「仍需明确字句」, which the quoted standing ruling is, so the rule text is untouched.Why
The ratchet priced
evals/**, which no customer session loads (skills/README.mdlayout: evals are 「used by maintainers to score the skill, inert (but harmless) in consumer installs」;git grep -c "evals/" origin/main -- 'skills/*/SKILL.md'→ 0), so an eval owed under #26369 B blocked on a ceiling that protects nothing a customer pays for, and every measured raise waited on a per-card ruling although the maintainer had already ruled the payment path on 2026-10-27 (quoted 40 times in the row comments). #26940 cost about 20 hours and three seats for +154 tokens. The maintainer ruled B on #27847 (record 6513306068, 「其他同意」).Confidence gap carried into the dispatch, checked: no harness reads
evals/*.jsoninto an authoring context. Readers onorigin/main9cd54faa:scripts/check-skills-token-ratchet.mjs(this gate),ui/scripts/check-skill-eval-tokens.mjs(maintainer scoring),scripts/pm/bare-root-worklist.mjs(a comment naming the folder),skills/README.md(the layout). No SKILL.md, rule, guide or reference points at an eval file.Serial: PR #27922 (#26940) edits one eval row in this file and still waits on its Tier H approval, so this PR is based on
main; that row (skills/objectstack-formula/evals/cel-predicates-formulas.json) leaves the priced population in this diff. If #27922 lands first, this branch rebases onto it and the row still leaves.Verification
node scripts/check-skills-token-ratchet.mjs --self-test→97 cases pass, exit 0. Ablated once per pin: the predicate forced tofalse→ 9 cases red and the gate red on 28 unpriced files; aCEILINGSrow onskills/objectui/evals/testing.json→no ceiling names an eval fixturered and the gate red with the eval-fixture refusal; the standing-path text reverted to the old sentence → the 5 standing-path cases red.node scripts/check-skills-token-ratchet.mjs→ exit 0:56 authored bundle file(s) within their ceilings; 10 generator-owned file(s) and 28 eval fixture(s) measured, not ratcheted. Bundle total 219351 before and after (main's script run on the same tree prints 219351);ratcheted (authored)180861 / 189813,eval fixtures27188.pnpm check:ratchet-remedy-authorityexit 0 (this gate still classified as marking the expanding remedy⛔ MAINTAINER-ONLY);eslint --no-inline-configon the file clean;node scripts/check-commit-card-trailers.mjs --range origin/main..HEADexit 0.node scripts/pm/dispatch-gates.mjs --commandsderived 32 families oncc1daeea(fresh checkout afterpnpm install --frozen-lockfile --ignore-scripts); every one ran with its exit code captured before any pipe: 32 run, 32 exit 0, 0 NOT MEASURED;--ranreconciliation:32 derived famil(ies) accounted for — 32 run, 0 NOT-MEASURED; re-derived after the commit, still 32. Among them:check-skills-token-ratchetand its--self-test,check:ratchet-remedy-authority,check:scripts-symbol-anchors,check:self-test-wired,check:pm-dispatch-gates,check:nul-bytes. No package source changed, so no package test or typecheck is owed; the 11 changeset-dependent families do not apply (skip-changeset).Clause-②: no
Metadata-protocol: none
Human Minimum
packages/specholds no runtime logic. (No spec change.)pnpm lintleft to CI).main, one pull request.scripts/**only), so no changeset;skip-changesetdeclared on the create; both declaration lines are filled in above.packages/specnot touched.content/docs/references/,packages/*/CHANGELOG.mdorcontent/docs/releases/.维护者速读
scripts/check-skills-token-ratchet.mjs一个文件。evals/** 退出计价总体(仍量、仍打印进 bundle 总量,28 行从 CEILINGS 删除,给 eval 文件加行即红);表头与超限拒绝文案把你 10-27 裁的「A:先削重复,余额按实测提高」写成门禁认可的唯一抬高路径(同文件可见删复述 + PR 正文引裁决 ⇒ 按实测余额抬、钉在实测;没删没引仍红);自测加 18 钉。verdict()的 eval 分支与超限文案。node scripts/check-skills-token-ratchet.mjs --self-test预期97 cases pass;node scripts/check-skills-token-ratchet.mjs预期末行56 authored … 10 generator-owned … 28 eval fixture(s),exit 0。🤖 Generated with Claude Code
https://claude.ai/code/session_016WV4cwV7T5pwdsjZBGP4Uv