Repository navigation
fix(spec): re-sync the #102-moved prose figures and bind them in verify:claims - #116
Merged
Merged
Conversation
…s to EXPERIMENTS.md The #102 re-score moved EXPERIMENTS.md §7.13 (LOO coder saving −7.5%), §7.10 (CfL free −0.10%, paid +2.11%) and §11.9 (best scalefactor-band arm −0.14%), but the prose restating them in V0.8-DECISIONS.md and spec/README.md kept the old values.
…ify:claims Registers the V0.8-DECISIONS.md LOO coder saving, spec/README.md's CfL free and paid figures, and both quotes of the best scalefactor-band arm, so a re-score that moves those cells fails the gate instead of leaving the prose stale.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The #102 re-score moved
spec/EXPERIMENTS.md§7.13, §7.10 and §11.9, but four prose figures that restate those cells by hand kept their old values, andverify:claimsbound none of them.spec/V0.8-DECISIONS.md— D1's prior evidence: LOO coder saving −7.4% → −7.5% (§7.13,per-index context backing off to order-0, LOO/vs fixed).spec/README.md— CfL roadmap row: free −0.09% → −0.10%, paid +2.18% → +2.11% (§7.10). Scalefactor-bands roadmap row and the §15 summary paragraph: −0.13% → −0.14% (§11.9).tools/comparison/src/verify-claims.ts— six new register entries binding those quotes (plus the CfL row's −0.90% code-3 figure), andspec/V0.8-DECISIONS.mdadded to the header's list of quoting files. The register now checks 34 figures across 6 files; registeringspec/V0.8-DECISIONS.mdalso puts it under the unregistered-figure scan, which finds nothing there.Validation
node tools/comparison/src/verify-claims.ts— exit 0: "Checked 34 quoted figure(s) across 6 files", no unregistered figure.pnpm --prefix tools/comparison run format:check— pass.pnpm --prefix tools/comparison run lint— pass.pnpm --prefix tools/comparison exec tsc --noEmit— exit 0.Coverage gaps
ci-comparison.yml's path filter does not listspec/V0.8-DECISIONS.md, so a PR editing only that file does not runverify:claims(a re-score that editsEXPERIMENTS.mdstill does). Outside this change's scope; filed as fix(comparison): run verify:claims on spec/V0.8-DECISIONS.md edits, and re-sync EXPERIMENTS.md §11.13's scalefactor cell #115.spec/EXPERIMENTS.md:2911(§11.13) still says −0.13% for scalefactor bands. That is the source document, which this gate cannot check; also in fix(comparison): run verify:claims on spec/V0.8-DECISIONS.md edits, and re-sync EXPERIMENTS.md §11.13's scalefactor cell #115.Risks and rollout
None. Documentation figures and a CI documentation gate only; no format, API or encoder change.
Decisions taken
Scalefactor bands, best arm, columnWikimedia, which holds the same measurement (−0.14%). Rejected: extending the register to bind prose (a new mechanism, and it would gate a sentence rather than a cell); adding a table to §11.9 (outside the manifest, andEXPERIMENTS.mdedits belong with the sweep bindings). Reverse: changesection/row/columnon the twoscalefactor-bandentries.shippedrow, not a table cell. Taken: bind theCfL paid, L24@5 C9@4/ΔE00cell and recompute againstshipped/ΔE00in atransform, the same shape as §11.14's WebP margin; the capture keeps the+and omitsabs, like the 108 B entry, because the sentence's content is the direction. Rejected:abs, which would pass a flipped sign. Reverse: edit that entry'stransform/pattern.CfL with free gains at code 3entry..github/workflows/ci-comparison.yml,spec/EXPERIMENTS.md). Taken: filed as fix(comparison): run verify:claims on spec/V0.8-DECISIONS.md edits, and re-sync EXPERIMENTS.md §11.13's scalefactor cell #115 rather than widening. Reverse: fold fix(comparison): run verify:claims on spec/V0.8-DECISIONS.md edits, and re-sync EXPERIMENTS.md §11.13's scalefactor cell #115 into this branch.Issue
Closes #113