Skip to content

docs: re-baseline the MCP context claims against tool search; scope /infinite - #98

Merged
tigers1997 merged 1 commit into
mainfrom
docs/mcp-rebaseline
Aug 25, 2026
Merged

tigers1997 merged 1 commit into
mainfrom
docs/mcp-rebaseline

Conversation

@tigers1997

Copy link
Copy Markdown
Owner

What & why

Split out of #94 at the reviewer's request. Two of the project's own claims had been overtaken by Claude Code and were overstating what the modules buy. Overclaiming is the real risk here: a user who measures the headline number and finds it wrong stops trusting the rest of the docs.

1. The MCP context claim was factually wrong. README claimed per-task profiles "drop a bloated 4-MCP baseline from ~49% context to under 5%", and docs/04 asserted "every MCP tool is a chunk of JSON schema loaded at session start". Tool search defers MCP schemas by default (alwaysLoad: true is the opt-out), so the premise no longer holds.

Measured rather than re-guessed — four local stdio servers advertising twelve tools each (48 total), identical one-turn session on CC 2.1.245:

Session Prompt tokens MCP's share
No MCP servers 26,665 —
4 servers, deferred (default) 27,361 +696 (~14/tool)
4 servers, alwaysLoad: true 40,993 +14,328 (~298/tool)

Deferral removes ~95% of the schema cost; the numbers reproduced exactly across runs. The stale claim was also embedded in four shipped templates — worse than in the docs, because it lands in every user's project: check-context/SKILL.md (its budget guardrails actively taught the model a wrong premise), claude-ctx.sh's rationale comment, servers-cookbook.md (which already explained deferral correctly a few sections earlier, so it contradicted itself), and the mcp.minimal.json comment. All corrected. Profiles are now documented for what they genuinely buy: which servers connect — startup time, auth prompts, cold start, and the blast radius --strict-mcp-config enforces.

The dated experiments-memory example keeps its original result with a superseding addendum rather than a rewrite — an experiment log records what was true when it ran, and that's also a better demonstration of the format.

2. /infinite scoped against dynamic workflows. Workflows now do staged, resumable, budgeted fan-out with structured output between stages. The skill opens with a decision table routing that work to a workflow and keeps the one case it's genuinely good at: N variants of one spec into disjoint slots.

Type of change

  • feat — new module / skill / feature (minor bump)
  • fix — bug fix (patch bump)
  • docs — documentation only
  • chore — tooling, CI, release plumbing
  • refactor — no behavioral change
  • BREAKING

Scope

  • One logical change. One commit: re-baseline claims that tool search has overtaken.
  • Modules affected: mcp, multi-agent, token-efficiency, experiments-memory
  • Personas affected: none — no scaffolded file changes name or location.

Tests

  • python3 configure.py --check passes locally — verified on this commit alone.
  • No fixture applies; this is prose plus template comments.

CHANGELOG

  • Added an entry under ## Unreleased.
  • I will SHA-anchor the entry after merge.

License & NOTICE

  • My contribution is my own work.
  • No AGPL-incompatible code.
  • No third-party code added.
  • templates/discipline-skills/ untouched by this PR.
  • LICENSE / NOTICE untouched.

Signing

  • All commits are signed.
  • Conventional Commits prefix.

I understand

  • An automated AI review will run on this PR.
  • No merge is possible while any required check is red.
  • My contribution rights are described in CONTRIBUTING.md.

Fourth of seven stacked PRs — based on fix/currency-corrections (#94).

@claude

claude Bot commented Aug 25, 2026

Copy link
Copy Markdown

VERDICT: PASS

Clean docs-only PR. The CHANGELOG ## Unreleased entry is present. No Python logic touched, no schema keys added, no third-party code, templates/discipline-skills/ untouched, and the two topics (MCP token-cost rebaseline + /infinite decision table) are tightly related overclaim corrections that fit a single logical change.

@tigers1997
tigers1997 force-pushed the fix/currency-corrections branch from 62db375 to 6de8825 Compare August 25, 2026 16:21
@tigers1997
tigers1997 force-pushed the docs/mcp-rebaseline branch from c0e614a to d0a2ae8 Compare August 25, 2026 16:21
@claude

claude Bot commented Aug 25, 2026

Copy link
Copy Markdown

VERDICT: PASS

Clean docs correction. All changed files are documentation, template content, or template comments — no code logic, no fixture tests, no persona snapshots. The stale MCP token-cost claim is removed consistently across all affected locations (README, docs/04, docs/06, check-context SKILL.md in both the template and the example, claude-ctx.sh, mcp.minimal.json, servers-cookbook.md), and the addendum pattern used in the experiments-memory file is the correct approach for an immutable experiment log. The /infinite decision table is a sensible scope guard. CHANGELOG ## Unreleased entry is present. No third-party code, no AGPL issue, templates/discipline-skills/ untouched, no schema additions.

@tigers1997
tigers1997 force-pushed the fix/currency-corrections branch from 6de8825 to ada0e68 Compare August 25, 2026 17:26
…infinite

Two headline claims had been overtaken by Claude Code and were overstating what
the modules buy.

MCP. README claimed per-task profiles "drop a bloated 4-MCP baseline from ~49%
context to under 5%", and docs/04 asserted that "every MCP tool is a chunk of
JSON schema loaded at session start". Tool search defers MCP schemas by default
(alwaysLoad: true is the opt-OUT), so the premise no longer holds.

Measured rather than re-guessed. Four local stdio servers advertising twelve
tools each (48 total), against an otherwise identical one-turn session on CC
2.1.245:

    no MCP servers            26,665 prompt tokens
    4 servers, deferred       27,361   (+696,    ~14 tokens/tool)
    4 servers, alwaysLoad     40,993   (+14,328, ~298 tokens/tool)

Deferral removes ~95% of the schema cost, and the numbers reproduced exactly
across runs.

The stale claim was also embedded in four SHIPPED templates, which is worse than
in the docs because it lands in every user's project: check-context/SKILL.md
(its budget guardrails and the "MCP > 10%" flag), claude-ctx.sh's rationale
comment, servers-cookbook.md (which already explained deferral correctly a few
sections earlier, so it contradicted itself), and the mcp.minimal.json profile
comment. All corrected.

Profiles are now documented for what they still genuinely buy -- which servers
connect: startup time, auth prompts, cold start, and the blast radius
--strict-mcp-config enforces. docs/06 picks up the same correction. The dated
experiments-memory example keeps its original result with a superseding
addendum rather than a rewrite, because an experiment log records what was true
when it ran; that is also a better demonstration of the format.

/infinite. Dynamic workflows now do staged, resumable, budgeted fan-out with
structured output between stages, and hand-rolled wave batching is the weaker
instrument for that job. The skill opens with a decision table routing staged,
merge-heavy or resumable work to a workflow, and keeps the one case it is
genuinely good at: N variants of a single spec into disjoint slots with no
cross-iteration coordination. README's module row and a new docs/04 section say
the same.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01JVndNviHZSnbKJnWP7jFbV
@tigers1997
tigers1997 force-pushed the docs/mcp-rebaseline branch from d0a2ae8 to a2b6c08 Compare August 25, 2026 17:31
@tigers1997
tigers1997 changed the base branch from fix/currency-corrections to main August 25, 2026 17:31
@claude

claude Bot commented Aug 25, 2026

Copy link
Copy Markdown

VERDICT: PASS

Documentation-only corrections: MCP context numbers re-measured against CC 2.1.245 (the old "~49% of 100k window" claim predated tool-search deferral), and /infinite repositioned against dynamic workflows. Both changes are factually grounded and internally consistent across all updated files (README, docs/04, docs/06, two SKILL.md templates, claude-ctx.sh, mcp.minimal.json, servers-cookbook.md, and the experiments-memory addendum). CHANGELOG entry present and detailed.

@claude

claude Bot commented Aug 25, 2026

Copy link
Copy Markdown

VERDICT: COMMENT-ONLY

Blocking

None.

Advisory

Scope (borderline): The PR bundles two distinct corrections — the MCP token-cost re-baselining and the /infinite vs. dynamic-workflows scoping — in a single commit. CONTRIBUTING.md asks for one logical change per PR. Both fixes share the root cause (stale capability claims overtaken by CC improvements) and a single CHANGELOG bullet covers them coherently, so this is a judgment call rather than a hard violation. Splitting is worth considering for future PRs of this shape, but not blocking here.

infinite/SKILL.md flow (nit): After the new opening section ends with "stop and reach for a workflow instead", the next paragraph begins "Then confirm this is a parallelizable fanout task." The word "Then" implies the reader has already passed the decision-table gate, which is the intent, but a reader skimming may find the transition abrupt. A bridging phrase like "If the work fits that narrow case, then confirm…" would make the two paragraphs read more cleanly. (templates/commands/infinite/SKILL.md:215)

Both are advisory only; the docs corrections are accurate, the CHANGELOG entry is present and detailed, no code paths or persona snapshots changed, no AGPL or MIT subtree concerns.

@tigers1997
tigers1997 merged commit f1c542d into main Aug 25, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant