Skip to content

feat(mcp): teach wizard modern capture support - #372

Open
lucasheriques wants to merge 2 commits into
mainfrom
codex/mcp-modern-capture-wizard
Open

feat(mcp): teach wizard modern capture support#372
lucasheriques wants to merge 2 commits into
mainfrom
codex/mcp-modern-capture-wizard

Conversation

@lucasheriques

@lucasheriques lucasheriques commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Summary

MCP server authors get modern-spec-aware Wizard guidance for TypeScript and Python instrumentation.

  • Enables self-reported model capture on supported TypeScript wrappers and explains its trust boundary.
  • Enables conversation correlation for supported 2026-07-28 wrapping paths.
  • Covers official MCP SDK 2.x in TypeScript and Python, including the handshake-free protocol revision.
  • Keeps custom dispatchers protocol-aware without promising unsupported model, resource, or prompt capture.
  • Requires posthog>=7.40.0 when Python projects need MCP SDK 2.x support.
  • Validates final report event names and requires the actual protocol revision on custom-dispatcher captures.

Validation

  • npm test - 173 tests passed.
  • npm run build - passed.
  • Wizard CI run - TypeScript wrapper 5/5, custom dispatcher 4/5, both YARA-clean.
  • Manual fixture review found two guidance gaps; the latest commit addresses both.
  • The run uses the CLI fix in PostHog/wizard#1187.

Agent context

Codex compared the skill against the shipped TypeScript and Python SDK behavior, exercised both workbench fixtures, and reviewed their generated code and reports.

Detect both MCP SDK majors in TypeScript and Python, enable conversation correlation for the handshake-free revision, and configure TypeScript model self-reporting where supported.

Keep custom dispatchers protocol-aware and prevent the wizard from promising automatic resource, prompt, or Python model capture.

Verified with npm test (173 tests) and npm run build.
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving
  • /wizard-ci warehouse
  • /wizard-ci warehouse-seeded

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/groq
  • /wizard-ci ai-observability/manual-capture
Show more apps
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit
  • /wizard-ci warehouse/monorepo-env
  • /wizard-ci warehouse/multi-source-next
  • /wizard-ci warehouse/stripe-node
  • /wizard-ci warehouse/zero-source
  • /wizard-ci warehouse-seeded/next-stripe
  • /wizard-ci warehouse-seeded/next-stripe-declined

Test against a wizard branch:

  • /wizard-ci all wizard:my-branch

Add wizard:<branch> to any command above to pin the wizard branch. It defaults to main.

Results will be posted here when complete.

@lucasheriques

Copy link
Copy Markdown
Contributor Author

/wizard-ci mcp-analytics

@wizard-ci-bot

wizard-ci-bot Bot commented Sep 1, 2026

Copy link
Copy Markdown

🧙 Wizard CI Results

Trigger ID: c40fca6
Workflow: View run

App Confidence PR YARA
mcp-analytics/custom-dispatcher/hono-server N/A Failed (logs)
mcp-analytics/typescript-sdk/stdio-server N/A Failed (logs)

Configuration

Setting Value
Wizard ref main
Context Mill ref codex/mcp-modern-capture-wizard
PostHog ref master

Search for trigger ID c40fca6 in wizard-workbench PRs.

@lucasheriques

Copy link
Copy Markdown
Contributor Author

/wizard-ci mcp-analytics wizard:codex/mcp-analytics-ci-region

@wizard-ci-bot

wizard-ci-bot Bot commented Sep 1, 2026

Copy link
Copy Markdown

🧙 Wizard CI Results

Trigger ID: d87b8fc
Workflow: View run

App Confidence PR YARA
mcp-analytics/custom-dispatcher/hono-server N/A Failed (logs)
mcp-analytics/typescript-sdk/stdio-server N/A Failed (logs)

Configuration

Setting Value
Wizard ref codex/mcp-analytics-ci-region
Context Mill ref codex/mcp-modern-capture-wizard
PostHog ref master

Search for trigger ID d87b8fc in wizard-workbench PRs.

@lucasheriques

Copy link
Copy Markdown
Contributor Author

/wizard-ci mcp-analytics wizard:codex/mcp-analytics-ci-region

@wizard-ci-bot

wizard-ci-bot Bot commented Sep 1, 2026

Copy link
Copy Markdown

🧙 Wizard CI Results

Trigger ID: e97a8e7
Workflow: View run

App Confidence PR YARA
mcp-analytics/custom-dispatcher/hono-server 4/5 #3750 (logs)
mcp-analytics/typescript-sdk/stdio-server 5/5 #3751 (logs)

Configuration

Setting Value
Wizard ref codex/mcp-analytics-ci-region
Context Mill ref codex/mcp-modern-capture-wizard
PostHog ref master

Search for trigger ID e97a8e7 in wizard-workbench PRs.

Require custom dispatchers to propagate the actual protocol revision on each capture and validate final report event names against the event reference.\n\nVerification:\n- npm test (173 tests)\n- npm run build
@lucasheriques

Copy link
Copy Markdown
Contributor Author

@PostHog/mcp-analytics could you review the modern MCP spec, model capture, and custom-dispatcher guidance? The pinned Wizard CI run scored 5/5 and 4/5 across the two fixtures; the follow-up commit addresses the two manual-review gaps.

@lucasheriques
lucasheriques requested review from a team and gesh September 1, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants