Probe prompts and resources alongside tools - #61
Merged
Merged
Conversation
A skills silo needs skills. Eight live endpoints, all of which answer tools/list, returned zero prompts between them -- including servers whose initialize response declares the prompts capability. Resources showed up on two of the eight. Eight is a sample; there are ~21,000 remote endpoints, so this asks the whole catalogue instead of guessing from a handful. - prompts/list and resources/list now run in the same session as tools/list - The three are independent: a refused prompts/list reports no prompts rather than discarding the tools that did come back - Resources are named by uri, tools and prompts by name - Empty prompts and resources are stored, unlike tools. Nothing declares them, so there is no publisher claim to protect and "answered, has none" is the finding -- unwritten, it looks identical to never asked - Tools keep their guard: a locked door is not evidence of an empty room Closes #60 --- Pages affected: - [MCP Harbor](https://ai.mcpharbor.dev/) -- registry home, search and newly added servers. - [server catalogue](https://ai.mcpharbor.dev/servers) -- the listings this probe reads capabilities from. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #60.
A skills silo needs skills to exist. Before building one, I measured: eight live endpoints — all of them servers that successfully answer
tools/list— returned zero prompts between them, including servers whoseinitializeresponse declares thepromptscapability. Resources appeared on two of the eight (155 and 1).Eight is a sample. There are ~21,000 remote endpoints in the catalogue, so this extends the prober to ask
prompts/listandresources/listin the same session it already opens fortools/list, and stores both. In a day there will be a real count to decide the silo on.Notes
prompts/listreports no prompts rather than failing the whole probe. That exact split was observed live.uri, tools and prompts byname.stdio) listings are still skipped.Tests: 146 passing, including a server that refuses prompts while answering tools, and one that answers zero of everything.
Pages affected:
🤖 Generated with Claude Code