Skip to content

fix(core): add connection tool search - #307

Merged
jyecusch merged 6 commits into
mainfrom
connection-tool-search
Oct 6, 2026
Merged

jyecusch merged 6 commits into
mainfrom
connection-tool-search

Conversation

@jyecusch

@jyecusch jyecusch commented Oct 6, 2026 •

Copy link
Copy Markdown
Member

Fixes SUGA-1936.

Every turn failed with a provider 400 once a pod's connections offered more tool definitions than the model's window holds: a 400-tool MCP server sent about 557k tokens on every call.

Connection tools are no longer sent to the model as tools of their own. Every turn offers tool_search, which finds connection tools by what a task needs and returns their input schemas, and call_tool, which runs the named tool as before, so its calls are recorded and approved as that tool. The turn's note lists the pod's connections and their tools by name within a fixed budget.

The tools sent to the model are now the same whatever a pod's connections offer, so adding, editing or removing a connection, or a server changing its tools, no longer invalidates the provider's cached prompt for a long-running thread.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Oct 6, 2026 •

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Updated (UTC)
✅ Deployment successful!
View logs
sugabots-website 46a3a49 Oct 06 2026, 09:03 AM

@jyecusch
jyecusch marked this pull request as ready for review October 6, 2026 07:17
@jyecusch jyecusch changed the title fix(core): offer a pod's connection tools through tool search when they would crowd the model's window fix(core): add connection tool search Oct 6, 2026
@jyecusch
jyecusch merged commit 01eb97a into main Oct 6, 2026
7 checks passed
@jyecusch
jyecusch deleted the connection-tool-search branch October 6, 2026 09:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant