mesh: upgrade runtime, enforce membership, add shared compute provider#1656
Open
michaelneale wants to merge 35 commits into
Open
mesh: upgrade runtime, enforce membership, add shared compute provider#1656michaelneale wants to merge 35 commits into
michaelneale wants to merge 35 commits into
Conversation
f82bf82 to
3b2652a
Compare
89fac0f to
0387003
Compare
412f7fb to
2e69859
Compare
ba7f836 to
7ee5325
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
So this updates buzz to use mesh-llm (a released version of it) via the rust SDK for it.
This also shifts things to use the mesh-llm cryptographic admission control, instead of relying on anon tokens and relay from buzz (doesn't/shoudln't require anything specific from buzz relays - just their membership is enough). This uses the mesh relays (different thing) which are e2e encrypted for better network hole punching, but keeps the membership with the buzz server (actually is more locked down than before).
Also adds a provider type of buzz compute etc - and some ergonomics to do with that.
Had to make a small change to fizz to ensure it would call the right tool to respond (odd, and also saw it with even frontier models, not sure what that was about!).
Doesn't have zero cost when compiled in, adds about 20mb to size due to deps (runtimes are pulled down etc). not looked at that too closely but that is the cost so far.
PTAL!
Summary
relay-meshas Buzz shared compute;autoor a currently advertised explicit model, with no custom-model escape hatch;User flow
Security and architecture
Validation
origin/main.-D warnings: passed.buzz-agent, initialized over ACP with the exact built-in Fizz system prompt, repliedMINI_FIZZ_MESH_OK; a second non-allowlisted owner reused the same invite, saw gossip, and received HTTP 503 on inference.autoinferenceThe hardware harness may print a known llama.cpp Metal static-destructor backtrace only after checks complete successfully.
A step-by-step local dev GUI/Fizz verification runbook is in
docs/buzz-shared-compute-dev.md.Remaining review gate