Skip to content

feat(gallery): add Ternary Bonsai 2 2B variants - #12773

Closed
localai-org-maint-bot wants to merge 1 commit into
masterfrom
gallery/20261019-third-pass
Closed

localai-org-maint-bot wants to merge 1 commit into
masterfrom
gallery/20261019-third-pass

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add Ternary Bonsai 2 2B to the gallery with PQ2_0, PTQ1_0, and Q2_0 variants. Each includes the Q8_0 vision projector, uses the existing Bonsai backend, and follows the publisher's thinking-mode sampling settings. The three packings contain the same weights in different storage layouts.

Document installation and explicit variant selection. All artifact URLs pin publisher revision 683f7be2629342a50987627b40881e54761a2430.

Notes for Reviewers

  • Source: https://huggingface.co/prism-ml/Ternary-Bonsai-2-2B-gguf
  • Double-checked all four unique SHA256 values against the pinned SHA256SUMS and each file's x-linked-etag header.
  • Confirmed the current Bonsai backend pin contains PQ2_0 and PTQ1_0 support.
  • Parsed the complete gallery with yaml.v3 and checked all three new entries, variant references, model/projector paths, pinned URLs, and hashes. git diff --check passes.
  • go test ./core/gallery -count=1 could not start: proxy.golang.org returned HTTP 403 for LocalAGI v0.0.0-20261016084905-7aa0c8fea076. Runtime inference was not tested.

Signed commits

  • Human DCO sign-off required; AI must not add Signed-off-by under repository policy.
  • Documentation updated (docs/content/) for user-facing changes.

@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261019-third-pass branch 2 times, most recently from 44f795c to b0e6ff0 Compare October 23, 2026 10:07
Add PQ2_0, PTQ1_0, and Q2_0 builds with the Q8_0 vision projector.
Pin files to the publisher revision and document variant selection.

Assisted-by: Codex:gpt-6
@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261019-third-pass branch from 7e397cf to e1aebd2 Compare October 25, 2026 10:06
mudler pushed a commit that referenced this pull request Oct 25, 2026
Add PQ2_0, PTQ1_0, and Q2_0 builds with the Q8_0 vision projector.
Pin files to the publisher revision and document variant selection.

Assisted-by: Codex:gpt-6

(cherry picked from commit 7270bdc, #12773)
Assisted-by: Claude:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler-agent

Copy link
Copy Markdown
Collaborator

Landed on master in f73e30e (batched gallery update).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants