Skip to content

feat(gallery): add Tess 4.5 27B variants - #12823

Closed
localai-org-maint-bot wants to merge 4 commits into
masterfrom
gallery/20261022-third-pass
Closed

localai-org-maint-bot wants to merge 4 commits into
masterfrom
gallery/20261022-third-pass

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add Tess 4.5 27B for llama.cpp in Q4_K_M, Q6_K, and Q8_0, grouped as gallery variants. Each entry includes the F16 vision projector, embedded chat template, upstream sampling defaults, and a 32,768-token default context. Add installation documentation. These builds do not enable speculative decoding or download MTP draft heads.

Sources: upstream model, publisher GGUFs. All artifacts are pinned to revision af17a3f0de2b8557849c1b6fcc303d3160052450.

Notes for Reviewers

  • Cross-checked all four artifact SHA256 values against both HF LFS metadata and the x-linked-etag headers at the pinned URLs.
  • Parsed the complete gallery with Go yaml.v3; checked all three new entries for valid variant targets, SHA256 format, and model/projector file references.
  • git diff --check passes.
  • go test ./core/gallery -run TestGallery -count=1 could not compile: this checkout has no generated Go files in pkg/grpc/proto. Inference has not been tested.

Signed commits

  • Human DCO sign-off required; AI attribution is recorded with Assisted-by per repository policy.
  • Documentation updated (docs/content/) for user-facing changes.

@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261022-third-pass branch from 66975b1 to a46adb3 Compare October 23, 2026 08:08
Add three GGUF quantizations with a shared vision projector and pinned
artifact URLs. Document installation and the default context size.

Assisted-by: Codex:gpt-6
Implement InstallLibraryBackend so the assistant tests satisfy the
LocalAIClient interface after the library integration.

Assisted-by: Codex:GPT-6
@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261022-third-pass branch from a46adb3 to 8471c0d Compare October 23, 2026 10:07
localai-org-maint-bot and others added 2 commits October 24, 2026 18:04
Merge current master and remove the redundant InstallLibraryBackend
stub that prevents the MCP endpoint tests from compiling.

Assisted-by: Codex:gpt-6
mudler pushed a commit that referenced this pull request Oct 25, 2026
Add three GGUF quantizations with a shared vision projector and pinned
artifact URLs. Document installation and the default context size.

Assisted-by: Codex:gpt-6

(cherry picked from commit c8df4d6, #12823)
Assisted-by: Claude:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler-agent

Copy link
Copy Markdown
Collaborator

Landed on master in d27a2ee (batched gallery update).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants