Skip to content

feat(gallery): add Spark-X2.6 4B variants - #12821

Closed
localai-org-maint-bot wants to merge 4 commits into
masterfrom
gallery/20261022-second-pass
Closed

localai-org-maint-bot wants to merge 4 commits into
masterfrom
gallery/20261022-second-pass

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add Spark-X2.6-4B Q4_K_M and Q8_0 GGUF builds as linked llama.cpp variants, with installation examples. Both use the embedded chat template, publisher sampling defaults, and a 32,768-token default context.

Source: XHToken's model card and weights.

Notes for Reviewers

  • Based on latest master 7f7b10fba.
  • Both downloads are pinned to fe31f8d64890302cc3a1d365d700357b4b75ba77. Each SHA256 matches both Hugging Face LFS metadata and the pinned download URL's x-linked-etag header.
  • Both GGUF headers declare spark2_5 and contain a Jinja chat template. LocalAI's pinned llama.cpp commit includes src/models/spark2-5.cpp; this is the architecture used by existing Spark-X2.5 entries.
  • Other engines are omitted because the publisher's examples require Spark-specific plugins or runtimes whose availability in LocalAI has not been verified.
  • Passed go test ./core/gallery -count=1 -ginkgo.focus='gallery/index.yaml|gallery variant lint', go test ./scripts/build/gallery -count=1, go run ./scripts/build/gallery . gallery <output>, and git diff --check.
  • Full go test ./core/gallery -count=1: 494 passed, 3 failed, 9 skipped. The three failures involve external GitHub fixtures returning Forbidden. No inference test was run.

Signed commits

  • Human DCO signoff required; AI attribution is recorded with Assisted-by.
  • Documentation updated (docs/content/) for user-facing changes.

@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261022-second-pass branch from c7be61f to 23c59fa Compare October 23, 2026 08:08
Add the publisher Q4_K_M and Q8_0 builds with pinned downloads and
verified SHA256 hashes. Document installation and variant selection.

Assisted-by: Codex:gpt-6
Implement InstallLibraryBackend so the assistant tests satisfy the
LocalAIClient interface after the library integration.

Assisted-by: Codex:GPT-6
@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261022-second-pass branch from 23c59fa to 2e55645 Compare October 23, 2026 10:07
localai-org-maint-bot and others added 2 commits October 24, 2026 18:04
Merge current master and remove the redundant InstallLibraryBackend
stub that prevents the MCP endpoint tests from compiling.

Assisted-by: Codex:gpt-6
mudler pushed a commit that referenced this pull request Oct 25, 2026
Add the publisher Q4_K_M and Q8_0 builds with pinned downloads and
verified SHA256 hashes. Document installation and variant selection.

Assisted-by: Codex:gpt-6

(cherry picked from commit 64d0b3b, #12821)
Assisted-by: Claude:claude-sonnet-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler-agent

Copy link
Copy Markdown
Collaborator

Landed on master in 8b0d6c0 (batched gallery update).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants