Skip to content

feat(gallery): add LFM Turbo Brilliance variants - #12831

Open
localai-org-maint-bot wants to merge 3 commits into
masterfrom
gallery/20261022-fifth-pass
Open

localai-org-maint-bot wants to merge 3 commits into
masterfrom
gallery/20261022-fifth-pass

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add DavidAU's LFM2.5-24B-A2B Turbo Brilliance IQ4_XS and Q8_0 MAX builds as linked llama.cpp variants. Both use the embedded chat template, publisher sampling defaults, and a 32,768-token default context. Document installation and explicit variant selection.

Source: publisher model card.

Notes for Reviewers

  • Based on latest master 7b9ef6a0f; checked master and pending gallery PRs for duplicates.
  • Pin both downloads to revision 69107daec71f075c94d7d84929b4a0222d1b8446. Both SHA256 values match HF LFS metadata and the pinned resolve URLs' x-linked-etag headers.
  • Parsed both GGUF metadata and tensor directories: lfm2moe, 131,072-token capacity, embedded Turbo Brilliance templates, and standard quantization types. The pinned llama.cpp revision includes src/models/lfm2moe.cpp.
  • Passed go test ./core/gallery -count=1 -ginkgo.focus='gallery/index.yaml|gallery variant lint', go test ./scripts/build/gallery -count=1, gallery packaging, and git diff --check.
  • Full go test ./core/gallery -count=1: 503 passed, 3 failed, 9 skipped. Unmodified master reproduces the same three failures fetching external GitHub fixtures with HTTP Forbidden. No inference test was run.

Signed commits

  • Human DCO sign-off required; AI involvement is recorded with Assisted-by.
  • Documentation updated (docs/content/) for user-facing changes.

@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261022-fifth-pass branch from 5fcaea8 to f0f8c62 Compare October 23, 2026 08:08
Add IQ4_XS and Q8_0 MAX builds with pinned downloads and linked variants.
Use the embedded chat template and document installation.

Assisted-by: Codex:gpt-6
Implement InstallLibraryBackend so the assistant tests satisfy the
LocalAIClient interface after the library integration.

Assisted-by: Codex:GPT-6
@localai-org-maint-bot
localai-org-maint-bot force-pushed the gallery/20261022-fifth-pass branch from f0f8c62 to a320f69 Compare October 23, 2026 10:07

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant