Skip to content

feat(LlamaRankingContext): add an option to chunk large documents - #645

Open
giladgd wants to merge 12 commits into
masterfrom
gilad/downloaderFixes
Open

feat(LlamaRankingContext): add an option to chunk large documents#645
giladgd wants to merge 12 commits into
masterfrom
gilad/downloaderFixes

Conversation

@giladgd

@giladgd giladgd commented Sep 8, 2026

Copy link
Copy Markdown
Member

Description of change

  • feat(LlamaRankingContext): add an option to chunk large documents
  • feat(LlamaModel): lazyMode support
  • feat: get model and context memory usage
  • feat: native jinja implementation fallback
  • fix: reading gguf files that have no tensors
  • fix: reading network gguf file retry conditions
  • fix: add missing supported quant file name
  • fix: check arch features directly from llama.cpp
  • fix: Metal 4 tensor API issues on M5 mac machines

Resolves #644

Pull-Request Checklist

  • Code is up-to-date with the master branch
  • npm run format to apply eslint formatting
  • npm run test passes with this change
  • This pull request links relevant issues as Fixes #0000
  • There are new or updated unit tests validating the change
  • Documentation has been updated to reflect this change
  • The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

@giladgd
giladgd requested a review from ido-pluto September 8, 2026 04:56
@giladgd giladgd self-assigned this Sep 8, 2026
@giladgd giladgd changed the title feat(LlamaRankingContext): add an option to chunk large documents feat(LlamaRankingContext): add an option to chunk large documents Sep 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

1 participant