Repository navigation
fix(deps): update dependency sentence-transformers to v6 - #374
Open
dreadnode-renovate-bot[bot] wants to merge 1 commit into
Open
dreadnode-renovate-bot[bot] wants to merge 1 commit into
dreadnode-renovate-bot[bot] wants to merge 1 commit into
Conversation
Contributor
Author
|
dreadnode-renovate-bot
Bot
force-pushed
the
renovate/sentence-transformers-6.x
branch
from
September 2, 2026 00:29
ecb95ca to
8afcff8
Compare
dreadnode-renovate-bot
Bot
force-pushed
the
renovate/sentence-transformers-6.x
branch
from
September 20, 2026 00:31
8afcff8 to
7052c0a
Compare
dreadnode-renovate-bot
Bot
deleted the
renovate/sentence-transformers-6.x
branch
October 4, 2026 01:09
dreadnode-renovate-bot
Bot
force-pushed
the
renovate/sentence-transformers-6.x
branch
2 times, most recently
from
October 7, 2026 00:31
7052c0a to
6ec1418
Compare
| datasource | package | from | to | | ---------- | --------------------- | ----- | ----- | | pypi | sentence-transformers | 5.7.0 | 6.2.0 |
dreadnode-renovate-bot
Bot
force-pushed
the
renovate/sentence-transformers-6.x
branch
from
October 25, 2026 00:29
6ec1418 to
d2c89cb
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Note
This PR body was truncated due to platform limits.
This PR contains the following updates:
>=5.1.0,<6.0.0→>=6.2.0,<6.3.0Release Notes
huggingface/sentence-transformers (sentence-transformers)
v6.2.0: - Model merging, faster loading, and distributed evaluationCompare Source
This release adds model merging for all four model types, reduces redundant Hub requests when loading models, and distributes evaluator inference across DDP ranks. It also includes lower-memory training losses, more flexible multi-vector compression, and fixes throughout inference, training, and evaluation.
Install this version with
Model merging for all four model types (#3776)
Combine compatible fine-tuned checkpoints without another training run using
SentenceTransformer.merge,SparseEncoder.merge,CrossEncoder.merge, orMultiVectorEncoder.merge. The integration uses Arcee AI's mergekit and supports well over a dozen methods such as Linear, SLERP, TIES, and DARE.Install the
mergeextra withpip install "sentence-transformers[merge]". For example, take a weighted average of two compatible MiniLM models:Or interpolate between the same inputs with SLERP:
The method returns a model that can be used, trained, and saved normally. Configuration, prompts, and processors come from the first input. Inputs must have compatible architectures, module configurations, and tokenizers. Merging uses FP32 on CPU by default and holds the inputs and result in memory.
See the merging guides for Sentence Transformers, Cross Encoders, Sparse Encoders (plus an example evaluation!), and Multi-Vector Encoders. Be sure to evaluate the merged model on your own tasks, since combining checkpoints can improve some tasks while regressing others.
Faster Hub model loading (#3890)
Combined with
huggingface_hub>=1.26.0, model loading now resolves the requested branch or tag to a commit once and reuses that result across component downloads, reducing repeated Hub requests. Older Hub versions retain the previous loading behavior.The loading benchmarks in #3890 measured constructor time in fresh processes with a warm cache and online Hub access. Values are medians of seven alternating runs per configuration:
sentence-transformers-testing/stsb-bert-tiny-safetensorssentence-transformers/all-MiniLM-L6-v2sparse-encoder-testing/splade-bert-tiny-nqcross-encoder/ms-marco-MiniLM-L6-v2Constructor time fell by 43 to 61 percent in these workloads. Loading models from local directories is unchanged and unaffected by this improvement.
Distributed evaluator inference during DDP training (#4004)
During DDP training, evaluators now share their
encode()andpredict()work across the existing training processes for all four model types, with each rank processing a shard of the inputs. Rank zero combines predictions in their original order, computes metrics over the full dataset, and writes evaluation output once. Metrics are then broadcast to every rank for checkpoint selection and early stopping.This now happens automatically when using an evaluator through the trainer. It also covers
encode_query(),encode_document(), andrank(), which use those inference methods internally.Explicit
deviceandpoolarguments retain their usual behavior, and calls with arguments that cannot be serialized fall back to rank zero. Predictions are gathered through CPU memory, so the speedup depends on inference cost and communication overhead. Evaluator support for FSDP and DeepSpeed is unchanged.Smaller Features
Experimental FP32 layers for CrossEncoders (#4230)
CrossEncoders can compute selected linear layers in FP32 to reduce BF16 score ties while keeping a reduced-precision backbone:
This uses the exact
model.named_modules()paths. The selection is saved with the model, works under autocast during training and inference, and leaves stored parameter dtypes unchanged. In my experiments, this doesn't improve NDCG@10, but solely helps reduce ties caused by the low BF16/FP16 output precision.Lower memory training losses (#4026, #4029, #4030)
BatchSemiHardTripletLossuses quadratic intermediate memory instead of constructing cubic distance and mask tensors. It also corrects a gradient issue when selected negative distances tie (#4026).BatchAllTripletLossremoves invalid anchor-positive pairs before constructing triplets. Memory is quadratic for paired labels, though large label groups can still require cubic storage (#4029).CoSENTLoss,AnglELoss, and their sparse counterparts use sorted suffix reductions with linear intermediate storage. MPS execution requires PyTorch 2.9 or newer (#4030).Multi-vector compression and scoring (#3965, #3941, #4008, #4153)
HierarchicalTokenPoolingaccepts fractionalpool_factorvalues for finer control over compression (#3965) and can use optionalfastclusterlinkage for faster clustering (#3941).HierarchicalTokenPoolingnow normalizes output tokens by default, including protected tokens. Older saved configurations retain their previous behavior. Setnormalize_embeddings=Falseon the pooling module to opt out (#4008).chunk_elements(#4153).Compatibility Notes
huggingface_hub2.x support, retaining Python 3.10 support and the Hub 1.3.0 minimum (#4162, #4003).int8oruint8calibration ranges from a single vector now raisesValueError. Encode floats first, then callquantize_embeddingswith representativecalibration_embeddingsor explicitranges(#4150)...path components, even withtrust_remote_code=True. Keep custom modules inside the checkpoint tree (#4175).Bug Fixes
Pooling precision and normalization
Multi-process inference
Model placement and memory
clear_placement_cache()after changing dispatch hooks or adding modules following the first inference call (#3986, #4035).use_cacheoverrides inconfig_kwargsremain honored (#3992).Cached and compiled training
CSR training
k_aux=0and used ordinary MSE for zero-variance reconstruction batches (#4017, #4016).Quantization, search, and mining
top_k, and the metric used for approximate FAISS inner-product search (#3948, #3956, #4022).semantic_searchby normalizing each corpus chunk once (#4197).max_pairscap, and excluded self-matches before enforcing each sentence'stop_k(#3930, #3979, #4189).min_scoreis set (#4073).Ranking losses and evaluators
Other fixes
SparseEncoder.max_active_dimsand Router module sharing across saving and loading (#4046, #4180).All Changes
fix] Prevent CSR inference from updating dead-feature statistics by @eSVeeF in #3910v6.1] Resolve Hub revisions before model loading by @Wauplin in #3890fix] Resolve IR evaluator scoring per call instead of latching onto the first model by @tomaarsen in #3976fix] Keep composed batch samplers synchronized across epochs by @eSVeeF in #4002tests] Use a new cached tiny MVE model by @tomaarsen in #4024fix] Prevent non-finite CSR reconstruction losses by @eSVeeF in #4016fix] Support disabling CSR auxiliary latents with k_aux=0 by @eSVeeF in #4017chore] Increment the dev version by @tomaarsen in #4049D417) by @Samoed in #4139fix] Respectverbose=Falsefor the average-positives message inmine_hard_negativesby @eSVeeF in #4100feat] Add model merging via mergekit for all archetypes by @yjoonjang in #3776Configuration
📅 Schedule: (UTC)
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate CLI.