Add Vast.ai-specific profile options#3909
Merged
Merged
Conversation
- Support setting backend-specific options in
profiles, run and fleet configurations. These
options are only applied to offers from the
respective backends, and ignored for other
offers.
- Add the following options for the `vastai`
backend:
- `offer_order` - Controls the order in which
offers are considered for provisioning. Use
`score` to prioritize the highest overall
score first (the default order in the Vast.ai
console), or `price` to prioritize the
lowest-cost offers first. Lower-cost offers
are often less reliable, so consider applying
stricter filters when using `price`. Defaults
to `score`.
- `min_reliability` - The minimum reliability
threshold for offers, on a scale from `0` to
`1`. Defaults to `0.9`.
- `min_score` - The minimum overall score
required for offers to be considered. The
scoring scale varies and may require
experimentation. Starting with a value in the
low hundreds is generally recommended.
Example:
```yaml
type: dev-environment
backend_options:
- type: vastai
offer_order: price
min_reliability: 0.97
min_score: 250
```
r4victor
approved these changes
May 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
vastaibackend:offer_order- Controls the order in which offers are considered for provisioning. Usescoreto prioritize the highest overall score first (the default order in the Vast.ai console), orpriceto prioritize the lowest-cost offers first. Lower-cost offers are often less reliable, so consider applying stricter filters when usingprice. Defaults toscore.min_reliability- The minimum reliability threshold for offers, on a scale from0to1. Defaults to0.9.min_score- The minimum overall score required for offers to be considered. The scoring scale varies and may require experimentation. Starting with a value in the low hundreds is generally recommended.Example:
Closes #3898
Before merging: