feat: support optional Ray actor resource affinity - #6
Open
RexFlux wants to merge 6 commits into
Open
Conversation
Allow the TransferQueue controller and SimpleStorage units to opt into hard node affinity based on a user-defined Ray custom resource. Preserve existing scheduling when unset and fail fast when no alive node matches.
NINGBENZHE
reviewed
Sep 8, 2026
Preflight storage affinity and account for per-node CPU capacity, including Controller CPU on its actual Ray node. Roll back only resources owned by failed affinity initialization and invalidate failed attachment handles. Add lifecycle, race, retry and heterogeneous-capacity regression tests. Validation: 154 tests, pre-commit checks, and isolated multi-node Ray init/retry.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
required_node_resourceconfiguration for theTransferQueueController and SimpleStorage actors.
TQ_LOGGING_LEVEL configuration.
Validation
in a live mixed stable/elastic Ray cluster.
in the running CE image.
Scope