Skip to content

feat(dtk): post-operation to pin numpy and remove nixl ep for vllm 0.18.1 - #269

Merged
thxCode merged 1 commit into
mainfrom
spec/dtk-post-op-pin-numpy-remove-nixl
Sep 1, 2026
Merged

thxCode merged 1 commit into
mainfrom
spec/dtk-post-op-pin-numpy-remove-nixl

Conversation

@thxCode

@thxCode thxCode commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Summary

Add post-operation 20260901_dtk_pin_numpy_remove_nixl_ep to patch the released gpustack/runner:dtk26.04-vllm0.18.1 image in place, backporting #265 (commit range bc1428f..372b411) to the already-published tag:

  • Pin numpy==1.26.4 (uv pip install --no-deps) with a build-time version assertion — the prebuilt DTK Torch is compiled against the NumPy 1.x ABI, and NumPy 2.x breaks distributed init at Tensor.numpy().
  • Remove CUDA-only NIXL EP distributions (uv pip uninstall nixl nixl-cu12 nixl-cu13 || true) with a build-time assertion that nixl_ep* modules are no longer discoverable — they make vLLM load an extension requiring NVIDIA libcuda.so.1, which fails on Hygon DCU.

Package layout follows existing post-operation conventions (matrix.yaml + dtk/Dockerfile), and the operation is logged in pack/.post_operation/README.md.

Also ignores the local .claude/ tooling directory.

Validation

Rollout (after merge)

  1. Pack workflow: post_operation=20260901_dtk_pin_numpy_remove_nixl_ep, backend=dtk, target=vllm, tag=dtk26.04-vllm0.18.1, dry_run=false, for_release=false → pushes -dev tag.
  2. Runtime validation on Hygon DCU with the -dev tag.
  3. Re-run with for_release=true to overwrite the released tag, then check off the README entry.

…18.1

- add pack/.post_operation/20260901_dtk_pin_numpy_remove_nixl_ep with matrix
  rule and overlay Dockerfile porting PR #265 fixes
- log the operation in pack/.post_operation/README.md
- ignore local .claude/ tooling directory

Task 1 of dtk-post-op-pin-numpy-remove-nixl.

Signed-off-by: thxCode <thxcode0824@gmail.com>
@thxCode
thxCode merged commit e1ac3be into main Sep 1, 2026
10 checks passed

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a post-operation patch for the Hygon DTK 26.04 backend running vLLM 0.18.1. Specifically, it adds a Dockerfile that pins numpy to version 1.26.4 to restore NumPy 1.x ABI compatibility with Torch, and uninstalls CUDA-only NIXL EP packages to prevent execution failures on Hygon DCU systems. It also configures the build matrix rule for this patch, updates the .gitignore to exclude local Claude agent tooling, and documents the new task in the README. There are no review comments, so no additional feedback is provided.

@thxCode
thxCode deleted the spec/dtk-post-op-pin-numpy-remove-nixl branch September 1, 2026 09:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant