Skip to content

Fix CUDA probing for mixed CPU/GPU releases#254

Merged
PaulFidika merged 1 commit into
masterfrom
fix/mixed-profile-cuda-probe
Jul 14, 2026
Merged

Fix CUDA probing for mixed CPU/GPU releases#254
PaulFidika merged 1 commit into
masterfrom
fix/mixed-profile-cuda-probe

Conversation

@PaulFidika

Copy link
Copy Markdown
Contributor

What changed

  • make CUDA health probing aware of mixed CPU/GPU discovery manifests
  • use the installed Torch build to distinguish the concrete CPU and CUDA images
  • retain fail-closed probing for GPU-only releases
  • release as gen-worker 0.25.2

Root cause

A release-level endpoint.lock contains functions from both build profiles. The prior any-GPU-function check therefore killed the CPU conversion image before worker hello even though the orchestrator had selected its CPU lane.

Validation

  • 1,072 tests passed; 25 skipped
  • mypy clean across 114 source files
  • HTTP timeout guard passed
  • wheel and sdist built
  • patched worker reached the real conversion container worker loop without an environment override

@PaulFidika PaulFidika marked this pull request as ready for review July 14, 2026 18:02
@PaulFidika PaulFidika merged commit ecadfb2 into master Jul 14, 2026
1 check passed
@PaulFidika PaulFidika deleted the fix/mixed-profile-cuda-probe branch July 14, 2026 18:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant