Skip to content

Fix VolumeSizeInGB missing from v3 deploy for models with inference_v…#5847

Open
lhnealreilly wants to merge 4 commits into
aws:masterfrom
lhnealreilly:fix/jumpstart-volume-size
Open

Fix VolumeSizeInGB missing from v3 deploy for models with inference_v…#5847
lhnealreilly wants to merge 4 commits into
aws:masterfrom
lhnealreilly:fix/jumpstart-volume-size

Conversation

@lhnealreilly
Copy link
Copy Markdown
Contributor

…olume_size

from_jumpstart_config() retrieves deploy kwargs (which includes volume_size) but never persisted it on the ModelBuilder instance. Then _deploy_core_endpoint read volume_size from kwargs with no self.* fallback, so it was always None.

Two-line fix in model_builder.py:

  1. from_jumpstart_config(): persist volume_size from deploy_kwargs (same as model_data_download_timeout and container_startup_health_check_timeout)
  2. _deploy_core_endpoint(): fall back to self.volume_size when not in kwargs

Same pattern as EnableNetworkIsolation fix in v3.10.1.

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

…olume_size

from_jumpstart_config() retrieves deploy kwargs (which includes volume_size)
but never persisted it on the ModelBuilder instance. Then _deploy_core_endpoint
read volume_size from kwargs with no self.* fallback, so it was always None.

Two-line fix in model_builder.py:
1. from_jumpstart_config(): persist volume_size from deploy_kwargs (same as
   model_data_download_timeout and container_startup_health_check_timeout)
2. _deploy_core_endpoint(): fall back to self.volume_size when not in kwargs

Same pattern as EnableNetworkIsolation fix in v3.10.1.
evakravi
evakravi previously approved these changes May 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants