Skip to content

docs(studios): add S3 versioning guidance for checkpoint storage costs#1447

Open
ejseqera wants to merge 3 commits into
masterfrom
docs/studios-checkpoint-s3-versioning-guidance
Open

docs(studios): add S3 versioning guidance for checkpoint storage costs#1447
ejseqera wants to merge 3 commits into
masterfrom
docs/studios-checkpoint-s3-versioning-guidance

Conversation

@ejseqera
Copy link
Copy Markdown
Member

@ejseqera ejseqera commented May 19, 2026

Summary

  • Studios writes a checkpoint to the same S3 key every five minutes. With S3 versioning enabled on the work bucket, each write creates a new object version rather than an overwrite — up to 96 non-current versions per day per active session — which can cause significant unexpected storage costs.
  • Adds a new ### S3 versioning and checkpoint storage costs subsection under the existing checkpoint section explaining the interaction and providing actionable remediation steps.
  • Applied to both platform-cloud and platform-enterprise docs.

Test plan

  • Preview renders correctly on both enterprise and cloud docs
  • JSON and shell code blocks render without errors
  • Links and cross-references in surrounding sections are unaffected
  • Pre-commit passes (verified locally)

🤖 Generated with Claude Code

ejseqera added 2 commits May 19, 2026 17:28
Studios writes a checkpoint every five minutes to the same S3 key. When
S3 versioning is enabled on the work bucket, each write creates a new
object version rather than an overwrite, producing up to 96 non-current
versions per day per active session.

Add a new subsection under "Studio session checkpoints" that:
- Explains the versioning interaction and its cost implications
- Recommends an S3 Lifecycle rule (NoncurrentVersionExpiration: 1 day)
  with a ready-to-use JSON policy block and aws s3api CLI command
- Provides a bulk-delete shell command for clearing existing accumulated
  non-current versions
- Clarifies that non-current versions are safe to delete, while the
  current version and checkpoint directories must not be removed

Changes applied to both platform-cloud and platform-enterprise docs.
@ejseqera ejseqera requested a review from gwright99 May 19, 2026 21:31
@netlify
Copy link
Copy Markdown

netlify Bot commented May 20, 2026

Deploy Preview for seqera-docs ready!

Name Link
🔨 Latest commit 2ef8d31
🔍 Latest deploy log https://app.netlify.com/projects/seqera-docs/deploys/6a0df35a1785ee00086aa26e
😎 Deploy Preview https://deploy-preview-1447--seqera-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@justinegeffen justinegeffen requested a review from t0randr May 20, 2026 19:01
@justinegeffen justinegeffen added the 1. Dev/PM/SME Needs a review by a Dev/PM/SME label May 20, 2026
@justinegeffen justinegeffen added the 2. Edu reviews complete Reviews complete. Remove label when confirmed in prod. label May 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

1. Dev/PM/SME Needs a review by a Dev/PM/SME 2. Edu reviews complete Reviews complete. Remove label when confirmed in prod.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants