Skip to content

test(conformance): add canonical main and environment capabilities - #3839

Open
elezar wants to merge 2 commits into
codex/conformance-smoke-splitfrom
codex/conformance-lifecycle-capabilities
Open

elezar wants to merge 2 commits into
codex/conformance-smoke-splitfrom
codex/conformance-lifecycle-capabilities

Conversation

@elezar

@elezar elezar commented Sep 29, 2026 •

Copy link
Copy Markdown
Member

Summary

Stacked on #3768, extend the leaf-scenario conformance set with canonical-main workload-result and declared-environment coverage. Remove only the Rust E2E cases superseded by those portable capabilities.

Related Issue

Depends on #3768.

No issue required: this is internal conformance and E2E test maintenance with no production behavior changes.

Changes

  • Add sandbox-lifecycle/canonical-main coverage for successful, nonzero, and immediate canonical-main exits, including persistent terminal status and exit codes.
  • Add sandbox-environment/declared coverage for declared environment propagation to canonical-main and exec processes.
  • Register both leaves with the standalone runner and Cargo suite wrappers, including family-selector tests.
  • Remove the superseded detached canonical-main and no-TTY declared-environment E2E tests.
  • Keep attached-terminal output, CLI exit-code propagation, TTY environment, attachment/recovery, restart-policy, signal, and no-keep assertions in Rust E2E.
  • Update the suite documentation and Podman artifact exclusions for the migrated coverage.

POSIX-independent lifecycle fixtures remain out of scope for this PR.

Testing

  • mise run pre-commit (local sccache: Operation not permitted failure in lockfile validation; completed checks and focused commands below pass)
  • cargo test -p openshell-conformance (18 passed)
  • cargo test -p openshell-conformance-cli (8 passed)
  • cargo test --manifest-path tests/suites/conformance/Cargo.toml --no-run
  • Lifecycle E2E test compiles with the e2e feature
  • Conformance and lifecycle E2E Clippy checks pass with warnings denied
  • cargo fmt --all -- --check
  • Live gateway conformance run (not run locally)

Checklist

  • Follows Conventional Commits
  • Commits are signed off (DCO)
  • Architecture docs updated (not applicable; test organization only)

Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
@elezar
elezar force-pushed the codex/conformance-lifecycle-capabilities branch from fe2013d to 3bfbb49 Compare September 30, 2026 09:01
@elezar elezar changed the title test(conformance): split sandbox lifecycle capabilities test(conformance): add canonical main and environment capabilities Sep 30, 2026
@elezar
elezar changed the base branch from main to codex/conformance-smoke-split September 30, 2026 09:03
@elezar
elezar added this pull request to stack #3946 September 30, 2026 09:06

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant