Skip to content

refactor(virt): migrate virt to direct constants submodule imports#5318

Open
vsibirsk wants to merge 2 commits into
RedHatQE:mainfrom
vsibirsk:vk-migrate-virt-imports
Open

refactor(virt): migrate virt to direct constants submodule imports#5318
vsibirsk wants to merge 2 commits into
RedHatQE:mainfrom
vsibirsk:vk-migrate-virt-imports

Conversation

@vsibirsk

@vsibirsk vsibirsk commented Jun 23, 2026

Copy link
Copy Markdown
Collaborator
What this PR does / why we need it:

Replace all from utilities.constants import X with from utilities.constants.<submodule> import X across 76 files in tests/virt/. Imports of Images are intentionally kept via from utilities.constants import Images (computed alias in init.py; pending circular-import cleanup in utilities/architecture.py).

Generated-by: Claude Sonnet 4.6

Which issue(s) this PR fixes:
Special notes for reviewer:

This is a next PR in a series.
https://redhat.atlassian.net/browse/CNV-80952 and a follow up of #5188

jira-ticket:

https://redhat.atlassian.net/browse/CNV-89564

Summary by CodeRabbit

Release Notes

  • Refactor
    • Reorganized test constant imports across test suite by splitting monolithic utilities.constants module into specialized submodules (e.g., utilities.constants.timeouts, utilities.constants.images, utilities.constants.virt) for improved code maintainability and organization. No functional changes to tests.

…orts

Replace all `from utilities.constants import X` with
`from utilities.constants.<submodule> import X` across 76 files in
tests/virt/. Imports of `Images` are intentionally kept via
`from utilities.constants import Images` (computed alias in __init__.py;
pending circular-import cleanup in utilities/architecture.py).

Generated-by: Claude Sonnet 4.6
Signed-off-by: vsibirsk <vsibirsk@redhat.com>
@coderabbitai

coderabbitai Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Warning

Review limit reached

@vsibirsk, we couldn't start this review because you've reached your PR review rate limit.

More reviews will be available in 20 minutes and 2 seconds. Learn how PR review limits work.

Your organization has used up its prepaid credits, and credit purchases are no longer available. Enable the review add-on in the billing tab to keep reviews running — you're only billed for reviews past your plan's rate limits ($0.25/file).

⌛ How to resolve this issue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based credits.

🚦 How do rate limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please see our Fair Usage Limits Policy for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro

Run ID: cfefd33a-5c25-4e0c-94d8-f8235327961b

📥 Commits

Reviewing files that changed from the base of the PR and between 7209838 and ba6fa21.

📒 Files selected for processing (1)
  • tests/virt/node/general/test_cloud_init_disk_vm.py
📝 Walkthrough

Walkthrough

All changes refactor import statements across ~75 test files under tests/virt/, splitting monolithic from utilities.constants import ... lines into imports from themed submodules: utilities.constants.aaq, .architecture, .cluster, .components, .hco, .images, .instance_types, .namespaces, .networking, .pytest, .storage, .timeouts, and .virt. No test logic, fixtures, or assertions are modified.

Changes

Import path migration to utilities.constants submodules

Layer / File(s) Summary
Cluster test import updates
tests/virt/cluster/aaq/*, tests/virt/cluster/common_templates/..., tests/virt/cluster/longevity_tests/*, tests/virt/cluster/migration_and_maintenance/*, tests/virt/cluster/operator_tests/*, tests/virt/cluster/sysprep/*, tests/virt/cluster/vm_cloning/*, tests/virt/cluster/vm_lifecycle/*
Constants previously grouped under utilities.constants are split into submodule imports (.aaq, .architecture, .components, .hco, .images, .instance_types, .namespaces, .networking, .pytest, .storage, .timeouts, .virt) across all cluster-level test and utility files.
Node test import updates
tests/virt/conftest.py, tests/virt/node/conftest.py, tests/virt/node/descheduler/*, tests/virt/node/general/*, tests/virt/node/gpu/..., tests/virt/node/high_performance_vm/*, tests/virt/node/hotplug/*, tests/virt/node/hyperv_support/*, tests/virt/node/log_verbosity/*, tests/virt/node/migration_and_maintenance/*, tests/virt/node/node_labeller/..., tests/virt/node/readonly_disk/*, tests/virt/node/workload_density/*
Same import splitting applied to all node-level test and utility files, routing each constant to its dedicated submodule.
Upgrade and shared utils import updates
tests/virt/upgrade/conftest.py, tests/virt/upgrade/test_upgrade_virt.py, tests/virt/upgrade/utils.py, tests/virt/upgrade_custom/aaq/*, tests/virt/upgrade_custom/vgpu/conftest.py, tests/virt/utils.py
Import paths updated in upgrade conftest/test/utils files and the shared tests/virt/utils.py module, following the same submodule routing pattern.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related PRs

Suggested reviewers

  • dshchedr
  • rnetser
  • rlobillo
  • RoniKishner
  • hmeir

Caution

Pre-merge checks failed

Please resolve all errors before merging. Addressing warnings is optional.

  • Ignore

❌ Failed checks (1 error)

Check name Status Explanation Resolution
Stp Link Required ❌ Error 88 out of 89 newly added test files in tests/virt/ lack required STP/RFE/Jira links in module/class docstrings. Only test_live_migration.py has a module-level STP link. Add STP/RFE/Jira docstring links to all 88 test files without module-level documentation, or ensure class-level links cover their test functions per requirement A/B in the check.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly describes the main change: migrating virt test imports from utilities.constants to specific submodules.
Description check ✅ Passed The description includes all required sections: what/why, issues fixed, special notes, and JIRA ticket. It provides sufficient context about the refactoring scope and exceptions.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Warning

Review ran into problems

🔥 Problems

Linked repositories: Your configuration references 1 linked repositories, but your current plan allows 0. Analyzed ``, skipped RedHatQE/openshift-virtualization-tests-design-docs.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@openshift-virtualization-qe-bot-6

Copy link
Copy Markdown

Report bugs in Issues

Welcome! 🎉

This pull request will be automatically processed with the following features:

🔄 Automatic Actions

  • Reviewer Assignment: Reviewers are automatically assigned based on the OWNERS file in the repository root
  • Size Labeling: PR size labels (XS, S, M, L, XL, XXL) are automatically applied based on changes
  • Issue Creation: A tracking issue is created for this PR and will be closed when the PR is merged or closed
  • Branch Labeling: Branch-specific labels are applied to track the target branch
  • Auto-verification: Auto-verified users have their PRs automatically marked as verified
  • Labels: Enabled categories: branch, can-be-merged, cherry-pick, has-conflicts, hold, needs-rebase, size, verified, wip

📋 Available Commands

PR Status Management

  • /wip - Mark PR as work in progress (adds WIP: prefix to title)
  • /wip cancel - Remove work in progress status
  • /hold - Block PR merging (approvers only)
  • /hold cancel - Unblock PR merging
  • /verified - Mark PR as verified
  • /verified cancel - Remove verification status
  • /reprocess - Trigger complete PR workflow reprocessing (useful if webhook failed or configuration changed)
  • /regenerate-welcome - Regenerate this welcome message
  • /security-override - Set security check runs to pass (maintainers only)
  • /security-override cancel - Re-run security checks

Review & Approval

  • /lgtm - Approve changes (looks good to me)
  • /approve - Approve PR (approvers only)
  • /assign-reviewers - Assign reviewers based on OWNERS file
  • /assign-reviewer @username - Assign specific reviewer
  • /check-can-merge - Check if PR meets merge requirements

Testing & Validation

  • /retest tox - Run Python test suite with tox
  • /retest build-container - Rebuild and test container image
  • /retest verify-bugs-are-open - verify-bugs-are-open
  • /retest all - Run all available tests

Container Operations

  • /build-and-push-container - Build and push container image (tagged with PR number)
    • Supports additional build arguments: /build-and-push-container --build-arg KEY=value

Cherry-pick Operations

  • /cherry-pick <branch> - Schedule cherry-pick to target branch when PR is merged
    • Multiple branches: /cherry-pick branch1 branch2 branch3
  • /cherry-pick-retry <branch> - Retry a failed cherry-pick (merged PRs only)

Branch Management

  • /rebase - Rebase this PR branch onto its base branch

Label Management

  • /<label-name> - Add a label to the PR
  • /<label-name> cancel - Remove a label from the PR

✅ Merge Requirements

This PR will be automatically approved when the following conditions are met:

  1. Approval: /approve from at least one approver
  2. LGTM Count: Minimum 2 /lgtm from reviewers
  3. Status Checks: All required status checks must pass
  4. No Blockers: No wip, hold, has-conflicts labels and PR must be mergeable (no conflicts)
  5. Verified: PR must be marked as verified

📊 Review Process

Approvers and Reviewers

Approvers:

  • dshchedr
  • myakove
  • rnetser
  • vsibirsk

Reviewers:

  • RoniKishner
  • SamAlber
  • akri3i
  • dshchedr
  • hmeir
  • rlobillo
  • rnetser
  • vsibirsk
Available Labels
  • hold
  • verified
  • wip
  • lgtm
  • approve
AI Features
  • Cherry-Pick Conflict Resolution: Enabled (claude/claude-opus-4-6[1m])
Security Checks
  • Suspicious Path Detection: Monitors paths: .claude/, .vscode/, .cursor/, .devcontainer/, .pi/, .github/workflows/, .github/actions/
  • Committer Identity Check: Verifies last committer matches PR author
  • Mandatory: Security checks block merge (use /security-override to bypass — maintainers only)

💡 Tips

  • WIP Status: Use /wip when your PR is not ready for review
  • Verification: The verified label is removed on new commits unless the push is detected as a clean rebase
  • Cherry-picking: Cherry-pick labels are processed when the PR is merged
  • Container Builds: Container images are automatically tagged with the PR number
  • Permission Levels: Some commands require approver permissions
  • Auto-verified Users: Certain users have automatic verification and merge privileges

For more information, please refer to the project documentation or contact the maintainers.

@vsibirsk

Copy link
Copy Markdown
Collaborator Author

@coderabbitai full review

@coderabbitai

coderabbitai Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor
✅ Action performed

Full review finished.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/virt/node/workload_density/test_kernel_samepage_merging.py`:
- Around line 12-15: For this import-only refactor that changes imports from
utilities.constants.timeouts without modifying any test logic, validate the
changes by running uv run pytest --collect-only on the
test_kernel_samepage_merging.py module rather than executing the full test
suite. This collect-only approach is sufficient to verify that the import paths
are correctly resolved without the overhead of full test execution.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro

Run ID: 52f6cd69-bc70-4cc7-97f5-5f2c4d04d3c2

📥 Commits

Reviewing files that changed from the base of the PR and between ce56f21 and 7209838.

📒 Files selected for processing (76)
  • tests/virt/cluster/aaq/conftest.py
  • tests/virt/cluster/aaq/constants.py
  • tests/virt/cluster/aaq/test_arq.py
  • tests/virt/cluster/aaq/utils.py
  • tests/virt/cluster/common_templates/centos/test_centos_os_support.py
  • tests/virt/cluster/common_templates/conftest.py
  • tests/virt/cluster/common_templates/custom_namespace/conftest.py
  • tests/virt/cluster/common_templates/custom_namespace/test_custom_namespace.py
  • tests/virt/cluster/common_templates/custom_namespace/utils.py
  • tests/virt/cluster/common_templates/fedora/test_fedora_os_support.py
  • tests/virt/cluster/common_templates/general/test_base_custom_templates.py
  • tests/virt/cluster/common_templates/general/test_base_template.py
  • tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py
  • tests/virt/cluster/common_templates/rhel/test_rhel_tablet_device.py
  • tests/virt/cluster/common_templates/utils.py
  • tests/virt/cluster/common_templates/windows/test_windows_custom_options.py
  • tests/virt/cluster/common_templates/windows/test_windows_os_support.py
  • tests/virt/cluster/common_templates/windows/test_windows_tablet_device.py
  • tests/virt/cluster/general/mass_machine_type_transition_tests/conftest.py
  • tests/virt/cluster/longevity_tests/constants.py
  • tests/virt/cluster/longevity_tests/utils.py
  • tests/virt/cluster/migration_and_maintenance/rbac_hardening/test_migration_rights.py
  • tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py
  • tests/virt/cluster/migration_and_maintenance/test_migration_policy.py
  • tests/virt/cluster/operator_tests/test_critical_pods.py
  • tests/virt/cluster/operator_tests/test_ssp_custom_resources.py
  • tests/virt/cluster/sysprep/test_sysprep.py
  • tests/virt/cluster/vm_cloning/conftest.py
  • tests/virt/cluster/vm_cloning/test_vm_cloning.py
  • tests/virt/cluster/vm_cloning/utils.py
  • tests/virt/cluster/vm_lifecycle/test_vm_data_persistency.py
  • tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py
  • tests/virt/conftest.py
  • tests/virt/node/conftest.py
  • tests/virt/node/descheduler/conftest.py
  • tests/virt/node/descheduler/test_descheduler_psi_metrics.py
  • tests/virt/node/descheduler/utils.py
  • tests/virt/node/general/test_cloud_init_disk_vm.py
  • tests/virt/node/general/test_cloud_init_vm.py
  • tests/virt/node/general/test_disk_io_option.py
  • tests/virt/node/general/test_machinetype.py
  • tests/virt/node/general/test_networkinterfacemultiqueue_feature.py
  • tests/virt/node/general/test_oom.py
  • tests/virt/node/general/test_static_ssh_key_injection.py
  • tests/virt/node/general/test_windows_vtpm_bitlocker.py
  • tests/virt/node/general/test_wsl2.py
  • tests/virt/node/gpu/conftest.py
  • tests/virt/node/gpu/gpu_pci_passthrough/conftest.py
  • tests/virt/node/gpu/gpu_pci_passthrough/test_rhel_vm_with_gpu_pci_passthrough.py
  • tests/virt/node/gpu/utils.py
  • tests/virt/node/high_performance_vm/test_numa.py
  • tests/virt/node/hotplug/test_cpu_memory_hotplug.py
  • tests/virt/node/hyperv_support/test_hyperv_features_in_vm.py
  • tests/virt/node/hyperv_support/test_windows_crash_detection.py
  • tests/virt/node/log_verbosity/test_log_verbosity.py
  • tests/virt/node/log_verbosity/test_log_virt_launcher.py
  • tests/virt/node/migration_and_maintenance/test_node_maintenance.py
  • tests/virt/node/migration_and_maintenance/test_odf_vm_migration.py
  • tests/virt/node/migration_and_maintenance/test_post_copy_migration.py
  • tests/virt/node/migration_and_maintenance/test_vm_disk_load_with_migration.py
  • tests/virt/node/migration_and_maintenance/test_vm_memory_load_with_migration.py
  • tests/virt/node/node_labeller/cpu_features/test_node_feature_discovery.py
  • tests/virt/node/node_labeller/cpu_features/test_vm_with_cpu_features.py
  • tests/virt/node/node_labeller/cpu_features/test_vm_with_cpu_flag.py
  • tests/virt/node/node_labeller/test_node_labeller_annotation.py
  • tests/virt/node/readonly_disk/test_vm_with_windows_guest_tools.py
  • tests/virt/node/workload_density/test_kernel_samepage_merging.py
  • tests/virt/node/workload_density/test_swap.py
  • tests/virt/upgrade/conftest.py
  • tests/virt/upgrade/test_upgrade_virt.py
  • tests/virt/upgrade/utils.py
  • tests/virt/upgrade_custom/aaq/conftest.py
  • tests/virt/upgrade_custom/aaq/constants.py
  • tests/virt/upgrade_custom/aaq/test_upgrade_virt_aaq.py
  • tests/virt/upgrade_custom/vgpu/conftest.py
  • tests/virt/utils.py

Comment thread tests/virt/node/workload_density/test_kernel_samepage_merging.py
@vsibirsk

Copy link
Copy Markdown
Collaborator Author

/verified

collect only since it's only import path updates (no logic change)

$ uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only
...
================================================================================= 535/560 tests collected (25 deselected) in 1.35s =================================================================================

================================================================================= 535/560 tests collected (25 deselected) in 1.35s =================================================================================

@openshift-virtualization-qe-bot-3

Copy link
Copy Markdown
Contributor

@coderabbitai

Test execution plan request details

CRITICAL: You MUST post an inline review comment on the first changed line of the first file.
The inline comment should contain the full Test Execution Plan (smoke decision, gating decision, and specific affected tests).
Do NOT submit a blocking review event (REQUEST_CHANGES/APPROVE).
Post a single inline PR comment on Files Changed (non-blocking COMMENT flow).

As an expert software testing engineer, analyze all modified files in this PR and create a targeted test execution plan.
You will post an inline review comment with the test execution plan on the first changed file.
If you fail to run or post a comment, retry.

Analysis Requirements:

  1. Examine code changes in each modified file

  2. Identify affected code paths, functions, and classes

  3. Analyze pytest-specific elements: fixtures (scope, dependencies), parametrization, markers, conftest changes

  4. Trace test dependencies through imports, shared utilities, fixture inheritance, fixture teardown, and yield from cleanup in conftest

  5. Detect new tests introduced in the PR

  6. Utilities and libs impact (when utilities/ or libs/ changes):
    You MUST use shell scripts (rg, git diff) to trace the full impact.
    Follow these sub-steps in order:

    6a. Identify modified symbols: For each changed file under utilities/ or libs/,
    list every modified function or method.
    Example: git diff HEAD~1 --unified=0 -- utilities/hco.py | grep '^[+-]def '

    6b. Find direct callers: Search tests and conftest for each symbol from 6a.
    Example: rg -l 'get_hco_version' tests/

    6c. Trace fixture teardown and cleanup: Find fixtures that reach
    the modified symbol through yield from or context-manager wrappers.
    Example: rg -l 'yield from.*enable_common_boot|def.*enable_common_boot' tests/

    6d. Trace same-file callers: In each changed file, find other functions
    whose body calls a modified symbol (including code after yield
    in @contextmanager helpers).
    Example: rg 'get_hco_version|enable_common_boot' utilities/hco.py

    6e. Expand transitively: If function A calls modified B, then
    tests/fixtures that call A are affected — even when the test body
    never imports B directly.

    Do NOT limit impact to tests that import the modified symbol only.

  7. Smoke test impact: Intersect the affected set from step 6 with smoke-marked tests.
    Run: rg -l '@pytest.mark.smoke' tests/
    VERIFY the above command returned actual file paths before concluding False.
    Set True if either condition is met:

    • a smoke-marked file appears in the affected set from 6b-6e, OR
    • any conftest.py in the smoke test's parent-directory hierarchy (up to repo root)
      imports or calls a modified utilities/libs symbol — including autouse fixtures
      that depend on modified functions. ALL tests in that directory and below are affected.
      Example check: for each smoke_file, scan dirname(smoke_file)/conftest.py,
      dirname(dirname(smoke_file))/conftest.py, etc. for modified symbol imports
      and autouse fixtures that depend on modified symbols.
  8. Gating test impact: Intersect the affected set from step 6 with gating-marked tests.
    Run: rg -l '@pytest.mark.gating' tests/
    Set True if a gating-marked file also appears in the affected set from 6b-6e.
    Utilities/libs changes often affect gating tests without affecting smoke tests.
    Do NOT stop analysis after concluding Run smoke tests: False.

Output rules:
Do NOT include analysis step numbers (1-8) in your visible output.

Your deliverable:
Your inline informational comment will be based on the following requirements:

Test Execution Plan

  • Run smoke tests: True / False — If True, state the dependency path (test → fixture → changed symbol). True ONLY with a verified path.
  • Run gating tests: True / False — If True, state the dependency path. True if any gating-marked test is in the affected set.
  • Affected tests to run (required when utilities/, libs/, or shared conftest changes — list concrete paths even when smoke is False)

Use these formats:

  • path/to/test_file.py - When the entire test file needs verification
  • path/to/test_file.py::TestClass::test_method - When specific test(s) needed
  • path/to/test_file.py::test_function - When specific test(s) needed
  • -m marker - When a marker covers multiple affected tests (e.g. -m gating only if ALL gating tests in scope need run)
  • Tag each listed test or group with its marker when not obvious, e.g. (gating) or (smoke)

Real test commands (MANDATORY when changes affect session/runtime code):

When the affected code runs at session/collection time (conftest fixtures, pytest plugins,
config hooks, session-scoped setup) or modifies runtime behavior that unit tests mock away,
you MUST include concrete pytest commands the PR author must run on a real cluster
to verify the change works end-to-end. Include:

  • A command for the error/fix path (the scenario the PR fixes)
  • A command for the happy path (regression: the normal case still works)
  • Use lightweight tests (e.g., --collect-only for startup failures,
    a single small test for runtime behavior)
    If the PR only changes test logic (not utilities/libs/conftest), the affected test
    paths themselves serve as the real test commands — no separate section needed.

Example output for a session-startup fix:

**Real tests (cluster required)**
Error path (the fix):
`pytest tests/storage/.../test_foo.py --storage-class-matrix=nonexistent-sc --collect-only`
Expected: ValueError with clear message, not IndexError

Happy path (regression):
`pytest tests/storage/.../test_foo.py --storage-class-matrix=<valid-sc> -k test_bar`
Expected: session starts normally

Guidelines:

  • Include tests affected directly OR via fixture setup/teardown, yield from cleanup, or transitive utility call chains (caller calls modified helper)
  • Use a full file path only if ALL tests in that file require verification
  • Use file path + test name when only specific tests use an affected fixture or utility wrapper (preferred for partial file impact)
  • If a test marker can cover multiple files/tests, provide the marker
  • Balance coverage vs over-testing - Keep descriptions minimal
  • Example: if leaf helper foo() changes, include tests whose fixture teardown calls wrapper bar() where bar() calls foo(), even when the test body only imports an unrelated symbol from the same utilities module

Hardware-Related Checks (SR-IOV, GPU, DPDK):

When PR modifies fixtures for hardware-specific resources:

  • Collection Safety: Fixtures MUST have existence checks (return None when hardware unavailable)
  • Test Plan: MUST verify both WITH and WITHOUT hardware:
    • Run affected tests on cluster WITH hardware
    • Verify collection succeeds on cluster WITHOUT hardware

CRITICAL WORKFLOW COMPLETION RULES:

When responding to this test execution plan request, you MUST follow these rules EXACTLY:

  1. YOUR ONLY DELIVERABLE: Post one non-blocking inline comment containing the test execution plan on the first changed line
  2. THEN STOP IMMEDIATELY - Do NOT generate any additional response
  3. FALLBACK ONLY: If inline comment API calls fail after retrying, post as a regular PR comment
  4. SILENCE = SUCCESS: After successfully submitting the review, your task is complete. No confirmation needed.

ABSOLUTE PROHIBITIONS (violating these creates empty/meaningless reviews):

  • ❌ Do NOT post acknowledgment messages like "Test execution plan posted", "Review posted successfully", "I've successfully posted"
  • ❌ Do NOT mention review IDs, URLs, or confirmation of posting in the PR thread
  • ❌ Do NOT add any follow-up comments after submitting the review
  • ❌ Do NOT reply to confirm task completion
  • ❌ Do NOT explain what you did - just do it and stop

Remember: The pull request review is visible to users. Additional comments are redundant noise.

CRITICAL — Verification rules for smoke and gating decisions:
- For each True decision, you must have traced a concrete path: test file → fixture → utility function → modified symbol.
- Do NOT assume impact based on scope, file proximity, or infrastructure-sounding names.
Only set True when you trace a concrete path through steps 6a-6e, then 7 or 8.
WRONG: "utilities/hco.py changed → run smoke" (no traced dependency path)
WRONG: "Run smoke tests: False" with no affected-test list when gating tests use the changed utility
RIGHT: "Run smoke tests: False, Run gating tests: True" plus tests/.../test_foo.py::TestBar::test_baz (gating)
RIGHT: "Smoke test X uses fixture Y → wrapper Z → changed function W in utilities/hco.py"

Comment thread tests/virt/cluster/aaq/conftest.py
@coderabbitai

coderabbitai Bot commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

# Get list of changed files to find the first one
gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only | head -5

echo "---DIFF_HEADER---"
# Get the first changed file and its first changed line number
gh pr diff "$PR_NUMBER" --repo "$REPO" | head -60

Length of output: 3215


🏁 Script executed:

#!/bin/bash
set -euo pipefail

# Check for smoke markers in changed test files under tests/virt/
rg -l '`@pytest.mark.smoke`' tests/virt/ 2>/dev/null | head -20
echo "---GATING---"
rg -l '`@pytest.mark.gating`' tests/virt/ 2>/dev/null | head -20

Length of output: 1687


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

# Get the list of changed files in this PR
CHANGED_FILES=$(gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only)
echo "Changed files:"
echo "$CHANGED_FILES" | head -10

FIRST_FILE=$(echo "$CHANGED_FILES" | head -1)
echo "First file: $FIRST_FILE"

# Get the diff for the first file to find the first changed line number
gh pr diff "$PR_NUMBER" --repo "$REPO" -- "$FIRST_FILE" 2>/dev/null | head -30

Length of output: 1417


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

# Check if test_container_disk_vm.py is in the PR changes
gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only | grep -E "test_container_disk_vm|test_rhel_os_support" || echo "Not found in PR"

Length of output: 488


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

# Get the commit SHA for the PR head (needed for inline comment)
HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "Head SHA: $HEAD_SHA"

# Post a non-blocking inline review comment (COMMENT, not REQUEST_CHANGES or APPROVE)
# First changed line in tests/virt/cluster/aaq/conftest.py is position in diff
# The hunk is @@ -23,15 +23,19 @@ — first changed line ("+") is line 26 in the new file

gh api \
  --method POST \
  "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" \
  --field commit_id="$HEAD_SHA" \
  --field event="COMMENT" \
  --field "comments[][path]=tests/virt/cluster/aaq/conftest.py" \
  --field "comments[][line]=26" \
  --field "comments[][side]=RIGHT" \
  --field "comments[][body]=## Test Execution Plan

**Run smoke tests: True**
Dependency path: \`tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py\` (smoke) → imports \`LINUX_STR\` directly changed from \`utilities.constants\` to \`utilities.constants.instance_types\` in this PR.

**Run gating tests: True**
Dependency paths (gating-marked files directly modified in this PR — import paths changed):
- \`tests/virt/upgrade/test_upgrade_virt.py\`
- \`tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py\`
- \`tests/virt/cluster/vm_cloning/test_vm_cloning.py\`
- \`tests/virt/cluster/migration_and_maintenance/test_migration_policy.py\`
- \`tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py\`
- \`tests/virt/node/node_labeller/cpu_features/test_vm_with_cpu_flag.py\`
- \`tests/virt/node/node_labeller/cpu_features/test_node_feature_discovery.py\`
- \`tests/virt/node/general/test_machinetype.py\`
- \`tests/virt/node/general/test_static_ssh_key_injection.py\`
- \`tests/virt/node/general/test_disk_io_option.py\`

**Affected tests to run**

All 76 modified files under \`tests/virt/\` have import-path-only changes (no logic). The PR author already validated collection succeeds:
\`\`\`
pytest tests/virt --collect-only  # 535/560 collected ✅
\`\`\`

Prioritized subset for runtime validation:

**Smoke (verify import resolution at runtime):**
- \`tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py\` (smoke)

**Gating (verify import resolution at runtime):**
- \`tests/virt/upgrade/test_upgrade_virt.py\` (gating)
- \`tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py\` (gating)
- \`tests/virt/cluster/vm_cloning/test_vm_cloning.py\` (gating)
- \`tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py\` (gating)
- \`tests/virt/node/general/test_machinetype.py\` (gating)

**Notes:**
- No \`utilities/\` or \`libs/\` files were modified — transitive fixture impact is nil.
- \`Images\` is intentionally kept at \`utilities.constants\` (computed alias in \`__init__.py\`); no action needed.
- \`--collect-only\` passed (535/560); collection errors from bad import paths would have surfaced there." \
  2>&1

Length of output: 4913



@openshift-virtualization-qe-bot-3

Copy link
Copy Markdown
Contributor

/retest all

Auto-triggered: Files in this PR were modified by merged PR #5404.

Overlapping files

tests/virt/node/general/test_cloud_init_disk_vm.py

@vsibirsk

Copy link
Copy Markdown
Collaborator Author

/check-can-merge

@vsibirsk

Copy link
Copy Markdown
Collaborator Author

@coderabbitai review

@coderabbitai

coderabbitai Bot commented Jun 28, 2026

Copy link
Copy Markdown
Contributor
✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@vsibirsk

Copy link
Copy Markdown
Collaborator Author

/verified

#5318 (comment)

@openshift-virtualization-qe-bot-3

Copy link
Copy Markdown
Contributor

@coderabbitai

Test execution plan request details

CRITICAL: You MUST post an inline review comment on the first changed line of the first file.
The inline comment should contain the full Test Execution Plan (smoke decision, gating decision, and specific affected tests).
Do NOT submit a blocking review event (REQUEST_CHANGES/APPROVE).
Post a single inline PR comment on Files Changed (non-blocking COMMENT flow).

As an expert software testing engineer, analyze all modified files in this PR and create a targeted test execution plan.
You will post an inline review comment with the test execution plan on the first changed file.
If you fail to run or post a comment, retry.

Analysis Requirements:

  1. Examine code changes in each modified file

  2. Identify affected code paths, functions, and classes

  3. Analyze pytest-specific elements: fixtures (scope, dependencies), parametrization, markers, conftest changes

  4. Trace test dependencies through imports, shared utilities, fixture inheritance, fixture teardown, and yield from cleanup in conftest

  5. Detect new tests introduced in the PR

  6. Utilities and libs impact (when utilities/ or libs/ changes):
    You MUST use shell scripts (rg, git diff) to trace the full impact.
    Follow these sub-steps in order:

    6a. Identify modified symbols: For each changed file under utilities/ or libs/,
    list every modified function or method.
    Example: git diff HEAD~1 --unified=0 -- utilities/hco.py | grep '^[+-]def '

    6b. Find direct callers: Search tests and conftest for each symbol from 6a.
    Example: rg -l 'get_hco_version' tests/

    6c. Trace fixture teardown and cleanup: Find fixtures that reach
    the modified symbol through yield from or context-manager wrappers.
    Example: rg -l 'yield from.*enable_common_boot|def.*enable_common_boot' tests/

    6d. Trace same-file callers: In each changed file, find other functions
    whose body calls a modified symbol (including code after yield
    in @contextmanager helpers).
    Example: rg 'get_hco_version|enable_common_boot' utilities/hco.py

    6e. Expand transitively: If function A calls modified B, then
    tests/fixtures that call A are affected — even when the test body
    never imports B directly.

    Do NOT limit impact to tests that import the modified symbol only.

  7. Smoke test impact: Intersect the affected set from step 6 with smoke-marked tests.
    Run: rg -l '@pytest.mark.smoke' tests/
    VERIFY the above command returned actual file paths before concluding False.
    Set True if either condition is met:

    • a smoke-marked file appears in the affected set from 6b-6e, OR
    • any conftest.py in the smoke test's parent-directory hierarchy (up to repo root)
      imports or calls a modified utilities/libs symbol — including autouse fixtures
      that depend on modified functions. ALL tests in that directory and below are affected.
      Example check: for each smoke_file, scan dirname(smoke_file)/conftest.py,
      dirname(dirname(smoke_file))/conftest.py, etc. for modified symbol imports
      and autouse fixtures that depend on modified symbols.
  8. Gating test impact: Intersect the affected set from step 6 with gating-marked tests.
    Run: rg -l '@pytest.mark.gating' tests/
    Set True if a gating-marked file also appears in the affected set from 6b-6e.
    Utilities/libs changes often affect gating tests without affecting smoke tests.
    Do NOT stop analysis after concluding Run smoke tests: False.

Output rules:
Do NOT include analysis step numbers (1-8) in your visible output.

Your deliverable:
Your inline informational comment will be based on the following requirements:

Test Execution Plan

  • Run smoke tests: True / False — If True, state the dependency path (test → fixture → changed symbol). True ONLY with a verified path.
  • Run gating tests: True / False — If True, state the dependency path. True if any gating-marked test is in the affected set.
  • Affected tests to run (required when utilities/, libs/, or shared conftest changes — list concrete paths even when smoke is False)

Use these formats:

  • path/to/test_file.py - When the entire test file needs verification
  • path/to/test_file.py::TestClass::test_method - When specific test(s) needed
  • path/to/test_file.py::test_function - When specific test(s) needed
  • -m marker - When a marker covers multiple affected tests (e.g. -m gating only if ALL gating tests in scope need run)
  • Tag each listed test or group with its marker when not obvious, e.g. (gating) or (smoke)

Real test commands (MANDATORY when changes affect session/runtime code):

When the affected code runs at session/collection time (conftest fixtures, pytest plugins,
config hooks, session-scoped setup) or modifies runtime behavior that unit tests mock away,
you MUST include concrete pytest commands the PR author must run on a real cluster
to verify the change works end-to-end. Include:

  • A command for the error/fix path (the scenario the PR fixes)
  • A command for the happy path (regression: the normal case still works)
  • Use lightweight tests (e.g., --collect-only for startup failures,
    a single small test for runtime behavior)
    If the PR only changes test logic (not utilities/libs/conftest), the affected test
    paths themselves serve as the real test commands — no separate section needed.

Example output for a session-startup fix:

**Real tests (cluster required)**
Error path (the fix):
`pytest tests/storage/.../test_foo.py --storage-class-matrix=nonexistent-sc --collect-only`
Expected: ValueError with clear message, not IndexError

Happy path (regression):
`pytest tests/storage/.../test_foo.py --storage-class-matrix=<valid-sc> -k test_bar`
Expected: session starts normally

Guidelines:

  • Include tests affected directly OR via fixture setup/teardown, yield from cleanup, or transitive utility call chains (caller calls modified helper)
  • Use a full file path only if ALL tests in that file require verification
  • Use file path + test name when only specific tests use an affected fixture or utility wrapper (preferred for partial file impact)
  • If a test marker can cover multiple files/tests, provide the marker
  • Balance coverage vs over-testing - Keep descriptions minimal
  • Example: if leaf helper foo() changes, include tests whose fixture teardown calls wrapper bar() where bar() calls foo(), even when the test body only imports an unrelated symbol from the same utilities module

Hardware-Related Checks (SR-IOV, GPU, DPDK):

When PR modifies fixtures for hardware-specific resources:

  • Collection Safety: Fixtures MUST have existence checks (return None when hardware unavailable)
  • Test Plan: MUST verify both WITH and WITHOUT hardware:
    • Run affected tests on cluster WITH hardware
    • Verify collection succeeds on cluster WITHOUT hardware

CRITICAL WORKFLOW COMPLETION RULES:

When responding to this test execution plan request, you MUST follow these rules EXACTLY:

  1. YOUR ONLY DELIVERABLE: Post one non-blocking inline comment containing the test execution plan on the first changed line
  2. THEN STOP IMMEDIATELY - Do NOT generate any additional response
  3. FALLBACK ONLY: If inline comment API calls fail after retrying, post as a regular PR comment
  4. SILENCE = SUCCESS: After successfully submitting the review, your task is complete. No confirmation needed.

ABSOLUTE PROHIBITIONS (violating these creates empty/meaningless reviews):

  • ❌ Do NOT post acknowledgment messages like "Test execution plan posted", "Review posted successfully", "I've successfully posted"
  • ❌ Do NOT mention review IDs, URLs, or confirmation of posting in the PR thread
  • ❌ Do NOT add any follow-up comments after submitting the review
  • ❌ Do NOT reply to confirm task completion
  • ❌ Do NOT explain what you did - just do it and stop

Remember: The pull request review is visible to users. Additional comments are redundant noise.

CRITICAL — Verification rules for smoke and gating decisions:
- For each True decision, you must have traced a concrete path: test file → fixture → utility function → modified symbol.
- Do NOT assume impact based on scope, file proximity, or infrastructure-sounding names.
Only set True when you trace a concrete path through steps 6a-6e, then 7 or 8.
WRONG: "utilities/hco.py changed → run smoke" (no traced dependency path)
WRONG: "Run smoke tests: False" with no affected-test list when gating tests use the changed utility
RIGHT: "Run smoke tests: False, Run gating tests: True" plus tests/.../test_foo.py::TestBar::test_baz (gating)
RIGHT: "Smoke test X uses fixture Y → wrapper Z → changed function W in utilities/hco.py"

@coderabbitai

coderabbitai Bot commented Jun 28, 2026

Copy link
Copy Markdown
Contributor

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

echo "== Changed files =="
gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only | tee /tmp/changed_files.txt

FIRST_FILE=$(head -n1 /tmp/changed_files.txt)
echo "== First changed file =="
echo "$FIRST_FILE"

echo "== First file diff header =="
gh pr diff "$PR_NUMBER" --repo "$REPO" -- "$FIRST_FILE" | sed -n '1,80p'

echo "== Smoke-marked changed files =="
python - <<'PY'
from pathlib import Path
changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
for path in changed:
    p = Path(path)
    if p.exists() and p.suffix == ".py":
        try:
            text = p.read_text()
        except Exception:
            continue
        if "`@pytest.mark.smoke`" in text:
            print(path)
PY

echo "== Gating-marked changed files =="
python - <<'PY'
from pathlib import Path
changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
for path in changed:
    p = Path(path)
    if p.exists() and p.suffix == ".py":
        try:
            text = p.read_text()
        except Exception:
            continue
        if "`@pytest.mark.gating`" in text:
            print(path)
PY

echo "== Changed conftest files =="
grep '/conftest.py$' /tmp/changed_files.txt || true

echo "== Sample smoke files under affected changed-conftest hierarchies =="
python - <<'PY'
from pathlib import Path
import itertools

changed = [Path(line.strip()) for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
conftests = [p for p in changed if p.name == 'conftest.py']
seen = set()
for conf in conftests:
    root = conf.parent
    for test in root.rglob('test_*.py'):
        try:
            text = test.read_text()
        except Exception:
            continue
        if "`@pytest.mark.smoke`" in text and str(test) not in seen:
            print(f"{conf} -> {test}")
            seen.add(str(test))
            break
PY

echo "== Sample gating files under affected changed-conftest hierarchies =="
python - <<'PY'
from pathlib import Path
import itertools

changed = [Path(line.strip()) for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
conftests = [p for p in changed if p.name == 'conftest.py']
seen = set()
for conf in conftests:
    root = conf.parent
    for test in root.rglob('test_*.py'):
        try:
            text = test.read_text()
        except Exception:
            continue
        if "`@pytest.mark.gating`" in text and str(test) not in seen:
            print(f"{conf} -> {test}")
            seen.add(str(test))
            break
PY

echo "== utilities/libs changes =="
grep -E '^(utilities|libs)/' /tmp/changed_files.txt || true

HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "== Head SHA =="
echo "$HEAD_SHA"

# Determine first added line number in the first changed file from the patch using GitHub API.
python - <<'PY' > /tmp/first_line.txt
import json, subprocess, re, sys
repo = "RedHatQE/openshift-virtualization-tests"
pr = "5318"
first_file = open('/tmp/changed_files.txt').read().splitlines()[0].strip()
data = subprocess.check_output(["gh","api",f"/repos/{repo}/pulls/{pr}/files","--paginate"])
files = json.loads(data)
target = next(f for f in files if f["filename"] == first_file)
patch = target["patch"]
new_line = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        print(new_line)
        sys.exit(0)
    if not line.startswith('-'):
        new_line += 1
raise SystemExit("Could not determine first added line")
PY
FIRST_LINE=$(cat /tmp/first_line.txt)
echo "== First changed line (new file side) =="
echo "$FIRST_LINE"

cat > /tmp/tep_comment.md <<'EOF'
## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) directly changed in this PR: test module import → `utilities.constants.instance_types.LINUX_STR`
- `tests/virt/node/conftest.py` changed at directory scope and affects smoke tests beneath `tests/virt/node/`; representative path: `tests/virt/node/<smoke test>` → `tests/virt/node/conftest.py` collection/setup import → `utilities.constants.architecture.AMD_64`

**Run gating tests: True**  
Verified paths:
- Directly changed gating files, for example:
  - `tests/virt/upgrade/test_upgrade_virt.py` (gating) → direct import change to `utilities.constants.hco.DATA_SOURCE_NAME` / `utilities.constants.pytest.DEPENDENCY_SCOPE_SESSION`
  - `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) → direct import change to `utilities.constants.timeouts.TIMEOUT_10MIN`
  - `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) → direct import change to `utilities.constants.instance_types.RHEL_WITH_INSTANCETYPE_AND_PREFERENCE`
- Changed conftest files also widen impact for tests collected under their directories, including gating-marked tests under `tests/virt/node/` and `tests/virt/upgrade*/`.

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/upgrade/test_upgrade_virt.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/node_labeller/cpu_features/test_node_feature_discovery.py` (gating)
- `tests/virt/node/node_labeller/cpu_features/test_vm_with_cpu_flag.py` (gating)

**Real tests (cluster required)**  
Error path (collection/import validation across changed conftest + test modules):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (runtime regression on representative smoke + gating coverage):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/upgrade/test_upgrade_virt.py tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py tests/virt/node/general/test_machinetype.py`  
Expected: selected smoke/gating tests start and import/setup succeeds on a real cluster.

**Why this scope**
- **CRITICAL:** changed `conftest.py` files execute during collection/setup, so import-path regressions can break entire directory trees even without logic changes.
- **HIGH:** several changed files are themselves smoke/gating tests, so direct runtime import verification is warranted.
- **LOW:** no `utilities/` or `libs/` implementation files changed, no new tests were added, and the diff is import-path-only.
EOF

echo "== Comment body preview =="
sed -n '1,220p' /tmp/tep_comment.md

echo "== Posting inline review comment =="
gh api \
  --method POST \
  "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" \
  --field commit_id="$HEAD_SHA" \
  --field event="COMMENT" \
  --field "comments[][path]=$FIRST_FILE" \
  --field "comments[][line]=$FIRST_LINE" \
  --field "comments[][side]=RIGHT" \
  --raw-field "comments[][body]=$(cat /tmp/tep_comment.md)"

Length of output: 8176


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only > /tmp/changed_files.txt

echo "== Changed files (first 20) =="
sed -n '1,20p' /tmp/changed_files.txt

FIRST_FILE=$(sed -n '1p' /tmp/changed_files.txt)
echo "== First changed file =="
echo "$FIRST_FILE"

echo "== First file diff header =="
gh pr diff "$PR_NUMBER" --repo "$REPO" -- "$FIRST_FILE" | sed -n '1,80p'

echo "== Smoke-marked files in repo =="
rg -l '`@pytest`\.mark\.smoke' tests/ | sed -n '1,40p' > /tmp/all_smoke.txt
sed -n '1,20p' /tmp/all_smoke.txt

echo "== Gating-marked files in repo =="
rg -l '`@pytest`\.mark\.gating' tests/ | sed -n '1,60p' > /tmp/all_gating.txt
sed -n '1,25p' /tmp/all_gating.txt

python - <<'PY'
from pathlib import Path

changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
all_smoke = set(Path('/tmp/all_smoke.txt').read_text().splitlines())
all_gating = set(Path('/tmp/all_gating.txt').read_text().splitlines())

changed_smoke = [p for p in changed if p in all_smoke]
changed_gating = [p for p in changed if p in all_gating]
changed_conftests = [p for p in changed if p.endswith('/conftest.py')]

print("== Changed smoke-marked files ==")
for p in changed_smoke:
    print(p)

print("== Changed gating-marked files ==")
for p in changed_gating:
    print(p)

print("== Changed conftest files ==")
for p in changed_conftests:
    print(p)

print("== Concrete smoke descendants under changed conftest hierarchies ==")
for conf in changed_conftests:
    root = Path(conf).parent
    found = []
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.smoke`' in text:
            found.append(str(test))
    if found:
        print(f"{conf} -> {found[0]}")
        if len(found) > 1:
            print(f"{conf} -> (+{len(found)-1} more smoke files)")

print("== Concrete gating descendants under changed conftest hierarchies ==")
for conf in changed_conftests:
    root = Path(conf).parent
    found = []
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.gating`' in text:
            found.append(str(test))
    if found:
        print(f"{conf} -> {found[0]}")
        if len(found) > 1:
            print(f"{conf} -> (+{len(found)-1} more gating files)")
PY

echo "== utilities/libs changes =="
grep -E '^(utilities|libs)/' /tmp/changed_files.txt || true

HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "== Head SHA =="
echo "$HEAD_SHA"

python - <<'PY' > /tmp/first_line.txt
import json, subprocess, re, sys
repo = "RedHatQE/openshift-virtualization-tests"
pr = "5318"
first_file = open('/tmp/changed_files.txt').read().splitlines()[0].strip()
data = subprocess.check_output(["gh","api",f"/repos/{repo}/pulls/{pr}/files","--paginate"])
files = json.loads(data)
target = next(f for f in files if f["filename"] == first_file)
patch = target["patch"]
new_line = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        print(new_line)
        sys.exit(0)
    if not line.startswith('-'):
        new_line += 1
raise SystemExit("Could not determine first added line")
PY
FIRST_LINE=$(cat /tmp/first_line.txt)
echo "== First changed line (new side) =="
echo "$FIRST_LINE"

python - <<'PY' > /tmp/tep_comment.md
from pathlib import Path

changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
all_smoke = set(Path('/tmp/all_smoke.txt').read_text().splitlines())
all_gating = set(Path('/tmp/all_gating.txt').read_text().splitlines())

changed_smoke = [p for p in changed if p in all_smoke]
changed_gating = [p for p in changed if p in all_gating]
changed_conftests = [p for p in changed if p.endswith('/conftest.py')]

smoke_desc = []
gating_desc = []
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.smoke`' in text:
            smoke_desc.append((conf, str(test)))
            break
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.gating`' in text:
            gating_desc.append((conf, str(test)))
            break

lines = []
lines.append("## Test Execution Plan")
lines.append("")
if changed_smoke or smoke_desc:
    lines.append("**Run smoke tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_smoke[:3]:
        lines.append(f"- `{p}` (smoke) -> direct module import updated in this PR")
    for conf, test in smoke_desc[:2]:
        lines.append(f"- `{test}` (smoke) -> parent `{conf}` changed -> collection/setup imports updated in this PR")
else:
    lines.append("**Run smoke tests: False**  ")
    lines.append("No smoke-marked changed file or verified smoke descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

if changed_gating or gating_desc:
    lines.append("**Run gating tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_gating[:5]:
        lines.append(f"- `{p}` (gating) -> direct module import updated in this PR")
    for conf, test in gating_desc[:2]:
        lines.append(f"- `{test}` (gating) -> parent `{conf}` changed -> collection/setup imports updated in this PR")
else:
    lines.append("**Run gating tests: False**  ")
    lines.append("No gating-marked changed file or verified gating descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

lines.append("**Affected tests to run**")
picked = []
for p in changed_smoke[:3] + changed_gating[:8]:
    if p not in picked:
        picked.append(p)
for conf, test in smoke_desc[:1] + gating_desc[:3]:
    if test not in picked:
        picked.append(test)
for p in picked:
    marker = []
    if p in all_smoke:
        marker.append("smoke")
    if p in all_gating:
        marker.append("gating")
    suffix = f" ({', '.join(marker)})" if marker else ""
    lines.append(f"- `{p}`{suffix}")

lines.append("")
lines.append("**Real tests (cluster required)**")
lines.append("Error path (collection/import validation):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  ")
lines.append("Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.")
lines.append("")
happy_targets = picked[:4] if picked else ["tests/virt"]
lines.append("Happy path (representative runtime regression):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test " + " ".join(happy_targets) + "`  ")
lines.append("Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.")
lines.append("")
lines.append("**Why this scope**")
lines.append("- **CRITICAL:** changed `conftest.py` files run during collection/setup, so bad import rewrites can break directory-wide test startup.")
lines.append("- **HIGH:** directly changed smoke/gating tests should be exercised because their imports now resolve through different constants submodules.")
lines.append("- **LOW:** no `utilities/` or `libs/` implementation files changed, and no new tests were added.")

print("\n".join(lines))
PY

echo "== Comment body preview =="
sed -n '1,240p' /tmp/tep_comment.md

set +e
INLINE_OUT=$(gh api \
  --method POST \
  "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" \
  --field commit_id="$HEAD_SHA" \
  --field event="COMMENT" \
  --field "comments[][path]=$FIRST_FILE" \
  --field "comments[][line]=$FIRST_LINE" \
  --field "comments[][side]=RIGHT" \
  --raw-field "comments[][body]=$(cat /tmp/tep_comment.md)" 2>&1)
STATUS=$?
set -e

echo "== Inline review API status =="
echo "$STATUS"
echo "$INLINE_OUT"

if [ "$STATUS" -ne 0 ]; then
  echo "== Inline failed, falling back to regular PR comment =="
  gh pr comment "$PR_NUMBER" --repo "$REPO" --body-file /tmp/tep_comment.md
fi

Length of output: 10461


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

gh api "/repos/${REPO}/pulls/${PR_NUMBER}/files?per_page=100" > /tmp/pr_files.json

python - <<'PY'
import json, re
from pathlib import Path

files = json.loads(Path('/tmp/pr_files.json').read_text())
changed = [f["filename"] for f in files]
Path('/tmp/changed_files.txt').write_text("\n".join(changed) + "\n")

print("== Changed files (first 20) ==")
for p in changed[:20]:
    print(p)

first = files[0]
print("== First changed file ==")
print(first["filename"])

print("== First file patch header ==")
patch = first.get("patch", "")
for line in patch.splitlines()[:40]:
    print(line)

new_line = None
first_added = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        first_added = new_line
        break
    if not line.startswith('-'):
        new_line += 1
if first_added is None:
    raise SystemExit("Could not determine first added line")
Path('/tmp/first_file.txt').write_text(first["filename"] + "\n")
Path('/tmp/first_line.txt').write_text(str(first_added) + "\n")
print("== First changed line (new side) ==")
print(first_added)
PY

echo "== Smoke-marked files in repo =="
rg -l '`@pytest`\.mark\.smoke' tests/ > /tmp/all_smoke.txt
sed -n '1,20p' /tmp/all_smoke.txt

echo "== Gating-marked files in repo =="
rg -l '`@pytest`\.mark\.gating' tests/ > /tmp/all_gating.txt
sed -n '1,25p' /tmp/all_gating.txt

python - <<'PY'
from pathlib import Path

changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
all_smoke = set(Path('/tmp/all_smoke.txt').read_text().splitlines())
all_gating = set(Path('/tmp/all_gating.txt').read_text().splitlines())

changed_smoke = [p for p in changed if p in all_smoke]
changed_gating = [p for p in changed if p in all_gating]
changed_conftests = [p for p in changed if p.endswith('/conftest.py')]

print("== Changed smoke-marked files ==")
for p in changed_smoke:
    print(p)

print("== Changed gating-marked files ==")
for p in changed_gating:
    print(p)

print("== Changed conftest files ==")
for p in changed_conftests:
    print(p)

smoke_desc = []
gating_desc = []
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.smoke`' in text:
            smoke_desc.append((conf, str(test)))
            break
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.gating`' in text:
            gating_desc.append((conf, str(test)))
            break

print("== Concrete smoke descendants under changed conftest hierarchies ==")
for conf, test in smoke_desc:
    print(f"{conf} -> {test}")

print("== Concrete gating descendants under changed conftest hierarchies ==")
for conf, test in gating_desc:
    print(f"{conf} -> {test}")

# Persist for comment generation
Path('/tmp/changed_smoke.txt').write_text("\n".join(changed_smoke) + ("\n" if changed_smoke else ""))
Path('/tmp/changed_gating.txt').write_text("\n".join(changed_gating) + ("\n" if changed_gating else ""))
Path('/tmp/smoke_desc.txt').write_text("\n".join(f"{c}|{t}" for c,t in smoke_desc) + ("\n" if smoke_desc else ""))
Path('/tmp/gating_desc.txt').write_text("\n".join(f"{c}|{t}" for c,t in gating_desc) + ("\n" if gating_desc else ""))
PY

echo "== utilities/libs changes =="
grep -E '^(utilities|libs)/' /tmp/changed_files.txt || true

HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "== Head SHA =="
echo "$HEAD_SHA"
printf '%s\n' "$HEAD_SHA" > /tmp/head_sha.txt

python - <<'PY'
import json
from pathlib import Path

def read_lines(path):
    p = Path(path)
    if not p.exists():
        return []
    return [line.strip() for line in p.read_text().splitlines() if line.strip()]

changed_smoke = read_lines('/tmp/changed_smoke.txt')
changed_gating = read_lines('/tmp/changed_gating.txt')
all_smoke = set(read_lines('/tmp/all_smoke.txt'))
all_gating = set(read_lines('/tmp/all_gating.txt'))

def read_pairs(path):
    p = Path(path)
    if not p.exists():
        return []
    pairs = []
    for line in p.read_text().splitlines():
        if not line.strip():
            continue
        c, t = line.split('|', 1)
        pairs.append((c, t))
    return pairs

smoke_desc = read_pairs('/tmp/smoke_desc.txt')
gating_desc = read_pairs('/tmp/gating_desc.txt')

lines = []
lines.append("## Test Execution Plan")
lines.append("")

if changed_smoke or smoke_desc:
    lines.append("**Run smoke tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_smoke[:4]:
        lines.append(f"- `{p}` (smoke) -> direct import path update in this PR")
    for conf, test in smoke_desc[:2]:
        lines.append(f"- `{test}` (smoke) -> parent `{conf}` changed -> collection/setup import path update")
else:
    lines.append("**Run smoke tests: False**  ")
    lines.append("No verified smoke-marked changed file or smoke descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

if changed_gating or gating_desc:
    lines.append("**Run gating tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_gating[:6]:
        lines.append(f"- `{p}` (gating) -> direct import path update in this PR")
    for conf, test in gating_desc[:3]:
        lines.append(f"- `{test}` (gating) -> parent `{conf}` changed -> collection/setup import path update")
else:
    lines.append("**Run gating tests: False**  ")
    lines.append("No verified gating-marked changed file or gating descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

lines.append("**Affected tests to run**")
picked = []
for p in changed_smoke[:4] + changed_gating[:8]:
    if p not in picked:
        picked.append(p)
for _, test in smoke_desc[:2] + gating_desc[:4]:
    if test not in picked:
        picked.append(test)
for p in picked:
    marker = []
    if p in all_smoke:
        marker.append("smoke")
    if p in all_gating:
        marker.append("gating")
    suffix = f" ({', '.join(marker)})" if marker else ""
    lines.append(f"- `{p}`{suffix}")

lines.append("")
lines.append("**Real tests (cluster required)**")
lines.append("Error path (collection/import validation):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  ")
lines.append("Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.")
lines.append("")
happy_targets = picked[:4] if picked else ["tests/virt"]
lines.append("Happy path (representative runtime regression):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test " + " ".join(happy_targets) + "`  ")
lines.append("Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.")
lines.append("")
lines.append("**Why this scope**")
lines.append("- **CRITICAL:** changed `conftest.py` files run during collection/setup, so import-path regressions can break directory-wide startup.")
lines.append("- **HIGH:** directly changed smoke/gating tests should be exercised because their imports now resolve through different constants submodules.")
lines.append("- **LOW:** no `utilities/` or `libs/` implementation files changed, and no new tests were added.")

body = "\n".join(lines)
Path('/tmp/tep_comment.md').write_text(body)

payload = {
    "commit_id": Path('/tmp/head_sha.txt').read_text().strip(),
    "event": "COMMENT",
    "comments": [
        {
            "path": Path('/tmp/first_file.txt').read_text().strip(),
            "line": int(Path('/tmp/first_line.txt').read_text().strip()),
            "side": "RIGHT",
            "body": body,
        }
    ],
}
Path('/tmp/review_payload.json').write_text(json.dumps(payload))
print("== Comment body preview ==")
print(body)
PY

echo "== Posting inline review comment =="
set +e
gh api --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" --input /tmp/review_payload.json
STATUS=$?
set -e
echo "== Inline review API status =="
echo "$STATUS"

if [ "$STATUS" -ne 0 ]; then
  echo "== Inline failed, falling back to regular PR comment =="
  gh pr comment "$PR_NUMBER" --repo "$REPO" --body-file /tmp/tep_comment.md
fi

Length of output: 19958


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

# Rebuild minimal metadata if temp files are missing
if [ ! -f /tmp/first_file.txt ] || [ ! -f /tmp/first_line.txt ] || [ ! -f /tmp/head_sha.txt ] || [ ! -f /tmp/tep_comment.md ]; then
  gh api "/repos/${REPO}/pulls/${PR_NUMBER}/files?per_page=100" > /tmp/pr_files.json
  python - <<'PY'
import json, re
from pathlib import Path

files = json.loads(Path('/tmp/pr_files.json').read_text())
first = files[0]
patch = first.get("patch", "")
new_line = None
first_added = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        first_added = new_line
        break
    if not line.startswith('-'):
        new_line += 1

Path('/tmp/first_file.txt').write_text(first["filename"] + "\n")
Path('/tmp/first_line.txt').write_text(str(first_added) + "\n")
PY
  gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid' > /tmp/head_sha.txt
fi

echo "== Target inline location =="
cat /tmp/first_file.txt
cat /tmp/first_line.txt
cat /tmp/head_sha.txt

echo "== Comment preview =="
sed -n '1,220p' /tmp/tep_comment.md

FIRST_FILE=$(tr -d '\n' < /tmp/first_file.txt)
FIRST_LINE=$(tr -d '\n' < /tmp/first_line.txt)
HEAD_SHA=$(tr -d '\n' < /tmp/head_sha.txt)

python - <<'PY'
import json
from pathlib import Path

payload = {
    "body": Path("/tmp/tep_comment.md").read_text(),
    "commit_id": Path("/tmp/head_sha.txt").read_text().strip(),
    "path": Path("/tmp/first_file.txt").read_text().strip(),
    "line": int(Path("/tmp/first_line.txt").read_text().strip()),
    "side": "RIGHT",
}
Path("/tmp/inline_comment_payload.json").write_text(json.dumps(payload))
print(Path("/tmp/inline_comment_payload.json").read_text())
PY

echo "== Attempt 1: REST inline review comment endpoint =="
set +e
INLINE_OUT=$(gh api --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/comments" --input /tmp/inline_comment_payload.json 2>&1)
INLINE_STATUS=$?
set -e
echo "$INLINE_OUT"
echo "inline_status=$INLINE_STATUS"

if [ "$INLINE_STATUS" -eq 0 ]; then
  exit 0
fi

python - <<'PY'
import json
from pathlib import Path
payload = {
    "body": Path("/tmp/tep_comment.md").read_text()
}
Path("/tmp/issue_comment_payload.json").write_text(json.dumps(payload))
print(Path("/tmp/issue_comment_payload.json").read_text())
PY

echo "== Attempt 2: REST PR issue comment endpoint fallback =="
set +e
ISSUE_OUT=$(gh api --method POST "/repos/${REPO}/issues/${PR_NUMBER}/comments" --input /tmp/issue_comment_payload.json 2>&1)
ISSUE_STATUS=$?
set -e
echo "$ISSUE_OUT"
echo "issue_status=$ISSUE_STATUS"

exit 0

Length of output: 15803



@openshift-virtualization-qe-bot-3

CRITICAL: I could not complete the posting step because the current GitHub integration does not have comment-write permission on PR #5318.

Both required write paths failed with the same blocker:

  • Inline review comment API: 403 Resource not accessible by integration
  • Regular PR comment fallback: 403 Resource not accessible by integration

This matters because the workflow rule requires an actual posted comment on the PR, and a local analysis alone does not satisfy that requirement.

Prepared inline comment target:

  • File: tests/virt/cluster/aaq/conftest.py
  • Line 26

Prepared Test Execution Plan content:

## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> direct import path update in this PR
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import path update
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/conftest.py` changed -> collection/setup import path update

**Run gating tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) -> direct import path update in this PR
- `tests/virt/node/general/test_disk_io_option.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import path update
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> parent `tests/virt/cluster/vm_cloning/conftest.py` changed -> collection/setup import path update
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> parent `tests/virt/conftest.py` changed -> collection/setup import path update

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)
- `tests/virt/node/cpu_sockets_threads/test_cpu_support_sockets_threads.py` (gating)

**Real tests (cluster required)**
Error path (collection/import validation):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (representative runtime regression):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/cluster/common_templates/general/test_base_template.py tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py tests/virt/cluster/migration_and_maintenance/test_migration_policy.py`  
Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.

**Why this scope**
- **CRITICAL:** changed `conftest.py` files run during collection/setup, so import-path regressions can break directory-wide startup.
- **HIGH:** directly changed smoke/gating tests should be exercised because their imports now resolve through different constants submodules.
- **LOW:** no `utilities/` or `libs/` implementation files changed, and no new tests were added.

@rnetser

rnetser commented Jun 28, 2026

Copy link
Copy Markdown
Collaborator

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain
🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

echo "== Changed files =="
gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only | tee /tmp/changed_files.txt

FIRST_FILE=$(head -n1 /tmp/changed_files.txt)
echo "== First changed file =="
echo "$FIRST_FILE"

echo "== First file diff header =="
gh pr diff "$PR_NUMBER" --repo "$REPO" -- "$FIRST_FILE" | sed -n '1,80p'

echo "== Smoke-marked changed files =="
python - <<'PY'
from pathlib import Path
changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
for path in changed:
    p = Path(path)
    if p.exists() and p.suffix == ".py":
        try:
            text = p.read_text()
        except Exception:
            continue
        if "`@pytest.mark.smoke`" in text:
            print(path)
PY

echo "== Gating-marked changed files =="
python - <<'PY'
from pathlib import Path
changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
for path in changed:
    p = Path(path)
    if p.exists() and p.suffix == ".py":
        try:
            text = p.read_text()
        except Exception:
            continue
        if "`@pytest.mark.gating`" in text:
            print(path)
PY

echo "== Changed conftest files =="
grep '/conftest.py$' /tmp/changed_files.txt || true

echo "== Sample smoke files under affected changed-conftest hierarchies =="
python - <<'PY'
from pathlib import Path
import itertools

changed = [Path(line.strip()) for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
conftests = [p for p in changed if p.name == 'conftest.py']
seen = set()
for conf in conftests:
    root = conf.parent
    for test in root.rglob('test_*.py'):
        try:
            text = test.read_text()
        except Exception:
            continue
        if "`@pytest.mark.smoke`" in text and str(test) not in seen:
            print(f"{conf} -> {test}")
            seen.add(str(test))
            break
PY

echo "== Sample gating files under affected changed-conftest hierarchies =="
python - <<'PY'
from pathlib import Path
import itertools

changed = [Path(line.strip()) for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
conftests = [p for p in changed if p.name == 'conftest.py']
seen = set()
for conf in conftests:
    root = conf.parent
    for test in root.rglob('test_*.py'):
        try:
            text = test.read_text()
        except Exception:
            continue
        if "`@pytest.mark.gating`" in text and str(test) not in seen:
            print(f"{conf} -> {test}")
            seen.add(str(test))
            break
PY

echo "== utilities/libs changes =="
grep -E '^(utilities|libs)/' /tmp/changed_files.txt || true

HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "== Head SHA =="
echo "$HEAD_SHA"

# Determine first added line number in the first changed file from the patch using GitHub API.
python - <<'PY' > /tmp/first_line.txt
import json, subprocess, re, sys
repo = "RedHatQE/openshift-virtualization-tests"
pr = "5318"
first_file = open('/tmp/changed_files.txt').read().splitlines()[0].strip()
data = subprocess.check_output(["gh","api",f"/repos/{repo}/pulls/{pr}/files","--paginate"])
files = json.loads(data)
target = next(f for f in files if f["filename"] == first_file)
patch = target["patch"]
new_line = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        print(new_line)
        sys.exit(0)
    if not line.startswith('-'):
        new_line += 1
raise SystemExit("Could not determine first added line")
PY
FIRST_LINE=$(cat /tmp/first_line.txt)
echo "== First changed line (new file side) =="
echo "$FIRST_LINE"

cat > /tmp/tep_comment.md <<'EOF'
## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) directly changed in this PR: test module import → `utilities.constants.instance_types.LINUX_STR`
- `tests/virt/node/conftest.py` changed at directory scope and affects smoke tests beneath `tests/virt/node/`; representative path: `tests/virt/node/<smoke test>` → `tests/virt/node/conftest.py` collection/setup import → `utilities.constants.architecture.AMD_64`

**Run gating tests: True**  
Verified paths:
- Directly changed gating files, for example:
  - `tests/virt/upgrade/test_upgrade_virt.py` (gating) → direct import change to `utilities.constants.hco.DATA_SOURCE_NAME` / `utilities.constants.pytest.DEPENDENCY_SCOPE_SESSION`
  - `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) → direct import change to `utilities.constants.timeouts.TIMEOUT_10MIN`
  - `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) → direct import change to `utilities.constants.instance_types.RHEL_WITH_INSTANCETYPE_AND_PREFERENCE`
- Changed conftest files also widen impact for tests collected under their directories, including gating-marked tests under `tests/virt/node/` and `tests/virt/upgrade*/`.

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/upgrade/test_upgrade_virt.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/node_labeller/cpu_features/test_node_feature_discovery.py` (gating)
- `tests/virt/node/node_labeller/cpu_features/test_vm_with_cpu_flag.py` (gating)

**Real tests (cluster required)**  
Error path (collection/import validation across changed conftest + test modules):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (runtime regression on representative smoke + gating coverage):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/upgrade/test_upgrade_virt.py tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py tests/virt/node/general/test_machinetype.py`  
Expected: selected smoke/gating tests start and import/setup succeeds on a real cluster.

**Why this scope**
- **CRITICAL:** changed `conftest.py` files execute during collection/setup, so import-path regressions can break entire directory trees even without logic changes.
- **HIGH:** several changed files are themselves smoke/gating tests, so direct runtime import verification is warranted.
- **LOW:** no `utilities/` or `libs/` implementation files changed, no new tests were added, and the diff is import-path-only.
EOF

echo "== Comment body preview =="
sed -n '1,220p' /tmp/tep_comment.md

echo "== Posting inline review comment =="
gh api \
  --method POST \
  "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" \
  --field commit_id="$HEAD_SHA" \
  --field event="COMMENT" \
  --field "comments[][path]=$FIRST_FILE" \
  --field "comments[][line]=$FIRST_LINE" \
  --field "comments[][side]=RIGHT" \
  --raw-field "comments[][body]=$(cat /tmp/tep_comment.md)"

Length of output: 8176

🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

gh pr diff "$PR_NUMBER" --repo "$REPO" --name-only > /tmp/changed_files.txt

echo "== Changed files (first 20) =="
sed -n '1,20p' /tmp/changed_files.txt

FIRST_FILE=$(sed -n '1p' /tmp/changed_files.txt)
echo "== First changed file =="
echo "$FIRST_FILE"

echo "== First file diff header =="
gh pr diff "$PR_NUMBER" --repo "$REPO" -- "$FIRST_FILE" | sed -n '1,80p'

echo "== Smoke-marked files in repo =="
rg -l '`@pytest`\.mark\.smoke' tests/ | sed -n '1,40p' > /tmp/all_smoke.txt
sed -n '1,20p' /tmp/all_smoke.txt

echo "== Gating-marked files in repo =="
rg -l '`@pytest`\.mark\.gating' tests/ | sed -n '1,60p' > /tmp/all_gating.txt
sed -n '1,25p' /tmp/all_gating.txt

python - <<'PY'
from pathlib import Path

changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
all_smoke = set(Path('/tmp/all_smoke.txt').read_text().splitlines())
all_gating = set(Path('/tmp/all_gating.txt').read_text().splitlines())

changed_smoke = [p for p in changed if p in all_smoke]
changed_gating = [p for p in changed if p in all_gating]
changed_conftests = [p for p in changed if p.endswith('/conftest.py')]

print("== Changed smoke-marked files ==")
for p in changed_smoke:
    print(p)

print("== Changed gating-marked files ==")
for p in changed_gating:
    print(p)

print("== Changed conftest files ==")
for p in changed_conftests:
    print(p)

print("== Concrete smoke descendants under changed conftest hierarchies ==")
for conf in changed_conftests:
    root = Path(conf).parent
    found = []
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.smoke`' in text:
            found.append(str(test))
    if found:
        print(f"{conf} -> {found[0]}")
        if len(found) > 1:
            print(f"{conf} -> (+{len(found)-1} more smoke files)")

print("== Concrete gating descendants under changed conftest hierarchies ==")
for conf in changed_conftests:
    root = Path(conf).parent
    found = []
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.gating`' in text:
            found.append(str(test))
    if found:
        print(f"{conf} -> {found[0]}")
        if len(found) > 1:
            print(f"{conf} -> (+{len(found)-1} more gating files)")
PY

echo "== utilities/libs changes =="
grep -E '^(utilities|libs)/' /tmp/changed_files.txt || true

HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "== Head SHA =="
echo "$HEAD_SHA"

python - <<'PY' > /tmp/first_line.txt
import json, subprocess, re, sys
repo = "RedHatQE/openshift-virtualization-tests"
pr = "5318"
first_file = open('/tmp/changed_files.txt').read().splitlines()[0].strip()
data = subprocess.check_output(["gh","api",f"/repos/{repo}/pulls/{pr}/files","--paginate"])
files = json.loads(data)
target = next(f for f in files if f["filename"] == first_file)
patch = target["patch"]
new_line = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        print(new_line)
        sys.exit(0)
    if not line.startswith('-'):
        new_line += 1
raise SystemExit("Could not determine first added line")
PY
FIRST_LINE=$(cat /tmp/first_line.txt)
echo "== First changed line (new side) =="
echo "$FIRST_LINE"

python - <<'PY' > /tmp/tep_comment.md
from pathlib import Path

changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
all_smoke = set(Path('/tmp/all_smoke.txt').read_text().splitlines())
all_gating = set(Path('/tmp/all_gating.txt').read_text().splitlines())

changed_smoke = [p for p in changed if p in all_smoke]
changed_gating = [p for p in changed if p in all_gating]
changed_conftests = [p for p in changed if p.endswith('/conftest.py')]

smoke_desc = []
gating_desc = []
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.smoke`' in text:
            smoke_desc.append((conf, str(test)))
            break
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.gating`' in text:
            gating_desc.append((conf, str(test)))
            break

lines = []
lines.append("## Test Execution Plan")
lines.append("")
if changed_smoke or smoke_desc:
    lines.append("**Run smoke tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_smoke[:3]:
        lines.append(f"- `{p}` (smoke) -> direct module import updated in this PR")
    for conf, test in smoke_desc[:2]:
        lines.append(f"- `{test}` (smoke) -> parent `{conf}` changed -> collection/setup imports updated in this PR")
else:
    lines.append("**Run smoke tests: False**  ")
    lines.append("No smoke-marked changed file or verified smoke descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

if changed_gating or gating_desc:
    lines.append("**Run gating tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_gating[:5]:
        lines.append(f"- `{p}` (gating) -> direct module import updated in this PR")
    for conf, test in gating_desc[:2]:
        lines.append(f"- `{test}` (gating) -> parent `{conf}` changed -> collection/setup imports updated in this PR")
else:
    lines.append("**Run gating tests: False**  ")
    lines.append("No gating-marked changed file or verified gating descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

lines.append("**Affected tests to run**")
picked = []
for p in changed_smoke[:3] + changed_gating[:8]:
    if p not in picked:
        picked.append(p)
for conf, test in smoke_desc[:1] + gating_desc[:3]:
    if test not in picked:
        picked.append(test)
for p in picked:
    marker = []
    if p in all_smoke:
        marker.append("smoke")
    if p in all_gating:
        marker.append("gating")
    suffix = f" ({', '.join(marker)})" if marker else ""
    lines.append(f"- `{p}`{suffix}")

lines.append("")
lines.append("**Real tests (cluster required)**")
lines.append("Error path (collection/import validation):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  ")
lines.append("Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.")
lines.append("")
happy_targets = picked[:4] if picked else ["tests/virt"]
lines.append("Happy path (representative runtime regression):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test " + " ".join(happy_targets) + "`  ")
lines.append("Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.")
lines.append("")
lines.append("**Why this scope**")
lines.append("- **CRITICAL:** changed `conftest.py` files run during collection/setup, so bad import rewrites can break directory-wide test startup.")
lines.append("- **HIGH:** directly changed smoke/gating tests should be exercised because their imports now resolve through different constants submodules.")
lines.append("- **LOW:** no `utilities/` or `libs/` implementation files changed, and no new tests were added.")

print("\n".join(lines))
PY

echo "== Comment body preview =="
sed -n '1,240p' /tmp/tep_comment.md

set +e
INLINE_OUT=$(gh api \
  --method POST \
  "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" \
  --field commit_id="$HEAD_SHA" \
  --field event="COMMENT" \
  --field "comments[][path]=$FIRST_FILE" \
  --field "comments[][line]=$FIRST_LINE" \
  --field "comments[][side]=RIGHT" \
  --raw-field "comments[][body]=$(cat /tmp/tep_comment.md)" 2>&1)
STATUS=$?
set -e

echo "== Inline review API status =="
echo "$STATUS"
echo "$INLINE_OUT"

if [ "$STATUS" -ne 0 ]; then
  echo "== Inline failed, falling back to regular PR comment =="
  gh pr comment "$PR_NUMBER" --repo "$REPO" --body-file /tmp/tep_comment.md
fi

Length of output: 10461

🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

gh api "/repos/${REPO}/pulls/${PR_NUMBER}/files?per_page=100" > /tmp/pr_files.json

python - <<'PY'
import json, re
from pathlib import Path

files = json.loads(Path('/tmp/pr_files.json').read_text())
changed = [f["filename"] for f in files]
Path('/tmp/changed_files.txt').write_text("\n".join(changed) + "\n")

print("== Changed files (first 20) ==")
for p in changed[:20]:
    print(p)

first = files[0]
print("== First changed file ==")
print(first["filename"])

print("== First file patch header ==")
patch = first.get("patch", "")
for line in patch.splitlines()[:40]:
    print(line)

new_line = None
first_added = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        first_added = new_line
        break
    if not line.startswith('-'):
        new_line += 1
if first_added is None:
    raise SystemExit("Could not determine first added line")
Path('/tmp/first_file.txt').write_text(first["filename"] + "\n")
Path('/tmp/first_line.txt').write_text(str(first_added) + "\n")
print("== First changed line (new side) ==")
print(first_added)
PY

echo "== Smoke-marked files in repo =="
rg -l '`@pytest`\.mark\.smoke' tests/ > /tmp/all_smoke.txt
sed -n '1,20p' /tmp/all_smoke.txt

echo "== Gating-marked files in repo =="
rg -l '`@pytest`\.mark\.gating' tests/ > /tmp/all_gating.txt
sed -n '1,25p' /tmp/all_gating.txt

python - <<'PY'
from pathlib import Path

changed = [line.strip() for line in Path('/tmp/changed_files.txt').read_text().splitlines() if line.strip()]
all_smoke = set(Path('/tmp/all_smoke.txt').read_text().splitlines())
all_gating = set(Path('/tmp/all_gating.txt').read_text().splitlines())

changed_smoke = [p for p in changed if p in all_smoke]
changed_gating = [p for p in changed if p in all_gating]
changed_conftests = [p for p in changed if p.endswith('/conftest.py')]

print("== Changed smoke-marked files ==")
for p in changed_smoke:
    print(p)

print("== Changed gating-marked files ==")
for p in changed_gating:
    print(p)

print("== Changed conftest files ==")
for p in changed_conftests:
    print(p)

smoke_desc = []
gating_desc = []
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.smoke`' in text:
            smoke_desc.append((conf, str(test)))
            break
for conf in changed_conftests:
    root = Path(conf).parent
    for test in sorted(root.rglob('test_*.py')):
        try:
            text = test.read_text()
        except Exception:
            continue
        if '`@pytest.mark.gating`' in text:
            gating_desc.append((conf, str(test)))
            break

print("== Concrete smoke descendants under changed conftest hierarchies ==")
for conf, test in smoke_desc:
    print(f"{conf} -> {test}")

print("== Concrete gating descendants under changed conftest hierarchies ==")
for conf, test in gating_desc:
    print(f"{conf} -> {test}")

# Persist for comment generation
Path('/tmp/changed_smoke.txt').write_text("\n".join(changed_smoke) + ("\n" if changed_smoke else ""))
Path('/tmp/changed_gating.txt').write_text("\n".join(changed_gating) + ("\n" if changed_gating else ""))
Path('/tmp/smoke_desc.txt').write_text("\n".join(f"{c}|{t}" for c,t in smoke_desc) + ("\n" if smoke_desc else ""))
Path('/tmp/gating_desc.txt').write_text("\n".join(f"{c}|{t}" for c,t in gating_desc) + ("\n" if gating_desc else ""))
PY

echo "== utilities/libs changes =="
grep -E '^(utilities|libs)/' /tmp/changed_files.txt || true

HEAD_SHA=$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')
echo "== Head SHA =="
echo "$HEAD_SHA"
printf '%s\n' "$HEAD_SHA" > /tmp/head_sha.txt

python - <<'PY'
import json
from pathlib import Path

def read_lines(path):
    p = Path(path)
    if not p.exists():
        return []
    return [line.strip() for line in p.read_text().splitlines() if line.strip()]

changed_smoke = read_lines('/tmp/changed_smoke.txt')
changed_gating = read_lines('/tmp/changed_gating.txt')
all_smoke = set(read_lines('/tmp/all_smoke.txt'))
all_gating = set(read_lines('/tmp/all_gating.txt'))

def read_pairs(path):
    p = Path(path)
    if not p.exists():
        return []
    pairs = []
    for line in p.read_text().splitlines():
        if not line.strip():
            continue
        c, t = line.split('|', 1)
        pairs.append((c, t))
    return pairs

smoke_desc = read_pairs('/tmp/smoke_desc.txt')
gating_desc = read_pairs('/tmp/gating_desc.txt')

lines = []
lines.append("## Test Execution Plan")
lines.append("")

if changed_smoke or smoke_desc:
    lines.append("**Run smoke tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_smoke[:4]:
        lines.append(f"- `{p}` (smoke) -> direct import path update in this PR")
    for conf, test in smoke_desc[:2]:
        lines.append(f"- `{test}` (smoke) -> parent `{conf}` changed -> collection/setup import path update")
else:
    lines.append("**Run smoke tests: False**  ")
    lines.append("No verified smoke-marked changed file or smoke descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

if changed_gating or gating_desc:
    lines.append("**Run gating tests: True**  ")
    lines.append("Verified paths:")
    for p in changed_gating[:6]:
        lines.append(f"- `{p}` (gating) -> direct import path update in this PR")
    for conf, test in gating_desc[:3]:
        lines.append(f"- `{test}` (gating) -> parent `{conf}` changed -> collection/setup import path update")
else:
    lines.append("**Run gating tests: False**  ")
    lines.append("No verified gating-marked changed file or gating descendant under a changed `conftest.py` hierarchy was found.")
lines.append("")

lines.append("**Affected tests to run**")
picked = []
for p in changed_smoke[:4] + changed_gating[:8]:
    if p not in picked:
        picked.append(p)
for _, test in smoke_desc[:2] + gating_desc[:4]:
    if test not in picked:
        picked.append(test)
for p in picked:
    marker = []
    if p in all_smoke:
        marker.append("smoke")
    if p in all_gating:
        marker.append("gating")
    suffix = f" ({', '.join(marker)})" if marker else ""
    lines.append(f"- `{p}`{suffix}")

lines.append("")
lines.append("**Real tests (cluster required)**")
lines.append("Error path (collection/import validation):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  ")
lines.append("Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.")
lines.append("")
happy_targets = picked[:4] if picked else ["tests/virt"]
lines.append("Happy path (representative runtime regression):  ")
lines.append("`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test " + " ".join(happy_targets) + "`  ")
lines.append("Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.")
lines.append("")
lines.append("**Why this scope**")
lines.append("- **CRITICAL:** changed `conftest.py` files run during collection/setup, so import-path regressions can break directory-wide startup.")
lines.append("- **HIGH:** directly changed smoke/gating tests should be exercised because their imports now resolve through different constants submodules.")
lines.append("- **LOW:** no `utilities/` or `libs/` implementation files changed, and no new tests were added.")

body = "\n".join(lines)
Path('/tmp/tep_comment.md').write_text(body)

payload = {
    "commit_id": Path('/tmp/head_sha.txt').read_text().strip(),
    "event": "COMMENT",
    "comments": [
        {
            "path": Path('/tmp/first_file.txt').read_text().strip(),
            "line": int(Path('/tmp/first_line.txt').read_text().strip()),
            "side": "RIGHT",
            "body": body,
        }
    ],
}
Path('/tmp/review_payload.json').write_text(json.dumps(payload))
print("== Comment body preview ==")
print(body)
PY

echo "== Posting inline review comment =="
set +e
gh api --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" --input /tmp/review_payload.json
STATUS=$?
set -e
echo "== Inline review API status =="
echo "$STATUS"

if [ "$STATUS" -ne 0 ]; then
  echo "== Inline failed, falling back to regular PR comment =="
  gh pr comment "$PR_NUMBER" --repo "$REPO" --body-file /tmp/tep_comment.md
fi

Length of output: 19958

🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

# Rebuild minimal metadata if temp files are missing
if [ ! -f /tmp/first_file.txt ] || [ ! -f /tmp/first_line.txt ] || [ ! -f /tmp/head_sha.txt ] || [ ! -f /tmp/tep_comment.md ]; then
  gh api "/repos/${REPO}/pulls/${PR_NUMBER}/files?per_page=100" > /tmp/pr_files.json
  python - <<'PY'
import json, re
from pathlib import Path

files = json.loads(Path('/tmp/pr_files.json').read_text())
first = files[0]
patch = first.get("patch", "")
new_line = None
first_added = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        first_added = new_line
        break
    if not line.startswith('-'):
        new_line += 1

Path('/tmp/first_file.txt').write_text(first["filename"] + "\n")
Path('/tmp/first_line.txt').write_text(str(first_added) + "\n")
PY
  gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid' > /tmp/head_sha.txt
fi

echo "== Target inline location =="
cat /tmp/first_file.txt
cat /tmp/first_line.txt
cat /tmp/head_sha.txt

echo "== Comment preview =="
sed -n '1,220p' /tmp/tep_comment.md

FIRST_FILE=$(tr -d '\n' < /tmp/first_file.txt)
FIRST_LINE=$(tr -d '\n' < /tmp/first_line.txt)
HEAD_SHA=$(tr -d '\n' < /tmp/head_sha.txt)

python - <<'PY'
import json
from pathlib import Path

payload = {
    "body": Path("/tmp/tep_comment.md").read_text(),
    "commit_id": Path("/tmp/head_sha.txt").read_text().strip(),
    "path": Path("/tmp/first_file.txt").read_text().strip(),
    "line": int(Path("/tmp/first_line.txt").read_text().strip()),
    "side": "RIGHT",
}
Path("/tmp/inline_comment_payload.json").write_text(json.dumps(payload))
print(Path("/tmp/inline_comment_payload.json").read_text())
PY

echo "== Attempt 1: REST inline review comment endpoint =="
set +e
INLINE_OUT=$(gh api --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/comments" --input /tmp/inline_comment_payload.json 2>&1)
INLINE_STATUS=$?
set -e
echo "$INLINE_OUT"
echo "inline_status=$INLINE_STATUS"

if [ "$INLINE_STATUS" -eq 0 ]; then
  exit 0
fi

python - <<'PY'
import json
from pathlib import Path
payload = {
    "body": Path("/tmp/tep_comment.md").read_text()
}
Path("/tmp/issue_comment_payload.json").write_text(json.dumps(payload))
print(Path("/tmp/issue_comment_payload.json").read_text())
PY

echo "== Attempt 2: REST PR issue comment endpoint fallback =="
set +e
ISSUE_OUT=$(gh api --method POST "/repos/${REPO}/issues/${PR_NUMBER}/comments" --input /tmp/issue_comment_payload.json 2>&1)
ISSUE_STATUS=$?
set -e
echo "$ISSUE_OUT"
echo "issue_status=$ISSUE_STATUS"

exit 0

Length of output: 15803

@openshift-virtualization-qe-bot-3

CRITICAL: I could not complete the posting step because the current GitHub integration does not have comment-write permission on PR #5318.

Both required write paths failed with the same blocker:

  • Inline review comment API: 403 Resource not accessible by integration
  • Regular PR comment fallback: 403 Resource not accessible by integration

This matters because the workflow rule requires an actual posted comment on the PR, and a local analysis alone does not satisfy that requirement.

Prepared inline comment target:

  • File: tests/virt/cluster/aaq/conftest.py
  • Line 26

Prepared Test Execution Plan content:

## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> direct import path update in this PR
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import path update
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/conftest.py` changed -> collection/setup import path update

**Run gating tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) -> direct import path update in this PR
- `tests/virt/node/general/test_disk_io_option.py` (gating) -> direct import path update in this PR
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import path update
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> parent `tests/virt/cluster/vm_cloning/conftest.py` changed -> collection/setup import path update
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> parent `tests/virt/conftest.py` changed -> collection/setup import path update

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)
- `tests/virt/node/cpu_sockets_threads/test_cpu_support_sockets_threads.py` (gating)

**Real tests (cluster required)**
Error path (collection/import validation):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (representative runtime regression):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/cluster/common_templates/general/test_base_template.py tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py tests/virt/cluster/migration_and_maintenance/test_migration_policy.py`  
Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.

**Why this scope**
- **CRITICAL:** changed `conftest.py` files run during collection/setup, so import-path regressions can break directory-wide startup.
- **HIGH:** directly changed smoke/gating tests should be exercised because their imports now resolve through different constants submodules.
- **LOW:** no `utilities/` or `libs/` implementation files changed, and no new tests were added.

@coderabbitai
you do have access

@coderabbitai

coderabbitai Bot commented Jun 28, 2026

Copy link
Copy Markdown
Contributor

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

echo "== PR head SHA =="
gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid' | tee /tmp/head_sha.txt

echo "== First changed file + first changed line =="
gh api "/repos/${REPO}/pulls/${PR_NUMBER}/files?per_page=100" > /tmp/pr_files.json
python - <<'PY'
import json, re
from pathlib import Path

files = json.loads(Path('/tmp/pr_files.json').read_text())
first = files[0]
patch = first.get("patch", "")
new_line = None
first_added = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        first_added = new_line
        break
    if not line.startswith('-'):
        new_line += 1

print(first["filename"])
print(first_added)
Path('/tmp/first_file.txt').write_text(first["filename"] + "\n")
Path('/tmp/first_line.txt').write_text(str(first_added) + "\n")
PY

echo "== Build minimal TEP comment body =="
cat > /tmp/tep_comment.md <<'EOF'
## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> direct import-path update in this PR
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import-path update
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/conftest.py` changed -> collection/setup import-path update

**Run gating tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) -> direct import-path update in this PR

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)

**Real tests (cluster required)**  
Error path (collection/import validation):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (representative runtime regression):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/cluster/common_templates/general/test_base_template.py tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py tests/virt/cluster/migration_and_maintenance/test_migration_policy.py`  
Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.
EOF

echo "== Attempt 1: inline review comment endpoint =="
python - <<'PY'
import json
from pathlib import Path
payload = {
    "body": Path("/tmp/tep_comment.md").read_text(),
    "commit_id": Path("/tmp/head_sha.txt").read_text().strip(),
    "path": Path("/tmp/first_file.txt").read_text().strip(),
    "line": int(Path("/tmp/first_line.txt").read_text().strip()),
    "side": "RIGHT",
}
Path("/tmp/inline_payload.json").write_text(json.dumps(payload))
print(Path("/tmp/inline_payload.json").read_text())
PY

set +e
gh api --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/comments" --input /tmp/inline_payload.json
status=$?
set -e
echo "inline_status=$status"

if [ "$status" -ne 0 ]; then
  echo "== Attempt 2: single-comment review endpoint =="
  python - <<'PY'
import json
from pathlib import Path
payload = {
    "commit_id": Path("/tmp/head_sha.txt").read_text().strip(),
    "event": "COMMENT",
    "comments": [{
        "path": Path("/tmp/first_file.txt").read_text().strip(),
        "line": int(Path("/tmp/first_line.txt").read_text().strip()),
        "side": "RIGHT",
        "body": Path("/tmp/tep_comment.md").read_text(),
    }],
}
Path("/tmp/review_payload.json").write_text(json.dumps(payload))
print(Path("/tmp/review_payload.json").read_text())
PY
  gh api --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" --input /tmp/review_payload.json
fi

Length of output: 5778


🏁 Script executed:

#!/bin/bash
set -euo pipefail

PR_NUMBER=5318
REPO="RedHatQE/openshift-virtualization-tests"

echo "== PR head SHA =="
HEAD_SHA="$(gh pr view "$PR_NUMBER" --repo "$REPO" --json headRefOid --jq '.headRefOid')"
printf '%s\n' "$HEAD_SHA"
printf '%s\n' "$HEAD_SHA" > /tmp/head_sha.txt

echo "== First changed file + first changed line =="
gh api "/repos/${REPO}/pulls/${PR_NUMBER}/files?per_page=100" > /tmp/pr_files.json
python - <<'PY'
import json, re
from pathlib import Path

files = json.loads(Path('/tmp/pr_files.json').read_text())
first = files[0]
patch = first.get("patch", "")
new_line = None
first_added = None
for line in patch.splitlines():
    if line.startswith('@@'):
        m = re.search(r'\+(\d+)', line)
        if m:
            new_line = int(m.group(1))
        continue
    if line.startswith('+') and not line.startswith('+++'):
        first_added = new_line
        break
    if not line.startswith('-'):
        new_line += 1

Path('/tmp/first_file.txt').write_text(first["filename"] + "\n")
Path('/tmp/first_line.txt').write_text(str(first_added) + "\n")
print(first["filename"])
print(first_added)
PY

cat > /tmp/tep_comment.md <<'EOF'
## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> direct import-path update in this PR
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import-path update
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/conftest.py` changed -> collection/setup import-path update

**Run gating tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) -> direct import-path update in this PR

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)

**Real tests (cluster required)**  
Error path (collection/import validation):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (representative runtime regression):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/cluster/common_templates/general/test_base_template.py tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py tests/virt/cluster/migration_and_maintenance/test_migration_policy.py`  
Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.
EOF

python - <<'PY'
import json
from pathlib import Path

inline_payload = {
    "body": Path("/tmp/tep_comment.md").read_text(),
    "commit_id": Path("/tmp/head_sha.txt").read_text().strip(),
    "path": Path("/tmp/first_file.txt").read_text().strip(),
    "line": int(Path("/tmp/first_line.txt").read_text().strip()),
    "side": "RIGHT",
}
Path("/tmp/inline_payload.json").write_text(json.dumps(inline_payload))

review_payload = {
    "commit_id": Path("/tmp/head_sha.txt").read_text().strip(),
    "event": "COMMENT",
    "comments": [{
        "path": Path("/tmp/first_file.txt").read_text().strip(),
        "line": int(Path("/tmp/first_line.txt").read_text().strip()),
        "side": "RIGHT",
        "body": Path("/tmp/tep_comment.md").read_text(),
    }],
}
Path("/tmp/review_payload.json").write_text(json.dumps(review_payload))
PY

echo "== Attempt 1: inline review comment endpoint =="
set +e
gh api -i --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/comments" --input /tmp/inline_payload.json > /tmp/inline_response.txt 2>&1
INLINE_STATUS=$?
set -e
printf 'inline_status=%s\n' "$INLINE_STATUS"
sed -n '1,120p' /tmp/inline_response.txt

if [ "$INLINE_STATUS" -ne 0 ]; then
  echo "== Attempt 2: single-comment review endpoint =="
  set +e
  gh api -i --method POST "/repos/${REPO}/pulls/${PR_NUMBER}/reviews" --input /tmp/review_payload.json > /tmp/review_response.txt 2>&1
  REVIEW_STATUS=$?
  set -e
  printf 'review_status=%s\n' "$REVIEW_STATUS"
  sed -n '1,160p' /tmp/review_response.txt
fi

Length of output: 8710



@rnetser CRITICAL: I re-ran this against GitHub successfully, and the blocker is real.

The write attempts reached GitHub and both were rejected with the same response:

  • POST /repos/RedHatQE/openshift-virtualization-tests/pulls/5318/commentsHTTP 403
  • POST /repos/RedHatQE/openshift-virtualization-tests/pulls/5318/reviewsHTTP 403

Returned body:

{"message":"Resource not accessible by integration","status":"403"}

Why this matters:

  • X-Accepted-Github-Permissions: pull_requests=write means the endpoint requires that permission.
  • It does not mean the current integration token is authorized to use it on this PR.
  • So this is no longer a shell/runtime issue; it is an integration authorization issue for this environment.

Verified target I tried to post to:

  • File: tests/virt/cluster/aaq/conftest.py
  • Line 26
  • Commit: ba6fa218c4b837c985fbdcfe2c202504fdd95f24

HIGH: Since the workflow requires an actual inline comment, I cannot truthfully claim completion when GitHub rejects the write.

If you want the fastest path forward, please paste this inline comment manually on tests/virt/cluster/aaq/conftest.py, Line 26:

## Test Execution Plan

**Run smoke tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> direct import-path update in this PR
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/cluster/common_templates/conftest.py` changed -> collection/setup import-path update
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke) -> parent `tests/virt/conftest.py` changed -> collection/setup import-path update

**Run gating tests: True**  
Verified paths:
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating) -> direct import-path update in this PR
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating) -> direct import-path update in this PR

**Affected tests to run**
- `tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py` (smoke)
- `tests/virt/cluster/common_templates/general/test_base_template.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py` (gating)
- `tests/virt/cluster/migration_and_maintenance/test_migration_policy.py` (gating)
- `tests/virt/cluster/vm_cloning/test_vm_cloning.py` (gating)
- `tests/virt/cluster/vm_lifecycle/test_vm_run_strategy.py` (gating)
- `tests/virt/node/general/test_disk_io_option.py` (gating)
- `tests/virt/node/general/test_machinetype.py` (gating)
- `tests/virt/node/general/test_static_ssh_key_injection.py` (gating)

**Real tests (cluster required)**  
Error path (collection/import validation):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt --collect-only`  
Expected: collection completes without `ImportError` / `AttributeError` from moved constants imports.

Happy path (representative runtime regression):  
`uv run pytest -rA -s -o log_cli=true --tc-file=tests/global_config_amd64.py --tc-format=python --cluster-sanity-skip-check --storage-class-matrix=ocs-storagecluster-ceph-rbd-virtualization --skip-deprecated-api-test tests/virt/cluster/common_templates/rhel/test_rhel_os_support.py tests/virt/cluster/common_templates/general/test_base_template.py tests/virt/cluster/migration_and_maintenance/test_evictionstrategy.py tests/virt/cluster/migration_and_maintenance/test_migration_policy.py`  
Expected: representative smoke/gating coverage imports, collects, and starts normally on a real cluster.

(•ㅅ•)՞

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants