Skip to content

✨ Evaluate stochastic RL pass candidates - #791

Closed
flowerthrower wants to merge 9 commits into
v3/configurable-pass-timeoutsfrom
v3/667-stochastic-actions
Closed

flowerthrower wants to merge 9 commits into
v3/configurable-pass-timeoutsfrom
v3/667-stochastic-actions

Conversation

@flowerthrower

@flowerthrower flowerthrower commented Aug 27, 2026 •

Copy link
Copy Markdown
Member

🤖 AI text below 🤖

Description

Evaluates repeated candidates for Qiskit RL actions marked as stochastic and retains the candidate with the best configured figure of merit. Candidates are translated to the target basis before scoring; supported scoring failures fall back to minimizing inserted SWAPs.

PredictorEnv.stochastic_action_trials configures the number of attempts and defaults to 20. QiskitSabreMapping and the SabreSwap action introduced by #785 use this path. A failed candidate does not abort the episode: the remaining attempts continue, and an all-failed run leaves the circuit unchanged. Pass and scoring timeouts are re-raised so the timeout layer can truncate immediately rather than continuing unbounded trials. Set the trial count to 1 to retain single-attempt selection.

This is position 9 of the stack. It depends on the timeout PR #789 and is followed by the GNN PR #788.

Validated with repository lint, focused RL checks, and direct pass- and scoring-timeout smokes.

Fixes #667

Part of #664

Checklist

  • The pull request only contains commits that are focused and relevant to this change.
  • I have updated the documentation to reflect these changes.
  • I have added entries to the changelog for noteworthy behavior changes.
  • I have added migration instructions to the upgrade guide.
  • The changes follow the project's style guidelines and introduce no new warnings.
  • I have reviewed my own code changes.

If PR contains AI-assisted content:

  • Any agent that created, edited, or submitted GitHub content was explicitly authorized for that scope, as required by our AI Usage Guidelines.
  • Every agent-authored or agent-edited public text body begins with the visible disclosure 🤖 *AI text below* 🤖 (titles are exempt).
  • I have disclosed AI assistance in the PR description.
  • I confirm that I have personally reviewed and understood all AI-generated content, and accept full responsibility for it.

flowerthrower added a commit that referenced this pull request Aug 27, 2026
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
flowerthrower and others added 9 commits August 27, 2026 15:28
Assisted-by: GPT-5 via Codex

Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5 via Codex

Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
@flowerthrower
flowerthrower force-pushed the v3/configurable-pass-timeouts branch from a748f7e to a7cf25f Compare August 27, 2026 13:28
@flowerthrower
flowerthrower force-pushed the v3/667-stochastic-actions branch from 68409e0 to 2e20811 Compare August 27, 2026 13:28
@flowerthrower flowerthrower added enhancement New feature or request major Part of a major release refactor PR or issues that refactor code labels Aug 27, 2026
@flowerthrower flowerthrower self-assigned this Aug 27, 2026
@flowerthrower

Copy link
Copy Markdown
Member Author

🤖 AI text below 🤖\n\nFolded into the rebuilt Qiskit/stochastic layer; it is no longer a standalone PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request major Part of a major release refactor PR or issues that refactor code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant