Skip to content

⚡ Use compact scalar RL observations - #770

Closed
flowerthrower wants to merge 11 commits into
v3/670-intermediate-rewardsfrom
v3/compact-observation-encoding
Closed

flowerthrower wants to merge 11 commits into
v3/670-intermediate-rewardsfrom
v3/compact-observation-encoding

Conversation

@flowerthrower

@flowerthrower flowerthrower commented Aug 21, 2026

Copy link
Copy Markdown
Member

🤖 AI text below 🤖

Description

Replaces the discrete num_qubits and depth RL observations with one-element float32 values in [0, 1]. Qubit count is scaled linearly and capped at 127; depth is log1p-scaled and capped at 999,999.

This prevents Stable-Baselines3 from expanding those values into large one-hot vectors and reduces the flattened policy input from 1,000,162 features to 36. Existing RL models must be retrained, and direct PredictorEnv observation consumers must handle the new array values.

This stacked PR depends on #760 and contains no phase/deadline observations, GNN changes, or local diagnostic tooling. Validated with uvx nox -s lint, the RL helper/tracer tests (7 passed), and an observation-schema smoke check.

Checklist

  • The pull request only contains commits that are focused and relevant to this change.
  • I have added appropriate tests that cover the new/changed functionality.
  • I have updated the documentation to reflect these changes.
  • I have added entries to the changelog for any noteworthy additions, changes, fixes, or removals.
  • I have added migration instructions to the upgrade guide (if needed).
  • The changes follow the project's style guidelines and introduce no new warnings.
  • The changes are fully tested and pass the CI checks.
  • I have reviewed my own code changes.

If PR contains AI-assisted content:

  • Any agent that created, edited, or submitted GitHub content was explicitly authorized for that scope, as required by our AI Usage Guidelines.
  • Every agent-authored or agent-edited public text body begins with the visible disclosure 🤖 *AI text below* 🤖 (titles are exempt).
  • I have disclosed AI assistance in the PR description.
  • I confirm that I have personally reviewed and understood all AI-generated content, and accept full responsibility for it.

@flowerthrower
flowerthrower force-pushed the v3/670-intermediate-rewards branch from 75d6d51 to 4585e35 Compare August 21, 2026 15:55
@flowerthrower
flowerthrower force-pushed the v3/compact-observation-encoding branch from 6db1d58 to 9dd57a6 Compare August 21, 2026 15:56
@codecov

codecov Bot commented Aug 26, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

flowerthrower and others added 11 commits August 26, 2026 12:53
Assisted-by: GPT-5 via Codex

Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT-5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT-5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
@flowerthrower
flowerthrower force-pushed the v3/compact-observation-encoding branch from 96d2c51 to c419b58 Compare August 26, 2026 11:07
@flowerthrower
flowerthrower force-pushed the v3/670-intermediate-rewards branch 2 times, most recently from 9fd0051 to a307857 Compare August 26, 2026 11:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant