⚡ Use compact scalar RL observations - #770
Closed
flowerthrower wants to merge 11 commits into
Closed
flowerthrower wants to merge 11 commits into
flowerthrower wants to merge 11 commits into
Conversation
flowerthrower
force-pushed
the
v3/670-intermediate-rewards
branch
from
August 21, 2026 15:55
75d6d51 to
4585e35
Compare
flowerthrower
force-pushed
the
v3/compact-observation-encoding
branch
from
August 21, 2026 15:56
6db1d58 to
9dd57a6
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Assisted-by: GPT-5 via Codex Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com> Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com> Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com> Assisted-by: GPT 5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com> Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT-5.6 via Codex Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT-5.6 via Codex Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
flowerthrower
force-pushed
the
v3/compact-observation-encoding
branch
from
August 26, 2026 11:07
96d2c51 to
c419b58
Compare
flowerthrower
force-pushed
the
v3/670-intermediate-rewards
branch
2 times, most recently
from
August 26, 2026 11:28
9fd0051 to
a307857
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🤖 AI text below 🤖
Description
Replaces the discrete
num_qubitsanddepthRL observations with one-elementfloat32values in[0, 1]. Qubit count is scaled linearly and capped at 127; depth islog1p-scaled and capped at 999,999.This prevents Stable-Baselines3 from expanding those values into large one-hot vectors and reduces the flattened policy input from 1,000,162 features to 36. Existing RL models must be retrained, and direct
PredictorEnvobservation consumers must handle the new array values.This stacked PR depends on #760 and contains no phase/deadline observations, GNN changes, or local diagnostic tooling. Validated with
uvx nox -s lint, the RL helper/tracer tests (7 passed), and an observation-schema smoke check.Checklist
If PR contains AI-assisted content:
🤖 *AI text below* 🤖(titles are exempt).