Skip to content

✨ Add configurable RL pass timeouts - #789

Closed
flowerthrower wants to merge 4 commits into
v3/reproducible-rl-seedingfrom
v3/configurable-pass-timeouts
Closed

flowerthrower wants to merge 4 commits into
v3/reproducible-rl-seedingfrom
v3/configurable-pass-timeouts

Conversation

@flowerthrower

@flowerthrower flowerthrower commented Aug 27, 2026

Copy link
Copy Markdown
Member

🤖 AI text below 🤖

Description

Adds an opt-in timeout for individual RL compilation passes during training and inference.

  • pass_timeout is exposed through training and inference entry points.
  • Pass execution remains unbounded by default.
  • A timeout truncates through the existing action-error path.
  • Per-call settings are restored so singleton predictors do not leak timeout state.

The implementation uses POSIX real-time signals on the main thread. Unsupported platforms or worker threads warn and continue without a timeout. Reward policy is intentionally not owned here; the final reward PR later changes failed-action rewards to the paper penalty.

This draft is stacked on the seeding PR. Validated with repository lint and six focused timeout tests.

Part of #664

Checklist

  • The diff is focused and preserves default behavior.
  • Existing focused tests pass.
  • Lint passes.
  • I confirm that I have personally reviewed and understood all AI-generated content.

If PR contains AI-assisted content:

  • AI assistance was authorized and is disclosed.
  • This body begins with the required visible disclosure.

Assisted-by: GPT-5.6 via Codex

Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Assisted-by: GPT-5.6 via Codex

Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Signed-off-by: flowerthrower <flowerthrower@users.noreply.github.com>
Assisted-by: GPT 5.6 via Codex
@flowerthrower
flowerthrower force-pushed the v3/configurable-pass-timeouts branch from a748f7e to a7cf25f Compare August 27, 2026 13:28
@flowerthrower
flowerthrower force-pushed the v3/reproducible-rl-seeding branch from 561bba3 to c55cdda Compare August 27, 2026 13:28
@flowerthrower flowerthrower added enhancement New feature or request major Part of a major release labels Aug 27, 2026
@flowerthrower flowerthrower self-assigned this Aug 27, 2026
@flowerthrower

Copy link
Copy Markdown
Member Author

🤖 AI text below 🤖\n\nSuperseded while rebuilding the corrected downstream stack after #758.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request major Part of a major release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant