Skip to content

refactor(ci): read the CI environment through the funnel - #1839

Merged
mergify[bot] merged 3 commits into
mainfrom
devs/sileht/test-env-access-ub/read-ci-env-funnel--668395af
Sep 18, 2026
Merged

mergify[bot] merged 3 commits into
mainfrom
devs/sileht/test-env-access-ub/read-ci-env-funnel--668395af

Conversation

@sileht

@sileht sileht commented Sep 18, 2026

Copy link
Copy Markdown
Member

mergify-ci is where most of the process-environment mutation
lived: 27 direct temp_env calls plus the 69 that went through
testing::with_ci_env. All of them now install a mergify_core::env
overlay instead, and the production side reads through the same
module.

CI_ENV_VARS goes with them, and with_ci_env with it. That helper
existed to merge a list of 43 variable names to unset into each
case's overrides, carrying the instruction to "keep this list aligned
with every env::var(...) call across detector::*; new detector
helpers must add their inputs here or their tests will be flaky on
CI". An overlay is exhaustive, so a name a test does not list is
unset whatever the host exports, and there is nothing left for the
list to be aligned with. The wrapper had nothing left to wrap. The
call sites say env::testing::with_vars / with_no_vars directly,
which is what they now mean.

detector::non_empty_env goes too: once the reads route through
mergify_core::env it was a second name for env::var_non_empty,
which the same file calls.

No behaviour changes. env::var returns Option where
std::env::var returned Result, so == Ok("true") becomes
== Some("true") and the .ok().filter(|s| !s.is_empty()) chains
collapse into var_non_empty, which is what they spelled out.

Not done here, and worth naming: seven of those == Some("true")
sites re-derive what detector::get_ci_provider() already answers,
and the crate would be better served by building one CI snapshot at
each command entry point and passing it down, with no ambient read at
all. That is a different change with different risk, since the two
precedences do not agree today, and it is not a prerequisite for
removing the undefined behaviour.

Co-Authored-By: Claude Opus 5 noreply@anthropic.com

@mergify
mergify Bot had a problem deploying to Mergify Merge Protections September 18, 2026 07:07 Failure
@sileht
sileht deployed to func-tests-live September 18, 2026 07:07 — with GitHub Actions Active
@sileht

sileht commented Sep 18, 2026

Copy link
Copy Markdown
Member Author

This pull request is part of a Mergify stack:

# Pull Request Link
1 refactor(tui): resolve the color env overrides at the CLI entry point #1837
2 feat(core): read the environment through one funnel, with a hermetic test overlay #1838
3 refactor(ci): read the CI environment through the funnel #1839 👈
4 refactor(stack): read the environment through the funnel #1840
5 refactor(cli): assert the clap env hook is absent without mutating the environment #1841
6 refactor(auth): read the environment through the funnel #1842
7 chore(lint): make the next process-environment read fail the build #1843

@mergify

mergify Bot commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

Merge Protections

🟢 All 6 merge protections satisfied — ready to merge.

Show 6 satisfied protections

🟢 🤖 Continuous Integration

  • all of:
    • check-success=ci-gate

🟢 👀 Review Requirements

  • any of:
    • #approved-reviews-by>=2
    • author = dependabot[bot]
    • author = mergify-ci-bot
    • author = renovate[bot]

🟢 Enforce conventional commit

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

  • title ~= ^(fix|feat|internal|docs|style|refactor|perf|test|build|ci|chore|revert|ui)(?:\(.+\))?!?:

🟢 🔎 Reviews

  • #changes-requested-reviews-by = 0
  • #review-requested = 0
  • #review-threads-unresolved = 0

🟢 📕 PR description

  • body ~= (?ms:.{48,})

🟢 🚦 Auto-queue

When all merge protections are satisfied, this pull request will be queued automatically.

@mergify
mergify Bot requested a review from a team September 18, 2026 07:14
`Theme::detect()` read `NO_COLOR`, `FORCE_COLOR` and `CLICOLOR_FORCE`
on every call, and it is called from production paths in
`mergify-freeze`, `mergify-queue`, `mergify-events` and
`mergify-stack`. So any test in any of those crates read the process
environment, on whatever thread it happened to run on, just by
rendering a themed line. That is the read half of the data race this
stack is about: the tests in `mergify-ci`, `mergify-core`,
`mergify-cli` and `mergify-stack` mutate the process environment
while these read it.

Those three reads could never change the answer inside a test binary
anyway. `resolve_enabled` returns `false` for a `None` choice
whatever they say, and only `mergify-cli`'s entry point ever records
a choice, which the doc comment on `set_color_choice` already said. A
test harness read three environment variables to compute a value it
had already decided.

`mergify-tui` now takes the resolved choice and never reads the
environment. `--color always|never` still wins, `NO_COLOR` still
beats `FORCE_COLOR` / `CLICOLOR_FORCE`, and `auto` with neither still
defers to the TTY. The precedence moves to `resolve_color_choice` in
the binary, next to the clap enum it maps from, which is also where
the workspace's environment funnel lives. `mergify-tui` cannot use
that funnel: it is `mergify-core`, and this crate deliberately stays
dependency-light.

Two behaviour fixes come with it, both in the same three variables:

Exported-but-empty no longer counts as set. A workflow writing
`NO_COLOR: ${{ inputs.no_color }}` with no input exports the empty
string, and every `mergify` in that job lost color with no way back
but `--color always`. <https://no-color.org> says "present and not an
empty string"; so does every other variable this CLI reads.

The log stream obeys the same decision. `init_tracing` was choosing
ANSI from `stderr().is_terminal()` alone, so `NO_COLOR=1` and
`--color never` gave plain stdout and a `-vv` stream still full of
escape sequences, which is the one output people redirect to a file.

The remaining visible difference is *when* the variables are read:
once at startup instead of at every `Theme::detect()`. Nothing
mutates the environment mid-run, so the answer is the same either
way.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

Change-Id: Ib099b7044861960ca2c9e85f443072914b333c20
@sileht
sileht force-pushed the devs/sileht/test-env-access-ub/read-ci-env-funnel--668395af branch from 0801c3a to fa102c1 Compare September 18, 2026 07:38
Copilot AI lite review requested due to automatic review settings September 18, 2026 07:38
@sileht

sileht commented Sep 18, 2026

Copy link
Copy Markdown
Member Author

Revision history

# Type Changes Reason Date
1 initial 0801c3a 2026-09-18 07:38 UTC
2 rebase 0801c3a → fa102c1 (rebase only) 2026-09-18 07:38 UTC
3 rebase fa102c1 → 89eaa4a (rebase only) 2026-09-18 08:13 UTC

@sileht
sileht deployed to func-tests-live September 18, 2026 07:39 — with GitHub Actions Active
@mergify
mergify Bot had a problem deploying to Mergify Merge Protections September 18, 2026 07:39 Failure

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The environment-read migration is consistent across the changed CI production paths and tests, with no unresolved correctness issues found.

Pull request overview

Refactors mergify-ci to use the shared environment funnel for production reads and exhaustive test overlays.

Changes:

  • Replaced direct environment access with mergify_core::env.
  • Removed with_ci_env, CI_ENV_VARS, and temp-env usage from CI tests.
  • Updated dependency lockfiles accordingly.
File summaries
File Description
crates/mergify-ci/src/detector.rs Routes CI detection through the shared environment module.
crates/mergify-ci/src/git_refs.rs Uses shared environment reads and overlays in tests.
crates/mergify-ci/src/github_event.rs Uses non-empty shared environment lookups.
crates/mergify-ci/src/github_output.rs Uses the shared environment funnel.
crates/mergify-ci/src/junit_process/command.rs Migrates runtime reads and test overlays.
crates/mergify-ci/src/junit_process/spans.rs Updates span tests to use overlays.
crates/mergify-ci/src/junit_process/split.rs Updates split tests to use overlays.
crates/mergify-ci/src/queue_info.rs Updates output-related tests.
crates/mergify-ci/src/scopes_detect/mod.rs Migrates config/debug reads and tests.
crates/mergify-ci/src/scopes_detect/outputs.rs Migrates output environment reads.
crates/mergify-ci/src/scopes_send.rs Replaces CI test helpers with shared overlays.
crates/mergify-ci/src/testing.rs Removes obsolete CI environment helpers.
crates/mergify-ci/src/tests_quarantine.rs Updates async environment test setup.
crates/mergify-ci/src/tests_show.rs Updates async environment test setup.
crates/mergify-ci/Cargo.toml Removes the unused temp-env dependency.
Cargo.lock Refreshes dependency entries.
Review details
  • Files reviewed: 15/16 changed files
  • Comments generated: 0
  • Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

…test overlay

`mergify_core::env` becomes the one place this workspace reads the
process environment, and `env::testing::with_vars` the one way a test
changes what it says. Nothing mutates the process environment any
more.

`temp_env` did, and that is undefined behaviour in a test binary.
`setenv` became `unsafe` in Rust 1.80 because on Unix it can
reallocate `environ` while another thread sits inside `getenv`: a
use-after-free, not a race whose worst case is a wrong assertion.
libtest runs its tests on many threads at once.

The concurrent reader was never only ours, which is what makes
serialising our own reads a non-answer. `std::env::temp_dir` is a
`getenv`, so every `tempfile::tempdir()` is one, and there are 94 of
those across the four crates that called `temp_env`. So is
`Command::spawn` snapshotting `environ` for the child, and the CLI's
tests spawn `git` constantly. `temp_env`'s lock serialises against
other `temp_env` calls and against nothing else.

So the environment is now read, never written. `var`, `var_os`,
`var_non_empty` and `var_os_non_empty` consult a thread-local overlay
first and the process environment otherwise; `env::testing::with_vars`
installs one for the duration of a closure or a future. No global
state changes, so tests that use it can run concurrently with
anything.

The overlay is a *replacement*, not a patch: while it is installed, a
name the test did not list reads as unset. That is deliberate and it
is worth more than the UB fix. It is what makes a test that reads
`GITHUB_ACTIONS` behave the same on a laptop and on a GitHub Actions
runner, which is the problem `mergify-ci`'s hand-maintained
`CI_ENV_VARS` scrub list existed to paper over, with a comment
admitting new detector inputs had to be added to it or their tests
went flaky on CI.

It is compiled unconditionally rather than behind `cfg(test)`.
`cfg(test)` provably cannot work here: it is false whenever the crate
is compiled as a dependency, so every consumer crate's tests would
read the real environment anyway. `mergify_tui::theme` carries a
comment about having been bitten by exactly that.

Three things the module says about itself, because each one is a way
to misuse it. It is the one place *this workspace* reads the
environment, not the one place the process does: `tracing-subscriber`
reads `RUST_LOG`, `dirs` reads `HOME`, `reqwest` reads the proxy
variables, and no overlay reaches inside a dependency. The guard is
`!Send`, so spawning a guarded future is a compile error, but work
the body itself hands to another thread is not covered. And two
overlay scopes must nest rather than overlap.

`with_no_vars` installs a genuinely empty map rather than layering an
empty list onto the enclosing overlay, which would have made it a
no-op exactly where its name promises the most.

Both accessors use `try_with`, since the overlay owns a `HashMap` and
therefore registers a thread-local destructor: a `Drop` impl reading
a variable while its thread tears down would otherwise panic where
`std::env::var_os` could not, and a panic in a `Drop` during
unwinding aborts.

The `gh auth token` leg of both token resolvers becomes a parameter.
Their tests used to point `PATH` at a nonexistent directory, and two
of them wrote a shell script named `gh` into a temp dir and put
*that* on `PATH`, which needs the environment to really change, for a
grandchild process. A closure says the same thing, including the case
worth pinning (`gh` echoing back the `mut_` value it was handed),
without a shell script, a temp directory or a `cfg(unix)` gate.

Nothing else moves yet: `mergify-ci`, `mergify-stack`, `mergify-cli`
and `mergify-auth` still call `temp_env`, and the lint that bans it
lands at the top of the stack.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

Change-Id: Ib777d5196b912ba69690a03554372442cdbc04be
`mergify-ci` is where most of the process-environment mutation
lived: 27 direct `temp_env` calls plus the 69 that went through
`testing::with_ci_env`. All of them now install a `mergify_core::env`
overlay instead, and the production side reads through the same
module.

`CI_ENV_VARS` goes with them, and `with_ci_env` with it. That helper
existed to merge a list of 43 variable names to unset into each
case's overrides, carrying the instruction to "keep this list aligned
with every `env::var(...)` call across `detector::*`; new detector
helpers must add their inputs here or their tests will be flaky on
CI". An overlay is exhaustive, so a name a test does not list is
unset whatever the host exports, and there is nothing left for the
list to be aligned with. The wrapper had nothing left to wrap. The
call sites say `env::testing::with_vars` / `with_no_vars` directly,
which is what they now mean.

`detector::non_empty_env` goes too: once the reads route through
`mergify_core::env` it was a second name for `env::var_non_empty`,
which the same file calls.

No behaviour changes. `env::var` returns `Option` where
`std::env::var` returned `Result`, so `== Ok("true")` becomes
`== Some("true")` and the `.ok().filter(|s| !s.is_empty())` chains
collapse into `var_non_empty`, which is what they spelled out.

Not done here, and worth naming: seven of those `== Some("true")`
sites re-derive what `detector::get_ci_provider()` already answers,
and the crate would be better served by building one CI snapshot at
each command entry point and passing it down, with no ambient read at
all. That is a different change with different risk, since the two
precedences do not agree today, and it is not a prerequisite for
removing the undefined behaviour.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

Change-Id: I668395af2157ffd73b41a70834a9d77dd504a2db
@sileht
sileht force-pushed the devs/sileht/test-env-access-ub/read-ci-env-funnel--668395af branch from fa102c1 to 89eaa4a Compare September 18, 2026 08:13
@sileht
sileht deployed to func-tests-live September 18, 2026 08:13 — with GitHub Actions Active
@mergify
mergify Bot deployed to Mergify Merge Protections September 18, 2026 08:14 Active
@sileht
sileht marked this pull request as ready for review September 18, 2026 08:17
Base automatically changed from devs/sileht/test-env-access-ub/read-env-one-funnel-hermetic-test-overlay--b777d519 to main September 18, 2026 12:29
@mergify
mergify Bot requested a review from a team September 18, 2026 13:50
@mergify

mergify Bot commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

Merge Queue Status

This pull request spent 7 minutes 5 seconds in the queue, including 6 minutes 31 seconds running CI.

Required conditions to merge

@mergify mergify Bot added the queued label Sep 18, 2026
@mergify
mergify Bot merged commit 1ef19c9 into main Sep 18, 2026
22 of 42 checks passed
@mergify
mergify Bot deleted the devs/sileht/test-env-access-ub/read-ci-env-funnel--668395af branch September 18, 2026 14:10
@mergify mergify Bot removed the queued label Sep 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

4 participants