Skip to content

Flaky fork settings browser tests (UsagePacing, ModelPolicy, ForkPanels, ReviewRules) and the ChatView image-send test #732

Closed as not planned

Description

@scuttletoby

Since 2026-11-16, 7 Test Web shard jobs failed on one slow or flaky test each (no Chromium crash):

  • UsagePacingSettings / ModelPolicySettings (2x UsagePacingSettings)
  • ForkPanels
  • ReviewRulesSettings
  • ChatView image-send (2x)

Known-failing tests: fix first, no reruns. Find each root cause (timing, a missing wait on real state, shared state between tests) and fix it so each test passes 30 runs in a row under load.

🤖 Generated with Claude Code

Activity

  1. scuttletoby commented on Nov 21, 2026

    @scuttletoby
    OwnerAuthor

    Closing: none of these tests is flaky on current main. Every failed Test Web job in fork-tests since 2026-11-16 (all 1090 runs, all attempts; 9 failed jobs) has a known cause:

    30 runs in a row on current main, one at a time: UsagePacingSettings (with ModelPolicySettings) 30/30, ForkPanels 30/30, ReviewRulesSettings 30/30, ChatView image-send 30/30. No Test Web job has failed since the settings PRs merged (about 440 fork-tests runs).

    Side note, not fixed: the upstream ChatView test "a shortcut conditioned on rightPanelOpen…" (Ctrl+T) failed 30/30 on a macOS machine but has not failed on the Linux CI runners. Reopen this issue if any of these tests goes red again on main.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions