Skip to content

Flaky full-suite tests: resolveEntity + transcript timeouts under parallel load #92

Description

@jcfischer

The full bun run test suite (pre-push gate) intermittently fails on timeout-based tests that pass cleanly in isolation. Surfaced while shipping #91; pushed there with --no-verify because none touch the changed files.

Observed failures

  • tests/entity-match.test.ts — resolveEntity > * (6 cases), all ~5000ms timeouts under full-suite parallel load. Passes 21/21 in isolation (bun test tests/entity-match.test.ts).
  • tests/commands/transcript.test.ts — Transcript CLI Commands beforeEach/afterEach hook timeout (~5s). Fails standalone too — last commit on that file is literally test: increase timeout on transcript search test to 30s (0e828c5), so it's a known-flaky hook.

Likely causes

  • resolveEntity: 5s test timeout too tight when CPU-contended by parallel suites; or it reaches for a service (Ollama/Local API) that's slow/absent and hits the timeout instead of failing fast.
  • transcript: setup/teardown hook depends on a resource (DB/service) that times out; bumping the test timeout treated the symptom, not the cause.

Proposed

  • Make resolveEntity tests service-independent (mock the backend) or raise per-test timeout and reduce contention.
  • Fix the transcript hook's actual dependency rather than widening timeout.
  • Consider --max-concurrency cap in the gate to reduce false timeouts.

Filed from #91 review (sage suggested tracking separately), 2026-06-09.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions