Skip to content

fix(agentx): allow sparse low-concurrency profile tails - #41

Merged
cquil11 merged 1 commit into
mainfrom
agent/agentx-liveness-window
Aug 12, 2026
Merged

fix(agentx): allow sparse low-concurrency profile tails#41
cquil11 merged 1 commit into
mainfrom
agent/agentx-liveness-window

Conversation

@cquil11

@cquil11 cquil11 commented Aug 12, 2026

Copy link
Copy Markdown

Summary

Lower the AgentX profile-liveness cutoff from 98% to 95%. On a one-hour profile, the allowed quiet tail changes from 72 seconds to 180 seconds; the run still fails when neither TTFT nor inter-token latency reaches that cutoff.

False-positive runs

Error and fix

At low concurrency, a long request can remain in flight through the end of an otherwise healthy profile, leaving no new latency sample in the final 72 seconds. The 95% cutoff tolerates that sparse tail while still detecting the intended failure mode: a server that produces neither latency signal for the final three minutes.

Validation

  • 103 focused tests passed
  • Ruff and format checks passed
  • all pre-commit hooks passed

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
@github-actions

Copy link
Copy Markdown

Try out this PR

Quick install:

pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@c5f353f0ae120bc4d2531122dbcec90194ffcaa9

Recommended with virtual environment (using uv):

uv venv --python 3.12 && source .venv/bin/activate
uv pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@c5f353f0ae120bc4d2531122dbcec90194ffcaa9

Last updated for commit: c5f353fBrowse code

@github-actions

Copy link
Copy Markdown

Fern Docs Preview: generation failed — see the Actions log for details. This does not block merge; ask a maintainer to retry if needed.

@cquil11
cquil11 merged commit 754356e into main Aug 12, 2026
12 of 16 checks passed
@cquil11
cquil11 deleted the agent/agentx-liveness-window branch August 12, 2026 11:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant