Repository navigation
Conversation
…ise mix 12000 tok/s 1h trace Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…n times (fixed_schedule) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ummary and report.html Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Generally most InferenceX submissions don't need to add changes to the infx package. On the off chance they do, generally the diff is small. Please prompt your agent to clean your PR to keep your diff to only necessary & minimal changes too. We have an increased code quality bar for changes to the infx package. 中文大多数 InferenceX 提交通常不需要修改 infx 包。即使确实需要,改动通常也很小。请让你的 agent 清理 PR,使改动只包含必要且最小的内容。infx 包的改动有更高的代码质量要求。 |
…it for checkout Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…verage at 92.3% < the lock's 95% Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1 s slices made ~80 MB per hour and an unreadable time axis; 60 s keeps aiperf's own per-slice stats at ~1.3 MB per hour. Whole-run metrics are unchanged; nothing in the repo read the 1 s slices. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…exported Markdown: a collapsed per-run table plus Mermaid lines for output tok/s and TTFT p90; HTML: SVG panels over minutes. No re-aggregation: values are aiperf's per-slice stats. Runs with slices under 30 s get a note. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…drop the RTX example The RTX nodes cannot pull lmsysorg/sglang:v0.5.22 from Docker Hub (401s mid-download over a slow link) until the image is staged on them. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Mermaid's auto y range drew a 9% change as a full-height climb; points sit at each slice's start, so a 3-minute run ends at minute 2. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…benchmark Re-running the old report job reuses that run's commit; this runs the current result-report. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ult) Other tools read the 1 s timeslice exports; coarser views belong in the report, not the artifact. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…est records The artifacts keep aiperf's 1 s slices (other tools read them). The report rebuilds the same per-slice numbers at ~60 windows per run from profile_export.jsonl with aiperf's rules; at 1 s it matches profile_export_aiperf_timeslices.json exactly (TimelineTest, fixture from run 40478619956). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
mixscenario: replays a mixed-traffic trace (bench repostudies/mixed-workload/mix.py) open loop at its own timestamps (fixed_schedule,blockSize: 64);conconly caps requests in flight. The rate is the load axis: one lock entry per rate, picked withoverrides.dataset.path+sha256(relative toinferencex-e2e/) instead of an HF repo/revision/file. First entry:mix-enterprise-12000-1h(6.8 MB, 12679 requests).gn-benchmark.ymlgets areportjob that runs.agents/skills/result-reportover the whole run, writesreport.mdto the run summary and uploadsreport.html(unzipped) plusreport.md/data.json.profile_export.jsonlwith aiperf's own time-slice rules; at 1 s it matches aiperf'sprofile_export_aiperf_timeslices.jsonexactly (test fixture from a real run). Artifacts keep aiperf's 1 s slices. Markdown: collapsed table + Mermaid lines (render on the Summary page); HTML: SVG panels.gh workflow run gn-benchmark.yml --ref <branch> -f report-run=<run id> -f test-name=...re-renders a finished run's report with the branch's code, no GPU job.configs/serving/qwen3-8b-mix-enterprise-h200.yaml(Qwen3-8B, 1x H200 on hgx-h200-01, HiCache L1+L2), docs and skill tables updated.Notes
inferencex-agentx-mvplocksagentic_replay;unsafeOverride: truekeepsfixed_scheduleand marks the run not submission-valid (same as E2/E3/LiveKit).durationequals the trace length (3600 s): the scenario lock needs TTFT/ITL over 95% of it. A smalleroverrides.durationcuts the replay.Testing
pytest infx/tests/serving: 183 passed; result-report tests: 105 passed + 107 subtests (rebuilt 1 s windows == aiperf's 1 s slices).aiperf validate mooncake-traceon the trace: 12679 rows OK.process_agentic_resultandvalidate_agentic_resultpass.duration: 3900(https://github.com/vngcloud/InferenceX/actions/runs/40465657027): all 12679 requests served, 0 errors, 3.52 req/s (= offered), TTFT p50/p90/p99 46/405/2957 ms, cache hit 34%; failed only on aiperf's coverage check (92.3% of 3900 s < 95%). Fixed byduration: 3600.lmsysorg/sglang:v0.5.22cannot be pulled from Docker Hub there (401s mid-download over a slow link, run 40482719267) until the image is staged on the nodes.🤖 Generated with Claude Code