Skip to content

[https://nvbugs/6721558][fix] Only record first token time when collecting perf metrics - #18746

Closed
trtllm-agent wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:repair-bot-bug6721558
Closed

trtllm-agent wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:repair-bot-bug6721558