Skip to content

[#19527][fix] Account for beam width when sizing CUDA graph warmup KV requests - #19568

Open
LiRunGuo wants to merge 1 commit into
NVIDIA:mainfrom
LiRunGuo:fix/beam-search-cuda-graph-warmup-kv-sizing
Open

[#19527][fix] Account for beam width when sizing CUDA graph warmup KV requests#19568
LiRunGuo wants to merge 1 commit into
NVIDIA:mainfrom
LiRunGuo:fix/beam-search-cuda-graph-warmup-kv-sizing

[#19527][fix] Account for beam width when sizing CUDA graph warmup KV…

24a4c29
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 23, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO