Skip to content

[None][feat] BREAKING: serve: default num_serve_frontends to 8 with single-frontend fallback - #19379

Open
lancelly wants to merge 2 commits into
NVIDIA:mainfrom
lancelly:feat/serve-num-frontends-default-8
Open

lancelly wants to merge 2 commits into
NVIDIA:mainfrom
lancelly:feat/serve-num-frontends-default-8