Skip to content

[ChatQnA] Remove enforce-eager to enable HPU graphs for better vLLM perf#1210

Merged
lvliang-intel merged 4 commits into
opea-project:mainfrom
wangkl2:update-vllm-gaudi
Dec 10, 2024
Merged

[ChatQnA] Remove enforce-eager to enable HPU graphs for better vLLM perf#1210
lvliang-intel merged 4 commits into
opea-project:mainfrom
wangkl2:update-vllm-gaudi

Increase the llm max timeout in ci for fully warmup

18ffa62
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs