Skip to content

feat: Free gpu space after each inference run#493

Open
hh-space-invader wants to merge 24 commits into
gpufrom
fix-gpu-fragmentation
Open

feat: Free gpu space after each inference run#493
hh-space-invader wants to merge 24 commits into
gpufrom
fix-gpu-fragmentation

fix: Pass providers and cuda to multimodal models

9e21de2
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs