feat(QUANT-GGUF-IQ4_NL): IQ4_NL keep-quant GEMM on ROCm - #3149
Open
localai-org-maint-bot wants to merge 7 commits into
Open
feat(QUANT-GGUF-IQ4_NL): IQ4_NL keep-quant GEMM on ROCm#3149localai-org-maint-bot wants to merge 7 commits into
localai-org-maint-bot wants to merge 7 commits into