Skip to content

cuda : support for sparse KV indices in MMA flash attention kernel - #25917

Closed
fairydreaming wants to merge 11 commits into
ggml-org:masterfrom
fairydreaming:sparse-fa-mma
Closed

cuda : support for sparse KV indices in MMA flash attention kernel#25917
fairydreaming wants to merge 11 commits into
ggml-org:masterfrom
fairydreaming:sparse-fa-mma