Popular repositories Loading
-
glm53-flash-a40-fp8kv
glm53-flash-a40-fp8kv PublicGLM-5.3-Flash AWQ on 8xA40 (sm_86): NoPE FP8 KV cache port (528 B/token, 1.85x KV), patch dry-run notes, concurrent canary monitor, tests + raw logs. Experimental.
Python 1
-
qwen38-flash-next-a40
qwen38-flash-next-a40 PublicServing Qwen3.8-Flash-Next (FP8) on 8x A40 (sm_86) with vLLM: version matrix (0.31 works, 0.32/0.33 do not), production config, microbenchmarks, negative results.
Python 1
-
-
glm53-flash-a40-sglang-dflash2
glm53-flash-a40-sglang-dflash2 PublicGLM-5.3-Flash (NVFP4) with SGLang + DFlash2 speculative decoding on 8xA40: launch recipe, passive metrics sampler, concurrency/acceptance analysis
Python
If the problem persists, check the GitHub status page or contact support.