24gb

Here is 1 public repository matching this topic...

Alvinpro / Deploy-Local-Llama-C1-Qwen-3.8-27B-3090-24GB-Windows-11

One-click deployment of Qwen3.8-27B on a single RTX 3090 (24GB) on Windows 11: Q4_K_XL quantization + MTP speculative decoding + 128K context window, exposed as an OpenAI-compatible llama-server, averaging ~47 tok/s with ~1.5× lossless MTP speedup

deployment windows-11 local-llm rtx-3090 24gb qwen-38-27b 128k-context

Updated Aug 20, 2026
PowerShell

Add this topic to your repo

To associate your repository with the 24gb topic, visit your repo's landing page and select "manage topics."

Learn more