int6

Here are 2 public repositories matching this topic...

intel / neural-speed

An innovative library for efficient LLM inference via low-bit quantization

Updated Aug 30, 2024
C++

QinXi-ai / pocket-moss-image

🌿 Pocket MOSS Image — run the full MOSS-Image 9B encoder in pocket-sized VRAM: packed INT6 weights + streamed fused INT8 DiT, ~6.6 GB GPU peak, no retraining.

cuda pytorch quantization text-to-image diffusion int8 generative-ai int6 low-vram moss-image

Updated Oct 18, 2026
Python

Add this topic to your repo

To associate your repository with the int6 topic, visit your repo's landing page and select "manage topics."

Learn more