Nunchaku Lite quantization in place - #14608

Draft

rootonchair wants to merge 7 commits into

huggingface:mainfrom

rootonchair:feature/data-free-quantization

Commits on Aug 25, 2026

Add data-free SVDQuant quantize-on-load to Nunchaku Lite

rootonchair
and
claude
committed
fc27874
Infer data-free quantization targets automatically

rootonchair
and
claude
committed
ebfc2c9
Infer data-free exclusions structurally

rootonchair
and
claude
committed
26bf67e
Rename modules_to_not_convert to exclude_targets

rootonchair
and
claude
committed
ae79c1b
Silence false missing/unexpected key warnings in data-free mode

rootonchair
and
claude
committed
67da88e

Commits on Aug 26, 2026

Rename data_free.py to svdquant.py

rootonchair
and
claude
committed
6cb4b2e
Rename mixin test to test_nunchaku_lite_quantize_on_load

rootonchair
and
claude
committed
cae6967