Skip to content

Adds support for 4bit (nf4) and 8bit bitsandbytes quantization (3/3)#151

Open
Rypo wants to merge 15 commits into
VectorSpaceLab:mainfrom
Rypo:bnb_quantization
Open

Adds support for 4bit (nf4) and 8bit bitsandbytes quantization (3/3)#151
Rypo wants to merge 15 commits into
VectorSpaceLab:mainfrom
Rypo:bnb_quantization

Merge branch 'main' into bnb_quantization

0acd89e
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs