Large Language Model (LLM) fine-tuning repository focused on Quantized Low-Rank Adaptation (QLoRA) and memory-efficient training. Covers 4-bit quantization, NF4, Double Quantization, LoRA adapters, supervised fine-tuning, dataset preparation, and model evaluation using Python, PyTorch, Hugging Face PEFT, TRL, and BitsAndBytes.
lora peft huggingface huggingface-transformers large-language-models low-rank-adaptation qlora bitsandbytes lora-training parameter-efficient-fine-tuning llm-fine-tuning peft-fine-tuning-llm large-language-models-llms 4bit-quantization peft-fine-tuning peft-llm peft-lora peft-qlora qlora-finetuning quantized-fine-tuning
-
Updated
Nov 15, 2026 - Jupyter Notebook