Efficient LLM fine-tuning & deployment: LoRA, QLoRA, PTQ and QAT — with benchmarking and config-driven pipelines.
-
Updated
Oct 5, 2026 - Python
Efficient LLM fine-tuning & deployment: LoRA, QLoRA, PTQ and QAT — with benchmarking and config-driven pipelines.
A practical Large Language Model (LLM) fine-tuning repository focused on Low-Rank Adaptation (LoRA) and Parameter-Efficient Fine-Tuning (PEFT). Covers LoRA architecture, adapter configuration, dataset preparation, supervised fine-tuning, model evaluation, and efficient LLM customization using Python, PyTorch, and Hugging Face Transformers.
A LoRA adapter that steers Helsinki-NLP/opus-mt-en-es toward literary prose. 589K trainable parameters — 0.75% of the model — trained on opus_books en-es. 19.99 sacreBLEU against 17.09 for the untouched base model. 2.4 MB; loads on top of the base with PEFT.
Large Language Model (LLM) fine-tuning repository focused on Quantized Low-Rank Adaptation (QLoRA) and memory-efficient training. Covers 4-bit quantization, NF4, Double Quantization, LoRA adapters, supervised fine-tuning, dataset preparation, and model evaluation using Python, PyTorch, Hugging Face PEFT, TRL, and BitsAndBytes.
Fine-tunes Llama 2 on medical Q&A data using QLoRA, with pipelines for preprocessing, evaluation, and FastAPI deployment.
Finetune AI Models : Reusable Hugging Face PEFT Lora and QLora finetuning scripts
To associate your repository with the peft-llm topic, visit your repo's landing page and select "manage topics."