---

base_model: unsloth/Qwen3.5-2B

datasets:

• theprint/CreativeWriting-3k

tags:

• fine-tuned
• lora
• sft
• auto-sft

language:

• en

library_name: transformers

---

CreativeWriter-v1-2B (GGUF)

A fine-tuned version of unsloth/Qwen3.5-2B trained on theprint CreativeWriting 3k data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.

The base model was adapted to follow the style and content of the theprint CreativeWriting 3k dataset. Expect improved performance on tasks similar to those represented in the training data.

Model Details

| Property | Value |

|---|---|

| Base model | unsloth/Qwen3.5-2B |

| Training data | theprint/CreativeWriting-3k |

| Fine-tuning epochs | 2 |

| Fine-tuning date | 2026-08-06 |

| Fine-tuning method | LoRA (merged to full 16-bit) |

Training Hyperparameters

LoRA

| Parameter | Value |

|---|---|

| r | 4 |

| alpha | 4 |

| dropout | 0.04 |

| target_modules | ['q_proj', 'v_proj', 'k_proj', 'o_proj', 'gate_proj', 'up_proj', 'down_proj'] |

Training

| Parameter | Value |

|---|---|

| learning_rate | 1e-05 |

| batch_size | 2 |

| gradient_accumulation_steps | 2 |

| warmup_ratio | 0.05 |

| max_seq_length | 2048 |

| quantization | none |

GGUF Files

These quantized GGUF files can be used directly with llama.cpp, Ollama, LM Studio, and other compatible runtimes.

| File | Description |

|---|---|

| CreativeWriter-v1-2B-GGUF-BF16.gguf | BF16 |

| CreativeWriter-v1-2B-GGUF-Q8_0.gguf | 8-bit — near-lossless, larger file |

| CreativeWriter-v1-2B-GGUF-Q6_K.gguf | 6-bit — high quality |

| CreativeWriter-v1-2B-GGUF-Q5_K_M.gguf | 5-bit medium — good quality/size balance |

| CreativeWriter-v1-2B-GGUF-Q5_K_S.gguf | Q5_K_S |

| CreativeWriter-v1-2B-GGUF-Q4_K_M.gguf | 4-bit medium — recommended for most use cases |

| CreativeWriter-v1-2B-GGUF-Q4_K_S.gguf | Q4_K_S |

| CreativeWriter-v1-2B-GGUF-Q3_K_L.gguf | Q3_K_L |

| CreativeWriter-v1-2B-GGUF-Q3_K_M.gguf | Q3_K_M |

| CreativeWriter-v1-2B-GGUF-Q3_K_S.gguf | Q3_K_S |

| CreativeWriter-v1-2B-GGUF-Q2_K.gguf | 2-bit — smallest size, lowest quality |

| CreativeWriter-v1-2B-GGUF-IQ4_XS.gguf | IQ4_XS |

| CreativeWriter-v1-2B-GGUF-IQ4_NL.gguf | IQ4_NL |

| CreativeWriter-v1-2B-GGUF-TQ2_0.gguf | TQ2_0 |

---

Generated by Auto-SFT — automated LoRA fine-tuning with hyperparameter search.