theprint/Survivor-v1-2B-GGUF overview
Survivor v1 2B GGUF A fine tuned version of theprint/Survivor v1 2B https://huggingface.co/theprint/Survivor v1 2B trained on Off Grid Survival sharegpt data u…
Runs locally from ~637.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Survivor-v1-2B-GGUF-BF16.gguf | GGUF | BF16 | 3.63 GB | Download |
| Survivor-v1-2B-GGUF-IQ4_NL.gguf | GGUF | IQ4_NL | 1.18 GB | Download |
| Survivor-v1-2B-GGUF-Q2_K.gguf | GGUF | Q2_K | 944.6 MB | Download |
| Survivor-v1-2B-GGUF-Q3_K_L.gguf | GGUF | Q3_K_L | 1.11 GB | Download |
| Survivor-v1-2B-GGUF-Q3_K_M.gguf | GGUF | Q3_K_M | 1.05 GB | Download |
| Survivor-v1-2B-GGUF-Q3_K_S.gguf | GGUF | Q3_K_S | 997.9 MB | Download |
| Survivor-v1-2B-GGUF-Q4_K_M.gguf | GGUF | Q4_K_M | 1.22 GB | Download |
| Survivor-v1-2B-GGUF-Q4_K_S.gguf | GGUF | Q4_K_S | 1.16 GB | Download |
| Survivor-v1-2B-GGUF-Q5_K_M.gguf | GGUF | Q5_K_M | 1.35 GB | Download |
| Survivor-v1-2B-GGUF-Q5_K_S.gguf | GGUF | Q5_K_S | 1.32 GB | Download |
| Survivor-v1-2B-GGUF-Q6_K.gguf | GGUF | Q6_K | 1.50 GB | Download |
| Survivor-v1-2B-GGUF-Q8_0.gguf | GGUF | Q8_0 | 1.93 GB | Download |
| mmproj-BF16.gguf | GGUF | BF16 | 640.3 MB | Download |
| mmproj-F16.gguf | GGUF | F16 | 637.3 MB | Download |
| mmproj-F32.gguf | GGUF | F32 | 1.23 GB | Download |
Model Details
Model README
---
base_model: theprint/Survivor-v1-2B
tags:
- fine-tuned
- lora
- sft
- auto-sft
language:
- en
library_name: transformers
---
Survivor-v1-2B (GGUF)
A fine-tuned version of theprint/Survivor-v1-2B trained on Off Grid Survival sharegpt data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.
The base model was adapted to follow the style and content of the Off Grid Survival sharegpt dataset. Expect improved performance on tasks similar to those represented in the training data.
Model Details
| Property | Value |
|---|---|
| Base model | theprint/Survivor-v1-2B |
| Training data | data/Off-Grid-Survival-sharegpt.json |
| Fine-tuning epochs | 2 |
| Fine-tuning date | 2026-07-10 |
| Fine-tuning method | LoRA (merged to full 16-bit) |
Training Hyperparameters
LoRA
| Parameter | Value |
|---|---|
| r | 16 |
| alpha | 64 |
| dropout | 0.06 |
| target_modules | ['q_proj', 'v_proj'] |
Training
| Parameter | Value |
|---|---|
| learning_rate | 2e-05 |
| batch_size | 4 |
| gradient_accumulation_steps | 4 |
| warmup_ratio | 0.03 |
| max_seq_length | 2048 |
| quantization | none |
GGUF Files
These quantized GGUF files can be used directly with llama.cpp, Ollama, LM Studio, and other compatible runtimes.
| File | Description |
|---|---|
| Survivor-v1-2B-GGUF-BF16.gguf | BF16 |
| Survivor-v1-2B-GGUF-Q8_0.gguf | 8-bit — near-lossless, larger file |
| Survivor-v1-2B-GGUF-Q6_K.gguf | 6-bit — high quality |
| Survivor-v1-2B-GGUF-Q5_K_M.gguf | 5-bit medium — good quality/size balance |
| Survivor-v1-2B-GGUF-Q5_K_S.gguf | Q5_K_S |
| Survivor-v1-2B-GGUF-Q4_K_M.gguf | 4-bit medium — recommended for most use cases |
| Survivor-v1-2B-GGUF-Q4_K_S.gguf | Q4_K_S |
| Survivor-v1-2B-GGUF-Q3_K_L.gguf | Q3_K_L |
| Survivor-v1-2B-GGUF-Q3_K_M.gguf | Q3_K_M |
| Survivor-v1-2B-GGUF-Q3_K_S.gguf | Q3_K_S |
| Survivor-v1-2B-GGUF-Q2_K.gguf | 2-bit — smallest size, lowest quality |
| Survivor-v1-2B-GGUF-IQ4_NL.gguf | IQ4_NL |
---
Generated by Auto-SFT
Run theprint/Survivor-v1-2B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models