fableforge-ai/FableForge-1.5B-GGUF overview
FableForge 1.5B GGUF FableForge generalist — all NEXUS domains distilled into one model. Downloads https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2F…
Runs locally from ~2.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| FableForge-1.5B-F16.gguf | GGUF | F16 | 2.88 GB | Download |
| FableForge-1.5B-IQ1_S.gguf | GGUF | IQ1_S | 416.3 MB | Download |
| FableForge-1.5B-IQ2_XXS.gguf | GGUF | IQ2_XXS | 487.3 MB | Download |
| FableForge-1.5B-IQ3_XXS.gguf | GGUF | IQ3_XXS | 637.8 MB | Download |
| FableForge-1.5B-IQ4_XS.gguf | GGUF | IQ4_XS | 854.2 MB | Download |
| FableForge-1.5B-Q2_K.gguf | GGUF | Q2_K | 645.0 MB | Download |
| FableForge-1.5B-Q3_K_M.gguf | GGUF | Q3_K_M | 869.2 MB | Download |
| FableForge-1.5B-Q4_0.gguf | GGUF | Q4_0 | 945.5 MB | Download |
| FableForge-1.5B-Q4_K_M.gguf | GGUF | Q4_K_M | 1008.4 MB | Download |
| FableForge-1.5B-Q5_K_M.gguf | GGUF | Q5_K_M | 1.12 GB | Download |
| FableForge-1.5B-Q6_K.gguf | GGUF | Q6_K | 1.24 GB | Download |
| FableForge-1.5B-Q8_0.gguf | GGUF | Q8_0 | 1.53 GB | Download |
| FableForge-1.5B-imatrix.gguf | GGUF | GGUF | 2.0 MB | Download |
| FableForge-1.5B-iq2_s.gguf | GGUF | IQ2_S | 537.7 MB | Download |
| FableForge-1.5B-iq2_xs.gguf | GGUF | IQ2_XS | 524.8 MB | Download |
| FableForge-1.5B-iq3_m.gguf | GGUF | IQ3_M | 740.7 MB | Download |
| FableForge-1.5B-iq3_s.gguf | GGUF | IQ3_S | 727.1 MB | Download |
| FableForge-1.5B-iq3_xs.gguf | GGUF | IQ3_XS | 697.8 MB | Download |
| FableForge-1.5B-iq4_nl.gguf | GGUF | IQ4_NL | 893.0 MB | Download |
| FableForge-1.5B-q3_k_l.gguf | GGUF | Q3_K_L | 839.4 MB | Download |
| FableForge-1.5B-q3_k_s.gguf | GGUF | Q3_K_S | 725.7 MB | Download |
| FableForge-1.5B-q4_1.gguf | GGUF | Q4_1 | 969.7 MB | Download |
| FableForge-1.5B-q4_k_s.gguf | GGUF | Q4_K_S | 896.7 MB | Download |
| FableForge-1.5B-q5_k_s.gguf | GGUF | Q5_K_S | 1.02 GB | Download |
Model Details
| Model ID | fableforge-ai/FableForge-1.5B-GGUF |
|---|---|
| Author | fableforge-ai |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | fableforge-ai/FableForge-1.5B |
| Last modified | 2026-07-17T04:46:49.000Z |
Model README
---
license: apache-2.0
language:
- en
library_name: gguf
pipeline_tag: text-generation
base_model: fableforge-ai/FableForge-1.5B
base_model_relation: quantized
tags:
- coding
- fableforge
- generalist
- gguf
- imatrix
- llama.cpp
- lm-studio
- nexus
- ollama
- reasoning
- text-generation
- uncensored
---
FableForge-1.5B-GGUF
> FableForge generalist — all NEXUS domains distilled into one model.
 
Base model: fableforge-ai/FableForge-1.5B · Part of the FableForge ecosystem.
---
⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)
ollama run hf.co/fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M
🦙 llama.cpp
llama-cli -hf fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M -p "Hello!"
💠 LM Studio
Search fableforge-ai/FableForge-1.5B-GGUF and pick a quant below.
---
📦 Provided quants (download one file, not the whole repo)
| File | Quant | Size | Notes |
| ---- | ----- | ---- | ----- |
| FableForge-1.5B-F16.gguf | F16 | 3.09 GB | Full precision (unquantized). Reference / conversion. |
| FableForge-1.5B-Q8_0.gguf | Q8_0 | 1.65 GB | Extremely high quality — usually overkill. |
| FableForge-1.5B-Q6_K.gguf | Q6_K | 1.33 GB | Very high quality, near-perfect. Recommended if you have the RAM. |
| FableForge-1.5B-Q5_K_M.gguf | Q5_K_M | 1.21 GB | High quality. Recommended. |
| FableForge-1.5B-Q4_K_M.gguf | Q4_K_M | 1.06 GB | ⭐ Best size/quality balance — default pick for most users. |
| FableForge-1.5B-IQ4_XS.gguf | IQ4_XS | 0.90 GB | imatrix — great quality, smaller than Q4_K_S. Recommended for low RAM. |
| FableForge-1.5B-Q4_0.gguf | Q4_0 | 0.99 GB | Legacy format — prefer Q4_K_M. |
| FableForge-1.5B-Q3_K_M.gguf | Q3_K_M | 0.91 GB | Lower quality; usable when RAM is tight. |
| FableForge-1.5B-IQ3_XXS.gguf | IQ3_XXS | 0.67 GB | imatrix very low quality. |
| FableForge-1.5B-Q2_K.gguf | Q2_K | 0.68 GB | Very low quality — surprisingly usable. |
| FableForge-1.5B-IQ2_XXS.gguf | IQ2_XXS | 0.51 GB | Tiny imatrix — last resort. |
| FableForge-1.5B-IQ1_S.gguf | ? | 0.44 GB | |
| FableForge-1.5B-imatrix.gguf | ? | 0.00 GB | |
Not sure? Take Q4_K_M. Low RAM → IQ4_XS. Max quality → Q6_K.
🧠 Prompt format (ChatML)
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
🌌 See it live — the FableForge demos
This family powers a galaxy of free, interactive HF Spaces:
---
🔗 Related models
- 🧠 Base model (safetensors):
FableForge-1.5B - 🔄 V2 GGUF:
FableForge-1.5B-v2-GGUF
---
⭐ Like & share — it helps people find the source instead of a mirror.
Run fableforge-ai/FableForge-1.5B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models