GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

fableforge-ai/FableForge-1.5B-GGUF overview

FableForge 1.5B GGUF FableForge generalist — all NEXUS domains distilled into one model. Downloads https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2F…

ggufcodingfableforgegeneralistimatrixllama.cpplm-studionexusollamareasoningtext-generationuncensoredenbase_model:fableforge-ai/FableForge-1.5Bbase_model:quantized:fableforge-ai/FableForge-1.5Blicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~2.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
4,352
Likes
1
Pipeline
text-generation

Repository Files & Downloads

24 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
FableForge-1.5B-F16.ggufGGUFF162.88 GBDownload
FableForge-1.5B-IQ1_S.ggufGGUFIQ1_S416.3 MBDownload
FableForge-1.5B-IQ2_XXS.ggufGGUFIQ2_XXS487.3 MBDownload
FableForge-1.5B-IQ3_XXS.ggufGGUFIQ3_XXS637.8 MBDownload
FableForge-1.5B-IQ4_XS.ggufGGUFIQ4_XS854.2 MBDownload
FableForge-1.5B-Q2_K.ggufGGUFQ2_K645.0 MBDownload
FableForge-1.5B-Q3_K_M.ggufGGUFQ3_K_M869.2 MBDownload
FableForge-1.5B-Q4_0.ggufGGUFQ4_0945.5 MBDownload
FableForge-1.5B-Q4_K_M.ggufGGUFQ4_K_M1008.4 MBDownload
FableForge-1.5B-Q5_K_M.ggufGGUFQ5_K_M1.12 GBDownload
FableForge-1.5B-Q6_K.ggufGGUFQ6_K1.24 GBDownload
FableForge-1.5B-Q8_0.ggufGGUFQ8_01.53 GBDownload
FableForge-1.5B-imatrix.ggufGGUFGGUF2.0 MBDownload
FableForge-1.5B-iq2_s.ggufGGUFIQ2_S537.7 MBDownload
FableForge-1.5B-iq2_xs.ggufGGUFIQ2_XS524.8 MBDownload
FableForge-1.5B-iq3_m.ggufGGUFIQ3_M740.7 MBDownload
FableForge-1.5B-iq3_s.ggufGGUFIQ3_S727.1 MBDownload
FableForge-1.5B-iq3_xs.ggufGGUFIQ3_XS697.8 MBDownload
FableForge-1.5B-iq4_nl.ggufGGUFIQ4_NL893.0 MBDownload
FableForge-1.5B-q3_k_l.ggufGGUFQ3_K_L839.4 MBDownload
FableForge-1.5B-q3_k_s.ggufGGUFQ3_K_S725.7 MBDownload
FableForge-1.5B-q4_1.ggufGGUFQ4_1969.7 MBDownload
FableForge-1.5B-q4_k_s.ggufGGUFQ4_K_S896.7 MBDownload
FableForge-1.5B-q5_k_s.ggufGGUFQ5_K_S1.02 GBDownload

Model Details

Model IDfableforge-ai/FableForge-1.5B-GGUF
Authorfableforge-ai
Pipelinetext-generation
Licenseapache-2.0
Base modelfableforge-ai/FableForge-1.5B
Last modified2026-07-17T04:46:49.000Z

Model README

---

license: apache-2.0

language:

- en

library_name: gguf

pipeline_tag: text-generation

base_model: fableforge-ai/FableForge-1.5B

base_model_relation: quantized

tags:

- coding

- fableforge

- generalist

- gguf

- imatrix

- llama.cpp

- lm-studio

- nexus

- ollama

- reasoning

- text-generation

- uncensored

---

FableForge-1.5B-GGUF

> FableForge generalist — all NEXUS domains distilled into one model.

![Downloads](https://huggingface.co/fableforge-ai/FableForge-1.5B-GGUF) ![Demos](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)

Base model: fableforge-ai/FableForge-1.5B · Part of the FableForge ecosystem.

---

⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)

ollama run hf.co/fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M

🦙 llama.cpp

llama-cli -hf fableforge-ai/FableForge-1.5B-GGUF:Q4_K_M -p "Hello!"

💠 LM Studio

Search fableforge-ai/FableForge-1.5B-GGUF and pick a quant below.

---

📦 Provided quants (download one file, not the whole repo)

| File | Quant | Size | Notes |

| ---- | ----- | ---- | ----- |

| FableForge-1.5B-F16.gguf | F16 | 3.09 GB | Full precision (unquantized). Reference / conversion. |

| FableForge-1.5B-Q8_0.gguf | Q8_0 | 1.65 GB | Extremely high quality — usually overkill. |

| FableForge-1.5B-Q6_K.gguf | Q6_K | 1.33 GB | Very high quality, near-perfect. Recommended if you have the RAM. |

| FableForge-1.5B-Q5_K_M.gguf | Q5_K_M | 1.21 GB | High quality. Recommended. |

| FableForge-1.5B-Q4_K_M.gguf | Q4_K_M | 1.06 GB | ⭐ Best size/quality balance — default pick for most users. |

| FableForge-1.5B-IQ4_XS.gguf | IQ4_XS | 0.90 GB | imatrix — great quality, smaller than Q4_K_S. Recommended for low RAM. |

| FableForge-1.5B-Q4_0.gguf | Q4_0 | 0.99 GB | Legacy format — prefer Q4_K_M. |

| FableForge-1.5B-Q3_K_M.gguf | Q3_K_M | 0.91 GB | Lower quality; usable when RAM is tight. |

| FableForge-1.5B-IQ3_XXS.gguf | IQ3_XXS | 0.67 GB | imatrix very low quality. |

| FableForge-1.5B-Q2_K.gguf | Q2_K | 0.68 GB | Very low quality — surprisingly usable. |

| FableForge-1.5B-IQ2_XXS.gguf | IQ2_XXS | 0.51 GB | Tiny imatrix — last resort. |

| FableForge-1.5B-IQ1_S.gguf | ? | 0.44 GB | |

| FableForge-1.5B-imatrix.gguf | ? | 0.00 GB | |

Not sure? Take Q4_K_M. Low RAM → IQ4_XS. Max quality → Q6_K.

🧠 Prompt format (ChatML)

<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

🌌 See it live — the FableForge demos

This family powers a galaxy of free, interactive HF Spaces:

---

🔗 Related models

---

⭐ Like & share — it helps people find the source instead of a mirror.

Run fableforge-ai/FableForge-1.5B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models