---

base_model: ibm-granite/granite-4.1-8b

base_model_relation: finetune

datasets:

• Glint-Research/Fable-5-traces
• Roman1111111/gpt5.5-terminal

license: apache-2.0

language:

• en

pipeline_tag: text-generation

library_name: gguf

tags:

• gguf
• qlora
• agentic
• agent
• coding
• tool-use
• terminal
• reasoning
• thinking
• claude
• claude-fable-5
• distillation
• trace-training
• llama.cpp
• ollama
• lm-studio
• granite

---

<picture>

<source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/ankit-aglawe/parable-assets/main/parable_header_dark.png">

<img alt="Parable" src="https://raw.githubusercontent.com/ankit-aglawe/parable-assets/main/parable_header.png">

</picture>

🪶 Parable-Granite-8B — trained on genuine Claude Fable 5 agent traces

The strongest Parable. Planning, tool use, and <think> reasoning distilled from real Claude Fable 5 and GPT-5.5 agent sessions — 70% lower held-out test loss than its base, and past the 0.71 mark the 9B-class incumbent reports on this data family.

> ~6 GB of RAM is all you need. The Q4 build fits comfortably on an ordinary laptop or a mid-range GPU.

> One command and you have a private, offline reasoning model on your machine:

>

> ```bash

> ollama run hf.co/AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF:Q4_K_M

> ```

Parable-Granite-4.1-8B is an ibm-granite/granite-4.1-8b fine-tune trained on real multi-step agent sessions: planning, tool use, and <think> reasoning captured from actual Claude Fable 5 and GPT-5.5 agent work, not synthetic Q&A. It is the largest release in the Parable series.

---

Announcements

🔮 v2 is coming. The 3B just got the v2 treatment (13× corpus, rebuilt recipe) — the same upgrade lands here next. Same links, in-place.

📦 Full family. This 8B is the largest Parable. Also available: 3B Granite, 8B Qwen, 4B Qwen — same recipe, no matter your hardware. Everything lives in the Parable collection.

---

Pick your size

| File | Size | Fits in | Notes |

|---|---|---|---|

| Q4_K_M | 4.8 GB | ~6 GB RAM/VRAM | ⭐ Recommended — best size/quality balance |

| Q5_K_M | 5.6 GB | ~7 GB | Higher quality |

| Q6_K | 6.4 GB | ~7.5 GB | Near-lossless |

| Q8_0 | 8.3 GB | ~9.5 GB | Maximum quality |

Full-precision safetensors (vLLM, transformers, further fine-tuning): Parable-Granite-4.1-8B-Claude-Fable-5

How to run it

Ollama (shorter command via the Parable namespace, or pull directly from this repo):

ollama run parable/granite4.1-fable:8b
# or straight from this repo:
ollama run hf.co/AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF:Q4_K_M

llama.cpp:

llama-cli -m Parable-Granite-4.1-8B-Claude-Fable-5-GGUF-Q4_K_M.gguf --jinja \
  -p "Write a bash one-liner to find the 10 largest files in a directory tree."

LM Studio: lms get parable/granite4.1-fable (parable on LM Studio Hub), or paste this repo URL.

Python (llama-cpp-python):

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF",
    filename="*Q4_K_M.gguf", n_ctx=8192,
)
out = llm.create_chat_completion(
    messages=[{"role": "user", "content": "Write a Python function that retries an HTTP request with exponential backoff."}],
    max_tokens=3000, temperature=0.7,
)
print(out["choices"][0]["message"]["content"])

Thinking mode

Every answer opens with a <think>...</think> reasoning block before the final answer — a behavior this fine-tune adds to Granite. llama.cpp's --jinja chat mode separates it automatically; strip it before showing replies to end users.

Sampling: temperature 0.7, top_p 0.95, and budget max_tokens generously (at least 2500) — trace-trained models think at length before answering.

---

Evaluation

!Held-out evals across the Parable family

Held-out test split, identical evaluation code and context length for base and fine-tune:

| Metric | Base Granite-4.1-8B | Parable | Δ |

|---|---|---|---|

| Test loss | 2.030 | 0.617 | −70% |

Qualitative review (34 coding/terminal/debugging prompts, strictly graded by mentally executing every answer): 20/34 fully correct, 32/34 correct or partially correct. We publish these numbers because strict qualitative grading is rare in this niche; judge accordingly.

For reference, the strongest published fine-tune on this data family (a 9B) reports 0.71 validation loss. Cross-repo numbers are indicative only: splits, tokenizers, and context lengths differ (ours is measured at 1,024 tokens).

Training data

• Glint-Research/Fable-5-traces: 4.4k real Claude Fable 5 coding-agent session traces with <think> reasoning and tool calls (AGPL-3.0)
• Roman1111111/gpt5.5-terminal: terminal-agent task solutions (MIT)

Every example passed a quality gate (schema validation, secrets scrub, length filtering) before training. QLoRA fine-tune (NF4, sequence length 1024) trained on a single 16 GB GPU, quantized with llama.cpp.

Good to know

• Trained for agent work: on ops-style prompts it sometimes (2/34 in our eval) responds with structured tool-call JSON rather than prose. Useful inside agent harnesses; in plain chat, re-prompt or lower the temperature.
• Fine-tuned at 1,024-token sequences; the base model's native 128K-token context remains fully available, so long sessions work, with the fine-tuned behavior strongest in the opening turns.
• As a fine-tune it inherits Granite-4.1-8B's base behaviors and knowledge cutoff. As with any local model, treat generated commands and code as drafts to review.

Base & license

Weights: Apache-2.0 (inherited from ibm-granite/granite-4.1-8b). Training data: Fable-5-traces AGPL-3.0, gpt5.5-terminal MIT — because those traces originate from third-party assistants, the providers' terms may apply to downstream training and distillation. If you plan to build on this model commercially, confirm your use aligns with those terms.

Get Parable

| Platform | |

|---|---|

| Ollama | ollama run parable/granite4.1-fable:8b · parable namespace |

| Ollama (family flagship, best per size) | ollama run parable/fable |

| Hugging Face | GGUF quants, full weights, eval reports |

| LM Studio | lms get parable/granite4.1-fable (parable on LM Studio Hub) |

Acknowledgements

Glint-Research & Roman1111111 for the open trace data · IBM Granite for the base · empero-ai, whose Qwable recipe the Parable series follows · llama.cpp

---

The strongest Parable. Real Fable 5 reasoning. Yours, offline, right now.

ollama run hf.co/AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF:Q4_K_M

More on the Parable models: ankitaglawe.com/parable