GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

WithinUsAI/Fable5-AI.Of.Thy.State-12B.GGUF overview

license: apache 2.0 datasets: WithinUsAI/claude mythos distilled 25k WithinUsAI/fable 5 distillation merged cleaned 25k base model: google/gemma 4 12B it qat q…

ggufdataset:WithinUsAI/claude_mythos_distilled_25kdataset:WithinUsAI/fable_5_distillation_merged_cleaned_25kbase_model:google/gemma-4-12B-it-qat-q4_0-ggufbase_model:quantized:google/gemma-4-12B-it-qat-q4_0-gguflicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~6.87 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Fable5-AI.Of.Thy.State-12B-Q4_K_M.ggufGGUFQ4_K_M6.87 GBDownload
Fable5-AI.Of.Thy.State-12B-Q5_K_M.ggufGGUFQ5_K_M7.96 GBDownload

Model Details

Model IDWithinUsAI/Fable5-AI.Of.Thy.State-12B.GGUF
AuthorWithinUsAI
Pipeline
Licenseapache-2.0
Base modelgoogle/gemma-4-12B-it-qat-q4_0-gguf
Last modified2026-07-16T05:15:35.000Z

Model README

---

license: apache-2.0

datasets:

  • WithinUsAI/claude_mythos_distilled_25k
  • WithinUsAI/fable_5_distillation_merged_cleaned_25k

base_model:

  • google/gemma-4-12B-it-qat-q4_0-gguf

---

Run WithinUsAI/Fable5-AI.Of.Thy.State-12B.GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models