GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

brindusa/Qwen3.8-27B-Fable-Distill-Heretic-ara-GGUF overview

This is a decensored version of TeichAI/Qwen3.8 27B Fable Distill https://huggingface.co/TeichAI/Qwen3.8 27B Fable Distill , made using Heretic https://github.…

ggufhereticuncensoreddecensoredabliteratedarallama.cppimage-text-to-textbase_model:armand0e/Qwen3.8-27B-Fable-Distill-Heretic-arabase_model:quantized:armand0e/Qwen3.8-27B-Fable-Distill-Heretic-araendpoints_compatibleregion:usconversational

Runs locally from ~884.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
image-text-to-text
Author

Repository Files & Downloads

17 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
BF16/Qwen3.8-27B-Fable-Distill-Heretic-ara-BF16-00001-of-00002.ggufGGUFBF1641.89 GBDownload
BF16/Qwen3.8-27B-Fable-Distill-Heretic-ara-BF16-00002-of-00002.ggufGGUFBF169.02 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-IQ4_NL.ggufGGUFIQ4_NL15.59 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-IQ4_XS.ggufGGUFIQ4_XS14.94 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q2_K.ggufGGUFQ2_K10.77 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q3_K_L.ggufGGUFQ3_K_L14.15 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q3_K_M.ggufGGUFQ3_K_M13.18 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q3_K_S.ggufGGUFQ3_K_S12.04 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q4_K_M.ggufGGUFQ4_K_M16.20 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q4_K_S.ggufGGUFQ4_K_S15.31 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q5_K_M.ggufGGUFQ5_K_M18.70 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q5_K_S.ggufGGUFQ5_K_S18.19 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q6_K.ggufGGUFQ6_K21.36 GBDownload
Qwen3.8-27B-Fable-Distill-Heretic-ara-Q8_0.ggufGGUFQ8_027.42 GBDownload
mmproj-BF16.ggufGGUFBF16888.0 MBDownload
mmproj-F16.ggufGGUFF16884.6 MBDownload
mmproj-F32.ggufGGUFF321.72 GBDownload

Model Details

Model IDbrindusa/Qwen3.8-27B-Fable-Distill-Heretic-ara-GGUF
Authorbrindusa
Pipelineimage-text-to-text
License
Base modelarmand0e/Qwen3.8-27B-Fable-Distill-Heretic-ara
Last modified2026-08-23T17:39:23.000Z

Model README

---

base_model:

  • armand0e/Qwen3.8-27B-Fable-Distill-Heretic-ara

pipeline_tag: image-text-to-text

tags:

  • heretic
  • uncensored
  • decensored
  • abliterated
  • ara
  • llama.cpp
  • gguf

---

This is a decensored version of TeichAI/Qwen3.8-27B-Fable-Distill, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method

The ablation is a rank-2 update applied to the attn.o_proj, mlp.down_proj projections of layers 30-64, solved in closed form rather than by gradient descent.

Abliteration parameters

| Parameter | Value |

| :-------- | :---: |

| start_layer_index | 30 |

| end_layer_index | 64 |

| overcorrect_relative_weight | 4.62087 |

| neighbor_count | 128 |

| rank | 2 |

| ridge | 1 |

Performance

| Metric | This model | Original model (TeichAI/Qwen3.8-27B-Fable-Distill) |

| :----- | :--------: | :---------------------------: |

| KL divergence | 0.1004 | 0 (by definition) |

| Refusals | 5/100 | 91/100 |

KL divergence is measured against the original model on held-out harmless

prompts (mlabonne/harmless_alpaca), and refusals are

counted over 100 harmful prompts

(mlabonne/harmful_behaviors, test[:100]).

-----

Run brindusa/Qwen3.8-27B-Fable-Distill-Heretic-ara-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models