brindusa/Qwen3.8-27B-Fable-Distill-Heretic-ara-GGUF overview
This is a decensored version of TeichAI/Qwen3.8 27B Fable Distill https://huggingface.co/TeichAI/Qwen3.8 27B Fable Distill , made using Heretic https://github.…
Runs locally from ~884.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| BF16/Qwen3.8-27B-Fable-Distill-Heretic-ara-BF16-00001-of-00002.gguf | GGUF | BF16 | 41.89 GB | Download |
| BF16/Qwen3.8-27B-Fable-Distill-Heretic-ara-BF16-00002-of-00002.gguf | GGUF | BF16 | 9.02 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-IQ4_NL.gguf | GGUF | IQ4_NL | 15.59 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-IQ4_XS.gguf | GGUF | IQ4_XS | 14.94 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q2_K.gguf | GGUF | Q2_K | 10.77 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q3_K_L.gguf | GGUF | Q3_K_L | 14.15 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q3_K_M.gguf | GGUF | Q3_K_M | 13.18 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q3_K_S.gguf | GGUF | Q3_K_S | 12.04 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q4_K_M.gguf | GGUF | Q4_K_M | 16.20 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q4_K_S.gguf | GGUF | Q4_K_S | 15.31 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q5_K_M.gguf | GGUF | Q5_K_M | 18.70 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q5_K_S.gguf | GGUF | Q5_K_S | 18.19 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q6_K.gguf | GGUF | Q6_K | 21.36 GB | Download |
| Qwen3.8-27B-Fable-Distill-Heretic-ara-Q8_0.gguf | GGUF | Q8_0 | 27.42 GB | Download |
| mmproj-BF16.gguf | GGUF | BF16 | 888.0 MB | Download |
| mmproj-F16.gguf | GGUF | F16 | 884.6 MB | Download |
| mmproj-F32.gguf | GGUF | F32 | 1.72 GB | Download |
Model Details
| Model ID | brindusa/Qwen3.8-27B-Fable-Distill-Heretic-ara-GGUF |
|---|---|
| Author | brindusa |
| Pipeline | image-text-to-text |
| License | — |
| Base model | armand0e/Qwen3.8-27B-Fable-Distill-Heretic-ara |
| Last modified | 2026-08-23T17:39:23.000Z |
Model README
---
base_model:
- armand0e/Qwen3.8-27B-Fable-Distill-Heretic-ara
pipeline_tag: image-text-to-text
tags:
- heretic
- uncensored
- decensored
- abliterated
- ara
- llama.cpp
- gguf
---
This is a decensored version of TeichAI/Qwen3.8-27B-Fable-Distill, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method
The ablation is a rank-2 update applied to the attn.o_proj, mlp.down_proj projections of layers 30-64, solved in closed form rather than by gradient descent.
Abliteration parameters
| Parameter | Value |
| :-------- | :---: |
| start_layer_index | 30 |
| end_layer_index | 64 |
| overcorrect_relative_weight | 4.62087 |
| neighbor_count | 128 |
| rank | 2 |
| ridge | 1 |
Performance
| Metric | This model | Original model (TeichAI/Qwen3.8-27B-Fable-Distill) |
| :----- | :--------: | :---------------------------: |
| KL divergence | 0.1004 | 0 (by definition) |
| Refusals | 5/100 | 91/100 |
KL divergence is measured against the original model on held-out harmless
prompts (mlabonne/harmless_alpaca), and refusals are
counted over 100 harmful prompts
(mlabonne/harmful_behaviors, test[:100]).
-----
Run brindusa/Qwen3.8-27B-Fable-Distill-Heretic-ara-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models