GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Grimxlock/Qwen3.8-27B-Abliterated-GGUF overview

Qwen3.8 27B Abliterated Abliterated variant of Qwen3.8 27B multimodal, 27B BF16 produced via targeted activation steering / ablation of the refusal direction a…

transformersggufsafetensorsqwen3_5image-text-to-textconversationalabliterateduncensoredablationactivation-steeringlicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~9.98 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
97
Likes
0
Pipeline
image-text-to-text
Author

Repository Files & Downloads

7 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.8-27B-Abliterated-BF16.ggufGGUFBF1650.11 GBDownload
Qwen3.8-27B-Abliterated-Q2_K.ggufGGUFQ2_K9.98 GBDownload
Qwen3.8-27B-Abliterated-Q3_K_M.ggufGGUFQ3_K_M12.39 GBDownload
Qwen3.8-27B-Abliterated-Q4_K_M.ggufGGUFQ4_K_M15.41 GBDownload
Qwen3.8-27B-Abliterated-Q5_K_M.ggufGGUFQ5_K_M17.91 GBDownload
Qwen3.8-27B-Abliterated-Q6_K.ggufGGUFQ6_K20.57 GBDownload
Qwen3.8-27B-Abliterated-Q8_0.ggufGGUFQ8_026.63 GBDownload

Model Details

Model IDGrimxlock/Qwen3.8-27B-Abliterated-GGUF
AuthorGrimxlock
Pipelineimage-text-to-text
Licenseapache-2.0
Base model
Last modified2026-08-21T23:06:46.000Z

Model README

---

license: apache-2.0

library_name: transformers

pipeline_tag: image-text-to-text

tags:

  • transformers
  • safetensors
  • qwen3_5
  • image-text-to-text
  • conversational
  • abliterated
  • uncensored
  • ablation
  • activation-steering

---

Qwen3.8-27B-Abliterated

Abliterated variant of Qwen3.8-27B (multimodal, 27B BF16) produced via targeted activation steering / ablation of the refusal direction across the model's residual stream, attention, and MLP surfaces.

Refusal eval: 0 / 450 harmful prompts refused (0 degenerate outputs). Capability degradation is minimal.

Results

| Metric | Base Qwen3.8-27B | Abliterated (this model) |

|---|---|---|

| Refusals on 450-prompt harmful eval | 283 / 450 | 0 / 450 |

| Degenerate / broken generations | 0 | 0 |

| PPL on capability corpus | 3.2987 | 3.3294 |

| Capability benchmark tasks passed | 15 / 15 | 14 / 15 |

The single missed capability item is a purely numeric/math error ("7th Fibonacci number from 1,1" answered as 8 instead of 13); all other capabilities (writing, reasoning structure, instruction following, coding, multilingual) remain intact.

Method

Applied the same abliteration methodology as the openbmb-MiniCPM5-1B-F16-Annihilated project: compute a refusal/steering direction from contrastive activations on refusal-vs-compliant prompts, then remove/steer that direction from the model weights. This checkpoints the winning steering state (N4) with 0/450 refusals.

Usage

from transformers import AutoProcessor, AutoModelForMultimodalLM

model = AutoModelForMultimodalLM.from_pretrained(
    "Grimxlock/Qwen3.8-27B-Abliterated",
    device_map="auto",
    torch_dtype="auto",
)
processor = AutoProcessor.from_pretrained("Grimxlock/Qwen3.8-27B-Abliterated")

License

Apache-2.0. This is a modified derivative of Qwen3.8-27B; the base model weights are subject to Qwen's original terms. Use responsibly.

Run Grimxlock/Qwen3.8-27B-Abliterated-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models