Grimxlock/Qwen3.8-27B-Abliterated-GGUF overview
Qwen3.8 27B Abliterated Abliterated variant of Qwen3.8 27B multimodal, 27B BF16 produced via targeted activation steering / ablation of the refusal direction a…
Runs locally from ~9.98 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.8-27B-Abliterated-BF16.gguf | GGUF | BF16 | 50.11 GB | Download |
| Qwen3.8-27B-Abliterated-Q2_K.gguf | GGUF | Q2_K | 9.98 GB | Download |
| Qwen3.8-27B-Abliterated-Q3_K_M.gguf | GGUF | Q3_K_M | 12.39 GB | Download |
| Qwen3.8-27B-Abliterated-Q4_K_M.gguf | GGUF | Q4_K_M | 15.41 GB | Download |
| Qwen3.8-27B-Abliterated-Q5_K_M.gguf | GGUF | Q5_K_M | 17.91 GB | Download |
| Qwen3.8-27B-Abliterated-Q6_K.gguf | GGUF | Q6_K | 20.57 GB | Download |
| Qwen3.8-27B-Abliterated-Q8_0.gguf | GGUF | Q8_0 | 26.63 GB | Download |
Model Details
| Model ID | Grimxlock/Qwen3.8-27B-Abliterated-GGUF |
|---|---|
| Author | Grimxlock |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | — |
| Last modified | 2026-08-21T23:06:46.000Z |
Model README
---
license: apache-2.0
library_name: transformers
pipeline_tag: image-text-to-text
tags:
- transformers
- safetensors
- qwen3_5
- image-text-to-text
- conversational
- abliterated
- uncensored
- ablation
- activation-steering
---
Qwen3.8-27B-Abliterated
Abliterated variant of Qwen3.8-27B (multimodal, 27B BF16) produced via targeted activation steering / ablation of the refusal direction across the model's residual stream, attention, and MLP surfaces.
Refusal eval: 0 / 450 harmful prompts refused (0 degenerate outputs). Capability degradation is minimal.
Results
| Metric | Base Qwen3.8-27B | Abliterated (this model) |
|---|---|---|
| Refusals on 450-prompt harmful eval | 283 / 450 | 0 / 450 |
| Degenerate / broken generations | 0 | 0 |
| PPL on capability corpus | 3.2987 | 3.3294 |
| Capability benchmark tasks passed | 15 / 15 | 14 / 15 |
The single missed capability item is a purely numeric/math error ("7th Fibonacci number from 1,1" answered as 8 instead of 13); all other capabilities (writing, reasoning structure, instruction following, coding, multilingual) remain intact.
Method
Applied the same abliteration methodology as the openbmb-MiniCPM5-1B-F16-Annihilated project: compute a refusal/steering direction from contrastive activations on refusal-vs-compliant prompts, then remove/steer that direction from the model weights. This checkpoints the winning steering state (N4) with 0/450 refusals.
Usage
from transformers import AutoProcessor, AutoModelForMultimodalLM
model = AutoModelForMultimodalLM.from_pretrained(
"Grimxlock/Qwen3.8-27B-Abliterated",
device_map="auto",
torch_dtype="auto",
)
processor = AutoProcessor.from_pretrained("Grimxlock/Qwen3.8-27B-Abliterated")
License
Apache-2.0. This is a modified derivative of Qwen3.8-27B; the base model weights are subject to Qwen's original terms. Use responsibly.
Run Grimxlock/Qwen3.8-27B-Abliterated-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models