GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

richardyoung/Qwen3-8B-Abliterated-GGUF overview

Qwen3 8B Abliterated GGUF GGUF quantized versions of richardyoung/Qwen3 8B Abliterated https://huggingface.co/richardyoung/Qwen3 8B Abliterated . Available Qua…

llama.cppggufabliterateduncensoredqwen3base_model:richardyoung/Qwen3-8B-Abliteratedbase_model:quantized:richardyoung/Qwen3-8B-Abliteratedlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~4.68 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
7,083
Likes
1
Pipeline
—

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
qwen3-8b-abliterated-Q4_K_M.ggufGGUFQ4_K_M4.68 GBDownload

Model Details

Model IDrichardyoung/Qwen3-8B-Abliterated-GGUF
Authorrichardyoung
Pipeline—
Licenseapache-2.0
Base modelrichardyoung/Qwen3-8B-Abliterated
Last modified2026-09-26T19:09:34.000Z

Model README

---

license: apache-2.0

base_model: richardyoung/Qwen3-8B-Abliterated

tags:

  • abliterated
  • uncensored
  • qwen3
  • gguf

library_name: llama.cpp

---

Qwen3-8B-Abliterated-GGUF

GGUF quantized versions of richardyoung/Qwen3-8B-Abliterated.

Available Quantizations

| File | Size | Description |

|------|------|-------------|

| qwen3-8b-abliterated-Q4_K_M.gguf | 4.7 GB | 4-bit quantization (recommended for most use cases) |

Usage with Ollama

ollama run hf.co/richardyoung/Qwen3-8B-Abliterated-GGUF:Q4_K_M

Usage with llama.cpp

./llama-cli -m qwen3-8b-abliterated-Q4_K_M.gguf -p "Your prompt here"

About

This is an abliterated version of Qwen3-8B with reduced safety refusals. See the base model for more details on the abliteration process.

Disclaimer

This model is provided for research purposes only. Users are responsible for ensuring ethical use.

---

Built & maintained by Richard Young · DeepNeuro

Run richardyoung/Qwen3-8B-Abliterated-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models