richardyoung/Qwen3-8B-Abliterated-GGUF overview
Qwen3 8B Abliterated GGUF GGUF quantized versions of richardyoung/Qwen3 8B Abliterated https://huggingface.co/richardyoung/Qwen3 8B Abliterated . Available Qua…
Runs locally from ~4.68 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| qwen3-8b-abliterated-Q4_K_M.gguf | GGUF | Q4_K_M | 4.68 GB | Download |
Model Details
| Model ID | richardyoung/Qwen3-8B-Abliterated-GGUF |
|---|---|
| Author | richardyoung |
| Pipeline | — |
| License | apache-2.0 |
| Base model | richardyoung/Qwen3-8B-Abliterated |
| Last modified | 2026-09-26T19:09:34.000Z |
Model README
---
license: apache-2.0
base_model: richardyoung/Qwen3-8B-Abliterated
tags:
- abliterated
- uncensored
- qwen3
- gguf
library_name: llama.cpp
---
Qwen3-8B-Abliterated-GGUF
GGUF quantized versions of richardyoung/Qwen3-8B-Abliterated.
Available Quantizations
| File | Size | Description |
|------|------|-------------|
| qwen3-8b-abliterated-Q4_K_M.gguf | 4.7 GB | 4-bit quantization (recommended for most use cases) |
Usage with Ollama
ollama run hf.co/richardyoung/Qwen3-8B-Abliterated-GGUF:Q4_K_M
Usage with llama.cpp
./llama-cli -m qwen3-8b-abliterated-Q4_K_M.gguf -p "Your prompt here"
About
This is an abliterated version of Qwen3-8B with reduced safety refusals. See the base model for more details on the abliteration process.
Disclaimer
This model is provided for research purposes only. Users are responsible for ensuring ethical use.
---
Built & maintained by Richard Young · DeepNeuro
Run richardyoung/Qwen3-8B-Abliterated-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models