GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

PocketWeights/Qwen3-8B-abliterated-GGUF overview

⚡ PocketWeights: Qwen3 8B Abliterated Heavy models, made light. We specialize in high quality GGUF quantizations optimized for edge devices and gaming laptops.…

ggufqwen3abliterateduncensoredsecurity-researchbase_model:huihui-ai/Qwen3-8B-abliteratedbase_model:quantized:huihui-ai/Qwen3-8B-abliteratedlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~4.68 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
120
Likes
0
Pipeline

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3-8B-abliterated-GGUF-Q4_K_M.ggufGGUFQ4_K_M4.68 GBDownload
Qwen3-8B-abliterated-GGUF-Q6_K.ggufGGUFQ6_K6.26 GBDownload

Model Details

Model IDPocketWeights/Qwen3-8B-abliterated-GGUF
AuthorPocketWeights
Pipeline
Licenseapache-2.0
Base modelhuihui-ai/Qwen3-8B-abliterated
Last modified2026-08-03T15:01:35.000Z

Model README

---

base_model: huihui-ai/Qwen3-8B-abliterated

library_name: gguf

license: apache-2.0

tags:

- gguf

- qwen3

- abliterated

- uncensored

- security-research

---

⚡ PocketWeights: Qwen3 8B Abliterated

Heavy models, made light. We specialize in high-quality GGUF quantizations optimized for edge devices and gaming laptops.

What is this model?

This is a specialized, uncensored version of Qwen3-8B created using a fast abliteration method to remove refusals. It has zero safety filters and is designed strictly for offline security research, red-teaming, and controlled pentesting environments.

📦 Pick Your Hardware

We bypass the confusing wall of files to provide specific sizes optimized for your hardware:

  • Q4_K_M (Fits 6GB VRAM): The standard. Perfect for RTX 3060/4050.
  • Q6_K (Fits 8GB VRAM): Near-lossless FP16 quality for RTX 4060/3070.

🚀 Quick Start Guide

Option 1: LM Studio (Easiest)

  1. Download & open LM Studio.
  2. In the search bar, type: PocketWeights/Qwen3-8B-abliterated-GGUF.
  3. Select your hardware size, click Download, and hit Play!

Option 2: Ollama

If you have Ollama installed, simply run this command in your terminal:

ollama run hf.co/PocketWeights/Qwen3-8B-abliterated-GGUF:Q4_K_M

Run PocketWeights/Qwen3-8B-abliterated-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models