GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

heterodoxin/qwen3-8b-apostate-gguf overview

qwen3 8b apostate — GGUF Join the community: Discord https://discord.gg/NPA7xrATEH GGUF quants of heterodoxin/qwen3 8b apostate https://huggingface.co/heterodo…

ggufapostateuncensoredllama.cppbase_model:heterodoxin/qwen3-8b-apostatebase_model:quantized:heterodoxin/qwen3-8b-apostatelicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~3.06 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline

Repository Files & Downloads

7 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
qwen3-8b-apostate-Q2_K.ggufGGUFQ2_K3.06 GBDownload
qwen3-8b-apostate-Q3_K_M.ggufGGUFQ3_K_M3.84 GBDownload
qwen3-8b-apostate-Q4_K_M.ggufGGUFQ4_K_M4.68 GBDownload
qwen3-8b-apostate-Q5_K_M.ggufGGUFQ5_K_M5.45 GBDownload
qwen3-8b-apostate-Q6_K.ggufGGUFQ6_K6.26 GBDownload
qwen3-8b-apostate-Q8_0.ggufGGUFQ8_08.11 GBDownload
qwen3-8b-apostate-bf16.ggufGGUFBF1615.26 GBDownload

Model Details

Model IDheterodoxin/qwen3-8b-apostate-gguf
Authorheterodoxin
Pipeline
Licenseapache-2.0
Base modelheterodoxin/qwen3-8b-apostate
Last modified2026-06-24T14:03:54.000Z

Model README

---

license: apache-2.0

base_model: heterodoxin/qwen3-8b-apostate

tags:

  • gguf
  • apostate
  • uncensored
  • llama.cpp

---

qwen3-8b-apostate — GGUF

> Join the community: Discord

GGUF quants of heterodoxin/qwen3-8b-apostate, an

Apostate weight-edit uncensored model.

Pick a single quant or the full-quality bf16.

Quants

| file | quant | notes |

|---|---|---|

| qwen3-8b-apostate-bf16.gguf | BF16 | full quality (default) |

| qwen3-8b-apostate-Q2_K.gguf | Q2_K | smallest, lowest quality |

| qwen3-8b-apostate-Q3_K_M.gguf | Q3_K_M | small |

| qwen3-8b-apostate-Q4_K_M.gguf | Q4_K_M | recommended balance |

| qwen3-8b-apostate-Q5_K_M.gguf | Q5_K_M | higher quality |

| qwen3-8b-apostate-Q6_K.gguf | Q6_K | near-lossless |

| qwen3-8b-apostate-Q8_0.gguf | Q8_0 | highest quality quant |

Install one quant (Ollama, easiest)

ollama run hf.co/heterodoxin/qwen3-8b-apostate-gguf:Q4_K_M      # any quant tag above, or BF16

Install one quant (llama.cpp / manual)

huggingface-cli download heterodoxin/qwen3-8b-apostate-gguf qwen3-8b-apostate-Q4_K_M.gguf --local-dir .
./llama-cli -m qwen3-8b-apostate-Q4_K_M.gguf -p "your prompt"

Swap Q4_K_M for any quant in the table, or qwen3-8b-apostate-bf16.gguf for full quality.

Run heterodoxin/qwen3-8b-apostate-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models