heterodoxin/qwen3.6-27b-apostate-gguf overview
qwen3.6 27b apostate — GGUF Join the community: Discord https://discord.gg/NPA7xrATEH GGUF quants of heterodoxin/qwen3.6 27b apostate https://huggingface.co/he…
Runs locally from ~17.91 GB disk (24 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| qwen3.6-27b-apostate-Q5_K_M.gguf | GGUF | Q5_K_M | 17.91 GB | Download |
Model Details
| Model ID | heterodoxin/qwen3.6-27b-apostate-gguf |
|---|---|
| Author | heterodoxin |
| Pipeline | — |
| License | apache-2.0 |
| Base model | heterodoxin/qwen3.6-27b-apostate |
| Last modified | 2026-06-24T13:45:02.000Z |
Model README
---
license: apache-2.0
base_model: heterodoxin/qwen3.6-27b-apostate
tags:
- gguf
- apostate
- uncensored
- llama.cpp
---
qwen3.6-27b-apostate — GGUF
> Join the community: Discord
GGUF quants of heterodoxin/qwen3.6-27b-apostate, an
Apostate weight-edit uncensored model.
Pick a single quant or the full-quality bf16.
Quants
| file | quant | notes |
|---|---|---|
| qwen3.6-27b-apostate-bf16.gguf | BF16 | full quality (default) |
| qwen3.6-27b-apostate-Q2_K.gguf | Q2_K | smallest, lowest quality |
| qwen3.6-27b-apostate-Q3_K_M.gguf | Q3_K_M | small |
| qwen3.6-27b-apostate-Q4_K_M.gguf | Q4_K_M | recommended balance |
| qwen3.6-27b-apostate-Q5_K_M.gguf | Q5_K_M | higher quality |
| qwen3.6-27b-apostate-Q6_K.gguf | Q6_K | near-lossless |
| qwen3.6-27b-apostate-Q8_0.gguf | Q8_0 | highest quality quant |
Install one quant (Ollama, easiest)
ollama run hf.co/heterodoxin/qwen3.6-27b-apostate-gguf:Q4_K_M # any quant tag above, or BF16
Install one quant (llama.cpp / manual)
huggingface-cli download heterodoxin/qwen3.6-27b-apostate-gguf qwen3.6-27b-apostate-Q4_K_M.gguf --local-dir .
./llama-cli -m qwen3.6-27b-apostate-Q4_K_M.gguf -p "your prompt"
Swap Q4_K_M for any quant in the table, or qwen3.6-27b-apostate-bf16.gguf for full quality.
Run heterodoxin/qwen3.6-27b-apostate-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models