GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

heterodoxin/vibethinker-3b-apostate-gguf overview

vibethinker 3b apostate — GGUF Join the community: Discord https://discord.gg/NPA7xrATEH GGUF quants of heterodoxin/vibethinker 3b apostate https://huggingface…

ggufapostateuncensoredllama.cppbase_model:heterodoxin/vibethinker-3b-apostatebase_model:quantized:heterodoxin/vibethinker-3b-apostatelicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~1.28 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
22
Likes
0
Pipeline

Repository Files & Downloads

7 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
vibethinker-3b-apostate-Q2_K.ggufGGUFQ2_K1.28 GBDownload
vibethinker-3b-apostate-Q3_K_M.ggufGGUFQ3_K_M1.61 GBDownload
vibethinker-3b-apostate-Q4_K_M.ggufGGUFQ4_K_M1.96 GBDownload
vibethinker-3b-apostate-Q5_K_M.ggufGGUFQ5_K_M2.27 GBDownload
vibethinker-3b-apostate-Q6_K.ggufGGUFQ6_K2.60 GBDownload
vibethinker-3b-apostate-Q8_0.ggufGGUFQ8_03.37 GBDownload
vibethinker-3b-apostate-bf16.ggufGGUFBF166.33 GBDownload

Model Details

Model IDheterodoxin/vibethinker-3b-apostate-gguf
Authorheterodoxin
Pipeline
Licenseapache-2.0
Base modelheterodoxin/vibethinker-3b-apostate
Last modified2026-06-24T13:44:41.000Z

Model README

---

license: apache-2.0

base_model: heterodoxin/vibethinker-3b-apostate

tags:

  • gguf
  • apostate
  • uncensored
  • llama.cpp

---

vibethinker-3b-apostate — GGUF

> Join the community: Discord

GGUF quants of heterodoxin/vibethinker-3b-apostate, an

Apostate weight-edit uncensored model.

Pick a single quant or the full-quality bf16.

Quants

| file | quant | notes |

|---|---|---|

| vibethinker-3b-apostate-bf16.gguf | BF16 | full quality (default) |

| vibethinker-3b-apostate-Q2_K.gguf | Q2_K | smallest, lowest quality |

| vibethinker-3b-apostate-Q3_K_M.gguf | Q3_K_M | small |

| vibethinker-3b-apostate-Q4_K_M.gguf | Q4_K_M | recommended balance |

| vibethinker-3b-apostate-Q5_K_M.gguf | Q5_K_M | higher quality |

| vibethinker-3b-apostate-Q6_K.gguf | Q6_K | near-lossless |

| vibethinker-3b-apostate-Q8_0.gguf | Q8_0 | highest quality quant |

Install one quant (Ollama, easiest)

ollama run hf.co/heterodoxin/vibethinker-3b-apostate-gguf:Q4_K_M      # any quant tag above, or BF16

Install one quant (llama.cpp / manual)

huggingface-cli download heterodoxin/vibethinker-3b-apostate-gguf vibethinker-3b-apostate-Q4_K_M.gguf --local-dir .
./llama-cli -m vibethinker-3b-apostate-Q4_K_M.gguf -p "your prompt"

Swap Q4_K_M for any quant in the table, or vibethinker-3b-apostate-bf16.gguf for full quality.

Run heterodoxin/vibethinker-3b-apostate-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models