GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF overview

VibeThinker 3B heretic decensored GGUF VibeThinker 3B heretic decensored is a reasoning focused language model built on top of WeiboAI/VibeThinker 3B and modif…

transformersggufllama-cpptext-generation-inferencemathcodereasoninggpqainstruction-followinghereticuncensoreddecensoredabliteratedtext-generationenbase_model:prithivMLmods/VibeThinker-3B-heretic_decensoredbase_model:quantized:prithivMLmods/VibeThinker-3B-heretic_decensoredlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~1.19 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
1
Pipeline
text-generation

Repository Files & Downloads

15 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
VibeThinker-3B-heretic_decensored.BF16.ggufGGUFGGUF5.75 GBDownload
VibeThinker-3B-heretic_decensored.F16.ggufGGUFGGUF5.75 GBDownload
VibeThinker-3B-heretic_decensored.F32.ggufGGUFGGUF11.50 GBDownload
VibeThinker-3B-heretic_decensored.Q2_K.ggufGGUFGGUF1.19 GBDownload
VibeThinker-3B-heretic_decensored.Q3_K_L.ggufGGUFGGUF1.59 GBDownload
VibeThinker-3B-heretic_decensored.Q3_K_M.ggufGGUFGGUF1.48 GBDownload
VibeThinker-3B-heretic_decensored.Q3_K_S.ggufGGUFGGUF1.35 GBDownload
VibeThinker-3B-heretic_decensored.Q4_0.ggufGGUFGGUF1.70 GBDownload
VibeThinker-3B-heretic_decensored.Q4_K_M.ggufGGUFGGUF1.80 GBDownload
VibeThinker-3B-heretic_decensored.Q4_K_S.ggufGGUFGGUF1.71 GBDownload
VibeThinker-3B-heretic_decensored.Q5_0.ggufGGUFGGUF2.02 GBDownload
VibeThinker-3B-heretic_decensored.Q5_K_M.ggufGGUFGGUF2.07 GBDownload
VibeThinker-3B-heretic_decensored.Q5_K_S.ggufGGUFGGUF2.02 GBDownload
VibeThinker-3B-heretic_decensored.Q6_K.ggufGGUFGGUF2.36 GBDownload
VibeThinker-3B-heretic_decensored.Q8_0.ggufGGUFGGUF3.06 GBDownload

Model Details

Model IDprithivMLmods/VibeThinker-3B-heretic_decensored-GGUF
AuthorprithivMLmods
Pipelinetext-generation
Licenseapache-2.0
Base modelprithivMLmods/VibeThinker-3B-heretic_decensored
Last modified2026-06-20T10:51:50.000Z

Model README

---

base_model:

  • prithivMLmods/VibeThinker-3B-heretic_decensored

tags:

  • llama-cpp
  • text-generation-inference
  • math
  • code
  • reasoning
  • gpqa
  • instruction-following
  • heretic
  • uncensored
  • decensored
  • abliterated

pipeline_tag: text-generation

license: apache-2.0

language:

  • en

library_name: transformers

---

VibeThinker-3B-heretic_decensored-GGUF

> VibeThinker-3B-heretic_decensored is a reasoning-focused language model built on top of WeiboAI/VibeThinker-3B and modified using the Heretic abliteration toolkit. The model applies refusal-direction analysis and targeted weight-space interventions to reduce internal refusal behaviors while preserving the strong mathematical, coding, and STEM reasoning capabilities inherited from the VibeThinker training pipeline.

> About VibeThinker-3B: VibeThinker-3B is a 3-billion-parameter reasoning-focused language model developed by WeiboAI. Built on top of Qwen2.5-Coder-3B, it was trained using the Spectrum-to-Signal Principle (SSP) post-training pipeline, combining curriculum-based two-stage supervised fine-tuning, multi-domain reinforcement learning through MaxEnt-Guided Policy Optimization (MGPO), offline self-distillation, and instruction-following reinforcement learning.

> [!IMPORTANT]

> This model is intended strictly for research and learning purposes. Due to reduced internal refusal mechanisms, it may generate sensitive or unrestricted content. Users assume full responsibility for how the model is used. The authors and hosting platform disclaim any liability for generated outputs.

> [!NOTE]

> This model is experimental and may generate unexpected behaviors or artifacts in certain scenarios.

Model Files

File Name | Quant Type | File Size | File Link |

|-----------|------------|-----------|-----------|

| VibeThinker-3B-heretic_decensored.BF16.gguf | BF16 | 6.18 GB | Download |

| VibeThinker-3B-heretic_decensored.F16.gguf | F16 | 6.18 GB | Download |

| VibeThinker-3B-heretic_decensored.F32.gguf | F32 | 12.3 GB | Download |

| VibeThinker-3B-heretic_decensored.Q2_K.gguf | Q2_K | 1.27 GB | Download |

| VibeThinker-3B-heretic_decensored.Q3_K_L.gguf | Q3_K_L | 1.71 GB | Download |

| VibeThinker-3B-heretic_decensored.Q3_K_M.gguf | Q3_K_M | 1.59 GB | Download |

| VibeThinker-3B-heretic_decensored.Q3_K_S.gguf | Q3_K_S | 1.45 GB | Download |

| VibeThinker-3B-heretic_decensored.Q4_0.gguf | Q4_0 | 1.82 GB | Download |

| VibeThinker-3B-heretic_decensored.Q4_K_M.gguf | Q4_K_M | 1.93 GB | Download |

| VibeThinker-3B-heretic_decensored.Q4_K_S.gguf | Q4_K_S | 1.83 GB | Download |

| VibeThinker-3B-heretic_decensored.Q5_0.gguf | Q5_0 | 2.17 GB | Download |

| VibeThinker-3B-heretic_decensored.Q5_K_M.gguf | Q5_K_M | 2.22 GB | Download |

| VibeThinker-3B-heretic_decensored.Q5_K_S.gguf | Q5_K_S | 2.17 GB | Download |

| VibeThinker-3B-heretic_decensored.Q6_K.gguf | Q6_K | 2.54 GB | Download |

| VibeThinker-3B-heretic_decensored.Q8_0.gguf | Q8_0 | 3.29 GB | Download |

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Run prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models