GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

darkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF overview

TokForge Website: https://tokforge.ai Discord: https://discord.gg/Acv3CBtfVm Google Play: https://play.google.com/store/apps/details?id=dev.tokforge iOS TestFl…

ggufqwen3.5moemixture-of-expertsquantizedimatrixhereticdecensoredabliterateduncensoredmpoamtptokforgetext-generationenbase_model:Qwen/Qwen3.5-35B-A3Bbase_model:quantized:Qwen/Qwen3.5-35B-A3Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~12.34 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
84
Likes
0
Pipeline
text-generation

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-35B-A3B-heretic-v2-Q2_K.ggufGGUFQ2_K12.34 GBDownload

Model Details

Model IDdarkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF
Authordarkmaniac7
Pipelinetext-generation
Licenseapache-2.0
Base modelllmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved,Qwen/Qwen3.5-35B-A3B
Last modified2026-07-17T07:46:21.000Z

Model README

---

license: apache-2.0

language:

  • en

pipeline_tag: text-generation

base_model:

  • llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved
  • Qwen/Qwen3.5-35B-A3B

quantized_by: mradermacher

tags:

  • gguf
  • qwen3.5
  • moe
  • mixture-of-experts
  • quantized
  • imatrix
  • heretic
  • decensored
  • abliterated
  • uncensored
  • mpoa
  • mtp
  • tokforge

---

TokForge

  • Website: https://tokforge.ai
  • Discord: https://discord.gg/Acv3CBtfVm
  • Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
  • iOS TestFlight: https://testflight.apple.com/join/jnufjzRr

Runs on-device in the TokForge app.

Qwen3.5-35B-A3B-heretic-v2-GGUF

Weighted/imatrix Q2_K GGUF of the heretic v2 decensored Qwen3.5-35B-A3B MoE, republished under a shorter neutral file name for the TokForge model catalog.

> All credit for the model, the decensor pass, and the quantization goes to the upstream authors listed below. This repo mirrors a single upstream file, renamed only; the bytes are identical.

What this is

  • Architecture: Qwen3.5-35B-A3B, a mixture-of-experts model with 35B total parameters and roughly 3B active per token (qwen35moe in llama.cpp terms).
  • Decensor: heretic v2 pass by llmfan46, with the model's native multi-token-prediction (MTP) head preserved through the process.
  • Quantization: weighted/imatrix Q2_K (2-bit) from mradermacher's i1 series.
  • MTP head: inert for standard autoregressive decoding in current llama.cpp builds, but kept intact in the weights so future speculative decoding support can use it.

Files

| File | Size | Notes |

|------|------|-------|

| Qwen3.5-35B-A3B-heretic-v2-Q2_K.gguf | 13,246,130,880 bytes | byte-identical to upstream Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved.i1-Q2_K.gguf, renamed only |

sha256: cb60a6e0acbb93c9ab5e85aade11d9ab1fb81ea7e63dcf80123f4656b079a49f

Credit chain

  1. Base model: Qwen/Qwen3.5-35B-A3B (apache-2.0)
  2. Decensor (heretic v2, MTP head natively preserved): llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved
  3. Quantization (weighted/imatrix i1 GGUF): mradermacher/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved-i1-GGUF

License and safety

  • Apache-2.0, inherited from the Qwen base model and the llmfan46 decensor.
  • This is a safety-reduced variant: it refuses far less than the base model. Deploy with appropriate user-facing controls and local policy.

Community

Run darkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models