darkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF overview
TokForge Website: https://tokforge.ai Discord: https://discord.gg/Acv3CBtfVm Google Play: https://play.google.com/store/apps/details?id=dev.tokforge iOS TestFl…
Runs locally from ~12.34 GB disk (16 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-35B-A3B-heretic-v2-Q2_K.gguf | GGUF | Q2_K | 12.34 GB | Download |
Model Details
| Model ID | darkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF |
|---|---|
| Author | darkmaniac7 |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved,Qwen/Qwen3.5-35B-A3B |
| Last modified | 2026-07-17T07:46:21.000Z |
Model README
---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
base_model:
- llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved
- Qwen/Qwen3.5-35B-A3B
quantized_by: mradermacher
tags:
- gguf
- qwen3.5
- moe
- mixture-of-experts
- quantized
- imatrix
- heretic
- decensored
- abliterated
- uncensored
- mpoa
- mtp
- tokforge
---
TokForge
- Website: https://tokforge.ai
- Discord: https://discord.gg/Acv3CBtfVm
- Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
- iOS TestFlight: https://testflight.apple.com/join/jnufjzRr
Runs on-device in the TokForge app.
Qwen3.5-35B-A3B-heretic-v2-GGUF
Weighted/imatrix Q2_K GGUF of the heretic v2 decensored Qwen3.5-35B-A3B MoE, republished under a shorter neutral file name for the TokForge model catalog.
> All credit for the model, the decensor pass, and the quantization goes to the upstream authors listed below. This repo mirrors a single upstream file, renamed only; the bytes are identical.
What this is
- Architecture: Qwen3.5-35B-A3B, a mixture-of-experts model with 35B total parameters and roughly 3B active per token (
qwen35moein llama.cpp terms). - Decensor: heretic v2 pass by llmfan46, with the model's native multi-token-prediction (MTP) head preserved through the process.
- Quantization: weighted/imatrix Q2_K (2-bit) from mradermacher's i1 series.
- MTP head: inert for standard autoregressive decoding in current llama.cpp builds, but kept intact in the weights so future speculative decoding support can use it.
Files
| File | Size | Notes |
|------|------|-------|
| Qwen3.5-35B-A3B-heretic-v2-Q2_K.gguf | 13,246,130,880 bytes | byte-identical to upstream Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved.i1-Q2_K.gguf, renamed only |
sha256: cb60a6e0acbb93c9ab5e85aade11d9ab1fb81ea7e63dcf80123f4656b079a49f
Credit chain
- Base model:
Qwen/Qwen3.5-35B-A3B(apache-2.0) - Decensor (heretic v2, MTP head natively preserved):
llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved - Quantization (weighted/imatrix i1 GGUF):
mradermacher/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved-i1-GGUF
License and safety
- Apache-2.0, inherited from the Qwen base model and the llmfan46 decensor.
- This is a safety-reduced variant: it refuses far less than the base model. Deploy with appropriate user-facing controls and local policy.
Community
- Website: tokforge.ai
- Discord: Join our Discord
- GitHub: TokForge on GitHub
Run darkmaniac7/Qwen3.5-35B-A3B-heretic-v2-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models