Model Intelligence Sheet
winterthurquant/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF-w overview
winterthurquant/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF-w GGUF downloads for local AI inference with guIDE.
Runs locally from ~875.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
23 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-IQ2_M.gguf | GGUF | IQ2_M | 4.60 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-IQ3_M.gguf | GGUF | IQ3_M | 5.23 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-IQ4_NL.gguf | GGUF | IQ4_NL | 6.16 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-IQ4_XS.gguf | GGUF | IQ4_XS | 5.96 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-IQ2_M.gguf | GGUF | IQ2_M | 4.60 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-IQ3_M.gguf | GGUF | IQ3_M | 5.33 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-IQ4_NL.gguf | GGUF | IQ4_NL | 6.29 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-IQ4_XS.gguf | GGUF | IQ4_XS | 6.08 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-Q4_K_M.gguf | GGUF | Q4_K_M | 6.50 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-Q4_K_S.gguf | GGUF | Q4_K_S | 6.23 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-Q5_K_M.gguf | GGUF | Q5_K_M | 7.30 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-Q5_K_S.gguf | GGUF | Q5_K_S | 7.15 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-Q6_K.gguf | GGUF | Q6_K | 8.16 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-MTP-Q8_0.gguf | GGUF | Q8_0 | 10.00 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-Q4_K_M.gguf | GGUF | Q4_K_M | 6.36 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-Q4_K_S.gguf | GGUF | Q4_K_S | 6.10 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-Q5_K_M.gguf | GGUF | Q5_K_M | 7.14 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-Q5_K_S.gguf | GGUF | Q5_K_S | 6.99 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-Q6_K.gguf | GGUF | Q6_K | 7.97 GB | Download |
| Qwen3.5-9B-The-Defiant-Fable-Uncnr-Heretic-NEO-MAX-Q8_0.gguf | GGUF | Q8_0 | 9.76 GB | Download |
| mmproj-BF16.gguf | GGUF | BF16 | 879.0 MB | Download |
| mmproj-F16.gguf | GGUF | F16 | 875.6 MB | Download |
| mmproj-F32.gguf | GGUF | F32 | 1.70 GB | Download |
Model Details
| Model ID | winterthurquant/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF-w |
|---|---|
| Author | winterthurquant |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | — |
| Last modified | 2026-07-31T00:49:12.000Z |
Run winterthurquant/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF-w with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models