Model Intelligence Sheet
armand0e/Qwen3.6-35B-A3B-Fable-5-Distill-GGUF overview
armand0e/Qwen3.6-35B-A3B-Fable-5-Distill-GGUF GGUF downloads for local AI inference with guIDE.
Runs locally from ~857.6 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
10 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.6-35B-A3B-Fable-5-Distill.iq4_nl.gguf | GGUF | GGUF | 20.15 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.mxfp4_moe.gguf | GGUF | GGUF | 20.01 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.q3_k_m.gguf | GGUF | GGUF | 17.19 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.q3_k_s.gguf | GGUF | GGUF | 15.71 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.q4_k_m.gguf | GGUF | GGUF | 21.29 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.q5_k_m.gguf | GGUF | GGUF | 24.61 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.q6_k.gguf | GGUF | GGUF | 28.13 GB | Download |
| Qwen3.6-35B-A3B-Fable-5-Distill.q8_0.gguf | GGUF | GGUF | 35.94 GB | Download |
| mmproj-F16.gguf | GGUF | F16 | 857.6 MB | Download |
| mmproj-F32.gguf | GGUF | F32 | 1.66 GB | Download |
Model Details
Run armand0e/Qwen3.6-35B-A3B-Fable-5-Distill-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models