Model Intelligence Sheet
mahmad-10xe/Qwen3.5-GGUF-Quants overview
mahmad-10xe/Qwen3.5-GGUF-Quants GGUF downloads for local AI inference with guIDE.
Runs locally from ~344.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
15 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_text_Q8_0_FP8_vision.gguf | GGUF | Q4_0_FP8_Q5_0_FP8 | 1.88 GB | Download |
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_text_Q8_0_FP8_vision.mmproj.gguf | GGUF | Q4_0_FP8_Q5_0_FP8 | 344.8 MB | Download |
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8_Q8_0_FP8-text-Q8_0-vision-outer_fp32/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_Q8_0_FP8_text_Q8_0_vision_outer_fp32.gguf | GGUF | Q4_0_FP8_Q5_0_FP8_Q8_0_FP8 | 1.88 GB | Download |
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8_Q8_0_FP8-text-Q8_0-vision-outer_fp32/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_Q8_0_FP8_text_Q8_0_vision_outer_fp32.mmproj.gguf | GGUF | Q4_0_FP8_Q5_0_FP8_Q8_0_FP8 | 344.8 MB | Download |
| Qwen3.5-2B-Q4_1X_Q5_1X-text-Q8_0-vision/qwen3_5_2b_Q4_1X_Q5_1X_text_Q8_0_vision.gguf | GGUF | Q4_1X_Q5_1X | 1.91 GB | Download |
| Qwen3.5-2B-Q4_1X_Q5_1X-text-Q8_0-vision/qwen3_5_2b_Q4_1X_Q5_1X_text_Q8_0_vision.mmproj.gguf | GGUF | Q4_1X_Q5_1X | 344.8 MB | Download |
| Qwen3.5-2B-Q4_1_FP8_Q5_1_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_1_FP8_Q5_1_FP8_text_Q8_0_FP8_vision.gguf | GGUF | Q4_1_FP8_Q5_1_FP8 | 1.94 GB | Download |
| Qwen3.5-2B-Q4_1_FP8_Q5_1_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_1_FP8_Q5_1_FP8_text_Q8_0_FP8_vision.mmproj.gguf | GGUF | Q4_1_FP8_Q5_1_FP8 | 344.8 MB | Download |
| Qwen3.5-2B-QFP4_0-text-QFP8_0-vision/qwen3_5_2b_QFP4_0_text_QFP8_0_vision.gguf | GGUF | GGUF | 1.78 GB | Download |
| Qwen3.5-2B-QFP4_0-text-QFP8_0-vision/qwen3_5_2b_QFP4_0_text_QFP8_0_vision.mmproj.gguf | GGUF | GGUF | 344.8 MB | Download |
| Qwen3.5-4B-Q4_1_FP8_G32-text-outer_fp32/qwen3_5_4b_Q4_1_FP8_G32_text_outer_fp32.gguf | GGUF | Q4_1_FP8_G32 | 2.22 GB | Download |
| Qwen3.5-4B-allocator-s2283-a1000-text/qwen3_5_4b_allocator_s2283_a1000.gguf | GGUF | GGUF | 2.14 GB | Download |
| Qwen3.5-4B-allocator-s2580-a0730-text/qwen3_5_4b_allocator_s2580_a0730.gguf | GGUF | GGUF | 2.41 GB | Download |
| Qwen3.5-4B-allocator-s2688-a0110-text/qwen3_5_4b_allocator_s2688_a0110.gguf | GGUF | GGUF | 2.52 GB | Download |
| Qwen3.5-4B-allocator-s2731-a0870-text/qwen3_5_4b_allocator_s2731_a0870.gguf | GGUF | GGUF | 2.56 GB | Download |
Model Details
| Model ID | mahmad-10xe/Qwen3.5-GGUF-Quants |
|---|---|
| Author | mahmad-10xe |
| Pipeline | — |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.5-2B |
| Last modified | 2026-09-23T20:18:23.000Z |
Run mahmad-10xe/Qwen3.5-GGUF-Quants with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models