Model Intelligence Sheet
mahmad-10xe/Qwen3.5-GGUF-Quants overview
mahmad-10xe/Qwen3.5-GGUF-Quants GGUF downloads for local AI inference with guIDE.
Runs locally from ~344.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
10 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_text_Q8_0_FP8_vision.gguf | GGUF | Q4_0_FP8_Q5_0_FP8 | 1.88 GB | Download |
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_text_Q8_0_FP8_vision.mmproj.gguf | GGUF | Q4_0_FP8_Q5_0_FP8 | 344.8 MB | Download |
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8_Q8_0_FP8-text-Q8_0-vision-outer_fp32/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_Q8_0_FP8_text_Q8_0_vision_outer_fp32.gguf | GGUF | Q4_0_FP8_Q5_0_FP8_Q8_0_FP8 | 1.88 GB | Download |
| Qwen3.5-2B-Q4_0_FP8_Q5_0_FP8_Q8_0_FP8-text-Q8_0-vision-outer_fp32/qwen3_5_2b_Q4_0_FP8_Q5_0_FP8_Q8_0_FP8_text_Q8_0_vision_outer_fp32.mmproj.gguf | GGUF | Q4_0_FP8_Q5_0_FP8_Q8_0_FP8 | 344.8 MB | Download |
| Qwen3.5-2B-Q4_1X_Q5_1X-text-Q8_0-vision/qwen3_5_2b_Q4_1X_Q5_1X_text_Q8_0_vision.gguf | GGUF | Q4_1X_Q5_1X | 1.91 GB | Download |
| Qwen3.5-2B-Q4_1X_Q5_1X-text-Q8_0-vision/qwen3_5_2b_Q4_1X_Q5_1X_text_Q8_0_vision.mmproj.gguf | GGUF | Q4_1X_Q5_1X | 344.8 MB | Download |
| Qwen3.5-2B-Q4_1_FP8_Q5_1_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_1_FP8_Q5_1_FP8_text_Q8_0_FP8_vision.gguf | GGUF | Q4_1_FP8_Q5_1_FP8 | 1.94 GB | Download |
| Qwen3.5-2B-Q4_1_FP8_Q5_1_FP8-text-Q8_0_FP8-vision/qwen3_5_2b_Q4_1_FP8_Q5_1_FP8_text_Q8_0_FP8_vision.mmproj.gguf | GGUF | Q4_1_FP8_Q5_1_FP8 | 344.8 MB | Download |
| Qwen3.5-2B-QFP4_0-text-QFP8_0-vision/qwen3_5_2b_QFP4_0_text_QFP8_0_vision.gguf | GGUF | GGUF | 1.78 GB | Download |
| Qwen3.5-2B-QFP4_0-text-QFP8_0-vision/qwen3_5_2b_QFP4_0_text_QFP8_0_vision.mmproj.gguf | GGUF | GGUF | 344.8 MB | Download |
Model Details
| Model ID | mahmad-10xe/Qwen3.5-GGUF-Quants |
|---|---|
| Author | mahmad-10xe |
| Pipeline | — |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.5-2B |
| Last modified | 2026-08-07T11:13:54.000Z |
Run mahmad-10xe/Qwen3.5-GGUF-Quants with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models