GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

prithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0-GGUF overview

Qwen3.5 9B DS v4 Flash v3.0 GGUF Qwen3.5 9B DS v4 Flash v3.0 is a reasoning capable 9B parameter language model based on prithivMLmods/Q3.5 9B DS v4 Flash v2.0…

transformersgguftext-generation-inferencellama-cppdeepseek-v4flashmathreasoningabliteratedimage-text-to-textenbase_model:prithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0base_model:quantized:prithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0license:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~595.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
1
Pipeline
image-text-to-text

Repository Files & Downloads

13 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-9B-DS-v4-Flash-v3.0.BF16.ggufGGUFGGUF16.69 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.F16.ggufGGUFGGUF16.69 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q3_K_L.ggufGGUFGGUF4.59 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q3_K_M.ggufGGUFGGUF4.31 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q3_K_S.ggufGGUFGGUF3.97 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q4_K_M.ggufGGUFGGUF5.24 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q4_K_S.ggufGGUFGGUF4.98 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q5_K_M.ggufGGUFGGUF6.02 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q5_K_S.ggufGGUFGGUF5.87 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.Q8_0.ggufGGUFGGUF8.87 GBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.mmproj-bf16.ggufGGUFBF16879.0 MBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.mmproj-f16.ggufGGUFF16879.0 MBDownload
Qwen3.5-9B-DS-v4-Flash-v3.0.mmproj-q8_0.ggufGGUFQ8_0595.3 MBDownload

Model Details

Model IDprithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0-GGUF
AuthorprithivMLmods
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelprithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0
Last modified2026-07-06T04:26:19.000Z

Model README

---

base_model:

  • prithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0

tags:

  • text-generation-inference
  • llama-cpp
  • deepseek-v4
  • flash
  • math
  • reasoning
  • abliterated

license: apache-2.0

language:

  • en

pipeline_tag: image-text-to-text

library_name: transformers

---

Qwen3.5-9B-DS-v4-Flash-v3.0-GGUF

> Qwen3.5-9B-DS-v4-Flash-v3.0 is a reasoning-capable 9B-parameter language model based on prithivMLmods/Q3.5-9B-DS-v4-Flash-v2.0, which is built on top of Qwen/Qwen3.5-9B. The model was trained through a multi-stage training pipeline using approximately 3.5K filtered samples drawn from DeepSeek V4 Flash reasoning traces, along with additional high-quality reasoning datasets, to improve long-form reasoning, mathematical problem solving, scientific analysis, coding, and instruction-following capabilities.

> [!NOTE]

> This model is an experimental release and may generate unexpected behaviors or reasoning artifacts in certain scenarios.

Model Files

File Name | Quant Type | File Size | File Link |

|-----------|------------|-----------|-----------|

| Qwen3.5-9B-DS-v4-Flash-v3.0.BF16.gguf | BF16 | 17.9 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.F16.gguf | F16 | 17.9 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q3_K_L.gguf | Q3_K_L | 4.93 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q3_K_M.gguf | Q3_K_M | 4.62 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q3_K_S.gguf | Q3_K_S | 4.26 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q4_K_M.gguf | Q4_K_M | 5.63 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q4_K_S.gguf | Q4_K_S | 5.35 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q5_K_M.gguf | Q5_K_M | 6.47 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q5_K_S.gguf | Q5_K_S | 6.31 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.Q8_0.gguf | Q8_0 | 9.53 GB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.mmproj-bf16.gguf | mmproj-bf16 | 922 MB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.mmproj-f16.gguf | mmproj-f16 | 922 MB | Download |

| Qwen3.5-9B-DS-v4-Flash-v3.0.mmproj-q8_0.gguf | mmproj-q8_0 | 624 MB | Download |

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Run prithivMLmods/Qwen3.5-9B-DS-v4-Flash-v3.0-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models