Model Intelligence Sheet
7ven7o/Qwen3.5-9B-Base-GGUF overview
Qwen3.5 9B Base Q4 K S Q4 K S GGUF of Qwen/Qwen3.5 9B Base https://huggingface.co/Qwen/Qwen3.5 9B Base , converted with llama.cpp. Original model is Apache 2.0…
Runs locally from ~5.11 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-9B-Base-Q4_K_S.gguf | GGUF | Q4_K_S | 5.11 GB | Download |
Model Details
Model README
---
license: apache-2.0
base_model: Qwen/Qwen3.5-9B-Base
library_name: gguf
tags:
- gguf
quantized_by: 7ven7o
---
Qwen3.5-9B-Base-Q4_K_S
Q4_K_S GGUF of Qwen/Qwen3.5-9B-Base, converted with llama.cpp.
Original model is Apache-2.0.
llama-cli -hf 7ven7o/Qwen3.5-9B-Base-GGUFRun 7ven7o/Qwen3.5-9B-Base-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models