Model Intelligence Sheet
7ven7o/Qwen3.5-4B-GGUF overview
Qwen3.5 4B Q4 K S Q4 K S GGUF of Qwen/Qwen3.5 4B https://huggingface.co/Qwen/Qwen3.5 4B , converted with llama.cpp. This file was taken from unsloth/Qwen3.5 4B…
Runs locally from ~2.41 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-4B-Q4_K_S.gguf | GGUF | Q4_K_S | 2.41 GB | Download |
Model Details
Model README
---
license: apache-2.0
base_model: Qwen/Qwen3.5-4B
library_name: gguf
tags:
- gguf
quantized_by: 7ven7o
---
Qwen3.5-4B-Q4_K_S
Q4_K_S GGUF of Qwen/Qwen3.5-4B, converted with llama.cpp.
This file was taken from unsloth/Qwen3.5-4B-GGUF (instruct 4B, not Base).
Original model is Apache-2.0.
llama-cli -hf 7ven7o/Qwen3.5-4B-GGUFRun 7ven7o/Qwen3.5-4B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models