Model Intelligence Sheet
7ven7o/Qwen3.5-4B-Base-GGUF overview
Qwen3.5 4B Base Q4 K S Q4 K S GGUF of Qwen/Qwen3.5 4B Base https://huggingface.co/Qwen/Qwen3.5 4B Base , converted with llama.cpp. Original model is Apache 2.0…
Runs locally from ~2.45 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-4B-Base-Q4_K_S.gguf | GGUF | Q4_K_S | 2.45 GB | Download |
Model Details
Model README
Qwen3.5-4B-Base-Q4_K_S
Q4_K_S GGUF of Qwen/Qwen3.5-4B-Base, converted with llama.cpp.
Original model is Apache-2.0.
llama-cli -hf 7ven7o/Qwen3.5-4B-Base-GGUFRun 7ven7o/Qwen3.5-4B-Base-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models