Latentiq/Qwen3-4B-GGUF overview
Qwen3 4B GGUF This repository provides a GGUF quantized version of Qwen3 4B. The original model was developed by Alibaba Cloud through the Qwen team. The GGUF …
Runs locally from ~2.33 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| qwen3-4b-q4_k_m.gguf | GGUF | Q4_K_M | 2.33 GB | Download |
Model Details
Model README
---
license: apache-2.0
base_model:
- Qwen/Qwen3-4B
- unsloth/Qwen3-4B-GGUF
---
Qwen3 4B GGUF
This repository provides a GGUF quantized version of Qwen3 4B.
The original model was developed by Alibaba Cloud through the Qwen team.
The GGUF quantization was created by Unsloth.
This repository redistributes the model for convenient use in GGUF compatible inference frameworks.
Attribution
Qwen3 4B © Alibaba Cloud, Qwen team
GGUF quantization by Unsloth
Sources
Original model: https://huggingface.co/Qwen/Qwen3-4B
GGUF quantization: https://huggingface.co/unsloth/Qwen3-4B-GGUF
License
This repository is distributed under the Apache 2.0 License, subject to the terms and conditions of the original model and any applicable upstream notices.
Notes
This repository does not claim ownership of the original model.
Please refer to the upstream repositories for full documentation, usage details, and any additional requirements.
Run Latentiq/Qwen3-4B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models