Model Intelligence Sheet
Dev218/Qwen3-nano-GGUF overview
Qwen3 Nano GGUF GGUF quantized version of Qwen3 Nano. Files Qwen3 nano.gguf Qwen3 nano Q4 K M.gguf Usage with llama.cpp bash llama cli \ m Qwen3 nano Q4 K M.gg…
Runs locally from ~461.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
Model README
Qwen3 Nano GGUF
GGUF quantized version of Qwen3 Nano.
Files
- Qwen3-nano.gguf
- Qwen3-nano-Q4_K_M.gguf
Usage with llama.cpp
llama-cli \
-m Qwen3-nano-Q4_K_M.gguf \
-p "Hello"Run Dev218/Qwen3-nano-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models