GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggml-org/Qwen3-0.6B-GGUF overview

Qwen3 0.6B Run it in the Llama app: https://llama.app Or from the terminal: bash llama serve hf ggml org/Qwen3 0.6B GGUF Source models https://huggingface.co/Q…

ggufquantizedtext-generationbase_model:Qwen/Qwen3-0.6Bbase_model:quantized:Qwen/Qwen3-0.6Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~409.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
41,409
Likes
19
Pipeline
text-generation
Author

Repository Files & Downloads

4 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3-0.6B-BF16.ggufGGUFBF161.41 GBDownload
Qwen3-0.6B-Q4_0.ggufGGUFQ4_0409.1 MBDownload
Qwen3-0.6B-Q8_0.ggufGGUFQ8_0767.5 MBDownload
Qwen3-0.6B-f16.ggufGGUFF161.41 GBDownload

Model Details

Model IDggml-org/Qwen3-0.6B-GGUF
Authorggml-org
Pipelinetext-generation
Licenseapache-2.0
Base modelQwen/Qwen3-0.6B
Last modified2026-10-19T15:35:25.000Z

Model README

---

license: apache-2.0

pipeline_tag: text-generation

tags:

  • gguf
  • quantized

base_model:

  • Qwen/Qwen3-0.6B

---

Qwen3-0.6B

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/Qwen3-0.6B-GGUF

Source models

  • https://huggingface.co/Qwen/Qwen3-0.6B

TODOs

  • add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Run ggml-org/Qwen3-0.6B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models