GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggerganov/Qwen3-0.6B-GGUF overview

Qwen3 0.6B Source repos: https://huggingface.co/Qwen/Qwen3 0.6B TODO: add info

ggufquantizedbase_model:Qwen/Qwen3-0.6Bbase_model:quantized:Qwen/Qwen3-0.6Blicense:otherendpoints_compatibleregion:usconversational

Runs locally from ~767.5 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3-0.6B-BF16.ggufGGUFBF161.41 GBDownload
Qwen3-0.6B-Q8_0.ggufGGUFQ8_0767.5 MBDownload

Model Details

Model IDggerganov/Qwen3-0.6B-GGUF
Authorggerganov
Pipeline
Licenseother
Base modelQwen/Qwen3-0.6B
Last modified2026-07-14T13:20:52.000Z

Model README

---

license: other

tags:

  • gguf
  • quantized

base_model:

  • Qwen/Qwen3-0.6B

---

Qwen3-0.6B

Source repos:

  • https://huggingface.co/Qwen/Qwen3-0.6B

TODO: add info

Run ggerganov/Qwen3-0.6B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models