Qwen3-0.6B Q4_K_M GGUF (RLX staging)

Qwen3-0.6B Q4_K_M GGUF + tokenizer.json for packed RLX prefill.

| Field | Value |

|---|---|

| Kind | Staging redistrib of an upstream checkpoint for RLX runners. |

| RLX crate | rlx-qwen3 |

| Upstream | https://huggingface.co/unsloth/Qwen3-0.6B-GGUF |

Quick start

hf download eugenehp/qwen3-0.6b-gguf --local-dir .
cargo run -p rlx-qwen3 --release -- --weights Qwen3-0.6B-Q4_K_M.gguf --packed --device metal

Clone rlx-models, place this repo under weights/lm/qwen3-0.6b-gguf (or pass the path explicitly), then:

cargo run -p rlx-qwen3 --release -- --weights Qwen3-0.6B-Q4_K_M.gguf --packed --device metal

Apache License 2.0 — see LICENSE. Inherit upstream terms when redistributing.

Original weights and authorship: https://huggingface.co/unsloth/Qwen3-0.6B-GGUF

This Hub repo exists so RLX recipes have a stable fetch target. When you only need the upstream checkpoint, prefer the Upstream link above.

Question 2

What license applies to eugenehp/qwen3-0.6b-gguf?

Accepted Answer

License: apache-2.0. Verify terms on Hugging Face before commercial use.

Question 3

How do I run eugenehp/qwen3-0.6b-gguf locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does eugenehp/qwen3-0.6b-gguf need?

Accepted Answer

Runs locally from ~461.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).