Question 1

What is inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB?

Accepted Answer

--- tags: - unsloth - qwen3 - qwen - inference-snaps base_model: - unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF library_name: transformers license: apache-2.0 license_link: https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct/blob/main/LICENSE pipeline_tag: text-generation --- The Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M model from [unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF](https://huggingface.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF) split into 5GB shards.

Question 2

What license applies to inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB?

Accepted Answer

License: apache-2.0. Verify terms on Hugging Face before commercial use.

Question 3

How do I run inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB need?

Accepted Answer

Runs locally from ~3.50 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB overview

Repository Files & Downloads

Model Details

Model README

Run inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB with guIDE

File	Type	Quantization	Size	Link
Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-00001-of-00004.gguf	GGUF	Q4_K_M	4.62 GB	Download
Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-00002-of-00004.gguf	GGUF	Q4_K_M	4.56 GB	Download
Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-00003-of-00004.gguf	GGUF	Q4_K_M	4.60 GB	Download
Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-00004-of-00004.gguf	GGUF	Q4_K_M	3.50 GB	Download

Model ID	inference-snaps/Qwen3-Coder-30B-A3B-Instruct-GGUF-Q4_K_M-5GB
Author	inference-snaps
Pipeline	text-generation
License	apache-2.0
Base model	unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF
Last modified	2026-06-22T14:52:04.000Z