GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

giocom/Qwen3.6-35B-A3B-MTP-GGUF overview

Qwen3.6 35B A3B MTP ONLY GGUF

ggufmtpspeculative-decodingqwentext-generationbase_model:Qwen/Qwen3.6-35B-A3Bbase_model:quantized:Qwen/Qwen3.6-35B-A3Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~1.17 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
1,206
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.6-35B-A3B-MTP-BF16.ggufGGUFBF163.48 GBDownload
Qwen3.6-35B-A3B-MTP-Q4_K_M.ggufGGUFQ4_K_M1.17 GBDownload
Qwen3.6-35B-A3B-MTP-Q8_0.ggufGGUFQ8_01.85 GBDownload

Model Details

Model IDgiocom/Qwen3.6-35B-A3B-MTP-GGUF
Authorgiocom
Pipelinetext-generation
Licenseapache-2.0
Base modelQwen/Qwen3.6-35B-A3B
Last modified2026-08-05T12:41:47.000Z

Model README

---

license: apache-2.0

pipeline_tag: text-generation

tags:

  • mtp
  • speculative-decoding
  • qwen

base_model:

  • Qwen/Qwen3.6-35B-A3B

---

Qwen3.6-35B-A3B-MTP-ONLY-GGUF

Run giocom/Qwen3.6-35B-A3B-MTP-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models