GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

DrMoriarty0/Qwen_Qwen3.6-35B-A3B-GGUF overview

mAPEX Quantized Models Source Data The source data for quantization was taken from bartowski/Qwen Qwen3.6 35B A3B GGUF https://huggingface.co/bartowski/Qwen Qw…

ggufbase_model:Qwen/Qwen3.6-35B-A3Bbase_model:quantized:Qwen/Qwen3.6-35B-A3Blicense:apache-2.0endpoints_compatibleregion:usimatrixconversational

Runs locally from ~9.75 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
—

Repository Files & Downloads

22 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen_Qwen3.6-35B-A3B-Tier1.ggufGGUFGGUF32.30 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier10-s.ggufGGUFGGUF16.39 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier10.ggufGGUFGGUF16.39 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier11-s.ggufGGUFGGUF14.38 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier11.ggufGGUFGGUF14.28 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier12-s.ggufGGUFGGUF13.70 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier12.ggufGGUFGGUF13.58 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier13-s.ggufGGUFGGUF12.69 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier13.ggufGGUFGGUF12.53 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier14-s.ggufGGUFGGUF10.49 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier14.ggufGGUFGGUF10.66 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier15-s.ggufGGUFGGUF9.75 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier15.ggufGGUFGGUF10.03 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier2.ggufGGUFGGUF30.36 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier3.ggufGGUFGGUF27.31 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier4.ggufGGUFGGUF25.07 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier5.ggufGGUFGGUF22.77 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier6.ggufGGUFGGUF21.99 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier7.ggufGGUFGGUF20.67 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier8.ggufGGUFGGUF18.33 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier9-s.ggufGGUFGGUF17.55 GBDownload
Qwen_Qwen3.6-35B-A3B-Tier9.ggufGGUFGGUF17.55 GBDownload

Model Details

Model IDDrMoriarty0/Qwen_Qwen3.6-35B-A3B-GGUF
AuthorDrMoriarty0
Pipeline—
Licenseapache-2.0
Base modelQwen/Qwen3.6-35B-A3B
Last modified2026-09-25T18:37:03.000Z

Model README

---

license: apache-2.0

base_model:

  • Qwen/Qwen3.6-35B-A3B

---

mAPEX Quantized Models

Source Data

The source data for quantization was taken from bartowski/Qwen_Qwen3.6-35B-A3B-GGUF.

Original source file: Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf

Quantization Method

All quants were produced using the modified APEX quantization scheme.

mAPEX (modified Automated Precision EXpert allocation) assigns per-layer, per-tensor precision

for MoE models using llama.cpp's --tensor-type-file.

For more information, see: <https://github.com/DrMoriarty/apex-quant/>

Quantized Models

> Note: TierN-s quants are typically slightly larger than their regular

> counterparts, but provide roughly 10–20% faster inference (highly dependent

> on the model and GPU).

| Name | Size (GB) | Comments |

|------|-----------|----------|

| tier1 | 32.30 | |

| tier2 | 30.36 | |

| tier3 | 27.31 | |

| tier4 | 25.07 | |

| tier5 | 22.77 | |

| tier6 | 21.99 | |

| tier7 | 20.67 | |

| tier8 | 18.33 | |

| tier9 | 17.55 | |

| tier9-s | 17.55 | |

| tier10 | 16.39 | |

| tier10-s | 16.39 | |

| tier11 | 14.28 | |

| tier11-s | 14.38 | |

| tier12 | 13.58 | |

| tier12-s | 13.70 | |

| tier13 | 12.53 | |

| tier13-s | 12.69 | |

| tier14 | 10.66 | |

| tier14-s | 10.49 | |

| tier15 | 10.03 | |

| tier15-s | 9.75 | |

Run DrMoriarty0/Qwen_Qwen3.6-35B-A3B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models