DrMoriarty0/Qwen_Qwen3.6-35B-A3B-GGUF overview
mAPEX Quantized Models Source Data The source data for quantization was taken from bartowski/Qwen Qwen3.6 35B A3B GGUF https://huggingface.co/bartowski/Qwen Qw…
Runs locally from ~9.75 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen_Qwen3.6-35B-A3B-Tier1.gguf | GGUF | GGUF | 32.30 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier10-s.gguf | GGUF | GGUF | 16.39 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier10.gguf | GGUF | GGUF | 16.39 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier11-s.gguf | GGUF | GGUF | 14.38 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier11.gguf | GGUF | GGUF | 14.28 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier12-s.gguf | GGUF | GGUF | 13.70 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier12.gguf | GGUF | GGUF | 13.58 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier13-s.gguf | GGUF | GGUF | 12.69 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier13.gguf | GGUF | GGUF | 12.53 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier14-s.gguf | GGUF | GGUF | 10.49 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier14.gguf | GGUF | GGUF | 10.66 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier15-s.gguf | GGUF | GGUF | 9.75 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier15.gguf | GGUF | GGUF | 10.03 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier2.gguf | GGUF | GGUF | 30.36 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier3.gguf | GGUF | GGUF | 27.31 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier4.gguf | GGUF | GGUF | 25.07 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier5.gguf | GGUF | GGUF | 22.77 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier6.gguf | GGUF | GGUF | 21.99 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier7.gguf | GGUF | GGUF | 20.67 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier8.gguf | GGUF | GGUF | 18.33 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier9-s.gguf | GGUF | GGUF | 17.55 GB | Download |
| Qwen_Qwen3.6-35B-A3B-Tier9.gguf | GGUF | GGUF | 17.55 GB | Download |
Model Details
| Model ID | DrMoriarty0/Qwen_Qwen3.6-35B-A3B-GGUF |
|---|---|
| Author | DrMoriarty0 |
| Pipeline | — |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.6-35B-A3B |
| Last modified | 2026-09-25T18:37:03.000Z |
Model README
---
license: apache-2.0
base_model:
- Qwen/Qwen3.6-35B-A3B
---
mAPEX Quantized Models
Source Data
The source data for quantization was taken from bartowski/Qwen_Qwen3.6-35B-A3B-GGUF.
Original source file: Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf
Quantization Method
All quants were produced using the modified APEX quantization scheme.
mAPEX (modified Automated Precision EXpert allocation) assigns per-layer, per-tensor precision
for MoE models using llama.cpp's --tensor-type-file.
For more information, see: <https://github.com/DrMoriarty/apex-quant/>
Quantized Models
> Note: TierN-s quants are typically slightly larger than their regular
> counterparts, but provide roughly 10–20% faster inference (highly dependent
> on the model and GPU).
| Name | Size (GB) | Comments |
|------|-----------|----------|
| tier1 | 32.30 | |
| tier2 | 30.36 | |
| tier3 | 27.31 | |
| tier4 | 25.07 | |
| tier5 | 22.77 | |
| tier6 | 21.99 | |
| tier7 | 20.67 | |
| tier8 | 18.33 | |
| tier9 | 17.55 | |
| tier9-s | 17.55 | |
| tier10 | 16.39 | |
| tier10-s | 16.39 | |
| tier11 | 14.28 | |
| tier11-s | 14.38 | |
| tier12 | 13.58 | |
| tier12-s | 13.70 | |
| tier13 | 12.53 | |
| tier13-s | 12.69 | |
| tier14 | 10.66 | |
| tier14-s | 10.49 | |
| tier15 | 10.03 | |
| tier15-s | 9.75 | |
Run DrMoriarty0/Qwen_Qwen3.6-35B-A3B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models