DrMoriarty0/Qwen3.5-35B-A3B-GGUF overview
mAPEX Quantized Models Source Data The source data for quantization was taken from unsloth/Qwen3.5 35B A3B GGUF https://huggingface.co/unsloth/Qwen3.5 35B A3B …
Runs locally from ~9.24 GB disk (12 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.5-35B-A3B-Tier1.gguf | GGUF | GGUF | 31.46 GB | Download |
| Qwen3.5-35B-A3B-Tier10-s.gguf | GGUF | GGUF | 15.82 GB | Download |
| Qwen3.5-35B-A3B-Tier10.gguf | GGUF | GGUF | 15.82 GB | Download |
| Qwen3.5-35B-A3B-Tier11-s.gguf | GGUF | GGUF | 13.80 GB | Download |
| Qwen3.5-35B-A3B-Tier11.gguf | GGUF | GGUF | 13.71 GB | Download |
| Qwen3.5-35B-A3B-Tier12-s.gguf | GGUF | GGUF | 13.13 GB | Download |
| Qwen3.5-35B-A3B-Tier12.gguf | GGUF | GGUF | 13.00 GB | Download |
| Qwen3.5-35B-A3B-Tier13-s.gguf | GGUF | GGUF | 12.18 GB | Download |
| Qwen3.5-35B-A3B-Tier13.gguf | GGUF | GGUF | 12.03 GB | Download |
| Qwen3.5-35B-A3B-Tier14-s.gguf | GGUF | GGUF | 9.98 GB | Download |
| Qwen3.5-35B-A3B-Tier14.gguf | GGUF | GGUF | 10.15 GB | Download |
| Qwen3.5-35B-A3B-Tier15-s.gguf | GGUF | GGUF | 9.24 GB | Download |
| Qwen3.5-35B-A3B-Tier15.gguf | GGUF | GGUF | 9.53 GB | Download |
| Qwen3.5-35B-A3B-Tier2.gguf | GGUF | GGUF | 29.52 GB | Download |
| Qwen3.5-35B-A3B-Tier3.gguf | GGUF | GGUF | 26.48 GB | Download |
| Qwen3.5-35B-A3B-Tier4.gguf | GGUF | GGUF | 24.24 GB | Download |
| Qwen3.5-35B-A3B-Tier5.gguf | GGUF | GGUF | 21.94 GB | Download |
| Qwen3.5-35B-A3B-Tier6.gguf | GGUF | GGUF | 21.16 GB | Download |
| Qwen3.5-35B-A3B-Tier7.gguf | GGUF | GGUF | 20.03 GB | Download |
| Qwen3.5-35B-A3B-Tier8.gguf | GGUF | GGUF | 17.68 GB | Download |
| Qwen3.5-35B-A3B-Tier9-s.gguf | GGUF | GGUF | 16.90 GB | Download |
| Qwen3.5-35B-A3B-Tier9.gguf | GGUF | GGUF | 16.90 GB | Download |
Model Details
| Model ID | DrMoriarty0/Qwen3.5-35B-A3B-GGUF |
|---|---|
| Author | DrMoriarty0 |
| Pipeline | — |
| License | apache-2.0 |
| Base model | Qwen/Qwen3.5-35B-A3B |
| Last modified | 2026-09-27T16:09:12.000Z |
Model README
---
license: apache-2.0
base_model:
- Qwen/Qwen3.5-35B-A3B
---
mAPEX Quantized Models
Source Data
The source data for quantization was taken from unsloth/Qwen3.5-35B-A3B-GGUF.
Original source file: BF16/Qwen3.5-35B-A3B-BF16-00001-of-00002.gguf
Quantization Method
All quants were produced using the modified APEX quantization scheme.
mAPEX (modified Automated Precision EXpert allocation) assigns per-layer, per-tensor precision
for MoE models using llama.cpp's --tensor-type-file.
For more information, see: <https://github.com/DrMoriarty/apex-quant/>
Quantized Models
> Note: TierN-s quants are typically slightly larger than their regular
> counterparts, but provide roughly 10–20% faster inference (highly dependent
> on the model and GPU).
| Name | Size (GB) | Comments |
|------|-----------|----------|
| Qwen3.5-35B-A3B-Tier1.gguf | 31.46 | |
| Qwen3.5-35B-A3B-Tier2.gguf | 29.52 | |
| Qwen3.5-35B-A3B-Tier3.gguf | 26.48 | |
| Qwen3.5-35B-A3B-Tier4.gguf | 24.24 | |
| Qwen3.5-35B-A3B-Tier5.gguf | 21.94 | |
| Qwen3.5-35B-A3B-Tier6.gguf | 21.16 | |
| Qwen3.5-35B-A3B-Tier7.gguf | 20.03 | |
| Qwen3.5-35B-A3B-Tier8.gguf | 17.68 | |
| Qwen3.5-35B-A3B-Tier9.gguf | 16.90 | |
| Qwen3.5-35B-A3B-Tier9-s.gguf | 16.90 | |
| Qwen3.5-35B-A3B-Tier10.gguf | 15.82 | |
| Qwen3.5-35B-A3B-Tier10-s.gguf | 15.82 | |
| Qwen3.5-35B-A3B-Tier11.gguf | 13.71 | |
| Qwen3.5-35B-A3B-Tier11-s.gguf | 13.80 | |
| Qwen3.5-35B-A3B-Tier12.gguf | 13.00 | |
| Qwen3.5-35B-A3B-Tier12-s.gguf | 13.13 | |
| Qwen3.5-35B-A3B-Tier13.gguf | 12.03 | |
| Qwen3.5-35B-A3B-Tier13-s.gguf | 12.18 | |
| Qwen3.5-35B-A3B-Tier14.gguf | 10.15 | |
| Qwen3.5-35B-A3B-Tier14-s.gguf | 9.98 | |
| Qwen3.5-35B-A3B-Tier15.gguf | 9.53 | |
| Qwen3.5-35B-A3B-Tier15-s.gguf | 9.24 | |
Run DrMoriarty0/Qwen3.5-35B-A3B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models