Alittlehammmer/Qwen3.6-35B-A3B-DFlash-GGUF-llama.cpp overview
Qwen3.6 35B A3B DFlash GGUF quantizations of z lab/Qwen3.6 35B A3B DFlash https://huggingface.co/z lab/Qwen3.6 35B A3B DFlash . Converted to BF16 using convert…
Runs locally from ~224.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Qwen3.6-35B-A3B-DFlash-BF16.gguf | GGUF | BF16 | 746.6 MB | Download |
| Qwen3.6-35B-A3B-DFlash-Q4_K_M.gguf | GGUF | Q4_K_M | 224.8 MB | Download |
| Qwen3.6-35B-A3B-DFlash-Q5_K.gguf | GGUF | Q5_K | 267.3 MB | Download |
| Qwen3.6-35B-A3B-DFlash-Q6_K.gguf | GGUF | Q6_K | 312.4 MB | Download |
| Qwen3.6-35B-A3B-DFlash-Q8_0.gguf | GGUF | Q8_0 | 401.6 MB | Download |
Model Details
| Model ID | Alittlehammmer/Qwen3.6-35B-A3B-DFlash-GGUF-llama.cpp |
|---|---|
| Author | Alittlehammmer |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | z-lab/Qwen3.6-35B-A3B-DFlash |
| Last modified | 2026-06-29T18:41:29.000Z |
Model README
---
base_model:
- z-lab/Qwen3.6-35B-A3B-DFlash
base_model_relation: quantized
quantized_by: Alittlehammmer
license: apache-2.0
license_link: https://huggingface.co/z-lab/Qwen3.6-35B-A3B-DFlash/blob/main/LICENSE
pipeline_tag: text-generation
library_name: gguf
tags:
- gguf
- quantized
- llama.cpp
- text-generation
- agentic-coding
- dflash
---
Qwen3.6-35B-A3B-DFlash
GGUF quantizations of z-lab/Qwen3.6-35B-A3B-DFlash.
Converted to BF16 using convert_hf_to_gguf.py, then quantized using llama-quantize from llama.cpp.
Available quants
| Quant | Bits | Size | Notes |
| ------ | ----- | ------- | -------------------------------- |
| Q4_K_M | 4 | ~235 MB | Average quality |
| Q5_K | 5 | ~280 MB | High quality |
| Q6_K | 6 | ~326 MB | Very high quality |
| Q8_0 | 8 | ~421 MB | Highest quality, near lossless, Recommended |
| BF16 | 16 | ~771 MB | Full precision, reference file |
Usage
Use in conjunction with existing Qwen3.6 Quants, example config if using llama-server:
[Qwen3.6-35B-A3B-Q8_0-DFlash]
model = /mnt/gguf/Qwen3.6-35B-A3B/Qwen3.6-35B-A3B-Q8_0.gguf
model-draft = /mnt/gguf/Qwen3.6-35B-A3B/Qwen3.6-35B-A3B-DFlash-Q8_0.gguf
spec-type = draft-dflash
spec-draft-n-max = 6 Original model
See the original model card
for details on capabilities, benchmarks, and license.
Run Alittlehammmer/Qwen3.6-35B-A3B-DFlash-GGUF-llama.cpp with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models