GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

magnitudedev/Qwen3.5-9B-DFlash-GGUF overview

Qwen3.5 9B DFlash GGUF Q8 0 GGUF conversion of z lab/Qwen3.5 9B DFlash https://huggingface.co/z lab/Qwen3.5 9B DFlash for use with Magnitude https://github.com…

llama.cppggufdflashspeculative-decodingmagnitudebase_model:z-lab/Qwen3.5-9B-DFlashbase_model:quantized:z-lab/Qwen3.5-9B-DFlashlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~1.29 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
82
Likes
0
Pipeline
—

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-9B-DFlash-Q8_0.ggufGGUFQ8_01.29 GBDownload

Model Details

Model IDmagnitudedev/Qwen3.5-9B-DFlash-GGUF
Authormagnitudedev
Pipeline—
Licenseapache-2.0
Base modelz-lab/Qwen3.5-9B-DFlash
Last modified2026-10-07T12:35:37.000Z

Model README

---

base_model:

- z-lab/Qwen3.5-9B-DFlash

license: apache-2.0

library_name: llama.cpp

tags:

- gguf

- dflash

- speculative-decoding

- magnitude

---

Qwen3.5-9B-DFlash GGUF

Q8_0 GGUF conversion of

z-lab/Qwen3.5-9B-DFlash

for use with Magnitude.

This is a DFlash draft model for speculative decoding with

Qwen/Qwen3.5-9B; the tokenizer metadata comes from that target.

Converted with

llama.cpp

at revision 43fe9c64281ef735046adc025e9e7559a1f659a5.

Artifact

  • File: Qwen3.5-9B-DFlash-Q8_0.gguf
  • Quantization: Q8_0
  • SHA-256: 42db4d8605d410989b418c051d09afdc2f68e89ab02272ae4c90c7f36fe64ca0
  • Source revision: 5fc3b3d474760f18c516db87d84c37edbfd3ede6

Draft metadata

  • dflash.attention.causal = [true, true, true, true, true, false]: the first five layers use causal attention; the last uses bidirectional attention.
  • dflash.sample_from_anchor = false: proposals come from mask rows, starting after the anchor.
  • Derived from the checkpoint configuration and Z-Lab’s reference implementation; verified against reference outputs.

Run magnitudedev/Qwen3.5-9B-DFlash-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models