GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ankk98/dspark-gemma4-12b-block7-Q4_0-GGUF overview

DSpark Gemma4 12B draft Q4 0 GGUF 4 bit pure Q4 0 GGUF draft for DSpark speculative decoding with google/gemma 4 12B it https://huggingface.co/google/gemma 4 1…

ggufllama-cppspeculative-decodingdsparkgemma4base_model:deepseek-ai/dspark_gemma4_12b_block7base_model:quantized:deepseek-ai/dspark_gemma4_12b_block7license:mitendpoints_compatibleregion:usconversational

Runs locally from ~1.81 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
dspark_gemma4_12b_q4pure.ggufGGUFQ4PURE1.81 GBDownload

Model Details

Model IDankk98/dspark-gemma4-12b-block7-Q4_0-GGUF
Authorankk98
Pipeline
Licensemit
Base modeldeepseek-ai/dspark_gemma4_12b_block7,google/gemma-4-12B-it
Last modified2026-06-30T07:42:56.000Z

Model README

---

base_model:

  • deepseek-ai/dspark_gemma4_12b_block7
  • google/gemma-4-12B-it

library_name: gguf

tags:

  • llama-cpp
  • speculative-decoding
  • dspark
  • gemma4

license: mit

---

DSpark Gemma4 12B draft (Q4_0 GGUF)

4-bit (pure Q4_0) GGUF draft for DSpark speculative decoding with

google/gemma-4-12B-it.

Converted with llama.cpp ft-dspark from

deepseek-ai/dspark_gemma4_12b_block7.

Files

| File | Description |

|------|-------------|

| dspark_gemma4_12b_q4pure.gguf | Draft model (~1.9 GB), LLM_ARCH_DSPARK |

Requirements

  • llama.cpp built from ft-dspark (or a release that includes draft-dspark)
  • A separate target Gemma4 12B GGUF (not included here)

Usage

llama-cli \
  -m /path/to/gemma-4-12B-it-Q4_0.gguf \
  -md ./dspark_gemma4_12b_q4pure.gguf \
  --spec-type draft-dspark \
  --spec-draft-n-max 4 \
  -c 512 -ngl 99 -ngld 99 \
  -p "Your prompt" -n 128 --temp 0

Run ankk98/dspark-gemma4-12b-block7-Q4_0-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models