---

license: apache-2.0

base_model: google/gemma-4-31B-it

base_model_relation: quantized

library_name: gguf

pipeline_tag: text-generation

tags:

• gguf
• llama.cpp
• dashq
• quantized

---

!DASH-Q

gemma-4-31B-it - DASH-Q 2-bit GGUF

A llama.cpp GGUF of google/gemma-4-31B-it quantized with

DASH-Q. It is a standard Q2_K-class mixed-precision file

(Q2_K / Q3_K / Q4_K tensors, about 3 bits per weight) and loads in any recent llama.cpp build.

| File | Size |

| --- | --- |

| gemma-4-31B-it-DASHQ-Q2_K_XL.gguf | 11.98 GB |

Text only: the vision tower is not included.

Quality vs. F16 (KL divergence)

Raw-text perplexity is not a meaningful metric for gemma-4-it (the F16 model itself scores in the thousands on WikiText-2 while generating normally),

so quality is reported as KL divergence of the next-token distribution to F16 (llama-perplexity --kl-divergence, WikiText-2, 4 x 2048 tokens):

| Model | Size | Mean KLD | Median KLD | Top-1 token agreement |

| --- | --- | --- | --- | --- |

| llama.cpp Q2_K (imatrix) | 11.92 GB | 3.04 | 1.96 | 44.4% |

| DASH-Q (this file) | 11.98 GB | 1.38 | 0.32 | 65.8% |

Usage

llama-cli -m gemma-4-31B-it-DASHQ-Q2_K_XL.gguf -ngl 99 -c 8192

License

Inherits the license of the base model (google/gemma-4-31B-it).