GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

magnitudedev/gemma-4-E2B-it-qat-MTP-GGUF overview

gemma 4 E2B it qat MTP GGUF Q4 0 GGUF of google/gemma 4 E2B it qat q4 0 unquantized assistant https://huggingface.co/google/gemma 4 E2B it qat q4 0 unquantized…

ggufmtpspeculative-decodingmagnitudebase_model:google/gemma-4-E2B-it-qat-q4_0-unquantized-assistantbase_model:quantized:google/gemma-4-E2B-it-qat-q4_0-unquantized-assistantlicense:apache-2.0region:usconversational

Runs locally from ~56.5 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
—

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
gemma-4-E2B-it-qat-MTP-Q4_0.ggufGGUFQ4_056.5 MBDownload

Model Details

Model IDmagnitudedev/gemma-4-E2B-it-qat-MTP-GGUF
Authormagnitudedev
Pipeline—
Licenseapache-2.0
Base modelgoogle/gemma-4-E2B-it-qat-q4_0-unquantized-assistant
Last modified2026-10-11T07:44:04.000Z

Model README

---

license: apache-2.0

base_model: google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

tags:

- gguf

- mtp

- speculative-decoding

- magnitude

inference: false

---

gemma-4-E2B-it-qat-MTP-GGUF

Q4_0 GGUF of google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant for use with Magnitude.

This is the MTP draft model for speculative decoding with the Gemma 4 E2B QAT model.

Artifact

  • File: gemma-4-E2B-it-qat-MTP-Q4_0.gguf
  • SHA-256: 586f2460b909008640981ec34060aa864e03c144fbabfb3173c4335087e4aae0
  • Source revision: ebc7e1a211354561464cb82ed6d886792138dcb6
  • GGUF from unsloth/gemma-4-E2B-it-qat-GGUF (mtp-gemma-4-E2B-it.gguf)

Run magnitudedev/gemma-4-E2B-it-qat-MTP-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models