GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

zanish-labs/gemma-4-e4b-q4km-gguf overview

Gemma 4 E4B — GGUF Q4 K M + mmproj Google's Gemma 4 E4B vision model, packaged for on device inference via llama.cpp. Includes both the base model and the mult…

ggufvisionmultimodalgemmaenlicense:gemmaendpoints_compatibleregion:us

Runs locally from ~533.9 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
11
Likes
0
Pipeline

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
gemma-4-E4B-it-Q4_K_M.ggufGGUFQ4_K_M4.97 GBDownload
mmproj-gemma-4-E4B-it-Q8_0.ggufGGUFQ8_0533.9 MBDownload

Model Details

Model IDzanish-labs/gemma-4-e4b-q4km-gguf
Authorzanish-labs
Pipeline
Licensegemma
Base model
Last modified2026-07-10T11:04:34.000Z

Model README

---

language:

  • en

license: gemma

library_name: gguf

tags:

  • vision
  • multimodal
  • gguf
  • gemma

---

Gemma 4 E4B — GGUF (Q4_K_M + mmproj)

Google's Gemma 4 E4B vision model, packaged for on-device inference via llama.cpp. Includes both the base model and the multimodal projector.

Contents

| File | Description | Quantization |

|------|-------------|-------------|

| gemma-4-E4B-it-Q4_K_M.gguf | Base model (text + vision) | Q4_K_M |

| mmproj-gemma-4-E4B-it-Q8_0.gguf | Multimodal projector | Q8_0 |

Source

The base model is sourced from ggml-org/gemma-4-e4b-it-GGUF.

The mmproj file is sourced from ggml-org/gemma-4-e4b-it-GGUF with full attribution.

License

This model is subject to the Gemma Terms of Use. Copyright 2024 Google LLC.

Run zanish-labs/gemma-4-e4b-q4km-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models