GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ggml-org/gemma-4-26B-A4B-it-GGUF overview

gemma 4 26B A4B it Run with https://llama.app bash llama serve hf ggml org/gemma 4 26B A4B it GGUF Source models https://huggingface.co/google/gemma 4 26B A4B …

ggufquantizedimage-text-to-textbase_model:google/gemma-4-26B-A4B-itbase_model:quantized:google/gemma-4-26B-A4B-itlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~240.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
224,111
Likes
79
Pipeline
image-text-to-text
Author

Repository Files & Downloads

10 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
dflash-gemma-4-26B-A4B-it-BF16.ggufGGUFBF16834.7 MBDownload
dflash-gemma-4-26B-A4B-it-Q8_0.ggufGGUFQ8_0450.5 MBDownload
gemma-4-26B-A4B-it-BF16.ggufGGUFBF1647.04 GBDownload
gemma-4-26B-A4B-it-Q4_0.ggufGGUFQ4_013.61 GBDownload
gemma-4-26B-A4B-it-Q8_0.ggufGGUFQ8_025.02 GBDownload
mmproj-gemma-4-26B-A4B-it-BF16.ggufGGUFBF161.11 GBDownload
mmproj-gemma-4-26B-A4B-it-Q8_0.ggufGGUFQ8_0769.1 MBDownload
mtp-gemma-4-26B-A4B-it-BF16.ggufGGUFBF16815.6 MBDownload
mtp-gemma-4-26B-A4B-it-Q4_0.ggufGGUFQ4_0240.3 MBDownload
mtp-gemma-4-26B-A4B-it-Q8_0.ggufGGUFQ8_0440.4 MBDownload

Model Details

Model IDggml-org/gemma-4-26B-A4B-it-GGUF
Authorggml-org
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelgoogle/gemma-4-26B-A4B-it
Last modified2026-07-26T02:27:48.000Z

Model README

---

license: apache-2.0

pipeline_tag: image-text-to-text

tags:

  • gguf
  • quantized

base_model:

  • google/gemma-4-26B-A4B-it

---

gemma-4-26B-A4B-it

Run with https://llama.app

llama serve -hf ggml-org/gemma-4-26B-A4B-it-GGUF

Source models

  • https://huggingface.co/google/gemma-4-26B-A4B-it
  • https://huggingface.co/google/gemma-4-26B-A4B-it-assistant
  • https://huggingface.co/google/gemma-4-26B-A4B-it-qat-q4_0-unquantized
  • https://huggingface.co/google/gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant
  • https://huggingface.co/z-lab/gemma-4-26B-A4B-it-DFlash

TODOs

  • add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Run ggml-org/gemma-4-26B-A4B-it-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models