GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

qsardor/Viorra-Gemma-4-E2B-QAT-GGUF overview

Viorra Gemma 4 E2B QAT GGUF : GGUF This model was finetuned and converted to GGUF format using Unsloth https://github.com/unslothai/unsloth . Example usage : F…

ggufgemma4llama.cppunslothvision-language-modelendpoints_compatibleregion:usconversational

Runs locally from ~941.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
gemma-4-E2B-it-qat-q4_0-unquantized.BF16-mmproj.ggufGGUFQ4_0941.1 MBDownload
gemma-4-E2B-it-qat-q4_0-unquantized.Q4_K_M.ggufGGUFQ4_03.19 GBDownload
gemma-4-E2B-it-qat-q4_0-unquantized.Q8_0.ggufGGUFQ4_04.61 GBDownload

Model Details

Model IDqsardor/Viorra-Gemma-4-E2B-QAT-GGUF
Authorqsardor
Pipeline
License
Base model
Last modified2026-07-25T14:39:02.000Z

Model README

---

tags:

  • gguf
  • llama.cpp
  • unsloth
  • vision-language-model

---

Viorra-Gemma-4-E2B-QAT-GGUF : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf qsardor/Viorra-Gemma-4-E2B-QAT-GGUF --jinja
  • For multimodal models: llama-mtmd-cli -hf qsardor/Viorra-Gemma-4-E2B-QAT-GGUF --jinja

Available Model files:

  • gemma-4-E2B-it-qat-q4_0-unquantized.Q8_0.gguf
  • gemma-4-E2B-it-qat-q4_0-unquantized.BF16-mmproj.gguf

This was trained 2x faster with Unsloth

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>

Run qsardor/Viorra-Gemma-4-E2B-QAT-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models