GraySoft
Download guIDE →
Model Comparison

unsloth/gemma-3-12b-it-qat-ggufvsunsloth/gemma-4-e4b-it-gguf

Side-by-side comparison of unsloth/gemma-3-12b-it-qat-gguf and unsloth/gemma-4-e4b-it-gguf: downloads, license, context length, tasks, and benchmarks.

unsloth/gemma-3-12b-it-qat-gguf

unsloth · image-text-to-text

**Model Page**: Gemma > [!Note] > This repository corresponds to the 12B **instruction-tuned** version of the Gemma 3 model using Quantization Aware Training (QAT). > > **The checkpoint in this repository is unquantized, please make sure to quantize with Q4_0 with your favorite …

unsloth/gemma-4-e4b-it-gguf

unsloth · image-text-to-text

processor = AutoProcessor.from_pretrained(MODEL_ID) model = AutoModelForCausalLM.from_pretrained( MODEL_ID, dtype="auto", device_map="auto" ) `` Once the model is loaded, you can start generating output: `python # Prompt messages = [ {"role": "system", "content": "You are a help…

Side-by-side Specifications

unsloth/gemma-3-12b-it-qat-ggufunsloth/gemma-4-e4b-it-gguf
Authorunslothunsloth
Pipeline Taskimage-text-to-textimage-text-to-text
Librarytransformers—
Downloads29,6631,249,310
Likes43276
LicenseUnknownUnknown
Context Length——
Created2025-04-212026-04-01
Last Modified2025-05-122026-04-11
Tags
transformersggufgemma3image-text-to-textunslothgemmagooglearxiv:1905.07830arxiv:1905.10044arxiv:1911.11641
ggufgemma4unslothgemmagoogleimage-text-to-textbase_model:google/gemma-4-E4B-itbase_model:quantized:google/gemma-4-E4B-itlicense:apache-2.0endpoints_compatible

View full details: unsloth/gemma-3-12b-it-qat-gguf · unsloth/gemma-4-e4b-it-gguf