GraySoft
Model Comparison

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufvsunsloth/gemma-3-12b-it-qat-gguf

Side-by-side comparison of hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf and unsloth/gemma-3-12b-it-qat-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-3B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

unsloth/gemma-3-12b-it-qat-gguf

unsloth · image-text-to-text

**Model Page**: Gemma > [!Note] > This repository corresponds to the 12B **instruction-tuned** version of the Gemma 3 model using Quantization Aware Training (QAT). > > **The checkpoint in this repository is unquantized, please make sure to quantize with Q4_0 with your favorite …

Side-by-side Specifications

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufunsloth/gemma-3-12b-it-qat-gguf
Authorhugging-quantsunsloth
Pipeline Tasktext-generationimage-text-to-text
Librarytransformers
Downloads23,87529,663
Likes2743
LicenseUnknownUnknown
Context Length
Created2024-09-252025-04-21
Last Modified2024-09-252025-05-12
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
transformersggufgemma3image-text-to-textunslothgemmagooglearxiv:1905.07830arxiv:1905.10044arxiv:1911.11641

View full details: hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf · unsloth/gemma-3-12b-it-qat-gguf