GraySoft
Model Comparison

ggml-org/gemma-4-31b-it-ggufvshugging-quants/llama-3.2-1b-instruct-q4_k_m-gguf

Side-by-side comparison of ggml-org/gemma-4-31b-it-gguf and hugging-quants/llama-3.2-1b-instruct-q4_k_m-gguf: downloads, license, context length, tasks, and benchmarks.

ggml-org/gemma-4-31b-it-gguf

ggml-org · —

# gemma-4-31B-it-GGUF Recommended way to run this model: ``sh llama-server -hf ggml-org/gemma-4-31B-it-GGUF `` Then, access http://localhost:8080

hugging-quants/llama-3.2-1b-instruct-q4_k_m-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-1B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Side-by-side Specifications

ggml-org/gemma-4-31b-it-ggufhugging-quants/llama-3.2-1b-instruct-q4_k_m-gguf
Authorggml-orghugging-quants
Pipeline Tasktext-generation
Library
Downloads52,52134,537
Likes3419
LicenseUnknownUnknown
Context Length
Created2026-04-012024-09-25
Last Modified2026-04-122024-09-25
Tags
ggufbase_model:google/gemma-4-31B-itbase_model:quantized:google/gemma-4-31B-itendpoints_compatibleregion:usconversational
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen

View full details: ggml-org/gemma-4-31b-it-gguf · hugging-quants/llama-3.2-1b-instruct-q4_k_m-gguf