GraySoft
Download guIDE →
Model Comparison

dampfinchen/google-gemma-3-12b-it-qat-q4_0-gguf-small-fixvsm4-ai/tinymistral-248m-v2-instruct-gguf

Side-by-side comparison of dampfinchen/google-gemma-3-12b-it-qat-q4_0-gguf-small-fix and m4-ai/tinymistral-248m-v2-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

dampfinchen/google-gemma-3-12b-it-qat-q4_0-gguf-small-fix

Dampfinchen · —

https://huggingface.co/stduhpf/google-gemma-3-12b-it-qat-q4_0-gguf-small but with tokens 105 and 106 and their corresponding image tokens set to control instead of normal. Added general.name metadata.

m4-ai/tinymistral-248m-v2-instruct-gguf

M4-ai · —

GGUF version of Locutusque/TinyMistral-248M-v2-Instruct. # Recommended inference parameters `` do_sample: true temperature: 0.1 top_p: 0.14 top_k: 12 repetition_penalty: 1.1 ` # Recommended prompt template ` user\n{user message}\nassistant\n{assistant message} ``

Side-by-side Specifications

dampfinchen/google-gemma-3-12b-it-qat-q4_0-gguf-small-fixm4-ai/tinymistral-248m-v2-instruct-gguf
AuthorDampfinchenM4-ai
Pipeline Task——
Library——
Downloads20,14929,482
Likes116
LicenseUnknownUnknown
Context Length——
Created2025-04-092024-02-03
Last Modified2025-04-092024-02-03
Tags
gguflicense:gemmaendpoints_compatibleregion:usconversational
ggufendataset:HuggingFaceH4/ultrachat_200kbase_model:Locutusque/TinyMistral-248M-v2-Instructbase_model:quantized:Locutusque/TinyMistral-248M-v2-Instructlicense:apache-2.0endpoints_compatibleregion:us

View full details: dampfinchen/google-gemma-3-12b-it-qat-q4_0-gguf-small-fix · m4-ai/tinymistral-248m-v2-instruct-gguf