GraySoft
Model Comparison

m4-ai/tinymistral-248m-v2-instruct-ggufvsmaziyarpanahi/gemma-3-12b-it-gguf

Side-by-side comparison of m4-ai/tinymistral-248m-v2-instruct-gguf and maziyarpanahi/gemma-3-12b-it-gguf: downloads, license, context length, tasks, and benchmarks.

m4-ai/tinymistral-248m-v2-instruct-gguf

M4-ai · —

GGUF version of Locutusque/TinyMistral-248M-v2-Instruct. # Recommended inference parameters `` do_sample: true temperature: 0.1 top_p: 0.14 top_k: 12 repetition_penalty: 1.1 ` # Recommended prompt template ` user\n{user message}\nassistant\n{assistant message} ``

maziyarpanahi/gemma-3-12b-it-gguf

MaziyarPanahi · text-generation

# MaziyarPanahi/gemma-3-12b-it-GGUF

Side-by-side Specifications

m4-ai/tinymistral-248m-v2-instruct-ggufmaziyarpanahi/gemma-3-12b-it-gguf
AuthorM4-aiMaziyarPanahi
Pipeline Tasktext-generation
Library
Downloads29,48289,348
Likes618
LicenseUnknownUnknown
Context Length
Created2024-02-032025-03-12
Last Modified2024-02-032025-03-12
Tags
ggufendataset:HuggingFaceH4/ultrachat_200kbase_model:Locutusque/TinyMistral-248M-v2-Instructbase_model:quantized:Locutusque/TinyMistral-248M-v2-Instructlicense:apache-2.0endpoints_compatibleregion:us
ggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bitGGUF

View full details: m4-ai/tinymistral-248m-v2-instruct-gguf · maziyarpanahi/gemma-3-12b-it-gguf