GraySoft
Download guIDE →
Model Comparison

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufvsm4-ai/tinymistral-248m-v2-instruct-gguf

Side-by-side comparison of hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf and m4-ai/tinymistral-248m-v2-instruct-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-3B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

m4-ai/tinymistral-248m-v2-instruct-gguf

M4-ai · —

GGUF version of Locutusque/TinyMistral-248M-v2-Instruct. # Recommended inference parameters `` do_sample: true temperature: 0.1 top_p: 0.14 top_k: 12 repetition_penalty: 1.1 ` # Recommended prompt template ` user\n{user message}\nassistant\n{assistant message} ``

Side-by-side Specifications

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufm4-ai/tinymistral-248m-v2-instruct-gguf
Authorhugging-quantsM4-ai
Pipeline Tasktext-generation—
Library——
Downloads23,87529,482
Likes276
LicenseUnknownUnknown
Context Length——
Created2024-09-252024-02-03
Last Modified2024-09-252024-02-03
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
ggufendataset:HuggingFaceH4/ultrachat_200kbase_model:Locutusque/TinyMistral-248M-v2-Instructbase_model:quantized:Locutusque/TinyMistral-248M-v2-Instructlicense:apache-2.0endpoints_compatibleregion:us

View full details: hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf · m4-ai/tinymistral-248m-v2-instruct-gguf