GraySoft
Model Comparison

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufvsmaziyarpanahi/mistral-small-3.1-24b-instruct-2503-hf-gguf

Side-by-side comparison of hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf and maziyarpanahi/mistral-small-3.1-24b-instruct-2503-hf-gguf: downloads, license, context length, tasks, and benchmarks.

hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf

hugging-quants · text-generation

This model was converted to GGUF format from meta-llama/Llama-3.2-3B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

maziyarpanahi/mistral-small-3.1-24b-instruct-2503-hf-gguf

MaziyarPanahi · text-generation

# MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Side-by-side Specifications

hugging-quants/llama-3.2-3b-instruct-q4_k_m-ggufmaziyarpanahi/mistral-small-3.1-24b-instruct-2503-hf-gguf
Authorhugging-quantsMaziyarPanahi
Pipeline Tasktext-generationtext-generation
Library
Downloads23,87585,895
Likes272
LicenseUnknownUnknown
Context Length
Created2024-09-252025-03-18
Last Modified2024-09-252025-03-18
Tags
gguffacebookmetapytorchllamallama-3llama-cppgguf-my-repotext-generationen
ggufmistralquantized2-bit3-bit4-bit5-bit6-bit8-bitGGUF

View full details: hugging-quants/llama-3.2-3b-instruct-q4_k_m-gguf · maziyarpanahi/mistral-small-3.1-24b-instruct-2503-hf-gguf