Model Intelligence Sheet
mrfakename/mistral-small-3.1-24b-instruct-2503-gguf overview
Also see: GGUF quants for Mistral Small 3.1 Instruct 24B, compatible with llama.cpp (or almost any other llama.cpp app) in the Mistral format. Use the Mistral chat template. Only the text component has been converted to GGUF, does not work as a vision model. No imatrix yet, sorry!
Downloads
357
Likes
17
Pipeline
text-generation
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
16 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| ggml-model-F16.gguf | GGUF | F16 | 43.92 GB | Download |
| ggml-model-Q2_K.gguf | GGUF | Q2_K | 8.28 GB | Download |
| ggml-model-Q3_K_L.gguf | GGUF | Q3_K_L | 11.55 GB | Download |
| ggml-model-Q3_K_M.gguf | GGUF | Q3_K_M | 10.69 GB | Download |
| ggml-model-Q3_K_S.gguf | GGUF | Q3_K_S | 9.69 GB | Download |
| ggml-model-Q4_0.gguf | GGUF | — | 12.52 GB | Download |
| ggml-model-Q4_1.gguf | GGUF | — | 13.85 GB | Download |
| ggml-model-Q4_K.gguf | GGUF | Q4_K | 13.35 GB | Download |
| ggml-model-Q4_K_S.gguf | GGUF | Q4_K_S | 12.62 GB | Download |
| ggml-model-Q5_0.gguf | GGUF | — | 15.18 GB | Download |
| ggml-model-Q5_1.gguf | GGUF | — | 16.52 GB | Download |
| ggml-model-Q5_K.gguf | GGUF | Q5_K | 15.61 GB | Download |
| ggml-model-Q5_K_M.gguf | GGUF | Q5_K_M | 15.61 GB | Download |
| ggml-model-Q5_K_S.gguf | GGUF | Q5_K_S | 15.18 GB | Download |
| ggml-model-Q6_K.gguf | GGUF | Q6_K | 18.02 GB | Download |
| ggml-model-Q8_0.gguf | GGUF | — | 23.33 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf"
],
"base_model": [
"mrfakename/mistral-small-3.1-24b-instruct-2503-hf"
],
"frontmatter": {
"license": "apache-2.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf"
],
"base_model": [
"mrfakename/mistral-small-3.1-24b-instruct-2503-hf"
]
},
"hero_image_url": "",
"summary": "**Also see:** GGUF quants for Mistral Small 3.1 Instruct 24B, compatible with llama.cpp (or almost any other llama.cpp app) in the Mistral format. Use the Mistral chat template. Only the text component has been converted to GGUF, does not work as a vision model. No imatrix yet, sorry!",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\npipeline_tag: text-generation\ntags:\n- gguf\nbase_model:\n- mrfakename/mistral-small-3.1-24b-instruct-2503-hf\n---\n\n**Also see:**\n\n- **24B Instruct GGUF (this model)**\n- [24B Instruct HF](https://huggingface.co/mrfakename/mistral-small-3.1-24b-instruct-2503-hf)\n- [24B Base HF](https://huggingface.co/mrfakename/mistral-small-3.1-24b-base-2503-hf)\n\nGGUF quants for [Mistral Small 3.1 Instruct 24B](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503), compatible with llama.cpp (or almost any other llama.cpp app) in the Mistral format.\n\nUse the Mistral chat template.\n\nOnly the text component has been converted to GGUF, does not work as a vision model.\n\nNo imatrix yet, sorry!",
"related_quantizations": []
},
"tags": [
"gguf",
"text-generation",
"base_model:mrfakename/mistral-small-3.1-24b-instruct-2503-hf",
"base_model:quantized:mrfakename/mistral-small-3.1-24b-instruct-2503-hf",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 17,
"downloads": 357,
"gated": false,
"private": false,
"last_modified": "2025-03-18T15:34:35.000Z",
"created_at": "2025-03-17T23:09:54.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "67d8abc2098c0ac77a17112d",
"id": "mrfakename/mistral-small-3.1-24b-instruct-2503-gguf",
"modelId": "mrfakename/mistral-small-3.1-24b-instruct-2503-gguf",
"sha": "72af174a032b5788b9c88b3c8907ab1363ef7f69",
"createdAt": "2025-03-17T23:09:54.000Z",
"lastModified": "2025-03-18T15:34:35.000Z",
"author": "mrfakename",
"downloads": 357,
"likes": 17,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 18
}