ggml-org/mistral-small-3.1-24b-instruct-2503-gguf Q8_0 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
ggml-org/mistral-small-3.1-24b-instruct-2503-gguf overview
Comprehensive model page for ggml-org/mistral-small-3.1-24b-instruct-2503-gguf
Downloads
258
Likes
7
Pipeline
image-text-to-text
Library
—
Visibility
Public
Access
Open
Repository Files & Downloads
3 files detected
Direct downloads for all repository files
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"base_model": [
"mistralai/Mistral-Small-3.1-24B-Instruct-2503"
],
"pipeline_tag": "image-text-to-text",
"frontmatter": {
"license": "apache-2.0",
"base_model": [
"mistralai/Mistral-Small-3.1-24B-Instruct-2503"
],
"pipeline_tag": "image-text-to-text"
},
"hero_image_url": "",
"summary": "",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\nbase_model:\n- mistralai/Mistral-Small-3.1-24B-Instruct-2503\npipeline_tag: image-text-to-text\n---\n\n## Mistral-Small-3.1-24B-Instruct-2503 with VISION support\n\n**IMPORTANT**: This repo is mainly used for CI testing purpose, so we don't upload all quants possible, only some of them.\n\nThe text model borrowed from UnslothAI, all credits to them: https://huggingface.co/unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF\n\n`mmproj` is generated from `convert_hf_to_gguf.py` with `--mmproj` option\n\nFor more details, see: https://github.com/ggml-org/llama.cpp/pull/13231\n",
"related_quantizations": []
},
"tags": [
"gguf",
"image-text-to-text",
"base_model:mistralai/Mistral-Small-3.1-24B-Instruct-2503",
"base_model:quantized:mistralai/Mistral-Small-3.1-24B-Instruct-2503",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"imatrix"
],
"likes": 7,
"downloads": 258,
"gated": false,
"private": false,
"last_modified": "2025-05-01T11:10:55.000Z",
"created_at": "2025-05-01T10:25:52.000Z",
"pipeline_tag": "image-text-to-text",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "68134c306c7f8a59004ffc94",
"id": "ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF",
"modelId": "ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF",
"sha": "68a3e055a6ec6952faa1db12aea9592e23d890e0",
"createdAt": "2025-05-01T10:25:52.000Z",
"lastModified": "2025-05-01T11:10:55.000Z",
"author": "ggml-org",
"downloads": 258,
"likes": 7,
"gated": false,
"private": false,
"pipeline_tag": "image-text-to-text",
"library_name": "",
"siblings_count": 5
}