GraySoft
Projects Models About FAQ Contact Download guIDE →

ggml-org/mistral-small-3.1-24b-instruct-2503-gguf F16 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

ggml-org/mistral-small-3.1-24b-instruct-2503-gguf overview

Comprehensive model page for ggml-org/mistral-small-3.1-24b-instruct-2503-gguf

ggufimage-text-to-textbase_model:mistralai/Mistral-Small-3.1-24B-Instruct-2503base_model:quantized:mistralai/Mistral-Small-3.1-24B-Instruct-2503license:apache-2.0endpoints_compatibleregion:usimatrix
ggml-org/mistral-small-3.1-24b-instruct-2503-gguf visual
Downloads
258
Likes
7
Pipeline
image-text-to-text
Library
Visibility
Public
Access
Open

Repository Files & Downloads

3 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf GGUF IQ2_M 8.15 GB Download
mmproj-Mistral-Small-3.1-24B-Instruct-2503-Q8_0.gguf GGUF 445.50 MB Download
mmproj-Mistral-Small-3.1-24B-Instruct-2503-f16.gguf GGUF F16 837.38 MB Download

Model Details Live

Model Slug
ggml-org/mistral-small-3.1-24b-instruct-2503-gguf
Author
ggml-org
Pipeline Task
image-text-to-text
Library
Created
2025-05-01
Last Modified
2025-05-01
Gated
No
Private
No
HF SHA
68a3e055a6ec6952faa1db12aea9592e23d890e0
License
apache-2.0
Language
Unknown
Base Model
mistralai/Mistral-Small-3.1-24B-Instruct-2503

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "base_model": [
      "mistralai/Mistral-Small-3.1-24B-Instruct-2503"
    ],
    "pipeline_tag": "image-text-to-text",
    "frontmatter": {
      "license": "apache-2.0",
      "base_model": [
        "mistralai/Mistral-Small-3.1-24B-Instruct-2503"
      ],
      "pipeline_tag": "image-text-to-text"
    },
    "hero_image_url": "",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nbase_model:\n- mistralai/Mistral-Small-3.1-24B-Instruct-2503\npipeline_tag: image-text-to-text\n---\n\n## Mistral-Small-3.1-24B-Instruct-2503 with VISION support\n\n**IMPORTANT**: This repo is mainly used for CI testing purpose, so we don't upload all quants possible, only some of them.\n\nThe text model borrowed from UnslothAI, all credits to them: https://huggingface.co/unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF\n\n`mmproj` is generated from `convert_hf_to_gguf.py` with `--mmproj` option\n\nFor more details, see: https://github.com/ggml-org/llama.cpp/pull/13231\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "image-text-to-text",
    "base_model:mistralai/Mistral-Small-3.1-24B-Instruct-2503",
    "base_model:quantized:mistralai/Mistral-Small-3.1-24B-Instruct-2503",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "imatrix"
  ],
  "likes": 7,
  "downloads": 258,
  "gated": false,
  "private": false,
  "last_modified": "2025-05-01T11:10:55.000Z",
  "created_at": "2025-05-01T10:25:52.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "68134c306c7f8a59004ffc94",
  "id": "ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF",
  "modelId": "ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF",
  "sha": "68a3e055a6ec6952faa1db12aea9592e23d890e0",
  "createdAt": "2025-05-01T10:25:52.000Z",
  "lastModified": "2025-05-01T11:10:55.000Z",
  "author": "ggml-org",
  "downloads": 258,
  "likes": 7,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "",
  "siblings_count": 5
}