enlistedghost/ministral-3-14b-reasoning-2512-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "datasets": [
      "mistralai/MM-MT-Bench"
    ],
    "language": [
      "en",
      "fr",
      "es",
      "de",
      "it",
      "pt",
      "nl",
      "zh",
      "ja",
      "ko",
      "ar",
      "ru"
    ],
    "base_model": [
      "mistralai/Ministral-3-14B-Reasoning-2512"
    ],
    "new_version": "EnlistedGhost/Ministral-3-14B-Reasoning-2512-GGUF",
    "pipeline_tag": "image-text-to-text",
    "tags": [
      "MistralAI",
      "Ministral",
      "Ministral-3",
      "Ollama",
      "Llama.cpp",
      "GGUF",
      "Image-Text-to-Text",
      "Conversational",
      "Multimodal",
      "Mistral3",
      "Multilingual",
      "Quantized",
      "LLM",
      "Thinking",
      "Reasoning"
    ],
    "frontmatter": {
      "license": "apache-2.0",
      "datasets": [
        "mistralai/MM-MT-Bench"
      ],
      "language": [
        "en",
        "fr",
        "es",
        "de",
        "it",
        "pt",
        "nl",
        "zh",
        "ja",
        "ko",
        "ar",
        "ru"
      ],
      "base_model": [
        "mistralai/Ministral-3-14B-Reasoning-2512"
      ],
      "new_version": "EnlistedGhost/Ministral-3-14B-Reasoning-2512-GGUF",
      "pipeline_tag": "image-text-to-text",
      "tags": [
        "MistralAI",
        "Ministral",
        "Ministral-3",
        "Ollama",
        "Llama.cpp",
        "GGUF",
        "Image-Text-to-Text",
        "Conversational",
        "Multimodal",
        "Mistral3",
        "Multilingual",
        "Quantized",
        "LLM",
        "Thinking",
        "Reasoning"
      ]
    },
    "hero_image_url": "https://ollama.com/assets/library/mistral-nemo/72045292-694a-4867-88c8-8635c9d97030",
    "summary": "The largest model in the Ministral 3 family, **Ministral 3 14B** offers frontier capabilities and performance comparable to its larger Mistral Small 3.2 24B counterpart. A powerful and efficient language model with vision capabilities. This model is the reasoning post-trained version, trained for reasoning tasks, making it ideal for math, coding and stem related use cases. The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware. Ministral 3 14B can even be deployed locally, capable of fitting in 32GB of VRAM in BF16, and less than 24GB of RAM/VRAM when quantized. Learn more in our blog post and paper.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\ndatasets:\n- mistralai/MM-MT-Bench\nlanguage:\n- en\n- fr\n- es\n- de\n- it\n- pt\n- nl\n- zh\n- ja\n- ko\n- ar\n- ru\nbase_model:\n- mistralai/Ministral-3-14B-Reasoning-2512\nnew_version: EnlistedGhost/Ministral-3-14B-Reasoning-2512-GGUF\npipeline_tag: image-text-to-text\ntags:\n- MistralAI\n- Ministral\n- Ministral-3\n- Ollama\n- Llama.cpp\n- GGUF\n- Image-Text-to-Text\n- Conversational\n- Multimodal\n- Mistral3\n- Multilingual\n- Quantized\n- LLM\n- Thinking\n- Reasoning\n---\n\n<img src=\"https://ollama.com/assets/library/mistral-nemo/72045292-694a-4867-88c8-8635c9d97030\" alt=\"Example image\" width=\"168\" height=\"128\"> \n\n\n<img src=\"https://ollama.com/assets/library/ministral-3/83fa3859-d87f-492c-bd81-596cfbceeccb\" alt=\"Example image\" width=\"64\" height=\"64\">\n\n ------------------------------------------------<br /> - Model Details and Specifications: -<br />------------------------------------------------\n<br /> Ministral-3 14B Reasoning 2512 (GGUF)\n\n\n## --------------------\n##        NOTICE: <br /> <br /> I noticed after testing (post-upload) <br /> that the template doesn't like to play nice <br /> (doesn't seem to engage the thinking tags correctly) <br /> when pulled from HuggingFace, <br /> I will be correcting this today/tomorrow at the latest!\n## --------------------\n\n\n\n**This release contains:** <br />\nLlama.cpp and Ollama compatible GGUF converted and Quantized model files \n*(Compatible with both Ollama, and Llama.cpp)*\n\n**Quantized GGUF version of:**\n- Ministral-3-14B-Reasoning-2512-BF16 <br /> *(by MistralAI)*\n\n**Original Model Link:**\n- [mistralai/Ministral-3-14B-Reasoning-2512](https://huggingface.co/mistralai/Ministral-3-14B-Reasoning-2512)\n\n**Description:** <br />\nThis release includes GGUF (Ollama + Llama.cpp - compatible) model files and two working multi-modal projector(s) \n(mmproj) files for the Vision Projector; offering full capabilities in Ollama or Llama.cpp.<br />\n\n**What is the \"Custom Tokenizer Chat Template?\"** <br />\nAs apposed to the standard \"Chat Template\" made available by MistralAI - this release of GGUF converted and quantized files offer a totally \ncustom Tokenizer Chat Template in order to provide: Smoother, Faster, Efficient, and Reliable interaction/inference with the model.\nThis template sheds the \"fluff\" or non-primary logic from the JINJA Chat/Tokenizer Template - allowing anyone who uses the model\nfor inferencing the opportunity to enjoy a significant improvement in speed, quality and context adherence without sacrificing any aspect of the initial release by MistralAI.\n\n**For reference - here is the new JINJA Tokenizer Chat-Template:** <br />\n*(This template features a sliding context window of FORTY-SIX (46) interactions, which may be adjusted per-individual requirements simply by altering\nthe fourth (4th) line of this template, upwards from the number forty-seven (47) to either higher or lower numerical values to increase or decrease the sliding context window)*\n```jinja\n{{- $remMessage := false }}\n[SYSTEM_PROMPT]{{- \"🟦 Follow instructions that the user provides. Think and respond to the user in the language they use or request. Next sections describes the capabilities that you have. \\n\\n🟦 [Reasoning Instructions]\\nYou have the ability to think before responding to the user. Always start your response by thinking, using an internal monologue. Always use this template when you respond: <think> thoughts and internal monologue </think> then respond directly to the user.\\n\\n🟦 [Multi-Modal Instructions]\\nYou have the ability to read images.\" }}[/SYSTEM_PROMPT]\n{{- range $index, $_ := .Messages }}\n{{- if lt (len (slice $.Messages $index)) 47 }}\n{{- $remMessage = true }}\n{{- end }}\n{{- if $remMessage }}{{- if eq .Role \"user\" }}\n[INST]{{ .Content }}[/INST]\n{{- else if eq .Role \"assistant\" }}\n{{ .Content }}{{- end }}\n{{- end }}\n{{- end }}\n```\n\n**No modifications, edits, or configurations are required** to use this model with\nOllama or llama.cpp, it works natively! **Both Vision and Text work with Ollama as well. (^.^)** <br />\n\n**Coming Soon!!!** <br />\nCheck back occasionally - as a automated installer/configure Python-3 script is making its way to all of my releases! \nThis allows anyone who is interested in using these models a hassle-free and stress-free experience where the Python-3\nscript takes care of setting up the model for Ollama (specifically for Ollama, other software optimizations coming later). \nIt is highly recommended to use the Ollama \"create\" command along with the supplied \".modelfile\" to ensure proper configuration\nfor anyone who wishes to get the most out of this particular release. Though, the Python-3 automated installer/configuration tool\nwill handle such aspects if it is chosen to be used.\n\nHappy Inferencing! <br />\n -- Jon Z (EnlistedGhost)\n\n----------------------------------------------\n\n### Model Updates (As of: Match 26, 2026)\n- Updated: Uploaded/Added all GGUF conversion(s) and non-i-matrix Quantized model file(s)<br />\n**Final Quantized and full-F16 modelfiles are uploaded!!!** - Check back for i-Matrix quant model files if you do not see your desired edition (They are being uploaded, thank you for your patience!)\n\n----------------------------------------------\n\n## -------------------------------------------------------------<br /> - GGUF Conversion and Quantization Details: -<br />-------------------------------------------------------------\n\n**Software used to convert Safetensors to GGUF:**\n- <a href=\"https://github.com/ggml-org/llama.cpp/\">llama.cpp | Version: 8189</a>\n\n**Software used to create Quantized GGUF Files:**\n- <a href=\"https://github.com/ggml-org/llama.cpp/\">llama.cpp | Version: 8189</a> \n\n**Specific GitHub Commit Point:**\n- <a href=\"https://github.com/ggml-org/llama.cpp/releases\">b8189</a>\n\n**Converted to GGUF and Quantized by:**\n- [EnlistedGhost](https://huggingface.co/EnlistedGhost)\n\n----------------------------------------------\n\n## --------------------------<br /> ---- Original Info ---- <br /> --------------------------\n*(Crossposted from the link in the above section: \"Model Details\"):*\n<br />\n<br />\n<br />\n<br />\n<br />\n<br />\n<br />\n\n# Ministral 3 14B Reasoning 2512 BF16\n\nThe largest model in the Ministral 3 family, **Ministral 3 14B** offers frontier capabilities and performance comparable to its larger [Mistral Small 3.2 24B](https://huggingface.co/mistralai/Mistral-Small-3.2-Instruct-2506) counterpart. A powerful and efficient language model with vision capabilities.\n\nThis model is the reasoning post-trained version, trained for reasoning tasks, making it ideal for math, coding and stem related use cases.\n\nThe Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware. Ministral 3 14B can even be deployed locally, capable of fitting in 32GB of VRAM in BF16, and less than 24GB of RAM/VRAM when quantized.\n\nLearn more in our [blog post](https://mistral.ai/news/mistral-3) and [paper](https://arxiv.org/abs/2601.08584).\n\n## Key Features\nMinistral 3 14B consists of two main architectural components:\n- **13.5B Language Model**\n- **0.4B Vision Encoder**\n\nThe Ministral 3 14B Reasoning model offers the following capabilities:\n- **Vision**: Enables the model to analyze images and provide insights based on visual content, in addition to text.\n- **Multilingual**: Supports dozens of languages, including English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic.\n- **System Prompt**: Maintains strong adherence and support for system prompts.\n- **Agentic**: Offers best-in-class agentic capabilities with native function calling and JSON outputting.\n- **Reasoning**: Excels at complex, multi-step reasoning and dynamic problem-solving.\n- **Edge-Optimized**: Delivers best-in-class performance at a small scale, deployable anywhere.\n- **Apache 2.0 License**: Open-source license allowing usage and modification for both commercial and non-commercial purposes.\n- **Large Context Window**: Supports a 256k context window.\n\n### Use Cases\nPrivate AI deployments where advanced capabilities meet practical hardware constraints:\n- Private/custom chat and AI assistant deployments in constrained environments\n- Advanced local agentic use cases\n- Fine-tuning and specialization\n- And more...\n  \nBringing advanced AI capabilities to most environments.\n\n### Recommended Settings\n\nWe recommend deploying with the following best practices:\n- System Prompt: Use our provided [system prompt](https://huggingface.co/mistralai/Ministral-3-14B-Reasoning-2512/blob/main/SYSTEM_PROMPT.txt), and append it to your custom system prompt to define a clear environment and use case, including guidance on how to effectively leverage tools in agentic systems.\n- Multi-turn Traces: We highly recommend keeping the reasoning traces in context.\n- Sampling Parameters: Use a **temperature of 1** for most environments ; Different temperatures may be explored for different use cases - developers are encouraged to experiment with alternative settings.\n- Tools: Keep the set of tools well-defined and limit their number to the minimum required for the use case - Avoiding overloading the model with an excessive number of tools.\n- Vision: When deploying with vision capabilities, we recommend maintaining an aspect ratio close to 1:1 (width-to-height) for images. Avoiding the use of overly thin or wide images - crop them as needed to ensure optimal performance.\n\n## Ministral 3 Family\n\n| Model Name                     | Type               | Precision | Link                                                                                     |\n|--------------------------------|--------------------|-----------|------------------------------------------------------------------------------------------|\n| Ministral 3 3B Base 2512       | Base pre-trained   | BF16      | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-3B-Base-2512)                |\n| Ministral 3 3B Instruct 2512   | Instruct post-trained | FP8   | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-3B-Instruct-2512)            |\n| Ministral 3 3B Reasoning 2512  | Reasoning capable  | BF16      | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-3B-Reasoning-2512)           |\n| Ministral 3 8B Base 2512       | Base pre-trained   | BF16      | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512)                |\n| Ministral 3 8B Instruct 2512   | Instruct post-trained | FP8    | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-8B-Instruct-2512)            |\n| Ministral 3 8B Reasoning 2512  | Reasoning capable  | BF16      | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-8B-Reasoning-2512)           |\n| Ministral 3 14B Base 2512      | Base pre-trained   | BF16      | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-14B-Base-2512)               |\n| Ministral 3 14B Instruct 2512  | Instruct post-trained | FP8    | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-14B-Instruct-2512)           |\n| **Ministral 3 14B Reasoning 2512** | **Reasoning capable**  | **BF16**      | [Hugging Face](https://huggingface.co/mistralai/Ministral-3-14B-Reasoning-2512)          |\n\nOther formats available [here](https://huggingface.co/collections/mistralai/ministral-3-additional-checkpoints).\n\n## Benchmark Results\n\nWe compare Ministral 3 to similar sized models.\n\n### Reasoning\n\n| Model                     | AIME25      | AIME24      | GPQA Diamond | LiveCodeBench |\n|---------------------------|-------------|-------------|--------------|---------------|\n| **Ministral 3 14B**       | <u>0.850</u>| <u>0.898</u>| <u>0.712</u> | <u>0.646</u>  |\n| Qwen3-14B (Thinking)      | 0.737       | 0.837       | 0.663        | 0.593         |\n|                           |             |             |              |               |\n| **Ministral 3 8B**        | 0.787       | <u>0.860</u>| 0.668        | <u>0.616</u>  |\n| Qwen3-VL-8B-Thinking      | <u>0.798</u>| <u>0.860</u>| <u>0.671</u> | 0.580         |\n|                           |             |             |              |               |\n| **Ministral 3 3B**        | <u>0.721</u>| <u>0.775</u>| 0.534        | <u>0.548</u>  |\n| Qwen3-VL-4B-Thinking      | 0.697       | 0.729       | <u>0.601</u> | 0.513         |\n\n### Instruct\n\n| Model                     | Arena Hard  | WildBench  | MATH Maj@1  | MM MTBench       |\n|---------------------------|-------------|------------|-------------|------------------|\n| **Ministral 3 14B**       | <u>0.551</u>| <u>68.5</u>| <u>0.904</u>| <u>8.49</u>      |\n| Qwen3 14B (Non-Thinking)  | 0.427       | 65.1       | 0.870       | NOT MULTIMODAL   |\n| Gemma3-12B-Instruct       | 0.436       | 63.2       | 0.854       | 6.70             |\n|                           |             |            |             |                  |\n| **Ministral 3 8B**        | 0.509       | <u>66.8</u>| 0.876       | <u>8.08</u>      |\n| Qwen3-VL-8B-Instruct      | <u>0.528</u>| 66.3       | <u>0.946</u>| 8.00             |\n|                           |             |            |             |                  |\n| **Ministral 3 3B**        | 0.305       | <u>56.8</u>| 0.830       | 7.83             |\n| Qwen3-VL-4B-Instruct      | <u>0.438</u>| <u>56.8</u>| <u>0.900</u>| <u>8.01</u>      |\n| Qwen3-VL-2B-Instruct      | 0.163       | 42.2       | 0.786       | 6.36             |\n| Gemma3-4B-Instruct        | 0.318       | 49.1       | 0.759       | 5.23             |\n\n### Base\n\n| Model               | Multilingual MMLU | MATH CoT 2-Shot | AGIEval 5-shot | MMLU Redux 5-shot | MMLU 5-shot | TriviaQA 5-shot |\n|---------------------|-------------------|-----------------|----------------|-------------------|-------------|-----------------|\n| **Ministral 3 14B** | 0.742             | <u>0.676</u>    | 0.648          | 0.820             | 0.794       | 0.749           |\n| Qwen3 14B Base      | <u>0.754</u>      | 0.620           | <u>0.661</u>   | <u>0.837</u>      | <u>0.804</u>| 0.703           |\n| Gemma 3 12B Base    | 0.690             | 0.487           | 0.587          | 0.766             | 0.745       | <u>0.788</u>    |\n|                     |                   |                 |                |                   |             |                 |\n| **Ministral 3 8B**  | <u>0.706</u>      | <u>0.626</u>    | 0.591          | 0.793             | <u>0.761</u>| <u>0.681</u>    |\n| Qwen 3 8B Base      | 0.700             | 0.576           | <u>0.596</u>   | <u>0.794</u>      | 0.760       | 0.639           |\n|                     |                   |                 |                |                   |             |                 |\n| **Ministral 3 3B**  | 0.652             | <u>0.601</u>    | 0.511          | 0.735             | 0.707       | 0.592           |\n| Qwen 3 4B Base      | <u>0.677</u>      | 0.405           | <u>0.570</u>   | <u>0.759</u>      | <u>0.713</u>| 0.530           |\n| Gemma 3 4B Base     | 0.516             | 0.294           | 0.430          | 0.626             | 0.589       | <u>0.640</u>    |\n\n\n## License\n\nThis model is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0.txt).\n\n*You must not use this model in a manner that infringes, misappropriates, or otherwise violates any third party’s rights, including intellectual property rights.*",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "MistralAI",
    "Ministral",
    "Ministral-3",
    "Ollama",
    "Llama.cpp",
    "GGUF",
    "Image-Text-to-Text",
    "Conversational",
    "Multimodal",
    "Mistral3",
    "Multilingual",
    "Quantized",
    "LLM",
    "Thinking",
    "Reasoning",
    "image-text-to-text",
    "en",
    "fr",
    "es",
    "de",
    "it",
    "pt",
    "nl",
    "zh",
    "ja",
    "ko",
    "ar",
    "ru",
    "dataset:mistralai/MM-MT-Bench",
    "arxiv:2601.08584",
    "base_model:mistralai/Ministral-3-14B-Reasoning-2512",
    "base_model:quantized:mistralai/Ministral-3-14B-Reasoning-2512",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 773,
  "gated": false,
  "private": false,
  "last_modified": "2026-04-05T09:43:16.000Z",
  "created_at": "2026-03-25T14:33:30.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": ""
}

{
  "_id": "69c3f23a909b1e0d7f58cb01",
  "id": "EnlistedGhost/Ministral-3-14B-Reasoning-2512-GGUF",
  "modelId": "EnlistedGhost/Ministral-3-14B-Reasoning-2512-GGUF",
  "sha": "06af3f75bc9d80258b2709c78c13e93aa3626575",
  "createdAt": "2026-03-25T14:33:30.000Z",
  "lastModified": "2026-04-05T09:43:16.000Z",
  "author": "EnlistedGhost",
  "downloads": 773,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "",
  "siblings_count": 22
}