enlistedghost/pixtral-12b-2409-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "language": [
      "en",
      "ja",
      "fr",
      "de",
      "es",
      "it",
      "pt",
      "ru",
      "zh"
    ],
    "base_model": [
      "mistralai/Pixtral-12B-2409"
    ],
    "pipeline_tag": "image-text-to-text",
    "new_version": "EnlistedGhost/Pixtral-12B-2409-GGUF",
    "datasets": [
      "mistralai/MM-MT-Bench"
    ],
    "tags": [
      "Pixtral,",
      "12B,",
      "Vision,",
      "Conversational,",
      "Ollama,",
      "ggml,",
      "gguf,",
      "Image-Text-to-Text,",
      "Multimodal,",
      "MistralAI",
      "Llama.cpp",
      "Quantized"
    ],
    "frontmatter": {
      "license": "apache-2.0",
      "language": [
        "en",
        "ja",
        "fr",
        "de",
        "es",
        "it",
        "pt",
        "ru",
        "zh"
      ],
      "base_model": [
        "mistralai/Pixtral-12B-2409"
      ],
      "pipeline_tag": "image-text-to-text",
      "new_version": "EnlistedGhost/Pixtral-12B-2409-GGUF",
      "datasets": [
        "mistralai/MM-MT-Bench"
      ],
      "tags": [
        "Pixtral,",
        "12B,",
        "Vision,",
        "Conversational,",
        "Ollama,",
        "ggml,",
        "gguf,",
        "Image-Text-to-Text,",
        "Multimodal,",
        "MistralAI",
        "Llama.cpp",
        "Quantized"
      ]
    },
    "hero_image_url": "",
    "summary": "# Model - Pixtral-12B-2409 (GGUF + Ollama Patched) *[The first official MistralAI Pixtral-12B to be GGUF converted and GGUF Quantized!]* ### NEW UPDATES! (As of: November 27th, 2025) (Read below!) ------------------------------------------------------------------------- **Description:**  EnlistedGhost's GGUF/Quantized Repository of - MistralAI Pixtral-12B-2409... This release includes GGUF+Ollama-Patched moodel files and three working projector (mmproj) files for the Vision Projector, offering full capabilities in Ollama or Llama.cpp. **No modifications, edits, or configurations are required** to use this model with Ollama, it works natively! **Both Vision and Text work with Ollama. (^.^)**  **Personal Notes:** The quality of interaction with this model from MistralAI **has been verified to be of a higher quality than others available.** There are other Pixtral-12B models that are community versions, however the weights that MistralAI had are different than from the community vertsion has and are significantly improved over community available releases. *Thank you for taking the time to read this!* **Some explaination for this claim -**  The currently available (publicly released on Huggingface) Pixtral-12B GGUF/GGUF-Quantized releases are from *mistral-community* and not *MistralAI* themselves. So, I am very excited to offer the Huggingface community an Ollama and Llama.cpp compatible version of the officially released: MistralAI/Pixtral-12B-2409 Multimodal Vision Model! **Public Notice: The statements and wording in this release DO NOT:** infer, suggest, slander or portray in a negative manner the mistral-community and their releases! I have nothing but a very high respect for mistral-community and their quality work. *(Be sure to check them out too!)*   The wording I use is only to offer a distinction between the fact that these GGUF/Quantized files are derrived directly from official MistralAI iterations. *(Sorry for the long disclaimer there - I just have to be very clear that I am not in any way saying anything negative about the already-quantized and GGUF converted Pixtral-12B from mistral-community)* Happy Inferencing!  -- Jon Z (EnlistedGhost) --------------------------------------------- ### Model Updates (As of: November 27th, 2025) **Final Quantized and full-BF16 modelfiles have been uploaded!!!**",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nlanguage:\n- en\n- ja\n- fr\n- de\n- es\n- it\n- pt\n- ru\n- zh\nbase_model:\n- mistralai/Pixtral-12B-2409\npipeline_tag: image-text-to-text\nnew_version: EnlistedGhost/Pixtral-12B-2409-GGUF\ndatasets:\n- mistralai/MM-MT-Bench\ntags:\n- Pixtral,\n- 12B,\n- Vision,\n- Conversational,\n- Ollama,\n- ggml,\n- gguf,\n- Image-Text-to-Text,\n- Multimodal,\n- MistralAI\n- Llama.cpp\n- Quantized\n---\n# Model - Pixtral-12B-2409 (GGUF + Ollama Patched) \n*[The first official MistralAI Pixtral-12B to be GGUF converted and GGUF Quantized!]*\n\n### NEW UPDATES! (As of: November 27th, 2025) (Read below!)\n\n-------------------------------------------------------------------------\n**Description:** <br />\nEnlistedGhost's GGUF/Quantized Repository of - MistralAI Pixtral-12B-2409...\nThis release includes GGUF+Ollama-Patched moodel files and three working projector \n(mmproj) files for the Vision Projector, offering full capabilities in Ollama or Llama.cpp.<br /><br />\n**No modifications, edits, or configurations are required** to use this model with\nOllama, it works natively! **Both Vision and Text work with Ollama. (^.^)** <br />\n\n**Personal Notes:**<br />\nThe quality of interaction with this model from MistralAI **has been verified\nto be of a higher quality than others available.** There are other Pixtral-12B models\nthat are community versions, however the weights that MistralAI had are different than\nfrom the community vertsion has and are significantly improved over community available releases.\n*Thank you for taking the time to read this!<br />*\n\n**Some explaination for this claim -** <br />\nThe currently available (publicly released on Huggingface) Pixtral-12B GGUF/GGUF-Quantized \nreleases are from *mistral-community* and not *MistralAI* themselves.\nSo, I am very excited to offer the Huggingface community an Ollama and\nLlama.cpp compatible version of the officially released: MistralAI/Pixtral-12B-2409\nMultimodal Vision Model!<br />\n\n**Public Notice: The statements and wording in this release DO NOT:**<br />\ninfer, suggest, slander or portray in a negative manner the\nmistral-community and their releases! I have nothing but a very high respect\nfor mistral-community and their quality work. \n*(Be sure to check them out too!)* <br /> <br /> \nThe wording I use is only to offer a distinction between the fact that these\nGGUF/Quantized files are derrived directly from official MistralAI iterations.\n*(Sorry for the long disclaimer there - I just have to be very clear that I am not\nin any way saying anything negative about the already-quantized and GGUF converted\nPixtral-12B from mistral-community)*<br /><br />\n\nHappy Inferencing! <br />\n -- Jon Z (EnlistedGhost)\n\n---------------------------------------------\n\n### Model Updates (As of: November 27th, 2025)\n- Updated: All GGUF model file(s) with Extremely-High-Quality GGUF file(s) (You won't be disappointed!)<br />\n**Final Quantized and full-BF16 modelfiles have been uploaded!!!**\n\n\n## How to run this Model using Ollama\nYou can run this model by using the \"ollama run\" command.<br />\nSimply copy & paste one of the commands from the list below into<br /> \nyour console, terminal or power-shell window.\n| Quant Type | File Size | Command |\n|:-----------|:----------|:--------|\n| Q2_K_S | 4.78 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q2_K_S  |\n| Q2_K   | 5.12 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q2_K    |\n| Q3_K_S | 5.62 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q3_K_S  |\n| Q3_K_M | 6.35 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q3_K_M  |\n| Q4_K_S | 7.29 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q4_K_S  |\n| Q4_K_M | 7.65 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q4_K_M  |\n| Q4_K_XL| 7.98 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q4_K_XL |\n| Q5_K_S | 8.43 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q5_K_S  |\n| Q5_K_M | 8.93 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q5_K_M  |\n| Q5_K_XL| 9.14 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q5_K_XL |\n| Q6_K   | 10.1 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q6_K    |\n| Q6_K_M | 10.4 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q6_K_M  |\n| Q6_K_XL| 11.6 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q6_K_XL |\n| Q8_0   | 13.0 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:Q8_0    |\n| F16    | 24.5 GB | ollama run hf.co/EnlistedGhost/Pixtral-12B-2409-GGUF:F16     |\n\n**mmproj (Vision Projector) Files**\n| Quant Type | File Size | Download-Link |\n|:-----------|:----------|:--------------|\n| Q8_0 | 465 MB | [[mmproj Vision Pixtral-12B rojector:Q8_0](https://huggingface.co/EnlistedGhost/Pixtral-12B-2409-GGUF/resolve/main/mmproj-Pixtral-12B-2409-Q8_0.gguf?download=true)]|\n| F16 | 870 MB | [[mmproj Vision Pixtral-12B rojector:F16](https://huggingface.co/EnlistedGhost/Pixtral-12B-2409-GGUF/resolve/main/mmproj-Pixtral-12B-2409-F16.gguf?download=true)]|\n| F32 | 1.74 GB | [[mmproj Vision Pixtral-12B rojector:F32](https://huggingface.co/EnlistedGhost/Pixtral-12B-2409-GGUF/resolve/main/mmproj-Pixtral-12B-2409-F32.gguf?download=true)]|\n\n-------------------------------------------------------------------------------\n\n### Intended Use\nSame as original:\n- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]\n\n\n### Out-of-Scope Use\nSame as original:\n- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]\n\n\n## Bias, Risks, and Limitations\nSame as original:\n- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]\n\n\n## Training Details\nTraining sets and data are from:\n- [[mistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]\n<br />(This is a direct off-shoot/decendant of the above mentioned model)\n\n\n## Evaluation\n- This model has NOT been evaluated in any form, scope or type of method. \n- **!!! USE AT YOUR OWN RISK !!!**\n- **!!! NO WARRANTY IS PROVIDED OF ANY KIND !!!**\n\n## Citation (Original Paper)\n[[MistalAI Pixtral-12B Original Paper](https://huggingface.co/papers/2410.07073)]\n\n\n## Detailed Release Information\n- **Originally Developed by:** [[mistralai](https://huggingface.co/mistralai/Pixtral-12B-2409)]\n- **MMPROJ (Vision) Quantized by:** [[EnlistedGhost](https://huggingface.co/EnlistedGhost)]\n- **Model Quantized for GGUF by:** [[EnlistedGhost](https://huggingface.co/EnlistedGhost)]\n- **Modified for Ollama by:** [[EnlistedGhost](https://huggingface.co/EnlistedGhost)]\n- **Model type & format:** [Quantized/GGUF]\n- **License type:** [Apache-2.0]\n\n\n## Attributions (Credits)\nA big thank-you is extended to the below credited sources!<br />\nThese contributions are what made this release possible!\n\n*Important Notice: **This is NOT a copy/paste release**, <br />\nI have created unique Quantized files that were then altered further <br />\nto properly work with Ollama software. <br />\nThis resulted in the first publicly available <br />\nPixtral-12B-2409 model that natively runs on Ollama.*\n\n- [[MistralAI](https://huggingface.co/mistralai/Pixtral-12B-2409)]\n- [[Ollama developers](https://github.com/ollama/ollama/issues/6748#issuecomment-3449009817)]\n\n## Model Card Authors and Contact\n[[EnlistedGhost](https://huggingface.co/EnlistedGhost)]",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "Pixtral,",
    "12B,",
    "Vision,",
    "Conversational,",
    "Ollama,",
    "ggml,",
    "gguf,",
    "Image-Text-to-Text,",
    "Multimodal,",
    "MistralAI",
    "Llama.cpp",
    "Quantized",
    "image-text-to-text",
    "en",
    "ja",
    "fr",
    "de",
    "es",
    "it",
    "pt",
    "ru",
    "zh",
    "dataset:mistralai/MM-MT-Bench",
    "arxiv:2410.07073",
    "base_model:mistralai/Pixtral-12B-2409",
    "base_model:quantized:mistralai/Pixtral-12B-2409",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 2,
  "downloads": 1189,
  "gated": false,
  "private": false,
  "last_modified": "2026-02-02T12:56:43.000Z",
  "created_at": "2025-11-21T10:26:00.000Z",
  "pipeline_tag": "image-text-to-text",
  "library_name": ""
}

{
  "_id": "69203e38d086092b9d78cd39",
  "id": "EnlistedGhost/Pixtral-12B-2409-GGUF",
  "modelId": "EnlistedGhost/Pixtral-12B-2409-GGUF",
  "sha": "8a634d451e4f54900a4213919e495e764c555bc2",
  "createdAt": "2025-11-21T10:26:00.000Z",
  "lastModified": "2026-02-02T12:56:43.000Z",
  "author": "EnlistedGhost",
  "downloads": 1189,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "image-text-to-text",
  "library_name": "",
  "siblings_count": 26
}