GraySoft
Projects Models About FAQ Contact Download guIDE →

lewdiculous/violet_magcap-12b-gguf-iq-imatrix Q5_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

lewdiculous/violet_magcap-12b-gguf-iq-imatrix overview

Uploading... --> ### Hello there. Here I share my personal GGUF-Imatrix quants of VioletMagcap-12B. "It will help you solve problems. It will also make you question your existence." "Use wisely—or don't." !image/webp *Please check out the original model card as well for added context and model information.* Discussions - General discussion and author feedback. Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations. Your comments for them are appreciated! SillyTavern - [[SillyTavern Presets]](https://huggingface.co/Lewdiculous/VioletMagcap-12B-GGUF-IQ-Imatrix/tree/main/SillyTavern) Initially recommended master-import presets and an additional quick-replies set. [Click Here] [Please Read] - Additional setup. Reasoning Block + Prefix: !Reasoning Format ChatML Format: !ChatML Format Mistral Format: !Mistral Format

ggufsillytavernpresetsmistralchatmlroleplayconversationalreasoningsmartenbase_model:Nitral-AI/Violet_Magcap-12Bbase_model:quantized:Nitral-AI/Violet_Magcap-12Blicense:otherendpoints_compatibleregion:usimatrix
lewdiculous/violet_magcap-12b-gguf-iq-imatrix visual
Downloads
2,392
Likes
26
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

14 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
ARM-Violet_Magcap-12B-Q4_0-imat.gguf GGUF 6.61 GB Download
Violet_Magcap-12B-IQ3_M-imat.gguf GGUF IQ3_M 5.33 GB Download
Violet_Magcap-12B-IQ3_S-imat.gguf GGUF IQ3_S 5.18 GB Download
Violet_Magcap-12B-IQ3_XS-imat.gguf GGUF IQ3_XS 4.94 GB Download
Violet_Magcap-12B-IQ3_XXS-imat.gguf GGUF IQ3_XXS 4.61 GB Download
Violet_Magcap-12B-IQ4_XS-imat.gguf GGUF IQ4_XS 6.28 GB Download
Violet_Magcap-12B-Q3_K_L-imat.gguf GGUF Q3_K_L 6.11 GB Download
Violet_Magcap-12B-Q3_K_M-imat.gguf GGUF Q3_K_M 5.67 GB Download
Violet_Magcap-12B-Q4_K_M-imat.gguf GGUF Q4_K_M 6.96 GB Download
Violet_Magcap-12B-Q4_K_S-imat.gguf GGUF Q4_K_S 6.63 GB Download
Violet_Magcap-12B-Q5_K_M-imat.gguf GGUF Q5_K_M 8.13 GB Download
Violet_Magcap-12B-Q5_K_S-imat.gguf GGUF Q5_K_S 7.93 GB Download
Violet_Magcap-12B-Q6_K-imat.gguf GGUF Q6_K 9.37 GB Download
Violet_Magcap-12B-Q8_0-imat.gguf GGUF 12.13 GB Download

Model Details Live

Model Slug
lewdiculous/violet_magcap-12b-gguf-iq-imatrix
Author
Lewdiculous
Pipeline Task
Library
Created
2025-04-19
Last Modified
2025-04-19
Gated
No
Private
No
HF SHA
94baa0f872d2bf006b5e622a2bff56c4521f9f03
License
other
Language
en
Base Model
Nitral-AI/Violet_Magcap-12B

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "language": [
      "en"
    ],
    "base_model": [
      "Nitral-AI/Violet_Magcap-12B"
    ],
    "tags": [
      "sillytavern",
      "presets",
      "mistral",
      "chatml",
      "roleplay",
      "conversational",
      "reasoning",
      "smart"
    ],
    "license": "other",
    "frontmatter": {
      "language": [
        "en"
      ],
      "base_model": [
        "Nitral-AI/Violet_Magcap-12B"
      ],
      "tags": [
        "sillytavern",
        "presets",
        "mistral",
        "chatml",
        "roleplay",
        "conversational",
        "reasoning",
        "smart"
      ],
      "license": "other"
    },
    "hero_image_url": "violet-magcap.webp",
    "summary": "[!WARNING] > **Uploading...**  --> ### Hello there. Here I share my personal **GGUF-Imatrix** quants of **Violet_Magcap-12B**.  `` sillytavern, presets, mistral, chatml, roleplay, conversational, reasoning, smart `` > [!IMPORTANT] > \"It will help you solve problems. It will also make you question your existence.\"  **\"Use wisely—or don't.\"**  > !image/webp > > *Please check out the original model card as well for added context and model information.* > [!TIP] > **Discussions**  > - General discussion and author feedback.  > Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations.  Your comments for them are appreciated! > [!NOTE] > **SillyTavern**  > - [[SillyTavern Presets]](https://huggingface.co/Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix/tree/main/SillyTavern)  > Initially recommended master-import presets and an additional quick-replies set.  [Click Here] [Please Read] - Additional setup.  Reasoning Block + Prefix: !Reasoning Format ChatML Format: !ChatML Format Mistral Format: !Mistral Format",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlanguage:\n- en\nbase_model:\n- Nitral-AI/Violet_Magcap-12B\ntags:\n- sillytavern\n- presets\n- mistral\n- chatml\n- roleplay\n- conversational\n- reasoning\n- smart\nlicense: other\n---\n<!--\n> [!WARNING]\n> **Uploading...** <br>\n-->\n\n### Hello there.\nHere I share my personal **GGUF-Imatrix** quants of [**Violet_Magcap-12B**](https://huggingface.co/Nitral-AI/Violet_Magcap-12B). <br>\n\n```\nsillytavern, presets, mistral, chatml,\nroleplay, conversational, reasoning, smart\n```\n\n> [!IMPORTANT]\n> \"It will help you solve problems. It will also make you question your existence.\" <br>\n**\"Use wisely—or don't.\"** <br>\n> ![image/webp](violet-magcap.webp)\n> \n> *Please check out the original model card as well for added context and model information.*\n\n> [!TIP]\n> **Discussions** <br>\n> - [General discussion and author feedback.](https://huggingface.co/Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix/discussions/1) <br>\n> Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations. <br> Your comments for them are appreciated!\n\n\n> [!NOTE]\n> **SillyTavern** <br>\n> - [[SillyTavern Presets]](https://huggingface.co/Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix/tree/main/SillyTavern) <br>\n> Initially recommended master-import presets and an additional quick-replies set.\n\n<details>\n  <summary>[Click Here] [Please Read] - Additional setup. </summary>\n\nReasoning Block + Prefix:\n![Reasoning Format](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Gb6aBgJ_PVU0nDMp40wHJ.png)\n\nChatML Format:\n![ChatML Format](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/cbb9qyoPs4cRKCzYU7jPN.png)\n\nMistral Format:\n![Mistral Format](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/IQO9dhOrAySbSPGyiEfmd.png)\n\n</details>\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "sillytavern",
    "presets",
    "mistral",
    "chatml",
    "roleplay",
    "conversational",
    "reasoning",
    "smart",
    "en",
    "base_model:Nitral-AI/Violet_Magcap-12B",
    "base_model:quantized:Nitral-AI/Violet_Magcap-12B",
    "license:other",
    "endpoints_compatible",
    "region:us",
    "imatrix"
  ],
  "likes": 26,
  "downloads": 2392,
  "gated": false,
  "private": false,
  "last_modified": "2025-04-19T16:52:46.000Z",
  "created_at": "2025-04-19T14:17:46.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6803b08a099c19465e39bdb0",
  "id": "Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix",
  "modelId": "Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix",
  "sha": "94baa0f872d2bf006b5e622a2bff56c4521f9f03",
  "createdAt": "2025-04-19T14:17:46.000Z",
  "lastModified": "2025-04-19T16:52:46.000Z",
  "author": "Lewdiculous",
  "downloads": 2392,
  "likes": 26,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 22
}